-- Logs begin at Sun 2022-09-18 00:10:30 UTC, end at Sun 2022-09-18 02:48:22 UTC. -- Sep 18 00:49:28.959214 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 18 00:49:28.972620 n-d-master-1 devstack@n-api.service[106326]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 18 00:49:28 2022] *** Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: nodename: n-d-master-1 Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: machine: x86_64 Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: clock source: unix Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: pcre jit disabled Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: detected number of CPU cores: 4 Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: current working directory: / Sep 18 00:49:28.974628 n-d-master-1 devstack@n-api.service[106326]: detected binary path: /usr/bin/uwsgi-core Sep 18 00:49:28.975343 n-d-master-1 devstack@n-api.service[106326]: your processes number limit is 47680 Sep 18 00:49:28.975343 n-d-master-1 devstack@n-api.service[106326]: your memory page size is 4096 bytes Sep 18 00:49:28.975343 n-d-master-1 devstack@n-api.service[106326]: detected max file descriptor number: 2048 Sep 18 00:49:28.975343 n-d-master-1 devstack@n-api.service[106326]: lock engine: pthread robust mutexes Sep 18 00:49:28.975343 n-d-master-1 devstack@n-api.service[106326]: thunder lock: enabled Sep 18 00:49:28.975343 n-d-master-1 devstack@n-api.service[106326]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 18 00:49:28.975343 n-d-master-1 devstack@n-api.service[106326]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 18 00:49:29.013744 n-d-master-1 devstack@n-api.service[106326]: Python main interpreter initialized at 0x55e2aa38a9c0 Sep 18 00:49:29.013744 n-d-master-1 devstack@n-api.service[106326]: python threads support enabled Sep 18 00:49:29.013744 n-d-master-1 devstack@n-api.service[106326]: your server socket listen backlog is limited to 100 connections Sep 18 00:49:29.013744 n-d-master-1 devstack@n-api.service[106326]: your mercy for graceful operations on workers is 90 seconds Sep 18 00:49:29.014092 n-d-master-1 devstack@n-api.service[106326]: mapped 403077 bytes (393 KB) for 2 cores Sep 18 00:49:29.014168 n-d-master-1 devstack@n-api.service[106326]: *** Operational MODE: preforking *** Sep 18 00:49:29.014392 n-d-master-1 devstack@n-api.service[106326]: *** uWSGI is running in multiple interpreter mode *** Sep 18 00:49:29.014392 n-d-master-1 devstack@n-api.service[106326]: spawned uWSGI master process (pid: 106326) Sep 18 00:49:29.014575 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 18 00:49:29.017857 n-d-master-1 devstack@n-api.service[106326]: spawned uWSGI worker 1 (pid: 106327, cores: 1) Sep 18 00:49:29.017857 n-d-master-1 devstack@n-api.service[106326]: spawned uWSGI worker 2 (pid: 106328, cores: 1) Sep 18 00:49:29.017857 n-d-master-1 devstack@n-api.service[106326]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 18 00:49:29.676118 n-d-master-1 devstack@n-api.service[106327]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:49:29.676967 n-d-master-1 devstack@n-api.service[106328]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:49:30.760706 n-d-master-1 devstack@n-api.service[106328]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:49:30.760706 n-d-master-1 devstack@n-api.service[106328]: from cryptography.utils import int_from_bytes Sep 18 00:49:30.761462 n-d-master-1 devstack@n-api.service[106328]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:49:30.761462 n-d-master-1 devstack@n-api.service[106328]: from cryptography.utils import int_from_bytes Sep 18 00:49:30.763732 n-d-master-1 devstack@n-api.service[106327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:49:30.763732 n-d-master-1 devstack@n-api.service[106327]: from cryptography.utils import int_from_bytes Sep 18 00:49:30.764154 n-d-master-1 devstack@n-api.service[106327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:49:30.764154 n-d-master-1 devstack@n-api.service[106327]: from cryptography.utils import int_from_bytes Sep 18 00:49:33.239636 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:49:33.240273 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:49:33.240371 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:49:33.240658 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:49:33.240908 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:49:33.241286 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.241637 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.241958 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.242271 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.242597 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.242918 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.243023 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:49:33.243370 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:49:33.243447 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.243521 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.243721 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:49:33.243826 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.244064 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.244164 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:49:33.244330 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:49:33.244426 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.244672 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.244842 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.244989 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.245077 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.245289 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.245382 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.245613 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.245721 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.245930 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.246022 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.246229 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.246321 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.246543 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.246630 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.246842 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.246938 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.247207 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.247329 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.247470 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.247774 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.247909 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.248069 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.248191 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.248377 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.248480 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.248698 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.248821 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.249003 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.249166 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.249312 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.249401 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.249647 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.249752 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.249953 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.250050 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.250271 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.250369 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.250576 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.250770 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.250976 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.251084 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.251289 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.251375 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.251597 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.251769 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.251906 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.251999 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.252309 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.252439 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.252632 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.252745 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.252920 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.253525 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.253781 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.253903 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.254101 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.254195 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.254408 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.254521 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.254728 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.254822 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.255044 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.255139 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.255374 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.255468 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.255672 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.255773 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.255969 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.256087 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.256276 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.256397 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.256581 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.256705 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.256895 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.257024 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.257197 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.257346 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.257499 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.257678 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.257765 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.258008 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.258096 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.258328 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.258413 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.258648 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.258749 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.258970 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.259075 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.259220 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.259312 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.259467 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.259563 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.259785 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.259872 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.260100 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.260187 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.260405 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.260502 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.260711 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.260812 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.260978 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.261063 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.261285 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.261384 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.261613 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.261721 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.261919 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.262013 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.262221 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.262315 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.262483 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.262575 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.262733 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.262830 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.263052 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.263150 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.263373 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.263460 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.263680 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.263778 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.263989 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.264075 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.264296 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.264393 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.264602 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.264701 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.264915 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.265063 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.265248 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.265366 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.265568 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.265683 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.265888 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.265977 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.266202 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.266297 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.266515 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.266613 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.266815 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.266901 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.267116 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.267203 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.267418 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.267514 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.267731 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.267824 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.268054 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.268141 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.268351 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.268438 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.268642 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.269291 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.269453 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.269596 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.269784 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.269881 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.270102 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.270196 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.270404 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.270490 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.270707 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.270801 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.271008 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.271101 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.271304 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.271399 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.271608 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.271695 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.271911 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.272003 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.272212 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.272314 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.272499 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.272591 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.272801 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.272933 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.273100 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.273198 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.273401 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.273487 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.273727 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.273816 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.274029 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.274127 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.274331 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.274424 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.274628 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.274713 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.274935 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.275032 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.275233 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.275317 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.275554 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.275641 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.275835 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.275933 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.276137 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.276223 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.276440 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.276525 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.276740 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.276833 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.277042 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.277156 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.277341 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.277427 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.277665 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.277761 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.277965 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.278074 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.278279 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.278372 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.278582 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.278668 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.278881 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.278969 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.279439 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.279533 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.279732 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.279818 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.280037 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.280129 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.280348 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.280445 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.280651 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.280739 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.280952 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.281038 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.281249 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.281334 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.281604 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.281697 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.281866 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.281962 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.282165 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.282251 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.282461 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.282554 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.282760 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.282846 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.283053 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.283148 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.283350 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.283445 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.283667 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.283753 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.283970 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.284080 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.284294 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.284416 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.284593 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.284679 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.284893 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.284988 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.285198 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.285295 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.285503 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.285619 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.285831 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.285929 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.286137 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.286224 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.286438 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.286523 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.286743 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.286837 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.287065 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.287151 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.287374 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.287467 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.287683 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.287777 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.287988 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.288075 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.288293 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.288377 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:49:33.288599 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.288692 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.288904 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.288996 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.289217 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.289310 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.289529 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.289694 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.289919 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.290006 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.290245 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.290338 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.290555 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.290640 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.290862 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.290946 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.291168 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.291262 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.291482 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.291578 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.291789 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.291889 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.292099 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.292194 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.292402 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.292493 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.292718 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.292804 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.293035 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.293173 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.293352 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.293436 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.293696 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.293798 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.294013 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.294114 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.294318 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.294403 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.294623 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.294712 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.294928 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.295022 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.295251 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.295337 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.295557 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.295649 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.295865 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.295952 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.296177 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.296271 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.296483 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.296611 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.296799 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.296926 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.297107 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.297253 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.297411 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.297592 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.297748 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.297909 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.298054 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.298224 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.298357 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.298536 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.298685 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.298878 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.298994 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.299192 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.299307 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.299506 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.299642 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.299853 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.299941 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.300169 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.300260 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.300491 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.300579 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.300804 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.300890 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.301109 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.301194 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.301410 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.301504 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.301734 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.301830 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.302033 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.302119 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.302337 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.302434 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.302635 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.302790 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.302949 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.303044 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.303268 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.303362 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.303568 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.303653 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.303886 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.303978 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.304184 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.304271 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.304488 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.304575 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.304796 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.304952 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.305092 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.305223 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.305383 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.305514 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.305712 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.305854 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.306015 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.306144 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.306315 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.306452 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.306633 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.306779 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.306938 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.307074 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.307238 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.307374 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.307555 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.307694 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.307848 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.307980 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.308141 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.308229 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.308450 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.308545 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.308752 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.308844 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.309057 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.309150 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.309362 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.309448 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.309690 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.309781 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.309997 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.310100 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.310304 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.310389 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.310610 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.310697 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.310914 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.311008 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.311238 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.311325 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.311535 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.311619 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.311853 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.311947 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.312171 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.312258 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.312479 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.312566 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.312776 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.312871 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.313077 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.313171 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.313375 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.313469 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.313696 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.313786 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.313997 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.314085 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.314299 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.314389 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.314596 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.314683 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.314899 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.315036 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.315198 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.315338 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.316007 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.316140 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.316308 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.316441 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.316624 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.316767 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.316927 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.317059 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.317226 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.317357 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.317523 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.317697 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.317834 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.317970 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.318185 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.318320 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.318456 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.318600 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.318775 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.318910 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.319085 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.319228 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.319395 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.319534 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.319707 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.319840 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.319998 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.320086 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.320314 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.320408 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.320618 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.320711 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.320922 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.321007 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.321224 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.321317 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.321528 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.321680 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.321866 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.321963 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.322174 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.322261 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.322487 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.322572 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.322792 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.322878 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.323111 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.323208 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.323415 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.323501 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.323729 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.323815 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.324030 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.324125 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.324339 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.324424 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.324652 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.324743 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.324967 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.325057 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.325278 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.325368 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.325615 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.325723 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.325925 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.326018 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.326235 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.326320 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.326541 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.326635 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.326846 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.326938 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.327151 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.327236 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.327454 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.327548 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.327768 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.327866 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.328073 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.328158 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.328386 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.328545 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.328688 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.328797 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.329004 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.329116 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.329306 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.329440 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.329641 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.329807 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.329940 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.330127 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.330227 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.330442 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.330548 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.330756 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.330874 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.331092 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.331730 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.332025 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.332112 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.332352 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.332438 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.332656 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.332749 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.332961 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.333046 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.333265 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.333352 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.333586 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.333693 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.333890 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.333977 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.334193 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.334279 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.334502 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.334640 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.334807 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.334896 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.335112 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.335245 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.335401 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.335543 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.335703 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.335847 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.336003 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.336162 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.336314 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.336451 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.336586 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.336720 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.336876 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.337012 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.337192 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.337330 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.337496 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.337654 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.337847 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.337994 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.338157 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.338293 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.338454 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.338583 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.338753 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.338896 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.339066 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.339207 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.339352 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.339488 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.339653 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.339793 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.339956 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.340087 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.340254 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.340386 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.340558 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.340721 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.340856 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.340993 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.341166 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.341304 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.341476 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.341680 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.341812 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.341946 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.342107 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.342251 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.342399 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.342536 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.342706 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.342842 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.343008 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.343154 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.343322 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.343457 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.343627 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.343760 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.343928 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.344063 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.344229 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.344364 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.344531 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.344674 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.344836 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.344975 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.345141 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.345230 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.345458 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.345544 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.345787 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.345891 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.346094 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.346180 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.346399 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.346494 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.346718 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.346813 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.347027 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.347113 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.347336 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.347429 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.347662 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.347900 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.347988 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.348232 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.348318 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.348547 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.348643 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.348863 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.348949 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.349172 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.349257 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.349496 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.349630 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.349837 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.349932 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.350164 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.350251 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.350466 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.350557 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.350770 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.350857 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.351074 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.351159 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.351374 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.351459 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.351675 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.351940 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.352035 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.352269 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.352355 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.352568 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.352662 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.352868 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.352961 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.353172 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.353258 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.353470 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.353659 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.353799 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.353895 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.354080 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.354216 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.354379 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.354536 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.354675 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.354905 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.354991 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.355225 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.355318 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.355534 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.355621 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.355841 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.355928 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.356143 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.356229 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.356446 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.356543 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.356745 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.356831 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.357044 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.357130 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.357354 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.357446 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.357687 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.357777 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.357994 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.358081 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.358300 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.358388 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.358617 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.358702 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.358935 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.359084 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.359233 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.359372 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.359539 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.359670 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.359843 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.359988 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.360143 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.360276 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.360441 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.360527 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.360744 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.360840 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.361044 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.361138 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.361342 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.361430 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.361679 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.361788 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.361984 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.362070 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.362289 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.362385 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.362610 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.362698 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.362908 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.363047 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.363210 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.363358 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.363507 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.363666 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.363817 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.363993 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.364120 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.364302 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.364417 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.364607 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.364731 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.364933 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.365025 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.365248 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.365343 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.365604 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.365696 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.365886 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.365972 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.366185 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.366280 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.366494 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.366582 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.366791 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.366876 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.367089 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.367176 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.367385 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.367472 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.367688 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.367774 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.367992 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.368090 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.368285 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.368376 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.368600 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.368686 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.368904 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.368990 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.369217 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.369324 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.369500 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.369622 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.369831 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.369926 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.370129 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.370216 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.370427 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.370523 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.370728 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.370813 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.371041 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.371125 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.371343 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.371441 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.371638 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.371722 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.371940 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.372034 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.372237 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.372331 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.372535 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.372620 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.372832 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.372918 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.373133 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.373220 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.373430 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.373516 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.373763 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.373850 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.374062 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.374200 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.374345 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.374481 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.374639 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.374783 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.374951 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.375086 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.375253 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.375344 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.375551 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.375682 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.375851 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.376003 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.376140 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.376275 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.376470 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.376619 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.376766 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.376904 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.377103 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.377237 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.377406 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.377571 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.377741 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.377874 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.378574 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.378710 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.378880 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.379022 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.379169 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.379306 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.379472 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.379611 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.379768 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.379912 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.380077 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.380209 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.380387 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.380517 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.380692 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.380824 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.380991 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.381139 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.381277 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.381410 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.381650 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.381784 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.381920 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.382055 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.382187 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.382329 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.382499 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.382644 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.382815 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.382959 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.383132 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.383270 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.383434 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.383571 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.383737 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.383881 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.384043 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.384174 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.384346 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.384484 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.384648 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.384780 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.384954 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.385104 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.385241 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.385376 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.385574 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.385709 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.385888 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.385992 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.386214 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.386301 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.386530 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.386616 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.386828 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.386920 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.387135 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.387228 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.387442 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.387534 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.387742 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.387840 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.388060 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.388146 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.388363 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.388449 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.388662 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.388749 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.388965 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.389050 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.389265 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.389352 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.389586 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.389678 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.389886 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.389974 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.390290 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.390375 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.390600 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.390686 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.390906 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.390992 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.391206 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.391300 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.391512 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.391605 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.391815 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.391899 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.392125 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.392219 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.392430 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.392514 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.392729 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.392814 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.393048 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.393150 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.393355 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.393441 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.394238 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.394351 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.394547 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.394644 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.394863 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.394950 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.395170 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.395258 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.395473 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.395607 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.395791 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.395885 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.396090 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.396197 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.396389 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.396507 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.396688 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.396820 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.397003 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.397134 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.397303 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.397452 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.397640 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.397800 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.398053 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.398150 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.398363 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.398515 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.398664 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.398831 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.399071 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.399158 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.399375 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.399470 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.399679 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.399765 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.399995 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.400095 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.400316 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.400402 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.400633 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.400720 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.400935 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.401029 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.401239 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.401324 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.401541 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.401643 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.401880 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.401979 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.402186 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.402285 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.402494 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.402579 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.402802 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.402917 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.403100 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.403233 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.403415 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.403541 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.403732 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.403958 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.404297 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.404528 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.404619 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.404839 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.404988 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.405166 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.405306 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.405502 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.405633 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.405906 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.405996 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.406217 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.406313 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.406533 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.406618 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.406835 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.406923 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.407143 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.407228 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.407444 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.407538 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.407747 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.407834 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.408064 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.408168 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.408365 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.408458 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.408673 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.408759 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.408980 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.409074 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.409308 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.409398 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.409632 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.409725 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.409937 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.410072 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.410260 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.410399 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.410561 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.410716 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.410880 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.411042 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.411192 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.411369 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.411510 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.411680 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.411827 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.411990 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.412128 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.412305 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.412445 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.412614 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.412749 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.412923 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.413050 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.413247 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.413335 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.413575 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.413666 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.413892 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.413990 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.414207 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.414300 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.414521 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.414616 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.414828 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.414916 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.415135 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.415259 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.415461 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.415556 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.415768 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.415855 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.416094 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.416188 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.416414 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.416508 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.416717 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.416801 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.417030 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.417130 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.417345 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.417430 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.417665 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.417756 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.417967 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.418067 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.418273 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.418360 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.418574 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.418660 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.418874 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.418969 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.419172 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.419259 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.419476 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.419572 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.419773 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.419862 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.420071 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.420165 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.420374 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.420468 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.420691 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.420780 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.420989 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.421077 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.421302 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.421461 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.421615 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.421812 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.421920 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.422126 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.422220 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.422447 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.422543 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.422775 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.422862 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.423083 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.423177 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.423392 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.423480 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.423703 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.423794 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.424007 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.424093 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.424316 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.424403 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.424622 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.424707 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.424955 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.425050 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.425260 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.425384 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.425608 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.425701 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.425893 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.425990 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.426202 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.426288 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.426506 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.426592 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.426818 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.426913 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.427126 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.427211 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.427434 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.427519 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.427735 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.427951 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.428038 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.428281 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.428367 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.428591 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.428678 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.428902 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.428991 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.429210 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.429296 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.429520 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.429638 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.429852 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.429939 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.430163 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.430259 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.430469 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.430568 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.430774 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.430867 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.431080 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.431169 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.431401 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.431496 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.431717 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.431805 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.432031 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.432123 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.432351 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.432446 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.432665 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.432751 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.432976 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.433062 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.433286 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.433501 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.433621 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.433865 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.433952 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.434187 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.434287 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.434506 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.434595 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.434825 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.434912 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.435134 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.435221 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.435444 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.435530 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.435753 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.435840 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.436059 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.436149 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.436367 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.436453 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.436674 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.436762 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.436978 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.437066 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.437281 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.437389 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.437610 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.437744 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.437922 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.438084 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.438240 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.438408 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.438567 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.438728 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.438882 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.439047 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.439194 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.439365 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.439502 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.439724 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.439816 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.440049 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.440316 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.440402 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.441139 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.441232 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.441471 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.441611 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.441817 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.441906 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.442132 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.442219 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.442442 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.442534 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.442754 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.442840 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.443068 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.443154 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.443364 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.443449 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.443666 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.443761 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.443971 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.444064 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.444276 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.444369 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.444576 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.444670 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.444891 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.444979 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.445197 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.445283 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.445495 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.445654 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.445834 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.445921 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.446137 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.446231 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.446663 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.446759 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.446978 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.447071 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.447296 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.447382 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.447614 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.447701 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.447934 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.448021 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.448244 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.448337 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.448546 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.448641 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.448865 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.448951 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.449164 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.449251 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.449463 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.449600 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.449796 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.449885 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.450100 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.450199 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.450399 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.450495 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.450702 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.450790 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.451006 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.451101 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.451310 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.451406 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.451606 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.451692 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.451906 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.452001 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.452205 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.452505 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.452593 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.452813 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.452929 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.453112 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.453248 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.453409 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.453595 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.453740 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.453926 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.454039 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.454246 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.454332 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.454556 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.454651 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.454883 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.454971 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.455192 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.455279 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.455487 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.455572 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.455790 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.455887 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.456128 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.456747 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.456931 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.457028 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.457236 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.457323 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.457564 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.457653 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.457883 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.457981 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.458185 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.458271 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.458488 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.458573 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.458787 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.458882 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.459098 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.459186 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.459404 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.459489 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.459711 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.459844 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.460015 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.460101 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.460317 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.460415 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.460628 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.460722 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.460935 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.461029 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.461240 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.461470 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.461592 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.461825 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.461913 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.462141 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.462238 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.462452 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.462551 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.462758 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.462845 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.463067 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.463152 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.463370 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.463468 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.463672 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.463759 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.463989 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.464075 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.464296 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.464390 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.464602 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.464688 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.464905 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.464990 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.465205 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.465291 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.465509 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.465613 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.465837 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.465924 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.466141 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.466237 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.466446 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.466536 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.466748 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.466834 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.467050 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.467181 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.467352 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.467620 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.467706 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.467945 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.468039 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.468248 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.468335 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.468553 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.468639 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.468885 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.468980 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.469192 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.469297 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.469500 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.469610 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.469828 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.469960 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.470139 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.470226 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.470443 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.470538 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.470751 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.470839 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.471053 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.471140 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.471356 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.471455 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.471685 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.471775 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.472004 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.472099 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.472309 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.472408 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.472610 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.472703 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.472919 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.473231 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.473316 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.473560 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.473652 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.473879 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.473967 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.474192 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.474291 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.474494 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.474580 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.474807 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.474892 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.475119 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.475213 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.475426 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.475512 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.475742 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.475838 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.476045 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.476144 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.476366 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.476495 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.476682 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.476770 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.476994 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.477126 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.477306 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.477402 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.477626 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.477717 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.477929 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.478018 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.478229 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.478323 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.478534 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.478621 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.478848 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.478973 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.479151 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.479449 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.479534 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.479745 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.479833 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.480048 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.480133 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.480344 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.480431 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.480646 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.480740 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.480944 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.481030 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.481240 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.481351 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.481541 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.481683 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.481858 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.482001 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.482152 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.482316 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.482448 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.482648 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.482743 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.482990 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.483077 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.483310 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.483397 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.483613 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.483699 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.483909 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.483996 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.484208 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.484296 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.484501 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.484587 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.484797 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.484890 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.485093 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.485188 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.485413 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.485500 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.485762 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.485851 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.486069 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.486158 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.486382 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.486469 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.486685 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.486787 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.486995 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.487080 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.487801 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.487895 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.488120 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.488215 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.488431 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.488525 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.488736 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.488823 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.489035 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.489128 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.489339 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.489432 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.489713 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.489809 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.489972 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.490067 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.490275 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.490378 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.490576 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.490662 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.490882 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.490968 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.491181 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.491265 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.491483 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.491568 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.491789 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.491878 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.492089 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.492174 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.492408 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.492494 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.492718 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.492807 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.493032 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.493120 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.493352 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.493445 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.493682 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.493772 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.494006 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.494091 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.494310 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.494408 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.494615 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.494702 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.494919 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.495019 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.495223 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.495385 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.495527 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.495614 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.495836 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.495922 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.496140 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.496227 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.496444 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.496532 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.496756 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.496852 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.497058 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.497152 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.497365 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.497451 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.497704 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.497794 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.498010 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.498099 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.498328 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.498415 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.498636 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.498721 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.498961 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.499049 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.499268 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.499361 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.499588 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.499682 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.499906 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.499994 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.500212 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.500297 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.500518 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.500614 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.500823 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.500910 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.501062 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:49:33.501149 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.501435 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.501779 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.502097 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.502416 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.502728 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.503580 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.503899 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.504214 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.504540 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.504867 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.505178 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.505504 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.505856 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.506205 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.506520 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.506868 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.507200 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.507516 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.507832 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.508138 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:49:33.508381 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:49:33.652884 n-d-master-1 devstack@n-api.service[106327]: INFO dbcounter [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Registered counter for database nova_api Sep 18 00:49:33.661311 n-d-master-1 devstack@n-api.service[106328]: INFO dbcounter [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Registered counter for database nova_api Sep 18 00:49:33.673376 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.680327 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:33.682224 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_db.sqlalchemy.engines [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.688624 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writer thread running {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:33.735832 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.context [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=106327) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:49:33.740348 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:49:33.740752 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:49:33.742324 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:49:33.743039 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:49:33.743479 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:49:33.745437 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:49:33.747430 n-d-master-1 devstack@n-api.service[106327]: INFO dbcounter [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Registered counter for database nova_cell0 Sep 18 00:49:33.747758 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.context [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=106328) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:49:33.751398 n-d-master-1 devstack@n-api.service[106327]: INFO dbcounter [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Registered counter for database nova_cell1 Sep 18 00:49:33.751710 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_concurrency.lockutils [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:49:33.752190 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_concurrency.lockutils [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:49:33.754446 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_concurrency.lockutils [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:49:33.755184 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_concurrency.lockutils [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:49:33.755637 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_concurrency.lockutils [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:49:33.757665 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_concurrency.lockutils [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:49:33.758991 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.759698 n-d-master-1 devstack@n-api.service[106328]: INFO dbcounter [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Registered counter for database nova_cell0 Sep 18 00:49:33.761344 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.763866 n-d-master-1 devstack@n-api.service[106328]: INFO dbcounter [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Registered counter for database nova_cell1 Sep 18 00:49:33.768987 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:33.769372 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:33.771642 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_db.sqlalchemy.engines [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.775129 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_db.sqlalchemy.engines [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.778551 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writer thread running {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:33.911458 n-d-master-1 devstack@n-api.service[106327]: INFO dbcounter [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Registered counter for database nova_cell0 Sep 18 00:49:33.916143 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writer thread running {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:33.918290 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.923004 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:33.926743 n-d-master-1 devstack@n-api.service[106328]: INFO dbcounter [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Registered counter for database nova_cell0 Sep 18 00:49:33.933539 n-d-master-1 devstack@n-api.service[106328]: DEBUG oslo_db.sqlalchemy.engines [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:49:33.938368 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writer thread running {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:49:34.257204 n-d-master-1 devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:49:34.264478 n-d-master-1 devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:49:34.268995 n-d-master-1 devstack@n-api.service[106328]: WARNING keystonemiddleware.auth_token [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:49:34.276304 n-d-master-1 devstack@n-api.service[106328]: WARNING keystonemiddleware.auth_token [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:49:34.602444 n-d-master-1 devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:49:34.608384 n-d-master-1 devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:49:34.613658 n-d-master-1 devstack@n-api.service[106327]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e2aa38a9c0 pid: 106327 (default app) Sep 18 00:49:34.615709 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:34.616886 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Sep 18 00:49:34.617296 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Sun Sep 18 00:49:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:34.619575 n-d-master-1 devstack@n-api.service[106328]: WARNING keystonemiddleware.auth_token [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:49:34.625528 n-d-master-1 devstack@n-api.service[106328]: WARNING keystonemiddleware.auth_token [None req-f02ff376-12b3-4f7c-a7f9-433baf77a6cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:49:34.631411 n-d-master-1 devstack@n-api.service[106328]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e2aa38a9c0 pid: 106328 (default app) Sep 18 00:50:55.659664 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:55.660677 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 18 00:50:55.661333 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:50:55.674922 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_api:SELECT=3 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:55.676339 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_cell0:SELECT=3 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:55.677633 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_cell1:SELECT=3 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:55.679711 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:56.557851 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-83ed5813-7535-473a-ad15-d73790465723 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:56.590634 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-83ed5813-7535-473a-ad15-d73790465723 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922064 Sep 18 00:50:56.591394 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 00:50:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:50:59.250283 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:59.251880 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-360915a9-96d5-4eed-8919-c72f06dcf2dd None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Sep 18 00:50:59.253587 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:50:59.700158 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-3a142f79-c66e-4940-a98c-d0d93f69c4d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:50:59.748942 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-3a142f79-c66e-4940-a98c-d0d93f69c4d8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490498 Sep 18 00:50:59.749497 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:50:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:50:59.763856 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=3 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:59.764714 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell1:SELECT=3 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:59.766830 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell0:SELECT=3 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:59.767611 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:59.972788 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-bdb65694-4a60-4590-acb9-e992658c2fb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:00.041634 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-bdb65694-4a60-4590-acb9-e992658c2fb2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282901 Sep 18 00:51:00.042139 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 18 00:50:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:51:02.664241 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-3a142f79-c66e-4940-a98c-d0d93f69c4d8 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:02.666023 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-3a142f79-c66e-4940-a98c-d0d93f69c4d8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Sep 18 00:51:02.666772 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:03.472298 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-040c79a7-3cfe-48ed-b21b-373acdd1c209 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "disk": 5, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:03.517765 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-040c79a7-3cfe-48ed-b21b-373acdd1c209 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.844129 Sep 18 00:51:03.519437 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:51:03.532503 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-a8b4e016-75b2-40e2-bd82-42d8b6369848 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:03.580201 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-a8b4e016-75b2-40e2-bd82-42d8b6369848 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052717 Sep 18 00:51:03.581357 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 18 00:51:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:51:06.364350 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-040c79a7-3cfe-48ed-b21b-373acdd1c209 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:06.366147 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-040c79a7-3cfe-48ed-b21b-373acdd1c209 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002265 Sep 18 00:51:06.367656 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:06.923176 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-9e95e975-7fe1-47b9-842d-9baa63725b82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:06.972563 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-9e95e975-7fe1-47b9-842d-9baa63725b82 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.596805 Sep 18 00:51:06.981954 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:51:06.988576 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-ee166a0a-4286-420b-a450-cc68035e521f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:07.017814 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-ee166a0a-4286-420b-a450-cc68035e521f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033692 Sep 18 00:51:07.018382 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 18 00:51:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:51:09.651129 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-9e95e975-7fe1-47b9-842d-9baa63725b82 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:09.652144 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-9e95e975-7fe1-47b9-842d-9baa63725b82 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 18 00:51:09.652542 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:10.127386 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-f269c081-00ff-4d57-957a-f01449cf3141 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:10.150296 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-f269c081-00ff-4d57-957a-f01449cf3141 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491302 Sep 18 00:51:10.151232 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:51:10.164295 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-0215fffa-cf09-4d30-8525-557e4ca933c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:10.197346 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-0215fffa-cf09-4d30-8525-557e4ca933c0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036569 Sep 18 00:51:10.197871 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 18 00:51:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:51:12.940152 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-f269c081-00ff-4d57-957a-f01449cf3141 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:12.941277 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-f269c081-00ff-4d57-957a-f01449cf3141 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Sep 18 00:51:12.947171 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:13.354925 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-5f427fbc-a749-44d8-8140-e75af5897b14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:13.376355 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-5f427fbc-a749-44d8-8140-e75af5897b14 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427586 Sep 18 00:51:13.389897 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5d298bc1-7714-4f2c-ba14-28d8e555e68f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:13.394801 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 00:51:13.421626 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-5d298bc1-7714-4f2c-ba14-28d8e555e68f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035993 Sep 18 00:51:13.422757 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 18 00:51:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:51:16.057292 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-5f427fbc-a749-44d8-8140-e75af5897b14 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:16.058972 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-5f427fbc-a749-44d8-8140-e75af5897b14 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002196 Sep 18 00:51:16.060042 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:16.544362 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-857d5d76-53e3-48ba-943e-970c2f7a48f2 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:16.568825 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-857d5d76-53e3-48ba-943e-970c2f7a48f2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.502019 Sep 18 00:51:16.569391 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 00:51:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:51:19.896299 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-5f427fbc-a749-44d8-8140-e75af5897b14 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:19.897704 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-5f427fbc-a749-44d8-8140-e75af5897b14 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001883 Sep 18 00:51:19.898171 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:20.331230 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5d8cfcb0-62bf-444d-80a0-d431fb1a7fcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "ram": 512, "id": "1", "swap": 0, "vcpus": 1}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:20.360072 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-5d8cfcb0-62bf-444d-80a0-d431fb1a7fcd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.453644 Sep 18 00:51:20.360849 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 00:51:20.374019 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4e48b95-959f-4626-ab71-29a9192dbe8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:20.406129 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4e48b95-959f-4626-ab71-29a9192dbe8d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036665 Sep 18 00:51:20.406708 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 18 00:51:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:51:23.264498 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5d8cfcb0-62bf-444d-80a0-d431fb1a7fcd admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:23.265498 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-5d8cfcb0-62bf-444d-80a0-d431fb1a7fcd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 18 00:51:23.265930 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:23.658421 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-6794b45a-a3fd-4d53-81ff-fd5b574df8ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:23.679004 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-6794b45a-a3fd-4d53-81ff-fd5b574df8ee admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407116 Sep 18 00:51:23.679716 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:51:23.691898 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-3401d43d-1fe8-45ff-8a4f-d671df0d0f1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:23.716062 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-3401d43d-1fe8-45ff-8a4f-d671df0d0f1a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028251 Sep 18 00:51:23.717097 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 18 00:51:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:51:26.330852 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-6794b45a-a3fd-4d53-81ff-fd5b574df8ee admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:26.331861 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-6794b45a-a3fd-4d53-81ff-fd5b574df8ee admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 18 00:51:26.332268 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:26.743908 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-18a30e46-99cb-48c0-89a0-e89fa6dde50e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "name": "m1.medium", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:26.771486 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-18a30e46-99cb-48c0-89a0-e89fa6dde50e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.432784 Sep 18 00:51:26.772580 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:51:26.785182 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-58d522e2-48db-492d-9216-ec6835281f19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:26.804212 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:26.813803 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-58d522e2-48db-492d-9216-ec6835281f19 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032728 Sep 18 00:51:26.814579 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 18 00:51:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:51:29.466684 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-18a30e46-99cb-48c0-89a0-e89fa6dde50e admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:29.467601 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-18a30e46-99cb-48c0-89a0-e89fa6dde50e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 18 00:51:29.467997 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:29.912033 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f2562ad6-7b98-4bc0-b5a7-92ed18f97a2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large"}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:29.935978 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f2562ad6-7b98-4bc0-b5a7-92ed18f97a2e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461358 Sep 18 00:51:29.936518 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:51:29.955592 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9f61df67-f0f5-44bd-b137-c8aee962ad7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:29.980949 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-9f61df67-f0f5-44bd-b137-c8aee962ad7d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033065 Sep 18 00:51:29.982224 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 18 00:51:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:51:32.608185 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f2562ad6-7b98-4bc0-b5a7-92ed18f97a2e admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:32.609921 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f2562ad6-7b98-4bc0-b5a7-92ed18f97a2e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Sep 18 00:51:32.610541 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:33.067457 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-19852e3b-ab1f-4f45-afb0-e16d73a450c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:33.081877 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:33.098487 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-19852e3b-ab1f-4f45-afb0-e16d73a450c2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.481881 Sep 18 00:51:33.099584 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 18 00:51:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:51:33.111481 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-b1d01f9b-dc79-479a-9551-c668f17744c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:51:33.148098 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-b1d01f9b-dc79-479a-9551-c668f17744c3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040256 Sep 18 00:51:33.149370 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 18 00:51:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:51:53.003736 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-19852e3b-ab1f-4f45-afb0-e16d73a450c2 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:53.004748 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-19852e3b-ab1f-4f45-afb0-e16d73a450c2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 18 00:51:53.005154 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:53.015730 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:53.392003 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-b2bb1790-f976-4f49-8d72-6abeef69db3b admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:53.410713 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-b2bb1790-f976-4f49-8d72-6abeef69db3b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399527 Sep 18 00:51:53.411312 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 00:51:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:51:54.710857 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-19852e3b-ab1f-4f45-afb0-e16d73a450c2 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:54.711854 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-19852e3b-ab1f-4f45-afb0-e16d73a450c2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 18 00:51:54.712250 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:55.238606 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-d7d8c313-0bf3-481d-9902-345260393610 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:55.243801 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.wsgi [None req-d7d8c313-0bf3-481d-9902-345260393610 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-d7d8c313-0bf3-481d-9902-345260393610 admin admin] Request method failure captured: Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: Accept: application/json Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: Accept-Encoding: gzip, deflate Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: Connection: keep-alive Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: Content-Length: 0 Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: Host: 10.222.0.25 Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: Openstack-Api-Version: compute 2.92 Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: Openstack-System-Scope: None Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: User-Agent: python-novaclient Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Auth-Token: gAAAAABjJmuqxdMYpGV0Uwyp2qToF4foqTGVNgj4vbCttNBvRmYVc2fSdv6N4AlrfmKq8975-fgtF9Zanc4_-r8fi5nmGQXNmHnbgLn-JZGthThvtT_077Eiq0eQPdcVnPmY20sH5J3gJhZE0czmkgGIgT8R-u2iYR3rlHtl1-viyjg0Hp8AKdk Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Domain-Id: None Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Domain-Name: None Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Identity-Status: Confirmed Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Is-Admin-Project: True Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Project-Domain-Id: default Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Project-Domain-Name: Default Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Project-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Project-Name: admin Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Role: reader,admin,member Sep 18 00:51:55.247081 n-d-master-1 devstack@n-api.service[106328]: X-Roles: reader,admin,member Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-Tenant: admin Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-Tenant-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-Tenant-Name: admin Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-User: admin Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-User-Domain-Id: default Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-User-Domain-Name: Default Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-User-Id: abda4e0ffd2f4964b65b402edfc96146 Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: X-User-Name: admin Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: method: > Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: exception: Flavor 42 could not be found. Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: action_args: {'id': '42'} Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:51:55.248752 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:55.250114 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.251505 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-d7d8c313-0bf3-481d-9902-345260393610 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:51:55.252892 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-d7d8c313-0bf3-481d-9902-345260393610 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393716 Sep 18 00:51:55.252892 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 18 00:51:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:55.258858 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-c20a4ea0-2102-40e8-aefb-b39a35da2eac admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:55.282776 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-c20a4ea0-2102-40e8-aefb-b39a35da2eac admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028138 Sep 18 00:51:55.283320 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 18 00:51:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:51:55.293851 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-adef4c9d-67ac-4583-ab4c-b09f8668c04c admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:55.315493 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-adef4c9d-67ac-4583-ab4c-b09f8668c04c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026130 Sep 18 00:51:55.316024 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 18 00:51:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:51:55.325393 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9cc0b6aa-c4f5-4a72-82d7-dc0803ff5639 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:55.331199 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.wsgi [None req-9cc0b6aa-c4f5-4a72-82d7-dc0803ff5639 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9cc0b6aa-c4f5-4a72-82d7-dc0803ff5639 admin admin] Request method failure captured: Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: Accept: application/json Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: Accept-Encoding: gzip, deflate Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: Connection: keep-alive Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: Content-Length: 0 Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: Host: 10.222.0.25 Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: Openstack-Api-Version: compute 2.92 Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: Openstack-System-Scope: None Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: User-Agent: python-novaclient Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Auth-Token: gAAAAABjJmuqxdMYpGV0Uwyp2qToF4foqTGVNgj4vbCttNBvRmYVc2fSdv6N4AlrfmKq8975-fgtF9Zanc4_-r8fi5nmGQXNmHnbgLn-JZGthThvtT_077Eiq0eQPdcVnPmY20sH5J3gJhZE0czmkgGIgT8R-u2iYR3rlHtl1-viyjg0Hp8AKdk Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Domain-Id: None Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Domain-Name: None Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Identity-Status: Confirmed Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Is-Admin-Project: True Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Project-Domain-Id: default Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Project-Domain-Name: Default Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Project-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Project-Name: admin Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Role: reader,admin,member Sep 18 00:51:55.334438 n-d-master-1 devstack@n-api.service[106327]: X-Roles: reader,admin,member Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-Tenant: admin Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-Tenant-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-Tenant-Name: admin Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-User: admin Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-User-Domain-Id: default Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-User-Domain-Name: Default Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-User-Id: abda4e0ffd2f4964b65b402edfc96146 Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: X-User-Name: admin Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: method: > Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: exception: Flavor 42 could not be found. Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: action_args: {'id': '42'} Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:51:55.335748 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:55.336530 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:55.337687 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9cc0b6aa-c4f5-4a72-82d7-dc0803ff5639 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:51:55.338681 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-9cc0b6aa-c4f5-4a72-82d7-dc0803ff5639 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014121 Sep 18 00:51:55.338681 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 18 00:51:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 18 00:51:56.558651 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-adef4c9d-67ac-4583-ab4c-b09f8668c04c admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:56.559657 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-adef4c9d-67ac-4583-ab4c-b09f8668c04c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 18 00:51:56.560049 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:57.085806 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5c79457f-fdb8-4743-ae34-2746bf9ca49f admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:57.090804 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.wsgi [None req-5c79457f-fdb8-4743-ae34-2746bf9ca49f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5c79457f-fdb8-4743-ae34-2746bf9ca49f admin admin] Request method failure captured: Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: Accept: application/json Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: Accept-Encoding: gzip, deflate Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: Connection: keep-alive Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: Content-Length: 0 Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: Host: 10.222.0.25 Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: Openstack-Api-Version: compute 2.92 Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: Openstack-System-Scope: None Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: User-Agent: python-novaclient Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Auth-Token: gAAAAABjJmusuArsp7uN7KOR9oNs9QBc9fAnZeEFV9wJ49Mr-mrWGCRQpfBBkeWEOsjRN-SHn0payBG19H-4rAJICByVkY3hN7FZS24gepvM3N4SoAPqszWua9s2JXTNP18yRoUTTw4vaIcOfg3dI5W2uTLQs9kT9aQItIIIndrsudQy0902ys4 Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Domain-Id: None Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Domain-Name: None Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Identity-Status: Confirmed Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Is-Admin-Project: True Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Project-Domain-Id: default Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Project-Domain-Name: Default Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Project-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Project-Name: admin Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Role: reader,admin,member Sep 18 00:51:57.092328 n-d-master-1 devstack@n-api.service[106327]: X-Roles: reader,admin,member Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-Tenant: admin Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-Tenant-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-Tenant-Name: admin Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-User: admin Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-User-Domain-Id: default Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-User-Domain-Name: Default Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-User-Id: abda4e0ffd2f4964b65b402edfc96146 Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: X-User-Name: admin Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: method: > Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: exception: Flavor 84 could not be found. Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: action_args: {'id': '84'} Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:51:57.094470 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:57.095353 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.096471 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5c79457f-fdb8-4743-ae34-2746bf9ca49f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:51:57.097509 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-5c79457f-fdb8-4743-ae34-2746bf9ca49f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397006 Sep 18 00:51:57.097509 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 18 00:51:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:57.104064 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-49d79847-1294-488b-87f0-ac04c6eab61a admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:57.118616 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-49d79847-1294-488b-87f0-ac04c6eab61a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018114 Sep 18 00:51:57.119124 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 18 00:51:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:51:57.128871 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-453039f6-0548-485d-b38a-c09f6109aafd admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:57.144813 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-453039f6-0548-485d-b38a-c09f6109aafd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019523 Sep 18 00:51:57.145329 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 18 00:51:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:51:57.154719 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-60035108-b717-428e-a5ca-74e623b35a63 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:57.159637 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.wsgi [None req-60035108-b717-428e-a5ca-74e623b35a63 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-60035108-b717-428e-a5ca-74e623b35a63 admin admin] Request method failure captured: Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: Accept: application/json Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: Accept-Encoding: gzip, deflate Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: Connection: keep-alive Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: Content-Length: 0 Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: Host: 10.222.0.25 Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: Openstack-Api-Version: compute 2.92 Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: Openstack-System-Scope: None Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: User-Agent: python-novaclient Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Auth-Token: gAAAAABjJmusuArsp7uN7KOR9oNs9QBc9fAnZeEFV9wJ49Mr-mrWGCRQpfBBkeWEOsjRN-SHn0payBG19H-4rAJICByVkY3hN7FZS24gepvM3N4SoAPqszWua9s2JXTNP18yRoUTTw4vaIcOfg3dI5W2uTLQs9kT9aQItIIIndrsudQy0902ys4 Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Domain-Id: None Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Domain-Name: None Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Identity-Status: Confirmed Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Is-Admin-Project: True Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Project-Domain-Id: default Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Project-Domain-Name: Default Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Project-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Project-Name: admin Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Role: reader,admin,member Sep 18 00:51:57.161119 n-d-master-1 devstack@n-api.service[106328]: X-Roles: reader,admin,member Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-Tenant: admin Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-Tenant-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-Tenant-Name: admin Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-User: admin Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-User-Domain-Id: default Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-User-Domain-Name: Default Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-User-Id: abda4e0ffd2f4964b65b402edfc96146 Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: X-User-Name: admin Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: method: > Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: exception: Flavor 84 could not be found. Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: action_args: {'id': '84'} Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:51:57.162656 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:57.163630 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:57.165016 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-60035108-b717-428e-a5ca-74e623b35a63 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:51:57.166327 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-60035108-b717-428e-a5ca-74e623b35a63 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011491 Sep 18 00:51:57.166327 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 18 00:51:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 18 00:51:58.380857 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-453039f6-0548-485d-b38a-c09f6109aafd admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:58.381900 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-453039f6-0548-485d-b38a-c09f6109aafd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 18 00:51:58.382289 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:51:58.903348 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-166fbe5c-a967-4655-9619-80e39ee4f1c2 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:58.909388 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.wsgi [None req-166fbe5c-a967-4655-9619-80e39ee4f1c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-166fbe5c-a967-4655-9619-80e39ee4f1c2 admin admin] Request method failure captured: Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: Accept: application/json Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: Accept-Encoding: gzip, deflate Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: Connection: keep-alive Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: Content-Length: 0 Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: Host: 10.222.0.25 Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: Openstack-Api-Version: compute 2.92 Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: Openstack-System-Scope: None Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: User-Agent: python-novaclient Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Auth-Token: gAAAAABjJmuuLYlFmdEYMVjjWgf34FKRbkoK2LWUHzLfIHtYXGbN5es33lh0quWcfd4ORpWAIHszXX_rWRNECrECVxmrF14U_K8gQVJI_kIwetDPonff11_cWfjH92-gKmKiiiOmylgtirDzJ5X5zVQlbMSTb5i_019vUrMRKhoGgzZuuarO1dM Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Domain-Id: None Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Domain-Name: None Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Identity-Status: Confirmed Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Is-Admin-Project: True Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Project-Domain-Id: default Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Project-Domain-Name: Default Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Project-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Project-Name: admin Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Role: reader,admin,member Sep 18 00:51:58.910908 n-d-master-1 devstack@n-api.service[106328]: X-Roles: reader,admin,member Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-Tenant: admin Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-Tenant-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-Tenant-Name: admin Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-User: admin Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-User-Domain-Id: default Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-User-Domain-Name: Default Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-User-Id: abda4e0ffd2f4964b65b402edfc96146 Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: X-User-Name: admin Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: method: > Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: exception: Flavor 451 could not be found. Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: action_args: {'id': '451'} Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:51:58.912502 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:58.913604 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.914970 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-166fbe5c-a967-4655-9619-80e39ee4f1c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:51:58.916238 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-166fbe5c-a967-4655-9619-80e39ee4f1c2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392110 Sep 18 00:51:58.916238 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 18 00:51:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:58.922025 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-b12ccfdb-f91e-4f91-8303-a552080ad6b5 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:58.937219 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-b12ccfdb-f91e-4f91-8303-a552080ad6b5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018764 Sep 18 00:51:58.937768 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 18 00:51:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:51:58.946748 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:58.961978 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018607 Sep 18 00:51:58.962496 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 18 00:51:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:51:58.971510 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5cc597b6-8a4b-4a9e-aaa3-cb92870384e2 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:51:58.976347 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.wsgi [None req-5cc597b6-8a4b-4a9e-aaa3-cb92870384e2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5cc597b6-8a4b-4a9e-aaa3-cb92870384e2 admin admin] Request method failure captured: Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: Accept: application/json Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: Accept-Encoding: gzip, deflate Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: Connection: keep-alive Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: Content-Length: 0 Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: Host: 10.222.0.25 Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: Openstack-Api-Version: compute 2.92 Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: Openstack-System-Scope: None Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: User-Agent: python-novaclient Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Auth-Token: gAAAAABjJmuuLYlFmdEYMVjjWgf34FKRbkoK2LWUHzLfIHtYXGbN5es33lh0quWcfd4ORpWAIHszXX_rWRNECrECVxmrF14U_K8gQVJI_kIwetDPonff11_cWfjH92-gKmKiiiOmylgtirDzJ5X5zVQlbMSTb5i_019vUrMRKhoGgzZuuarO1dM Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Domain-Id: None Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Domain-Name: None Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Identity-Status: Confirmed Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Is-Admin-Project: True Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Project-Domain-Id: default Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Project-Domain-Name: Default Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Project-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Project-Name: admin Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Role: reader,admin,member Sep 18 00:51:58.977868 n-d-master-1 devstack@n-api.service[106327]: X-Roles: reader,admin,member Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b06bbb2b4b6a4cdc8eae60ce15b81df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-Tenant: admin Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-Tenant-Id: b06bbb2b4b6a4cdc8eae60ce15b81df6 Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-Tenant-Name: admin Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-User: admin Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-User-Domain-Id: default Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-User-Domain-Name: Default Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-User-Id: abda4e0ffd2f4964b65b402edfc96146 Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: X-User-Name: admin Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: method: > Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: exception: Flavor 451 could not be found. Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: action_args: {'id': '451'} Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:51:58.979428 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:58.980588 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Sep 18 00:51:58.982030 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-5cc597b6-8a4b-4a9e-aaa3-cb92870384e2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:51:58.983853 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-5cc597b6-8a4b-4a9e-aaa3-cb92870384e2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011211 Sep 18 00:51:58.983853 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 18 00:51:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:52:00.196208 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:52:00.197246 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 18 00:52:00.197672 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:52:00.714386 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-dc2eac20-70de-4938-ab14-ea2debb85610 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:52:00.734365 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-dc2eac20-70de-4938-ab14-ea2debb85610 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397933 Sep 18 00:52:00.734907 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 18 00:52:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:52:01.955983 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:52:01.956979 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 18 00:52:01.957372 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:52:02.485484 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-039c383e-15cc-4dc5-b92e-41f5fcf348a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:52:02.503555 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-039c383e-15cc-4dc5-b92e-41f5fcf348a2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408954 Sep 18 00:52:02.504088 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 18 00:52:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:52:03.717342 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:52:03.718393 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 18 00:52:03.718839 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:52:04.229969 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-e225e6a0-165f-4312-8591-9d4a822c0214 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:52:04.248934 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-e225e6a0-165f-4312-8591-9d4a822c0214 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.393249 Sep 18 00:52:04.249474 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 18 00:52:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:52:05.458311 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:52:05.459323 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 18 00:52:05.459746 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:52:05.975452 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d18606bb-a251-449d-8056-26f7eddf7305 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:52:05.993957 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-d18606bb-a251-449d-8056-26f7eddf7305 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395724 Sep 18 00:52:05.994497 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 18 00:52:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:52:07.210065 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:52:07.211062 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 18 00:52:07.211477 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:52:07.724384 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-03ddd06f-d6bc-4eaf-b0ef-443227303c92 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:52:07.744189 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-03ddd06f-d6bc-4eaf-b0ef-443227303c92 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395691 Sep 18 00:52:07.744739 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Sun Sep 18 00:52:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:53:04.819207 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:04.820163 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-f4f649f5-926d-4ea2-8f07-6d04ed3f57c3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 18 00:53:04.820537 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 18 00:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:53:04.831105 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:05.206394 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-f6bc38eb-ab6d-444e-8098-47211f3da93e admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:05.226867 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-f6bc38eb-ab6d-444e-8098-47211f3da93e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400237 Sep 18 00:53:05.227402 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 00:53:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:53:05.247853 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_api:SELECT=14 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:05.251658 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-75ff2058-10d5-4beb-a9b1-1477a4a4a80a admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:05.258950 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-75ff2058-10d5-4beb-a9b1-1477a4a4a80a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012467 Sep 18 00:53:05.259470 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Sep 18 00:53:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:53:05.271331 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-2ef979f0-e695-4b2c-8f16-f899bf798ecb admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:05.279472 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-2ef979f0-e695-4b2c-8f16-f899bf798ecb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011706 Sep 18 00:53:05.279972 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Sep 18 00:53:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:53:05.290896 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-863e73ff-e666-4124-a470-5768ebe7a9a1 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:05.298022 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-863e73ff-e666-4124-a470-5768ebe7a9a1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010536 Sep 18 00:53:05.298533 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Sep 18 00:53:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:53:05.309373 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-74df80fb-1ffe-40fe-9f83-f897370de06d admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:05.316353 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-74df80fb-1ffe-40fe-9f83-f897370de06d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010407 Sep 18 00:53:05.316853 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Sep 18 00:53:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:18.457525 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-863e73ff-e666-4124-a470-5768ebe7a9a1 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:18.458551 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-863e73ff-e666-4124-a470-5768ebe7a9a1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 18 00:58:18.458978 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:18.599125 n-d-master-1 devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=6 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:18.741377 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:18.746161 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.746627 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.747047 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.747745 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.748182 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.748598 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.787272 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-1706b7aa-90f9-42a3-b347-7d31fa2430f8 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189358 Sep 18 00:58:18.787822 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 18 00:58:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:19.867365 n-d-master-1 devstack@n-api.service[106328]: DEBUG nova.api.openstack.wsgi [None req-863e73ff-e666-4124-a470-5768ebe7a9a1 admin admin] Calling method '>' {{(pid=106328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:19.868412 n-d-master-1 devstack@n-api.service[106328]: INFO nova.api.openstack.requestlog [None req-863e73ff-e666-4124-a470-5768ebe7a9a1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 18 00:58:19.868811 n-d-master-1 devstack@n-api.service[106328]: [pid: 106328|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 18 00:58:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:20.059333 n-d-master-1 devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:20.062791 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:20.063286 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:20.063713 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:20.064472 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:20.064918 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:20.065329 n-d-master-1 devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:20.087831 n-d-master-1 devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-0666bbf1-cd46-4fe7-bd0a-2a14aadec6b6 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079772 Sep 18 00:58:20.088367 n-d-master-1 devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 18 00:58:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:07.290362 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 18 00:59:07.290944 n-d-master-1 devstack@n-api.service[106326]: Sun Sep 18 00:59:07 2022 - graceful shutdown triggered... Sep 18 00:59:07.291400 n-d-master-1 devstack@n-api.service[106328]: Gracefully killing worker 2 (pid: 106328)... Sep 18 00:59:07.291767 n-d-master-1 devstack@n-api.service[106327]: Gracefully killing worker 1 (pid: 106327)... Sep 18 00:59:07.416662 n-d-master-1 devstack@n-api.service[106328]: DEBUG dbcounter [-] [106328] Writing DB stats nova_api:SELECT=4 {{(pid=106328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:08.291900 n-d-master-1 devstack@n-api.service[106326]: worker 1 buried after 1 seconds Sep 18 00:59:08.291900 n-d-master-1 devstack@n-api.service[106326]: worker 2 buried after 1 seconds Sep 18 00:59:08.291900 n-d-master-1 devstack@n-api.service[106326]: goodbye to uWSGI. Sep 18 00:59:08.293420 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 18 00:59:08.294005 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 18 00:59:08.297321 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 18 00:59:08.311208 n-d-master-1 devstack@n-api.service[122365]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 18 00:59:08 2022] *** Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: nodename: n-d-master-1 Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: machine: x86_64 Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: clock source: unix Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: pcre jit disabled Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: detected number of CPU cores: 4 Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: current working directory: / Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: detected binary path: /usr/bin/uwsgi-core Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: your processes number limit is 47680 Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: your memory page size is 4096 bytes Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: detected max file descriptor number: 2048 Sep 18 00:59:08.313842 n-d-master-1 devstack@n-api.service[122365]: lock engine: pthread robust mutexes Sep 18 00:59:08.314931 n-d-master-1 devstack@n-api.service[122365]: thunder lock: enabled Sep 18 00:59:08.314931 n-d-master-1 devstack@n-api.service[122365]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 18 00:59:08.314931 n-d-master-1 devstack@n-api.service[122365]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 18 00:59:08.353541 n-d-master-1 devstack@n-api.service[122365]: Python main interpreter initialized at 0x55febff3a9c0 Sep 18 00:59:08.353541 n-d-master-1 devstack@n-api.service[122365]: python threads support enabled Sep 18 00:59:08.353541 n-d-master-1 devstack@n-api.service[122365]: your server socket listen backlog is limited to 100 connections Sep 18 00:59:08.353541 n-d-master-1 devstack@n-api.service[122365]: your mercy for graceful operations on workers is 90 seconds Sep 18 00:59:08.353922 n-d-master-1 devstack@n-api.service[122365]: mapped 403077 bytes (393 KB) for 2 cores Sep 18 00:59:08.354006 n-d-master-1 devstack@n-api.service[122365]: *** Operational MODE: preforking *** Sep 18 00:59:08.354284 n-d-master-1 devstack@n-api.service[122365]: *** uWSGI is running in multiple interpreter mode *** Sep 18 00:59:08.354284 n-d-master-1 devstack@n-api.service[122365]: spawned uWSGI master process (pid: 122365) Sep 18 00:59:08.354494 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 18 00:59:08.355166 n-d-master-1 devstack@n-api.service[122365]: spawned uWSGI worker 1 (pid: 122373, cores: 1) Sep 18 00:59:08.356094 n-d-master-1 devstack@n-api.service[122365]: spawned uWSGI worker 2 (pid: 122374, cores: 1) Sep 18 00:59:08.356094 n-d-master-1 devstack@n-api.service[122365]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 18 00:59:09.022783 n-d-master-1 devstack@n-api.service[122374]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:59:09.023407 n-d-master-1 devstack@n-api.service[122373]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:59:10.193093 n-d-master-1 devstack@n-api.service[122374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:59:10.193093 n-d-master-1 devstack@n-api.service[122374]: from cryptography.utils import int_from_bytes Sep 18 00:59:10.193914 n-d-master-1 devstack@n-api.service[122374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:59:10.193914 n-d-master-1 devstack@n-api.service[122374]: from cryptography.utils import int_from_bytes Sep 18 00:59:10.201939 n-d-master-1 devstack@n-api.service[122373]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:59:10.201939 n-d-master-1 devstack@n-api.service[122373]: from cryptography.utils import int_from_bytes Sep 18 00:59:10.202460 n-d-master-1 devstack@n-api.service[122373]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:59:10.202460 n-d-master-1 devstack@n-api.service[122373]: from cryptography.utils import int_from_bytes Sep 18 00:59:12.620556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:59:12.621219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:59:12.621219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:59:12.621612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:59:12.621870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:59:12.622261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.622582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.622914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.623236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.623565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.623877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.624198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.624522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.625384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.625676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.625995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.626469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.626794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.627106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.627418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.627746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.628053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.628376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.628694 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.629198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.630349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.630349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.630349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.630662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.630916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.631214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.631534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.631848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.632170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.632483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.632886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.633218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.633531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.633820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:59:12.634244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.634336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:59:12.634410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.634664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.634784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:59:12.634862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.634943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:59:12.635169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.635294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:59:12.635535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.635670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.635869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.636042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.636206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.636355 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.636492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.636598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.636810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.636919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.637124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.637256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.637422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.637520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.637760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.637877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.638073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.638183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.638332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.638429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.638646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.638743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.638972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.639098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.639258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.639425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.639533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.639735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.639838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.640050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.640151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.640374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.640528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.641305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.641518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.641642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.641832 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.642034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.642130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.642424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.642524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.642735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.642842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.643045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.643151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.643355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.643460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.643661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.643760 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.643969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.644078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.644275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.644432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.644585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.644731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.644891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.645048 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.645195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.645351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.645504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.645723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.645873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.646059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.646209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.646356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.646509 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.646661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.646817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.646971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.647124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.647288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.647435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.647581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.647735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.647882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.648049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.648203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.648351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.648506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.648660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.648807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.648953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.649108 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.649284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.649445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.649650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.649814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.649969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.650126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.650280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.650441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.650977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.651137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.651354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.651514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.651672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.651851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.651999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.652407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.652564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.652721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.652882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.653036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.653189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.653342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.653496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.653693 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.653856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.654023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.654169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.654321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.654471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.654628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.654786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.654938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.655094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.655239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.655393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.655626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.655779 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.655942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.656126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.656281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.656427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.656586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.656733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.656886 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.657038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.657192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.657338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.657497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.657669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.657818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.657990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.658147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.658302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.658455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.658607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.658755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.658913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.659066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.659218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.659372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.659525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.659680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.659844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.660004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.660157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.660310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.660456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.660618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.661213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.661431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.661612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.661767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.661922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.662079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.662227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.662393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.662549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.662695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.662848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.663004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.663151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.663297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.663442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.663587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.663748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.663895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.664057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.664211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.664375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.664529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.664684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.664841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.664996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.665143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.665289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.665434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.665632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.665795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.665940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.666101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.666249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.666405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.666559 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.666706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.666858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.667004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.667158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.667313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.667468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.667622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.667775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.667928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.668082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.668237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.668401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.668555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.668701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.668846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.668999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.669162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.669317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.669463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.669645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.669807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.669961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.670120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.670292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.670446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.670592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.670746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.670921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.671545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.671743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.671897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.672055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.672215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.672371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.672517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.672670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.672841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.672996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.673150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.673311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.673465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.673632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.673795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.673943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.674096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.674250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.674406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.674562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.674562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.674866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.675013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.675158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.675311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.675471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.675618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.675771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.675924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.676077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.676230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.676426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.676426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.676733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.676894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.677048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.677194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.677347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.677502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.677705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.677853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.678005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.678151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.678305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.678459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.679677 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.679871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.680031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.680192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.680342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.680498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.680667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.680830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.680977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.681131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.681700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.681968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.682128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.682284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.682443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.682597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.682753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.682909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:59:12.683067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.683214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.683368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.683514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.683742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.683899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.684053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.684205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.684352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.684516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.684679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.684827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.684982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.685130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.685284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.685446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.685703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.685857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.686005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.686151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.686305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.686475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.686630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.686785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.686932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.687078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.687225 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.687908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.688065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.688213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.688371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.688518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.688671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.688826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.688984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.689138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.689293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.689439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.689616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.689786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.689941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.690088 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.690243 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.690397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.690554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.690701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.690853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.691017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.691177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.691334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.691840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.692015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.692278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.692444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.692593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.692748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.692908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.693063 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.693211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.693377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.693532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.693766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.693930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.694090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.694246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.694400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.694547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.694707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.694855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.695000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.695145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.695290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.695446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.695601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.695749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.695902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.696048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.696200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.696354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.696510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.696665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.696821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.696969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.697123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.697269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.697439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.697606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.697759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.697904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.698061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.698217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.698376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.698528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.698675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.698829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.698975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.699141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.699316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.700053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.700053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.700361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.700509 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.700668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.700816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.700969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.701123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.701270 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.701423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.701623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.702102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.702280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.702435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.702588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.702749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.702948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.703751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.704130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.704297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.704454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.704615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.704769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.704917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.705074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.705239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.705400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.705580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.705734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.705890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.705890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.706170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.706170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.706635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.706791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.706937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.707094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.707250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.707396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.707541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.707857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.708005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.708165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.708320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.708474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.708634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.708793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.708975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.709145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.709299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.709450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.709631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.709830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.709995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.710158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.710320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.710481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.710641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.710872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.711037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.711211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.711365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.711526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.711686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.711847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.712317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.712493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.712649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.712810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.712963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.713123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.713291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.713446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.713667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.713944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.714103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.714264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.714432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.714588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.714740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.714903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.715057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.715217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.715380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.715535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.715693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.715865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.716018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.716255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.716411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.716571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.716724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.716884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.717043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.717206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.717359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.717513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.717700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.717867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.718020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.718181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.718342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.718496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.718712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.718875 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.719029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.719190 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.719351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.719504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.719664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.719829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.720008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.720170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.720336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.720490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.720650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.720811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.720977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.721131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.721282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.721435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.721663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.721841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.722004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.722465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.722632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.722796 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.722956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.723117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.723279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.723433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.723592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.723746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.723904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.724185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.724358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.724521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.724685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.724846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.724999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.725165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.725165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.725471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.725665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.725829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.725992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.726158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.726318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.726479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.726639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.727386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.728052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.728241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.728398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.728558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.728711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.728863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.729016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.729180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.729343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.729504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.729728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.729909 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.730079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.730241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.730402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.730561 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.730714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.730878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.731040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.731203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.731364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.731516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.731676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.731828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.732000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.732163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.732609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.732783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.732946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.733099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.733269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.733424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.733597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.733758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.733911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.734075 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.734358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.734538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.734701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.734868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.735030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.735198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.735353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.735505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.735505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.735802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.735955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.736116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.736276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.736430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.736604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.736765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.736917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.737078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.737231 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.737391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.737544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.737745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.737908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.738068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.738227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.738380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.738540 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.738703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.738864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.739018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.739170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.739329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.739482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.739643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.739643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.739955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.740116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.740278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.740431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.740601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.740763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.740916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.741069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.741228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.741389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.741571 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.741734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.741896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.742064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.742226 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.742380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.742792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.742973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.743142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.743304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.743466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.743621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.743781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.743934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.744093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.744245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.744511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.744680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.744834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.744987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.745155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.745322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.745484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.745661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.745817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.745970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.746122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.746291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.746446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.746599 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.746757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.746911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.747086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.747310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.747466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.747627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.747781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.747934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.748100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.748254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.748406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.748558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.748719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.748880 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.749047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.749224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.749390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.749544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.749753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.750446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.750610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.750764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.750924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.751086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.751246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.751407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.751574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.751775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.751949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.752119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.752281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.752450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.752631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.753027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.753189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.753350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.753511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.753734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.753899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.753899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.754192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.754356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.754529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.754934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.755117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.755273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.755434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.755596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.755596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.755901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.756066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.756229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.756393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.756559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.756719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.756872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.757032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.757185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.757348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.757509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.757697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.757859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.758996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.759443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.759602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.759762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.759916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.760077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.760236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.760392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.760546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.760708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.760861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.761022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.761177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.761330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.761488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.761719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.761875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.762037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.762198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.762350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.762511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.762666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.762842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.763652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.763808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.763808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.764100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.764253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.764429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.764584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.764739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.765021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.765181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.765334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.765600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.765788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.765944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.766106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.766261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.766420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.766582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.766737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.766890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.767055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.767210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.767371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.767532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.767703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.767858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.768017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.768171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.768337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.768492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.768653 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.768815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.768976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.769130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.769291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.769446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.769655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.769826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.769997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.770152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.770329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.770484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.770637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.770797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.770951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.771118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.771279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.771447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.771601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.771753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.771921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.772090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.772244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.772398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.772550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.772702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.772864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.773363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.773532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.773725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.773891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.774046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.774201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.774375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.774537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.774699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.774853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.775025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.775286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.775454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.775616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.775778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.775940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.776882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.777638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.777799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.777961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.778121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.778283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.778450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.778606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.778776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.778931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.779084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.779250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.779419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.779581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.779734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.779895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.780048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.780221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.780389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.780543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.780703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.780868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.781532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.781754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.781910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.782074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.782229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.782382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.782543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.782708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.782863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.783016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.783169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.783602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.783789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.783945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.784106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.784268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.784422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.784576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.784737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.784899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.785052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.785205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.785474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.785684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.785868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.786024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.786177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.786338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.786492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.786646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.786810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.786966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.787126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.787289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.787442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.787604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.787771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.787939 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.788100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.788254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.788408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.788574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.788574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.788883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.789037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.789197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.789357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.789524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.789706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.789872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.790036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.790198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.790358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.790525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.790696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.790856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.791921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.792232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.792395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.792549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.792702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.792702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.793010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.793173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.793173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.793797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.793972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.793972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.794281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.794463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.794463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.794764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.794926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.794926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.795219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.795382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.795649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.795809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.795809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.796111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.796278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.796445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.796606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.797329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.797497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.797497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.797838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.798001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.798001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.798293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.798447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.798447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.798746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.798909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.799079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.799244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.799399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.799560 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.799560 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.799851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.800010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.800171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.800325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.800490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.800490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.800794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.800949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.801111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.801271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.801434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.801619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.801787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.801787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.802092 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.802245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.802245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.802547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.802706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.802706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.802997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.803169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.803335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.803491 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.803491 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.804079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.804235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.804235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.804539 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.804713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.804876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.805038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.805038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.805356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.805511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.805819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.805989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.806157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.806312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.806473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.806629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.806782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.806943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.807106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.807269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.807269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.807596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.807757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.807913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.808075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.808237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.808391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.808544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.808699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.808860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.809028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.809184 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.809337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.809500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.809678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.809892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.810065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.810065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.810380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.810534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.810534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.810852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.811016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.811170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.811331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.811331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.811647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.811810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.811810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.812110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.812298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.812478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.812634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.812796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.812951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.813112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.813274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.813428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.813630 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.814071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.814243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.814406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.814567 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.814722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.814885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.815049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.815211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.815376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.815532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.815686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.815872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.816138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.816318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.816474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.816635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.816797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.816967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.817123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.817283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.817446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.817618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.817794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.817958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.818119 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.818293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.818293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.818585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.818752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.818907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.819059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.819213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.819373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.819528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.819690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.819845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.819845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.820144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.820318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.820478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.820644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.820811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.820963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.821123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.821277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.821439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.821676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.821852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.822015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.822170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.822330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.822503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.822657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.822817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.822971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.823140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.823303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.823472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.823627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.823780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.824209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.824209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.824209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.824671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.824837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.824992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.825145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.825305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.825469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.825645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.825803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.825957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.826129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.826376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.826549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.826712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.826877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.827030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.827183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.827335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.827501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.827665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.827826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.828510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.828674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.828828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.829028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.829193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.829354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.829527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.829734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.829899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.830054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.830207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.830366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.830520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.830672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.830835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.830989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.831157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.831157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.831473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.831643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.831643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.831946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.832107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.832267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.832421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.832573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.832735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.832890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.833043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.833196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.833357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.833519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.833709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.833865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.834019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.834413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.834573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.834745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.834903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.835063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.835224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.835377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.835538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.835704 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.835881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.836036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.836198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.836379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.836697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.836858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.837014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.837168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.837321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.837474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.837667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.837834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.838005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.838160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.838324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.838486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.838649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.838810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.838973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.839136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.839136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.839438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.839600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.839761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.839926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.840080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.840235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.840402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.840557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.840719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.840880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.841034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.841204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.841373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.841528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.841733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.841896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.842069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.842237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.842393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.842546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.842699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.842852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.843013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.843177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.843339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.843501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.843725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.843881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.844049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.844566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.844736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.844736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.845568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.845731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.845898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.846053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.846206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.846361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.846526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.846794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.846979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.847135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.847288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.847441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.847595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.847766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.847922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.848075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.848236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.848397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.848560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.848726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.848898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.849054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.849213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.849373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.849526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.849526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.849526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.850055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.850209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.850363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.850516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.850679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.850841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.851005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.851165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.851331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.884664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.886155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.886349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.886526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.886706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.886881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.887095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.887317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.887555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.887797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.888447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.888718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.888992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.889301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.889301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.889921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.890197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.891302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.891586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.891586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.892378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.892610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.892610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.893045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.893341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.893488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.893652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.893789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.893923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.893923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894571 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.894992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.895390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.895587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.895738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.895876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.895876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.896128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.896261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.896394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.896536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.896536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.896800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.896934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.897901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.898490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.898704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.898864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.899814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.900078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.900211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.900344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.900487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.900630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.900765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.900898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.901032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.901270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.901497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.901703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.901882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.902058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.902612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.902829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.903101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.903410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.903668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.905668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.905821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.905960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.906164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.906310 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.906447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.906581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.906765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.906922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.907992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.908127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.908278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.908701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.908922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.909064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.909199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.909335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.909499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.909705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.909872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.910096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.910278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.910727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.910902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.911072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.911217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.911466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.911766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.911918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.912054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.912164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.912263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.912263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.912443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.912560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.912846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.913100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.913258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.913397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.913535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.913740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.913880 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.914998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.915505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.915505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.915938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.916076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.916214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.916350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.916496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.916633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.916633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.916891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.917027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.917170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.917308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.917444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.917663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.917808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.917944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.918091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.918228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.918228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.918754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.918919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.919142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.919302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.919445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.919580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.919727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.919865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.920816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.921074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.921208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.921342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.921509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.922511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.922677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.922989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.923134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.923271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.923416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.923553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.923690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.923827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.923963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.924100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.924255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.924393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.924529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.924665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.924800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.924935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.925080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.925218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.925354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.925489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.925683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.925880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.926034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.926172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.926308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.926547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.926692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.926838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.926983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.927120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.927256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.927394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.927394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.927659 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.927797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.927960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.928098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.928236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.928372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.928515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.928892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.929044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.929270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.929415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.929569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.929726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.929865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930150 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.930974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.931110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.931253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.931390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.931527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.931671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.931819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.931955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.932098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.932235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.932480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.932715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.932859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.933165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.933319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.933458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.933625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.933769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.933904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.934052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.934200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.934338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.934478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.934615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.934751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.934887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.935032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.935169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.935305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.935442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.935578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.935722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.935722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.936039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.936178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.936178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.936433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.936597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.936597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.936957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.937095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.937230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.937423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.937423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.938228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.938378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.938378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.938378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.938378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.938378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.938378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.939593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.939741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.939741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.939741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.940926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.941182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.941317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.941317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.941627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.941772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.941911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.942047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.942193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.942337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.942492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.942722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.942960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.943122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.943424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.943572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.943710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.943846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.943983 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.944118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.944265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.944411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.944548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.944684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.944820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.944957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.945101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.945239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.945374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.945509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.945669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.945807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.946010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.946156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.946294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.946430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.946565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.946701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.946862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.947098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.947241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.947378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.947513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.947657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.947794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.947940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.948121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.948299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.948451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.948595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.948746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.948885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.948885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.949381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.949686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.949845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.949985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.949985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:59:12.950260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.950260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.950260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.950260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.950260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:59:12.950260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:59:12.971728 n-d-master-1 devstack@n-api.service[122373]: INFO dbcounter [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Registered counter for database nova_api Sep 18 00:59:12.974200 n-d-master-1 devstack@n-api.service[122374]: INFO dbcounter [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Registered counter for database nova_api Sep 18 00:59:12.994991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_db.sqlalchemy.engines [None req-af03816d-5927-4135-8632-f66ad409a487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:12.996483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_db.sqlalchemy.engines [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:13.003990 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writer thread running {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.004576 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writer thread running {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.065413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.context [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=122374) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:59:13.071312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.071797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.073475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.074267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.074704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.076388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.context [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=122373) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:59:13.076761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.079338 n-d-master-1 devstack@n-api.service[122374]: INFO dbcounter [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Registered counter for database nova_cell0 Sep 18 00:59:13.081312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.081939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.083604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.083694 n-d-master-1 devstack@n-api.service[122374]: INFO dbcounter [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Registered counter for database nova_cell1 Sep 18 00:59:13.084429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.084945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.087102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.089207 n-d-master-1 devstack@n-api.service[122373]: INFO dbcounter [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Registered counter for database nova_cell0 Sep 18 00:59:13.091251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_db.sqlalchemy.engines [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:13.095618 n-d-master-1 devstack@n-api.service[122373]: INFO dbcounter [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Registered counter for database nova_cell1 Sep 18 00:59:13.096917 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writer thread running {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.097948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_db.sqlalchemy.engines [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:13.112643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_db.sqlalchemy.engines [None req-af03816d-5927-4135-8632-f66ad409a487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:13.117153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_db.sqlalchemy.engines [None req-af03816d-5927-4135-8632-f66ad409a487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:13.123215 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writer thread running {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.130829 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writer thread running {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.276257 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writer thread running {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.286127 n-d-master-1 devstack@n-api.service[122374]: INFO dbcounter [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Registered counter for database nova_cell0 Sep 18 00:59:13.293265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_db.sqlalchemy.engines [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:13.298488 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writer thread running {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.302480 n-d-master-1 devstack@n-api.service[122373]: INFO dbcounter [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Registered counter for database nova_cell0 Sep 18 00:59:13.311682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_db.sqlalchemy.engines [None req-af03816d-5927-4135-8632-f66ad409a487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:59:13.319584 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writer thread running {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:59:13.629047 n-d-master-1 devstack@n-api.service[122374]: WARNING keystonemiddleware.auth_token [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:59:13.636605 n-d-master-1 devstack@n-api.service[122374]: WARNING keystonemiddleware.auth_token [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:59:13.650349 n-d-master-1 devstack@n-api.service[122373]: WARNING keystonemiddleware.auth_token [None req-af03816d-5927-4135-8632-f66ad409a487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:59:13.658154 n-d-master-1 devstack@n-api.service[122373]: WARNING keystonemiddleware.auth_token [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:59:13.982465 n-d-master-1 devstack@n-api.service[122374]: WARNING keystonemiddleware.auth_token [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:59:13.988949 n-d-master-1 devstack@n-api.service[122374]: WARNING keystonemiddleware.auth_token [None req-388aa811-5988-42a4-b686-9d10e5befd02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:59:13.994310 n-d-master-1 devstack@n-api.service[122374]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55febff3a9c0 pid: 122374 (default app) Sep 18 00:59:14.009534 n-d-master-1 devstack@n-api.service[122373]: WARNING keystonemiddleware.auth_token [None req-af03816d-5927-4135-8632-f66ad409a487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:59:14.015757 n-d-master-1 devstack@n-api.service[122373]: WARNING keystonemiddleware.auth_token [None req-af03816d-5927-4135-8632-f66ad409a487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:59:14.021064 n-d-master-1 devstack@n-api.service[122373]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55febff3a9c0 pid: 122373 (default app) Sep 18 00:59:54.005043 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:54.006699 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:54.007798 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:54.008897 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:54.974068 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:54.979409 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:54.986541 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:54.986541 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:55.720338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-824910306", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:56.468472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Calling method '.version_select at 0x7f7007efa430>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:56.480045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=122373) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 18 00:59:56.481729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.482399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.483655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.517529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.518634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.519432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.539478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.540478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.541181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.558906 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aa26b36a-2f60-454b-a9f0-c38b294dc0ca tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.608932 Sep 18 00:59:56.562271 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1208 bytes} [Sun Sep 18 00:59:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:59:56.983020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:56.985380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.986119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.986831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.987940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.991656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.992244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.030628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:59:57.080443 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68e1e48c-c440-41b9-a258-a2b782db7ddc tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.515266 Sep 18 00:59:57.081250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1164 bytes} [Sun Sep 18 00:59:56 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 00:59:57.295251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:57.299417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.302080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.302521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.303259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.310304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.310758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.371535 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ccae3316-9f01-460f-bcef-b0cc49c876a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.288848 Sep 18 00:59:57.372499 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 00:59:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:57.604428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:59:57.605009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:59:57.605675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:59:57.606241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:59:57.606791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:59:57.624217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.625001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.625800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.626708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.627334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.627941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.633373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f7007db5550>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:57.635787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.636267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.636698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.670836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.671225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.672131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.689424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.690225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.690912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.697518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61614651-6d92-4a04-9e68-79ea07520afa tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.323988 Sep 18 00:59:57.698666 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 4/4] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 00:59:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:57.705674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Getting quotas for project eecbfc5594c74b798ba6eaa2d8c19059. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:59:57.713929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Getting quotas for user 450f5767908346de9e8884f72376614a and project eecbfc5594c74b798ba6eaa2d8c19059. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:59:57.727741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:59:57.731037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:59:57.830785 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba81dddf-df18-4414-97f7-d1eb06dfe1c1 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.828803 Sep 18 00:59:57.842642 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1/5] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 00:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:59:57.850724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-736b25cc-2c4f-45cd-82df-0cd862c67f3f tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-469993659"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:57.855798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-736b25cc-2c4f-45cd-82df-0cd862c67f3f tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Generated uuid 63eabf78-a9db-4943-8d0f-88c506a4ad43 for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 00:59:57.954643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-736b25cc-2c4f-45cd-82df-0cd862c67f3f tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.110028 Sep 18 00:59:57.966528 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2/6] 10.222.0.25 () {62 vars in 1205 bytes} [Sun Sep 18 00:59:57 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:59:57.973333 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:57.977360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.983848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.987530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.988569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.989231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.989858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.090103 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34556d68-666e-4418-9300-f6045918e8bb tempest-AZAdminV2TestJSON-1606945710 tempest-AZAdminV2TestJSON-1606945710-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.119889 Sep 18 00:59:58.092947 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1185 bytes} [Sun Sep 18 00:59:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:58.099062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f70074db9d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.110410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '.version_select at 0x7f7007d691f0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.112542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.113086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.114181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.115792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=122374) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 18 00:59:58.118910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.120896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.121925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.144954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.144954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.145399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.177660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.178154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.180068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.197123 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf0a6b2d-70d5-407e-82a9-3c37f1373c95 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.495750 Sep 18 00:59:58.201689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.202185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.204455 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 18 00:59:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:58.207323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.217879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c412480-1ba3-4fde-9769-54cfa6a14c4d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.220331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c412480-1ba3-4fde-9769-54cfa6a14c4d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:58.236334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.239579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.240360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.249027 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4504887e-e70e-4b0a-a455-870a6bc431dc tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.154813 Sep 18 00:59:58.263440 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 18 00:59:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:58.269631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80edd04e-6257-4246-be42-e73cd0b74bc4 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-110201986"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:58.476156 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80edd04e-6257-4246-be42-e73cd0b74bc4 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.211267 Sep 18 00:59:58.481025 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 5/10] 10.222.0.25 () {62 vars in 1210 bytes} [Sun Sep 18 00:59:58 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:59:58.485828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f70074db820>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.492769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.495603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.496263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.530563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.535554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.536100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.562847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.578531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.579318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.594121 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cfdb98d9-1d94-4e4d-b46e-bb56dea858d7 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.111677 Sep 18 00:59:58.598633 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 00:59:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:58.617719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70edc4d9-5ac6-4971-8ce6-ad4484834f98 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.638776 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70edc4d9-5ac6-4971-8ce6-ad4484834f98 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.028285 Sep 18 00:59:58.640566 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 7/12] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 18 00:59:58 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:59:58.651685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f700748ae50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.656808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.657518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.658282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.682180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.683074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.684089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.694817 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3602f638-9fd2-48f6-ba9a-25591cc8051c tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.052532 Sep 18 00:59:58.709265 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 00:59:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:58.717904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e316c8d5-5024-413c-8559-4b07782b1e1d tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:58.748184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e316c8d5-5024-413c-8559-4b07782b1e1d tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.749643 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e316c8d5-5024-413c-8559-4b07782b1e1d tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.750403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e316c8d5-5024-413c-8559-4b07782b1e1d tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.203935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c412480-1ba3-4fde-9769-54cfa6a14c4d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:59.232448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c412480-1ba3-4fde-9769-54cfa6a14c4d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1219 microversion: 2.1 time: 1.024147 Sep 18 00:59:59.233878 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 6/14] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:58 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1219 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:59.249264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-99abbdfc-823e-43a7-b496-e07b0dab46d4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f7007d699d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.253825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99abbdfc-823e-43a7-b496-e07b0dab46d4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.254689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99abbdfc-823e-43a7-b496-e07b0dab46d4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.255198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99abbdfc-823e-43a7-b496-e07b0dab46d4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.277081 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-99abbdfc-823e-43a7-b496-e07b0dab46d4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.037101 Sep 18 00:59:59.278446 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1179 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:59.396699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f7007d75a60>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.402434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.403845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.405035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.407741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.408422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.410111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.530381 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3129774f-5416-4b97-8839-562c1acd1da0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.250680 Sep 18 00:59:59.531536 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1128 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:59.538843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f7007d69940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.543573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.544223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.544833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.564159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.564854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.566721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.591284 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e316c8d5-5024-413c-8559-4b07782b1e1d tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.880634 Sep 18 00:59:59.592277 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 9/17] 10.222.0.25 () {62 vars in 1232 bytes} [Sun Sep 18 00:59:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:59:59.602219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f70074a09d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.602895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.603447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.603894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.606382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.606876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.607316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.609029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.609486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.610012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.622888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-51b42bcc-e25a-417a-a670-26e1ce89dc86 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.090117 Sep 18 00:59:59.624191 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:59.633483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-58ceda76-4193-4e34-a731-3a36c65ced13 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:59.649227 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56d0da49-4054-4ed2-b359-22b0ab7d75e0 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.055535 Sep 18 00:59:59.652921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1139 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:59.658612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f70074a0310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.660880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.661668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.662738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.687308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.688150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.689379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.695222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-58ceda76-4193-4e34-a731-3a36c65ced13 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.695719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-58ceda76-4193-4e34-a731-3a36c65ced13 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.696216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-58ceda76-4193-4e34-a731-3a36c65ced13 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.720311 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f922925-610b-4bab-9b07-263f80d5e0b4 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.065143 Sep 18 00:59:59.721164 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 11/20] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:59.733400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f70074a0550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.738309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.739052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.739663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.744218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.745220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.746000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.794101 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c05c613e-4ae6-4278-b640-48de61691cd6 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.065925 Sep 18 00:59:59.796577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 12/21] 10.222.0.25 () {58 vars in 1145 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 00:59:59.818326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f7007439ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.831088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.831088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.831088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.838745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.839378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.840023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.849155 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-67e9f4d3-4734-4798-8a7d-cd190f48ad91 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.050810 Sep 18 00:59:59.859535 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 13/22] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:59.865428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Calling method '.version_select at 0x7f70074395e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.875680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.876287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.876775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.894044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.894806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.895431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.911310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.911966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.914967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.926858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 00:59:59.927650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d68db7d8-84e9-4a0e-964c-090447dfcf85 tempest-HypervisorAdminTestJSON-1477685530 tempest-HypervisorAdminTestJSON-1477685530-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 00:59:59.929009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.929757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.930473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.932238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.933191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.933886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.945225 n-d-master-1 devstack@n-api.service[122374]: INFO nova.compute.rpcapi [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 18 00:59:59.946361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] Releasing lock "compute-rpcapi-router" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:00:00.016299 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-339fb869-9cba-44bc-876d-0bc419da2c61 None None] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.154803 Sep 18 01:00:00.017363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 14/23] 10.222.0.25 () {58 vars in 1173 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:00.261144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:00.262214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:00.282432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.283815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.284470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.285858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.286568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.287244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.509020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:00.547979 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-79726220-e6e4-4a67-9ed0-53001f21f390 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1215 microversion: 2.1 time: 0.291203 Sep 18 01:00:00.548925 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 15/24] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:00 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1215 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:00.768744 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-58ceda76-4193-4e34-a731-3a36c65ced13 tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 1.143136 Sep 18 01:00:00.772468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 10/25] 10.222.0.25 () {62 vars in 1232 bytes} [Sun Sep 18 00:59:59 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:00.784036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50373670-96bb-49b0-820a-75dc2ee9576d tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:00.845946 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50373670-96bb-49b0-820a-75dc2ee9576d tempest-AggregatesAdminTestV241-482903908 tempest-AggregatesAdminTestV241-482903908-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.065993 Sep 18 01:00:00.846540 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 16/26] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 18 01:00:00 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:00.864685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f7007ce1ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:00.875010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.875825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.877466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.879151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.881982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.882756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.944508 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ce14a6f9-d0d0-4c03-a403-80efedcf94e8 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.086978 Sep 18 01:00:00.946526 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 11/27] 10.222.0.25 () {58 vars in 1128 bytes} [Sun Sep 18 01:00:00 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:00.956264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f700738b8b0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:00.961643 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.962122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.962563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.963306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.963751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.964174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.008807 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46234859-5138-438f-9278-513a32abe643 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.055999 Sep 18 01:00:01.010436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 17/28] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:00 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.024986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f7007c82790>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.031799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.032314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.034014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.036796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.037283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.039070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.054264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a50e6d5-99c2-44d0-96ab-6d5e27cb8be4 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-531737880"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:01.061384 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-2a50e6d5-99c2-44d0-96ab-6d5e27cb8be4 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid 16cf0903-f8e0-446d-bf23-de40eb07f1bf for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:01.117615 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a50e6d5-99c2-44d0-96ab-6d5e27cb8be4 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068268 Sep 18 01:00:01.125076 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 18/29] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.125277 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dbd05d09-1d09-4423-8d58-1df65249e4d4 tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.101201 Sep 18 01:00:01.125696 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 12/30] 10.222.0.25 () {58 vars in 1128 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.132385 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37eb141a-21a2-4b6f-b728-fdb2bf637016 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:01.146016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f7007c82b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.155992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37eb141a-21a2-4b6f-b728-fdb2bf637016 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.158680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37eb141a-21a2-4b6f-b728-fdb2bf637016 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.159140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37eb141a-21a2-4b6f-b728-fdb2bf637016 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.166785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.167891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.169027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.196449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.198127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.199047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.296631 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a6543e8-8b0d-4da6-a2b5-0a0dc9b4458f tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.164318 Sep 18 01:00:01.297931 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 13/31] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 467 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.312130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Calling method '.version_select at 0x7f7007c825e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.332621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.333460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.335169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.368107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.370624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.372426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.399791 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-84388ee3-e340-47d6-b62d-0bd78a74808a tempest-HostsAdminTestJSON-2102829125 tempest-HostsAdminTestJSON-2102829125-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 332 microversion: 2.1 time: 0.091141 Sep 18 01:00:01.404431 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 14/32] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.428973 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37eb141a-21a2-4b6f-b728-fdb2bf637016 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.300877 Sep 18 01:00:01.429961 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 19/33] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:01 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.441926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:01.454226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.454715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.455206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.534529 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-master-1. Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 39 Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:01.559904 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: {"add_host": {"host": "n-h1-master-1"}} Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:01.561087 n-d-master-1 devstack@n-api.service[122373]: exception: Aggregate 2 already has host n-h1-master-1. Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result.read() Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 01:00:01.561957 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi session.flush() Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 01:00:01.567124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 01:00:01.568961 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 01:00:01.571208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result.read() Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 18, 1, 0, 1, 509715), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 2}] Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:01.573839 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-master-1. Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.577319 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-master-1. Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:01.580702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:01.583429 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-master-1. Sep 18 01:00:01.583429 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:01.583429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-master-1. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:01.583429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2c3dd738-d573-4a55-b8fb-9153da3b9af5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.123425 Sep 18 01:00:01.583429 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 15/34] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:01 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 18 01:00:01.584773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4c3cdd76-d16d-4517-9e33-b7f110f647e6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:01.584917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.584917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:01.593918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c3cdd76-d16d-4517-9e33-b7f110f647e6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.594097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.594703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.594826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c3cdd76-d16d-4517-9e33-b7f110f647e6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.594910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.595582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.595892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c3cdd76-d16d-4517-9e33-b7f110f647e6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.596047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.596463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.786445 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4c3cdd76-d16d-4517-9e33-b7f110f647e6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.208516 Sep 18 01:00:01.787309 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 20/35] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:01 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.803147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d0a489d-b516-45fe-afc4-f17dc41bd43b tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.815291 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:01.872113 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d0a489d-b516-45fe-afc4-f17dc41bd43b tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.076794 Sep 18 01:00:01.873422 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 21/36] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:01 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:01.891772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa161352-e046-497f-a44a-46bc0c9667e6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1261155985", "name": "tempest-test_aggregate-1716393201"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:01.929138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-fa161352-e046-497f-a44a-46bc0c9667e6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid fc1f01c8-7bc3-49a8-a6a5-ff0b96cfab6b for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:01.938203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:01.957982 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-791d2de6-7124-4bbe-ad02-0c207af5e5ec tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1277 microversion: 2.1 time: 0.387230 Sep 18 01:00:01.959063 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 16/37] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:01.964271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-385c8aa8-61b6-4702-8b44-1d6d07537f35 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2042586028"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:01.970881 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa161352-e046-497f-a44a-46bc0c9667e6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.089886 Sep 18 01:00:01.979857 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 22/38] 10.222.0.25 () {60 vars in 1165 bytes} [Sun Sep 18 01:00:01 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:01.991661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c7776ff-4207-4928-b0ae-1a2e0b5e0e8b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.993954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-385c8aa8-61b6-4702-8b44-1d6d07537f35 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid e5049293-913f-4ce1-9b6c-d86f664dc95b for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:02.015836 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c7776ff-4207-4928-b0ae-1a2e0b5e0e8b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.034338 Sep 18 01:00:02.016613 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 23/39] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:02.031571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38c3595c-dc09-4687-b50b-efb0700f9e46 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:02.044566 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-385c8aa8-61b6-4702-8b44-1d6d07537f35 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084312 Sep 18 01:00:02.045129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38c3595c-dc09-4687-b50b-efb0700f9e46 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:02.045897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38c3595c-dc09-4687-b50b-efb0700f9e46 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:02.046522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38c3595c-dc09-4687-b50b-efb0700f9e46 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:02.049142 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 17/40] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:02.259658 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-38c3595c-dc09-4687-b50b-efb0700f9e46 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.234447 Sep 18 01:00:02.261411 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 24/41] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:02 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:02.979268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-018092a3-7ce0-47b5-8de1-5fe9adef0523 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:02.983228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-018092a3-7ce0-47b5-8de1-5fe9adef0523 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c471d1f448fe493d9f1654f3122f9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5063060fcc66473ba0c329aceb560008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-018092a3-7ce0-47b5-8de1-5fe9adef0523 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Request method failure captured: Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 39 Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2J8orw7bnZvu7RR8zfliWCh5JDKy_mX0uD621FOwzbn4NNq7uUPBqszuri-F6IqLWUh2LSyr9O2_Ar2letJTAQ_5ZsGVVEMysv6OxYxGnWc5LtJnt7OjoM-tLhe1vNmpLHefqpvqfsWxZ68swP-Z2zvWzoccEj1UWKzk_Rz-tvc1U Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:02.995341 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5063060fcc66473ba0c329aceb560008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5063060fcc66473ba0c329aceb560008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c471d1f448fe493d9f1654f3122f9a1f Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: {"add_host": {"host": "n-h1-master-1"}} Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:02.996738 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:02.997535 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 18 01:00:02.999110 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.002254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-018092a3-7ce0-47b5-8de1-5fe9adef0523 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:03.007996 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-018092a3-7ce0-47b5-8de1-5fe9adef0523 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.951048 Sep 18 01:00:03.008808 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 18/42] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:02 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 952 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:03.024658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.025432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:03.039853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.043170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.043823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.046756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.051802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.052599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.149399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:03.165636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3b0e3ebb-65b9-4f85-9a10-8c7b65fa4add tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1299 microversion: 2.1 time: 0.154813 Sep 18 01:00:03.171742 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 19/43] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:03 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:03.183175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b950ed2d-9b68-4480-8f87-436a316d0e06 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.239586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b950ed2d-9b68-4480-8f87-436a316d0e06 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.066381 Sep 18 01:00:03.240617 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 20/44] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:03 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:03.252086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d1366e62-2670-4e1a-9864-d632ac397a7b tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-121148350"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.259840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-d1366e62-2670-4e1a-9864-d632ac397a7b tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid 5349cf3c-93dd-4437-9cf9-ab08b3647cb1 for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:03.304937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d1366e62-2670-4e1a-9864-d632ac397a7b tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057219 Sep 18 01:00:03.307654 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 21/45] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:03.319458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1627323640"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.340835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.341684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.343749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.359627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.366541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.366865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.391177 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1627323640 could not be found. Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 58 Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:03.394227 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: {"add_host": {"host": "tempest-nonexist_host-1627323640"}} Sep 18 01:00:03.395500 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: exception: Compute host tempest-nonexist_host-1627323640 could not be found. Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1627323640'}}} Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1627323640' is not mapped to any cell Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.396233 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 18 01:00:03.397242 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1627323640 could not be found. Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1627323640 could not be found. Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.398228 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1627323640 could not be found. Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1627323640 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78ad85a1-29e5-4b8c-a006-ae403badee0c tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.080367 Sep 18 01:00:03.401987 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 22/46] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:03.407438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7d1eb5f-7bcb-4185-870c-48d5de9d7421 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.454514 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7d1eb5f-7bcb-4185-870c-48d5de9d7421 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.051667 Sep 18 01:00:03.465730 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 23/47] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:03 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:03.480683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d31352b9-56fe-441a-8e9b-f6de7b57faa9 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d31352b9-56fe-441a-8e9b-f6de7b57faa9 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 283 Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:03.489926 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.491350 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:00:03.491987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:03.492656 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.493706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.494653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:00:03.494653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:00:03.494653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:00:03.494653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.499072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d31352b9-56fe-441a-8e9b-f6de7b57faa9 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:03.500592 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d31352b9-56fe-441a-8e9b-f6de7b57faa9 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031862 Sep 18 01:00:03.504260 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 24/48] 10.222.0.25 () {60 vars in 1165 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:00:03.516583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a51f626-bcf8-4563-bdc1-a7732a9b01ad tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a51f626-bcf8-4563-bdc1-a7732a9b01ad tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 27 Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:03.520949 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: {"aggregate": {"name": ""}} Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:03.522370 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi '' Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:03.523293 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:00:03.524702 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.527874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a51f626-bcf8-4563-bdc1-a7732a9b01ad tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:03.528992 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a51f626-bcf8-4563-bdc1-a7732a9b01ad tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019358 Sep 18 01:00:03.530785 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:00:03.552868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ddf990a-cf59-4e8a-81f5-d3c3665ce8cd tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-707424199"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.560071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ddf990a-cf59-4e8a-81f5-d3c3665ce8cd tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c471d1f448fe493d9f1654f3122f9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5063060fcc66473ba0c329aceb560008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ddf990a-cf59-4e8a-81f5-d3c3665ce8cd tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Request method failure captured: Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 59 Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2J8orw7bnZvu7RR8zfliWCh5JDKy_mX0uD621FOwzbn4NNq7uUPBqszuri-F6IqLWUh2LSyr9O2_Ar2letJTAQ_5ZsGVVEMysv6OxYxGnWc5LtJnt7OjoM-tLhe1vNmpLHefqpvqfsWxZ68swP-Z2zvWzoccEj1UWKzk_Rz-tvc1U Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:03.564513 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5063060fcc66473ba0c329aceb560008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5063060fcc66473ba0c329aceb560008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c471d1f448fe493d9f1654f3122f9a1f Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: {"aggregate": {"name": "tempest-test_aggregate-707424199"}} Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:03.566039 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-707424199'}}} Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:03.571793 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:03.572963 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 18 01:00:03.574131 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.574131 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ddf990a-cf59-4e8a-81f5-d3c3665ce8cd tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:03.574131 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ddf990a-cf59-4e8a-81f5-d3c3665ce8cd tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.024603 Sep 18 01:00:03.574131 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:03.580306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3910f935-d9b0-49cd-b388-d57173230249 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1159450026"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.589117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-3910f935-d9b0-49cd-b388-d57173230249 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid 6f61fddc-5c2d-4768-a936-20e8b89628a9 for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:03.630477 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3910f935-d9b0-49cd-b388-d57173230249 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057846 Sep 18 01:00:03.631678 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 27/51] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:03.652695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4187227-9a8a-47d0-ad28-9be50d58a7db tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1159450026"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.660311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-f4187227-9a8a-47d0-ad28-9be50d58a7db tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid 0b134bc2-9725-45e7-b2f8-3bdc414b9985 for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:03.696419 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f4187227-9a8a-47d0-ad28-9be50d58a7db tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1159450026 already exists. Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4187227-9a8a-47d0-ad28-9be50d58a7db tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 60 Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:03.701840 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: {"aggregate": {"name": "tempest-test_aggregate-1159450026"}} Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:03.702946 n-d-master-1 devstack@n-api.service[122373]: exception: Aggregate tempest-test_aggregate-1159450026 already exists. Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1159450026'}}} Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 18 01:00:03.703794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1159450026 already exists. Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:03.704924 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1159450026 already exists. Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1159450026 already exists. Sep 18 01:00:03.706273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.713046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4187227-9a8a-47d0-ad28-9be50d58a7db tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1159450026 already exists. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:03.716269 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f4187227-9a8a-47d0-ad28-9be50d58a7db tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.074962 Sep 18 01:00:03.718968 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 28/52] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:03.734545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a19082f-d320-4e18-81e4-9fa39936ee37 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.762747 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:03.805774 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a19082f-d320-4e18-81e4-9fa39936ee37 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.082111 Sep 18 01:00:03.807617 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 29/53] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:03 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 18 01:00:03.817521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c91eea31-1738-41cc-aea8-49e6563c2623 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-905455276"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.827453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-c91eea31-1738-41cc-aea8-49e6563c2623 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid b1aa178b-36a4-4da9-9847-ad9149def07f for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:03.871050 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c91eea31-1738-41cc-aea8-49e6563c2623 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057570 Sep 18 01:00:03.872919 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 30/54] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:03.885592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bcb1f405-c7ac-410d-ab54-85240d5e8feb tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.888682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bcb1f405-c7ac-410d-ab54-85240d5e8feb tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c471d1f448fe493d9f1654f3122f9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5063060fcc66473ba0c329aceb560008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bcb1f405-c7ac-410d-ab54-85240d5e8feb tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Request method failure captured: Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2J8orw7bnZvu7RR8zfliWCh5JDKy_mX0uD621FOwzbn4NNq7uUPBqszuri-F6IqLWUh2LSyr9O2_Ar2letJTAQ_5ZsGVVEMysv6OxYxGnWc5LtJnt7OjoM-tLhe1vNmpLHefqpvqfsWxZ68swP-Z2zvWzoccEj1UWKzk_Rz-tvc1U Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:03.893966 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5063060fcc66473ba0c329aceb560008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5063060fcc66473ba0c329aceb560008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c471d1f448fe493d9f1654f3122f9a1f Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 18 01:00:03.895279 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '7'} Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:03.895903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 18 01:00:03.896821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:03.899077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bcb1f405-c7ac-410d-ab54-85240d5e8feb tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:03.901753 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bcb1f405-c7ac-410d-ab54-85240d5e8feb tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.022468 Sep 18 01:00:03.903573 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 31/55] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:03.922023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc1bfc13-370e-4232-ac75-5643408106f4 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.983129 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc1bfc13-370e-4232-ac75-5643408106f4 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.070205 Sep 18 01:00:03.987988 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 32/56] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:04.008751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a86a8791-2631-4385-86ac-b4f055c512e5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:04.032499 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a86a8791-2631-4385-86ac-b4f055c512e5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a86a8791-2631-4385-86ac-b4f055c512e5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:04.034707 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: exception: Aggregate -1 could not be found. Sep 18 01:00:04.035955 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '-1'} Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 18 01:00:04.036607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.037541 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:04.039747 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:04.039747 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:04.039747 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:04.039747 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:04.039747 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 18 01:00:04.039747 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.041763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a86a8791-2631-4385-86ac-b4f055c512e5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:04.043175 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a86a8791-2631-4385-86ac-b4f055c512e5 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.044891 Sep 18 01:00:04.044905 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 33/57] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:03 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:04.054560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89fe83e9-b688-404a-9b95-c8e7f1f0d9fe tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-302355841"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:04.059175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-89fe83e9-b688-404a-9b95-c8e7f1f0d9fe tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid b8bd33ae-25b9-477d-9857-d5c43967ef3e for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:04.099513 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89fe83e9-b688-404a-9b95-c8e7f1f0d9fe tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047546 Sep 18 01:00:04.100341 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 34/58] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:04 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:04.115817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-021b23e0-ab58-49ad-a031-4f9938df2a5e tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:04.120778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-021b23e0-ab58-49ad-a031-4f9938df2a5e tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c471d1f448fe493d9f1654f3122f9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5063060fcc66473ba0c329aceb560008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-021b23e0-ab58-49ad-a031-4f9938df2a5e tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Request method failure captured: Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2J8orw7bnZvu7RR8zfliWCh5JDKy_mX0uD621FOwzbn4NNq7uUPBqszuri-F6IqLWUh2LSyr9O2_Ar2letJTAQ_5ZsGVVEMysv6OxYxGnWc5LtJnt7OjoM-tLhe1vNmpLHefqpvqfsWxZ68swP-Z2zvWzoccEj1UWKzk_Rz-tvc1U Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:04.126195 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5063060fcc66473ba0c329aceb560008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5063060fcc66473ba0c329aceb560008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c471d1f448fe493d9f1654f3122f9a1f Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 18 01:00:04.127430 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8'} Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:04.128029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:04.128926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-021b23e0-ab58-49ad-a031-4f9938df2a5e tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:04.132748 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-021b23e0-ab58-49ad-a031-4f9938df2a5e tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.021090 Sep 18 01:00:04.132748 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 35/59] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:00:04 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:00:04.142456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-062790ee-01da-4dd9-acea-510269425ef2 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:04.160662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1250253239", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "availability_zone": "tempest-test_az-1261155985"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:04.190398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.192179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.193233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.194691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.196785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.200160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.227225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-062790ee-01da-4dd9-acea-510269425ef2 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.088131 Sep 18 01:00:04.234607 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 36/60] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:04 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:04.252554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:04.253972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:04.263624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.268443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.269059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.270965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.271966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.272742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.398805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:05.081339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:05.097037 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c716f9de-3384-4eff-849c-5c4c138b9449 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.850047 Sep 18 01:00:05.112606 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 37/61] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:04 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:05.124365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d2925227-2a9d-4c67-9f7c-e415153332cf tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:05.135105 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d2925227-2a9d-4c67-9f7c-e415153332cf tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d2925227-2a9d-4c67-9f7c-e415153332cf tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:05.138382 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: exception: Aggregate -1 could not be found. Sep 18 01:00:05.139703 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '-1'} Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:05.140370 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 18 01:00:05.141511 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.147450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d2925227-2a9d-4c67-9f7c-e415153332cf tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:05.149250 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d2925227-2a9d-4c67-9f7c-e415153332cf tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029721 Sep 18 01:00:05.150227 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 38/62] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:05 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:05.165238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c67d851-5577-42fd-956c-9ca65055acee tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:05.168647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6c67d851-5577-42fd-956c-9ca65055acee tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c471d1f448fe493d9f1654f3122f9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5063060fcc66473ba0c329aceb560008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c67d851-5577-42fd-956c-9ca65055acee tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Request method failure captured: Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2J8orw7bnZvu7RR8zfliWCh5JDKy_mX0uD621FOwzbn4NNq7uUPBqszuri-F6IqLWUh2LSyr9O2_Ar2letJTAQ_5ZsGVVEMysv6OxYxGnWc5LtJnt7OjoM-tLhe1vNmpLHefqpvqfsWxZ68swP-Z2zvWzoccEj1UWKzk_Rz-tvc1U Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:05.177049 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5063060fcc66473ba0c329aceb560008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5063060fcc66473ba0c329aceb560008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c471d1f448fe493d9f1654f3122f9a1f Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 18 01:00:05.178278 n-d-master-1 devstack@n-api.service[122373]: action_args: {} Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:05.178902 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 18 01:00:05.179926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:05.181783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c67d851-5577-42fd-956c-9ca65055acee tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:05.182785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6c67d851-5577-42fd-956c-9ca65055acee tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.026281 Sep 18 01:00:05.183834 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 39/63] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:00:05 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:05.383860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:05.384440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:05.384641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:05.385223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:05.385940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:05.420569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.422040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.424156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.425104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.426233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.428559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.483418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Getting quotas for project e9933df3eac04c98b2b9d4fc0faf8661. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:05.494861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Getting quotas for user 198c87e49acc41bcaf1f3e5b4d24ab7a and project e9933df3eac04c98b2b9d4fc0faf8661. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:05.534650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:05.540286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:05.645277 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-311ed88a-daad-48e6-8ecf-c2ee04185bd6 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.689804 Sep 18 01:00:05.648832 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 25/64] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:00:05.672477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d198faa3-f03b-44c3-8430-72b125d7e764 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:05.673025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d198faa3-f03b-44c3-8430-72b125d7e764 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:05.890495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d198faa3-f03b-44c3-8430-72b125d7e764 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:05.902433 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d198faa3-f03b-44c3-8430-72b125d7e764 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1243 microversion: 2.1 time: 0.240741 Sep 18 01:00:05.903041 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 40/65] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:05 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1243 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:06.126042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:06.128941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:06.146041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.147180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.149744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.151937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.163908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.166197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.927899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80d33b07-71b0-4aeb-a666-df1a244fa0df tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:06.929314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-80d33b07-71b0-4aeb-a666-df1a244fa0df tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:07.280363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:07.288128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-80d33b07-71b0-4aeb-a666-df1a244fa0df tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:07.296560 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80d33b07-71b0-4aeb-a666-df1a244fa0df tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1243 microversion: 2.1 time: 0.373007 Sep 18 01:00:07.312494 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d65e303-6169-4cbe-a53f-0546f7111480 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 1.177743 Sep 18 01:00:07.312494 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 26/66] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:06 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:07.313009 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 41/67] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:06 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1243 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:08.321031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:08.322502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:08.326029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:08.327329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:08.336223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.336947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.337398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.338166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.338633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.339050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.343478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.344366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.346889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.347831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.351121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.357463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.822345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:08.881892 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e77ea722-5647-46e9-8306-691dfc0780e8 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1291 microversion: 2.1 time: 0.560318 Sep 18 01:00:08.885747 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 27/68] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:08 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1291 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:09.124267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:09.143646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb9f34ad-5f48-4fe9-9a1f-2fd84fbf0d26 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.820379 Sep 18 01:00:09.147838 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 42/69] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:08 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:09.915009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:09.915938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:09.928011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.933623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.934774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:09.938151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.938842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.940949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:10.183554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:10.197404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-694c8c1e-00a5-4fe2-bc21-cf589b4ac781 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1297 microversion: 2.1 time: 0.283849 Sep 18 01:00:10.199095 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 28/70] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:09 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1297 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:10.212106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:10.214467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:10.228850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:10.229836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:10.230488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:10.231538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:10.232220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:10.233327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.150517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Calling method '.version_select at 0x7f700704f940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:11.153532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.153993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.154968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.253794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.259594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.260243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.305148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.306063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.306757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.315461 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ad2b299b-9817-4783-b5ac-94b263d19b49 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.170879 Sep 18 01:00:11.333443 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 43/71] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:11.712905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:11.722287 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-648f50d9-ca15-4a46-aed0-59a7ecfca760 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 1.521946 Sep 18 01:00:11.728515 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 29/72] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:10 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:11.738485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:11.739286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:11.763154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.764019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.764637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.766380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.767001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.767655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.855837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-7324b026-1efa-4aa0-9274-96bcf65abf52 req-2c88dea9-3b36-49fc-bc27-ea34eae81925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c510769c-b06f-4952-85ce-5bcc1375b839", "tag": "13982067-397c-4a69-92dd-d40782cd0fda"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:11.927794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7324b026-1efa-4aa0-9274-96bcf65abf52 req-2c88dea9-3b36-49fc-bc27-ea34eae81925 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.928301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7324b026-1efa-4aa0-9274-96bcf65abf52 req-2c88dea9-3b36-49fc-bc27-ea34eae81925 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.931767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7324b026-1efa-4aa0-9274-96bcf65abf52 req-2c88dea9-3b36-49fc-bc27-ea34eae81925 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.983872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:11.988720 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-7324b026-1efa-4aa0-9274-96bcf65abf52 req-2c88dea9-3b36-49fc-bc27-ea34eae81925 service nova] Creating event network-changed:13982067-397c-4a69-92dd-d40782cd0fda for instance c510769c-b06f-4952-85ce-5bcc1375b839 on n-h1-master-1 Sep 18 01:00:11.989252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7324b026-1efa-4aa0-9274-96bcf65abf52 req-2c88dea9-3b36-49fc-bc27-ea34eae81925 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:00:11.989668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7324b026-1efa-4aa0-9274-96bcf65abf52 req-2c88dea9-3b36-49fc-bc27-ea34eae81925 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:00:11.990744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.991197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.991618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.992321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.994201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.996282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.998820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5cf8efd0-07dc-4521-878e-940919377509 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1297 microversion: 2.1 time: 0.268966 Sep 18 01:00:12.021586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 30/73] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:11 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1297 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:12.028528 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.rpcapi [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 18 01:00:12.030480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:00:12.054873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-22a26b75-7550-4176-85e9-37cd690ad6a6 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.718863 Sep 18 01:00:12.056511 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 44/74] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:12.564178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a82325c3-bd89-4759-8550-b250b9241b52 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Calling method '.version_select at 0x7f700738b820>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.567103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a82325c3-bd89-4759-8550-b250b9241b52 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '742feecd893247a9a8fff19e59371d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753ee162686c4780b9f522e46b347bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a82325c3-bd89-4759-8550-b250b9241b52 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Request method failure captured: Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2WxFHsZouJ0CvSjWcApZ72enQSqGwOY9Y8zFcPvafVREKC-xvh_gQT6tXKiqguriJDYy6A_RRybhBegKDIxOBHVA6ItIWzaDl-Wvs7TYq2bJB-zqoAZO7PCf_3j_1ZQ9YvszF2LGQDP6vJlQ666eDEYjRDqPj2PKI-Nshgdfrmdb0 Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 753ee162686c4780b9f522e46b347bf8 Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1886674581 Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:12.574199 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/753ee162686c4780b9f522e46b347bf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/753ee162686c4780b9f522e46b347bf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_753ee162686c4780b9f522e46b347bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/753ee162686c4780b9f522e46b347bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1886674581 Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 753ee162686c4780b9f522e46b347bf8 Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1886674581 Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 742feecd893247a9a8fff19e59371d81 Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 18 01:00:12.575671 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'n-h1-master-1'} Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:12.576566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 18 01:00:12.577836 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.579486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a82325c3-bd89-4759-8550-b250b9241b52 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:12.581784 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a82325c3-bd89-4759-8550-b250b9241b52 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.567207 Sep 18 01:00:12.585638 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 31/75] 10.222.0.25 () {58 vars in 1209 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 575 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:12.596474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Calling method '.version_select at 0x7f700704fd30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.598399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.598884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.599305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.646739 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Request method failure captured: Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2Z83o3v2QVN4KbWqoWCWdpt30fQ2aYt3l6yfPkQbvSPW1jLDEchGsoOCuRX7Dki17E49v9orFw80OHLWfEHOw-I9gpUtOAWxVCLE3fB1iuc7BR8yoO_z5n9bWCR5xk57OucS3AX-IiJCTrC6-JfEYmj4ZGgzCVdjz6YDjMKjl3nCE Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 76792abce1da4a3889505619e4114503 Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-618240485 Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:12.656153 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76792abce1da4a3889505619e4114503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76792abce1da4a3889505619e4114503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76792abce1da4a3889505619e4114503"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76792abce1da4a3889505619e4114503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-618240485 Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 76792abce1da4a3889505619e4114503 Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-618240485 Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4f5f6e8e5aba4b30a9e0e0735ae9defd Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 18 01:00:12.657390 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.658130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.659153 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.659153 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:12.659153 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:12.659153 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 18 01:00:12.659153 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.660785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:12.661918 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89534785-d004-458e-b088-58a90c5575a2 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.070555 Sep 18 01:00:12.663055 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 45/76] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:12.672162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Calling method '.version_select at 0x7f70073014c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.674588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.676031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.676841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.682112 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:12.710073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.714847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.717814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.743624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.753286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.755256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.755624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.756346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:12.771958 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b7bbc06b-70f4-492b-9d67-e57649664487 tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104038 Sep 18 01:00:12.777668 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 32/77] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:12.789182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c7e914f-8832-477c-a6b0-c6e608ce8da3 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Calling method '.version_select at 0x7f70074a0310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.791595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c7e914f-8832-477c-a6b0-c6e608ce8da3 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '742feecd893247a9a8fff19e59371d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753ee162686c4780b9f522e46b347bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:12.795369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.795859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.796289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c7e914f-8832-477c-a6b0-c6e608ce8da3 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Request method failure captured: Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2WxFHsZouJ0CvSjWcApZ72enQSqGwOY9Y8zFcPvafVREKC-xvh_gQT6tXKiqguriJDYy6A_RRybhBegKDIxOBHVA6ItIWzaDl-Wvs7TYq2bJB-zqoAZO7PCf_3j_1ZQ9YvszF2LGQDP6vJlQ666eDEYjRDqPj2PKI-Nshgdfrmdb0 Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 753ee162686c4780b9f522e46b347bf8 Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1886674581 Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:12.797478 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/753ee162686c4780b9f522e46b347bf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/753ee162686c4780b9f522e46b347bf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_753ee162686c4780b9f522e46b347bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/753ee162686c4780b9f522e46b347bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1886674581 Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 753ee162686c4780b9f522e46b347bf8 Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1886674581 Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 742feecd893247a9a8fff19e59371d81 Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 18 01:00:12.798747 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1'} Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:12.799380 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 18 01:00:12.800316 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.807000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c7e914f-8832-477c-a6b0-c6e608ce8da3 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:12.808824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.809451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.810231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c7e914f-8832-477c-a6b0-c6e608ce8da3 tempest-HypervisorAdminNegativeUnderV252Test-1886674581 tempest-HypervisorAdminNegativeUnderV252Test-1886674581-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029764 Sep 18 01:00:12.811055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.812849 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 33/78] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:00:12.822911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Calling method '.version_select at 0x7f7007312e50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.829206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.836906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.837969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.881764 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] HTTP exception thrown: No hypervisor matching 'c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2' could be found. Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Request method failure captured: Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hypervisors/c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2/servers HTTP/1.1 Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2Z83o3v2QVN4KbWqoWCWdpt30fQ2aYt3l6yfPkQbvSPW1jLDEchGsoOCuRX7Dki17E49v9orFw80OHLWfEHOw-I9gpUtOAWxVCLE3fB1iuc7BR8yoO_z5n9bWCR5xk57OucS3AX-IiJCTrC6-JfEYmj4ZGgzCVdjz6YDjMKjl3nCE Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 76792abce1da4a3889505619e4114503 Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-618240485 Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:12.883401 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76792abce1da4a3889505619e4114503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76792abce1da4a3889505619e4114503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76792abce1da4a3889505619e4114503"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76792abce1da4a3889505619e4114503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-618240485 Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 76792abce1da4a3889505619e4114503 Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-618240485 Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4f5f6e8e5aba4b30a9e0e0735ae9defd Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: exception: No hypervisor matching 'c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2' could be found. Sep 18 01:00:12.884583 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2'} Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2' could be found. Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.885203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.886249 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.886249 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.886249 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:12.886249 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:12.886249 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2' could be found. Sep 18 01:00:12.886249 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.887459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] Returning 404 to user: No hypervisor matching 'c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2' could be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:12.888494 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f9c5db4-f9e9-4c64-a9ea-a9dc9bf1d1cb tempest-HypervisorAdminNegativeUnderV252Test-618240485 tempest-HypervisorAdminNegativeUnderV252Test-618240485-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2/servers" status: 404 len: 123 microversion: 2.1 time: 0.069618 Sep 18 01:00:12.893763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 34/79] 10.222.0.25 () {58 vars in 1281 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/os-hypervisors/c63a02ec-4ebb-42e8-b4cc-5bfeb5a03ba2/servers => generated 123 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:13.047682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:13.068869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:13.103312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.106142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.107103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.109971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.111602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.114188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.456911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:13.482631 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b02c8b88-e4ac-4250-8d5c-160178c7ca35 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1297 microversion: 2.1 time: 0.446314 Sep 18 01:00:13.499225 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 35/80] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:13 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1297 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:14.004669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:14.017783 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9bfce3d2-a594-46b4-b412-74c079139855 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 1.263988 Sep 18 01:00:14.034484 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 46/81] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:14.410725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Calling method '.version_select at 0x7f7007225ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:14.421175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.421754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.422203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.475232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.475671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.477130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.518523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.519818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.520940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.558813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-86cac2f9-5397-4494-b408-b2ed9543901c tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.037689 Sep 18 01:00:14.562602 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 36/82] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:14.572186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:14.573021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:14.588030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.588916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.589800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.593446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.596836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.597954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.625937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c69d3604-b177-48ce-a93a-49ee7862e3c6 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1669579287", "id": 2072157249, "os-flavor-access:is_public": "True"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:14.694935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c69d3604-b177-48ce-a93a-49ee7862e3c6 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.328406 Sep 18 01:00:14.698341 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 47/83] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:00:14 2022] POST /compute/v2.1/flavors => generated 449 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:00:14.708469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Calling method '.version_select at 0x7f7006fc6430>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:14.710568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.713290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.713963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.742696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.744957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.745599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.792644 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:14.805916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.809935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.810829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.827888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45fb0ace-65c3-4d24-a489-755a21c79c38 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.124080 Sep 18 01:00:14.829438 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 48/84] 10.222.0.25 () {58 vars in 1212 bytes} [Sun Sep 18 01:00:14 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:15.456523 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=16 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:15.520879 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:15.606812 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:15.607335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e22a1a9c-10a8-4bf8-99ba-89710c13fe96 tempest-FlavorsV255TestJSON-247016134 tempest-FlavorsV255TestJSON-247016134-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:15.616288 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3bfffb5e-06e2-49be-92a5-7093b8ce659a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 1.051468 Sep 18 01:00:15.621347 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 37/85] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:14 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:15.631975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Calling method '.version_select at 0x7f7007312ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:15.639870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.640609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.642542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.684785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.685271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.693380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.724367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.724944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.725389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.728207 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e22a1a9c-10a8-4bf8-99ba-89710c13fe96 tempest-FlavorsV255TestJSON-247016134 tempest-FlavorsV255TestJSON-247016134-project] 10.222.0.25 "GET /compute/v2.1/flavors/2072157249" status: 200 len: 449 microversion: 2.55 time: 0.893771 Sep 18 01:00:15.743728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8a7a7e2-8db3-43de-835b-b2cab85923a4 tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.120908 Sep 18 01:00:15.743984 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 49/86] 10.222.0.25 () {60 vars in 1199 bytes} [Sun Sep 18 01:00:14 2022] GET /compute/v2.1/flavors/2072157249 => generated 449 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:15.744922 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 38/87] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:15.760773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:15.763432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:15.780553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.782508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.785995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.787518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.790560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.791677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.959789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b3fdf4e-60d2-4a3c-bead-78dc80b4ef60 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:15.971128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b3fdf4e-60d2-4a3c-bead-78dc80b4ef60 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.224372 Sep 18 01:00:15.973011 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 39/88] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:00:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:16.114327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Calling method '.version_select at 0x7f70071fc430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:16.118780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.120446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.122240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.166451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.167199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.168067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.245254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.246133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.247264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.280322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.281333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.282246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.322278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.325192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.325857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.343582 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8177c429-bf89-45f9-ba20-17d2e15ac76d tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.357807 Sep 18 01:00:16.351251 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 40/89] 10.222.0.25 () {60 vars in 1243 bytes} [Sun Sep 18 01:00:15 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:16.360450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c8129a8-67ea-4fda-bef0-dbd3ad256609 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] Action: 'update', calling method: .version_select at 0x7f70082b6b80>, body: {"flavor": {"description": "new"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:16.463394 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c8129a8-67ea-4fda-bef0-dbd3ad256609 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/2072157249" status: 200 len: 450 microversion: 2.55 time: 0.110367 Sep 18 01:00:16.465283 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 41/90] 10.222.0.25 () {62 vars in 1219 bytes} [Sun Sep 18 01:00:16 2022] PUT /compute/v2.1/flavors/2072157249 => generated 450 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:16.470925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Calling method '.version_select at 0x7f70071fc550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:16.472857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.473499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.474936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.490462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.491821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.492248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.500003 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92e5bd2b-4536-42b2-aac0-692c8f8a5f3e tempest-HypervisorAdminUnderV252Test-496020972 tempest-HypervisorAdminUnderV252Test-496020972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.033435 Sep 18 01:00:16.500612 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 42/91] 10.222.0.25 () {58 vars in 1209 bytes} [Sun Sep 18 01:00:16 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:16.609625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:16.624817 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-21432170-8bce-409a-9be1-4eb242c63ee3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.874883 Sep 18 01:00:16.626938 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 50/92] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:15 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:16.641499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Calling method '.version_select at 0x7f7006f47820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:16.652061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.654715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.656272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.700350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.702805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.704064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.760366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.761169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.761811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.803136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.803642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.805653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.841845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.842723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.843329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.858957 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7582749c-686b-4aca-b570-2442b696a1a4 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.229920 Sep 18 01:00:16.871067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 51/93] 10.222.0.25 () {60 vars in 1222 bytes} [Sun Sep 18 01:00:16 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:16.876565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e9061380-f7fc-475a-9771-9e589b78f4dd tempest-FlavorsV255TestJSON-247016134 tempest-FlavorsV255TestJSON-247016134-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:16.935389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e9061380-f7fc-475a-9771-9e589b78f4dd tempest-FlavorsV255TestJSON-247016134 tempest-FlavorsV255TestJSON-247016134-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.062658 Sep 18 01:00:16.936823 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 52/94] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:00:16 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:16.942444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:16.943420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:16.950616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.951404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.952179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.953152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.953865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.954209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.075458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-136f9b8d-1aaf-48d1-94bb-600385f2da26 tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-757369733", "id": 2123573806, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:17.148396 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-136f9b8d-1aaf-48d1-94bb-600385f2da26 tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.645797 Sep 18 01:00:17.156872 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 43/95] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:16 2022] POST /compute/v2.1/flavors => generated 424 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:17.164844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Calling method '.version_select at 0x7f70072821f0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.192719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.194636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.195254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.231835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.232595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.233829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.247734 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3972eb8f-6ccd-44bd-8779-24873707e5a7 tempest-HypervisorAdminV253TestBase-276719589 tempest-HypervisorAdminV253TestBase-276719589-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/19d273cc-ce8c-4167-9849-af3ca6c50fac" status: 200 len: 792 microversion: 2.53 time: 0.089684 Sep 18 01:00:17.248879 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 44/96] 10.222.0.25 () {60 vars in 1298 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/os-hypervisors/19d273cc-ce8c-4167-9849-af3ca6c50fac => generated 792 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:17.254182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c293e88a-65c1-4d17-bd56-02ed01b6eac9 tempest-FlavorsV255TestJSON-247016134 tempest-FlavorsV255TestJSON-247016134-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.274396 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:17.292473 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c293e88a-65c1-4d17-bd56-02ed01b6eac9 tempest-FlavorsV255TestJSON-247016134 tempest-FlavorsV255TestJSON-247016134-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3421 microversion: 2.55 time: 0.041990 Sep 18 01:00:17.292772 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:17.293839 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 45/97] 10.222.0.25 () {60 vars in 1166 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/flavors => generated 3421 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:17.299134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9248b776-9141-412e-9640-78936be0708a tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.312111 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9248b776-9141-412e-9640-78936be0708a tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015571 Sep 18 01:00:17.318115 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 46/98] 10.222.0.25 () {58 vars in 1182 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:00:17.323787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5364a2b2-d595-4a8e-8edf-3a6419bc9739 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.360162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5364a2b2-d595-4a8e-8edf-3a6419bc9739 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2072157249" status: 202 len: 0 microversion: 2.55 time: 0.040549 Sep 18 01:00:17.367822 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 47/99] 10.222.0.25 () {60 vars in 1202 bytes} [Sun Sep 18 01:00:17 2022] DELETE /compute/v2.1/flavors/2072157249 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:17.376733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb76d547-9710-4947-931f-d8b0632b6e62 tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1023828852", "id": 1309193408, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:17.419411 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb76d547-9710-4947-931f-d8b0632b6e62 tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.047935 Sep 18 01:00:17.420731 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 48/100] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:17 2022] POST /compute/v2.1/flavors => generated 425 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:17.428003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-288d3551-1e3a-4545-bedd-70af1f525687 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.523802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-288d3551-1e3a-4545-bedd-70af1f525687 tempest-FlavorsV255TestJSON-1092761909 tempest-FlavorsV255TestJSON-1092761909-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.100594 Sep 18 01:00:17.539572 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 49/101] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:17.553740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3c61b25-963f-434c-bb10-f05f840d9e6f tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.578069 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3c61b25-963f-434c-bb10-f05f840d9e6f tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026366 Sep 18 01:00:17.586995 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 50/102] 10.222.0.25 () {58 vars in 1182 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:00:17.614743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-23ef070b-2476-4ca2-8497-79b61bcdd680 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Action: 'create', calling method: .version_select at 0x7f70071f9ca0>, body: {"keypair": {"name": "tempest-keypair-8537872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84ml/mDOA0u7Feb5T7K/sz2fCHaYuB0GEYcxKGQc+EVkrC9u/rHxRDF2KhhkKDx/1dWsknhwPaHZbgXzeNJ4PCYroJL+mwo59PEWkorYiiorhwsEQSE4iTqMxqkSNOCw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:17.705119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-23ef070b-2476-4ca2-8497-79b61bcdd680 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Getting quotas for project 1bf7634e26214d1592e971399bc13360. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:17.723428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-23ef070b-2476-4ca2-8497-79b61bcdd680 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Getting quotas for user fad1db1d4f7a41559b0cb1e57ba9c12d and project 1bf7634e26214d1592e971399bc13360. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:17.814250 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-23ef070b-2476-4ca2-8497-79b61bcdd680 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.216213 Sep 18 01:00:17.821797 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 51/103] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:00:17 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:17.831263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.831901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:17.872394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.880372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.880372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.880372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.880372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.885105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:18.462515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:18.477819 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00a1b1bb-2572-430d-b1b6-5ec527b45d82 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 1.539453 Sep 18 01:00:18.490421 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 53/104] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:16 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:18.521027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ffa34667-0f14-481d-a045-6fff112e873d req-f2b9575c-158b-4888-8c4d-49ad7a83258b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4", "tag": "2c4c3c6b-a5d0-4260-ae84-15209c209404"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:18.543836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffa34667-0f14-481d-a045-6fff112e873d req-f2b9575c-158b-4888-8c4d-49ad7a83258b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:18.544784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffa34667-0f14-481d-a045-6fff112e873d req-f2b9575c-158b-4888-8c4d-49ad7a83258b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:18.545463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffa34667-0f14-481d-a045-6fff112e873d req-f2b9575c-158b-4888-8c4d-49ad7a83258b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:18.594203 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ffa34667-0f14-481d-a045-6fff112e873d req-f2b9575c-158b-4888-8c4d-49ad7a83258b service nova] Creating event network-changed:2c4c3c6b-a5d0-4260-ae84-15209c209404 for instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 on n-h1-master-1 Sep 18 01:00:18.612823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ffa34667-0f14-481d-a045-6fff112e873d req-f2b9575c-158b-4888-8c4d-49ad7a83258b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088936 Sep 18 01:00:18.614292 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 54/105] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:18.696222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:18.707315 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-89afa56e-c9d3-45c5-8376-63e97835b93e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.884343 Sep 18 01:00:18.708437 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 52/106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:19.506700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:19.507462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:19.520464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.521294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.521930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.522914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.527465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.528245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.733272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:19.734620 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:19.752650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.755764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.756173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.758429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.759755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.762384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.851389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:19.860834 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-95126140-0d53-4d94-b6e8-255349ef4a84 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.358882 Sep 18 01:00:19.880516 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 55/107] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:19 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:20.088622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:20.100802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abd3211a-4cf2-4add-b69d-1487a5c614f2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.372571 Sep 18 01:00:20.101996 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 53/108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:19 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:20.887830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:20.890835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:20.920588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:20.920997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:20.921616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:20.922245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:20.922882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:20.923035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:21.127006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:21.127565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:21.146934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:21.166296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:21.166296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:21.166296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:21.166296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:21.166598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:21.265469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:21.284359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60e68eb6-b6ee-4e5c-ad8b-62260f37e9e2 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.401976 Sep 18 01:00:21.287687 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 56/109] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:20 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:21.501757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:21.516675 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3c1c251b-5956-4e9f-aa21-00c8c8b89bb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.394046 Sep 18 01:00:21.517356 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:21 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:21.870989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-339835222", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "1309193408", "adminPass": "***", "networks": [{"uuid": "f0bf96a5-f47b-4e66-a279-b85a45861654"}], "security_groups": [{"name": "tempest-securitygroup--1604510097"}], "key_name": "tempest-keypair-8537872", "user_data": "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:22.010030 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=14 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:22.105453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] validate_networks() for [('f0bf96a5-f47b-4e66-a279-b85a45861654', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:22.315187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:22.315787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:22.325761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:22.327594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:22.328369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:22.329088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:22.329759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:22.331387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:22.775592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:22.789014 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb68d45b-e9d1-4e25-8db1-0b1a211aedf3 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.481758 Sep 18 01:00:22.790037 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 55/111] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:22 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:22.801290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:22.801998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:22.813043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:22.813539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:22.814011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:22.814729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:22.815199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:22.815627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.215576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:23.234602 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-322025d9-df42-4588-86be-7f7e0a11fad2 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.443404 Sep 18 01:00:23.235964 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 56/112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:22 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:23.344029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:23.344505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:23.344949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:23.345380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:23.346000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:23.362948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.363673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.364843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.365752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.366213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.367255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.408603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Getting quotas for project 1bf7634e26214d1592e971399bc13360. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:23.416104 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Getting quotas for user fad1db1d4f7a41559b0cb1e57ba9c12d and project 1bf7634e26214d1592e971399bc13360. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:23.428266 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:23.430615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:23.434741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:23.514641 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c31a2d40-246c-46bf-ae05-a3a226ba15ea tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.648710 Sep 18 01:00:23.516530 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 57/113] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:00:23.528754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d61e0694-e804-4b84-ba32-96f5da666033 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:23.529810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d61e0694-e804-4b84-ba32-96f5da666033 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:23.626445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d61e0694-e804-4b84-ba32-96f5da666033 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:23.636590 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d61e0694-e804-4b84-ba32-96f5da666033 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1261 microversion: 2.1 time: 0.112012 Sep 18 01:00:23.637889 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 58/114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:23 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:23.737119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1320187754", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:23.814917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:23.815545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:23.815980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:23.822518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.823225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.823953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.824964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.825942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.826502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.092273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:24.104306 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-deb321e4-fef6-4092-9c15-38d4006f10cb tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.294743 Sep 18 01:00:24.106458 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 59/115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:23 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:24.184108 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:24.184704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:24.187014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:24.187635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:24.188210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:24.212032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.212926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.213360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.214373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.214996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.215416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.239689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Getting quotas for project 4e98321089b343359e9ae05ad97b8372. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:24.244746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Getting quotas for user c06c8778aeff44d2ba7a3a36336b32a3 and project 4e98321089b343359e9ae05ad97b8372. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:24.260874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:24.261729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:24.262544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:24.266077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:24.271339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.272479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.274479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.275766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.276524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.277425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.340730 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d78f90b-9d75-4cb0-87b4-727ce33c9c8a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103074 Sep 18 01:00:24.347610 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 57/116] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:00:24.353450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15ff85c8-0afb-4888-8151-344a0cc84394 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:24.354105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15ff85c8-0afb-4888-8151-344a0cc84394 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:24.422689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15ff85c8-0afb-4888-8151-344a0cc84394 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:24.440013 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15ff85c8-0afb-4888-8151-344a0cc84394 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1219 microversion: 2.1 time: 0.091261 Sep 18 01:00:24.451022 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 58/117] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:24 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:24.518057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:24.529330 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-553de91b-b752-4ae4-a705-211283eabddc tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.272352 Sep 18 01:00:24.545169 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 60/118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:24 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:24.662412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:24.663029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:24.686241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.686736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.687175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.687922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.688395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.688823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.809106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:24.818664 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-222e6cce-ceae-4fdf-8b87-764164f6df1b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1313 microversion: 2.1 time: 0.161259 Sep 18 01:00:24.819435 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 59/119] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:24 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:25.136267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:25.137096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:25.155473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.159178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.160084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.168256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.171291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.171754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.416805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:25.430043 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-113280a3-a218-4a32-99f9-d0be5846811c tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.297610 Sep 18 01:00:25.435722 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 61/120] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:25 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:25.516442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Action: 'update', calling method: .version_select at 0x7f7007130af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:25.555945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Calling method '.version_select at 0x7f700709bc10>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:25.560867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.561795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.562387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.563383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.563983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.564556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.594353 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-49d6e3e5-e421-495e-a426-4abbdfabe5a3 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.155580 Sep 18 01:00:25.602381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 62/121] 10.222.0.25 () {58 vars in 1128 bytes} [Sun Sep 18 01:00:25 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:25.606986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.607479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.607915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.610401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.611280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.612485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.652384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1283074109", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": "none"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:25.675599 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3597e50-99fa-421d-8def-2da4d95816fe tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed" status: 200 len: 148 microversion: 2.57 time: 0.455787 Sep 18 01:00:25.682064 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 60/122] 10.222.0.25 () {62 vars in 1303 bytes} [Sun Sep 18 01:00:25 2022] PUT /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed => generated 148 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:00:25.682064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:25.682064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:25.687805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.688289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.688726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.689423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.689907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.690329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.715781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:25.716995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:25.717647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:25.718247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:25.718791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:25.730075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.730498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.731632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.732754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.733213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.733680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.757521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Getting quotas for project 4d791f5670a647538efc012d0d2407b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:25.762148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Getting quotas for user c836023cd5b84ceea65cba0c68e62e3d and project 4d791f5670a647538efc012d0d2407b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:25.791818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:25.801215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:25.802116 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0de1792a-6a26-4914-a138-e5a42831b78e tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1271 microversion: 2.1 time: 0.124794 Sep 18 01:00:25.802880 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 61/123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:25 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:25.819627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:25.895949 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67f1faea-4431-403b-abc7-33725a7fd99b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.292069 Sep 18 01:00:25.896957 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 63/124] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:00:25.900899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-130a1193-82af-4946-afa0-a28769166882 req-259a5bd0-cb89-48a4-b7db-1cb06c6a5222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c510769c-b06f-4952-85ce-5bcc1375b839", "name": "network-vif-plugged", "status": "completed", "tag": "13982067-397c-4a69-92dd-d40782cd0fda"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:25.902423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:25.903251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:25.910881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.911580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.912014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.921936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.923050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.923803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.924263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-130a1193-82af-4946-afa0-a28769166882 req-259a5bd0-cb89-48a4-b7db-1cb06c6a5222 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:25.925396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-130a1193-82af-4946-afa0-a28769166882 req-259a5bd0-cb89-48a4-b7db-1cb06c6a5222 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:25.926550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-130a1193-82af-4946-afa0-a28769166882 req-259a5bd0-cb89-48a4-b7db-1cb06c6a5222 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.964061 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-130a1193-82af-4946-afa0-a28769166882 req-259a5bd0-cb89-48a4-b7db-1cb06c6a5222 service nova] Creating event network-vif-plugged:13982067-397c-4a69-92dd-d40782cd0fda for instance c510769c-b06f-4952-85ce-5bcc1375b839 on n-h1-master-1 Sep 18 01:00:25.970757 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-130a1193-82af-4946-afa0-a28769166882 req-259a5bd0-cb89-48a4-b7db-1cb06c6a5222 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166266 Sep 18 01:00:25.972079 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 62/125] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:26.138488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1def0563-eb1e-41cc-a64e-aa860e77158f tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Calling method '.version_select at 0x7f70071f9790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.142935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1def0563-eb1e-41cc-a64e-aa860e77158f tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '0c08f61508cf46c8924a66228be80d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06230d4c6384f9fbf6204294c87b014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1def0563-eb1e-41cc-a64e-aa860e77158f tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Request method failure captured: Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2nfKotJp2brnzZJGGt-H-ZLttQZSlW1vlm9mFSrLHIa3w-CpsEbX8_3djSmJBxQQFAGwMmRq-CaiHphJYbklZYFR13lGk7NPxz4UxZXltacKI57iXDp0FKgXAPrfeU-Exl3xqdTx_W7vGlGi1mbR0FaI1A-iciZKsg4BslO07NeWI Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:26.145178 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0c08f61508cf46c8924a66228be80d14 Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:00:26.146454 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:26.147252 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 18 01:00:26.148428 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.149612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1def0563-eb1e-41cc-a64e-aa860e77158f tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:26.149612 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1def0563-eb1e-41cc-a64e-aa860e77158f tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.173151 Sep 18 01:00:26.149612 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 63/126] 10.222.0.25 () {58 vars in 1128 bytes} [Sun Sep 18 01:00:25 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:26.152870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Calling method '.version_select at 0x7f7007103b80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.255113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.255826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.256450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.257306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.257962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.258621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.259385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.269383 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:26.276776 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f49d0af7-6d71-4584-b5a8-35f08a88effb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.378183 Sep 18 01:00:26.300487 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 64/127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:25 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:26.302616 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-24d8c00a-6fd2-41c6-bb3f-73c30a168c67 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed/detail" status: 200 len: 463 microversion: 2.57 time: 0.153930 Sep 18 01:00:26.303484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 64/128] 10.222.0.25 () {60 vars in 1304 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed/detail => generated 463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:26.305966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.306844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:26.308350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aac449dc-f0cc-401d-b0b7-d3b76987cc59 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:26.311565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aac449dc-f0cc-401d-b0b7-d3b76987cc59 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:26.313889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.315023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.315693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.316616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.317178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.317804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.336078 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:26.482426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.486839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aac449dc-f0cc-401d-b0b7-d3b76987cc59 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.498692 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1caeac60-f2fe-4a02-bd6b-e971ba94d1ad tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1319 microversion: 2.1 time: 0.196309 Sep 18 01:00:26.501001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 65/129] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:26.504389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aac449dc-f0cc-401d-b0b7-d3b76987cc59 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.507472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aac449dc-f0cc-401d-b0b7-d3b76987cc59 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.517354 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aac449dc-f0cc-401d-b0b7-d3b76987cc59 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "PUT /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1359 microversion: 2.75 time: 0.212505 Sep 18 01:00:26.518606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efc0ea55-215a-46c6-ba57-85a454e65ac1 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Calling method '.version_select at 0x7f7006ee2ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.519347 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 65/130] 10.222.0.25 () {62 vars in 1297 bytes} [Sun Sep 18 01:00:26 2022] PUT /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:26.521878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efc0ea55-215a-46c6-ba57-85a454e65ac1 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '0c08f61508cf46c8924a66228be80d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06230d4c6384f9fbf6204294c87b014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efc0ea55-215a-46c6-ba57-85a454e65ac1 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Request method failure captured: Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2nfKotJp2brnzZJGGt-H-ZLttQZSlW1vlm9mFSrLHIa3w-CpsEbX8_3djSmJBxQQFAGwMmRq-CaiHphJYbklZYFR13lGk7NPxz4UxZXltacKI57iXDp0FKgXAPrfeU-Exl3xqdTx_W7vGlGi1mbR0FaI1A-iciZKsg4BslO07NeWI Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:26.524257 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 0c08f61508cf46c8924a66228be80d14 Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'n-d-master-1'} Sep 18 01:00:26.525719 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:26.526617 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 18 01:00:26.528070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.529969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.529969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:26.541593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efc0ea55-215a-46c6-ba57-85a454e65ac1 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:26.542442 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efc0ea55-215a-46c6-ba57-85a454e65ac1 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.038014 Sep 18 01:00:26.543008 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 66/131] 10.222.0.25 () {58 vars in 1188 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:26.563506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef224a59-3c60-477b-8552-b411f4f3bc91 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Calling method '.version_select at 0x7f7006e7b160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.574425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.574980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.575444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.578656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.579311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.579665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.582438 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ef224a59-3c60-477b-8552-b411f4f3bc91 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef224a59-3c60-477b-8552-b411f4f3bc91 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:26.584337 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'nonexistent_hostname'} Sep 18 01:00:26.585483 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:26.586478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 18 01:00:26.587861 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef224a59-3c60-477b-8552-b411f4f3bc91 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef224a59-3c60-477b-8552-b411f4f3bc91 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.035017 Sep 18 01:00:26.590420 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 67/132] 10.222.0.25 () {58 vars in 1212 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:26.594569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Action: 'update', calling method: .version_select at 0x7f70070b40d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:26.686801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.687637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.688339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.689457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.690151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.690680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.761267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.762563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.762915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.764603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.765737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.767028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.842849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ccba225-921a-4a6f-8f3e-3465b7be5f0c tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed?user_id=30fdb4837bbd476886f81313e990b89a" status: 200 len: 148 microversion: 2.57 time: 0.255000 Sep 18 01:00:26.845758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 68/133] 10.222.0.25 () {62 vars in 1384 bytes} [Sun Sep 18 01:00:26 2022] PUT /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed?user_id=30fdb4837bbd476886f81313e990b89a => generated 148 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:26.848884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.852497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.853864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:26.863730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.864609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.865208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.866096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.866215 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d4e8401-ed63-46ba-822f-8808358ed289 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.345645 Sep 18 01:00:26.866689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.867179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.885775 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 66/134] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:26.891883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1e60146-8d6c-4adf-8584-61890edda3e4 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Calling method '.version_select at 0x7f70070d0ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.896736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c1e60146-8d6c-4adf-8584-61890edda3e4 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '0c08f61508cf46c8924a66228be80d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06230d4c6384f9fbf6204294c87b014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1e60146-8d6c-4adf-8584-61890edda3e4 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Request method failure captured: Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2nfKotJp2brnzZJGGt-H-ZLttQZSlW1vlm9mFSrLHIa3w-CpsEbX8_3djSmJBxQQFAGwMmRq-CaiHphJYbklZYFR13lGk7NPxz4UxZXltacKI57iXDp0FKgXAPrfeU-Exl3xqdTx_W7vGlGi1mbR0FaI1A-iciZKsg4BslO07NeWI Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:26.898397 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0c08f61508cf46c8924a66228be80d14 Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'n-d-master-1'} Sep 18 01:00:26.899568 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:26.900235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 18 01:00:26.908721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:26.909946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1e60146-8d6c-4adf-8584-61890edda3e4 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:26.909946 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c1e60146-8d6c-4adf-8584-61890edda3e4 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.013204 Sep 18 01:00:26.909946 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 67/135] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:26.909946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.909946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:26.927964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.928357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.928804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.929797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.931496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.931496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.009238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.018828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.020606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.029614 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-66d54a4a-32b6-45b7-8232-c23d3e85d37d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1385 microversion: 2.75 time: 0.181792 Sep 18 01:00:27.030465 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 69/136] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:27.037432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8edeed82-fa94-402c-8fad-0e8fdba2bc58 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] Calling method '.version_select at 0x7f7006e074c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.049369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.064935 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9d52e7d-afed-4214-abd0-c8a9f0620020 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1271 microversion: 2.1 time: 0.162240 Sep 18 01:00:27.065703 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 68/137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:27.071194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4404d380-08b7-46b6-bdea-ebff60dd91e8 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Calling method '.version_select at 0x7f70070d0e50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.078969 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4404d380-08b7-46b6-bdea-ebff60dd91e8 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4404d380-08b7-46b6-bdea-ebff60dd91e8 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:27.081838 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'nonexistent_hostname'} Sep 18 01:00:27.083301 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.084418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.085876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.086867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4404d380-08b7-46b6-bdea-ebff60dd91e8 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.086867 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4404d380-08b7-46b6-bdea-ebff60dd91e8 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016310 Sep 18 01:00:27.086867 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 69/138] 10.222.0.25 () {58 vars in 1191 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:27.093593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f0af26e-a7b7-4449-aa2d-8250a7587f21 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Calling method '.version_select at 0x7f7007103a60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.102182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1f0af26e-a7b7-4449-aa2d-8250a7587f21 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '0c08f61508cf46c8924a66228be80d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06230d4c6384f9fbf6204294c87b014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f0af26e-a7b7-4449-aa2d-8250a7587f21 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Request method failure captured: Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2nfKotJp2brnzZJGGt-H-ZLttQZSlW1vlm9mFSrLHIa3w-CpsEbX8_3djSmJBxQQFAGwMmRq-CaiHphJYbklZYFR13lGk7NPxz4UxZXltacKI57iXDp0FKgXAPrfeU-Exl3xqdTx_W7vGlGi1mbR0FaI1A-iciZKsg4BslO07NeWI Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:27.103826 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0c08f61508cf46c8924a66228be80d14 Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'n-d-master-1'} Sep 18 01:00:27.105011 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:27.106828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 18 01:00:27.109275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.110489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f0af26e-a7b7-4449-aa2d-8250a7587f21 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.110489 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f0af26e-a7b7-4449-aa2d-8250a7587f21 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017065 Sep 18 01:00:27.110489 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1194 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:00:27.118471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-267c8526-f6b5-4a99-8273-c9c4eb5b34e7 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Calling method '.version_select at 0x7f7007103a60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.134414 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8edeed82-fa94-402c-8fad-0e8fdba2bc58 tempest-QuotasAdminTestV257-158570093 tempest-QuotasAdminTestV257-158570093-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed?user_id=30fdb4837bbd476886f81313e990b89a" status: 200 len: 190 microversion: 2.57 time: 0.103093 Sep 18 01:00:27.135401 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 70/140] 10.222.0.25 () {60 vars in 1364 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/os-quota-sets/1cdc73cc5e9247099e0f4825e6af26ed?user_id=30fdb4837bbd476886f81313e990b89a => generated 190 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:27.137759 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-267c8526-f6b5-4a99-8273-c9c4eb5b34e7 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-267c8526-f6b5-4a99-8273-c9c4eb5b34e7 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:27.143923 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'nonexistent_hostname'} Sep 18 01:00:27.145261 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:27.146131 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 18 01:00:27.147588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-267c8526-f6b5-4a99-8273-c9c4eb5b34e7 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-267c8526-f6b5-4a99-8273-c9c4eb5b34e7 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.032809 Sep 18 01:00:27.148797 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 71/141] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 18 01:00:27.158936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-18db7393-3412-4782-b9b5-5c50268e6100 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Calling method '.version_select at 0x7f7006dfe4c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.161670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-18db7393-3412-4782-b9b5-5c50268e6100 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '0c08f61508cf46c8924a66228be80d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06230d4c6384f9fbf6204294c87b014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-18db7393-3412-4782-b9b5-5c50268e6100 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Request method failure captured: Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2nfKotJp2brnzZJGGt-H-ZLttQZSlW1vlm9mFSrLHIa3w-CpsEbX8_3djSmJBxQQFAGwMmRq-CaiHphJYbklZYFR13lGk7NPxz4UxZXltacKI57iXDp0FKgXAPrfeU-Exl3xqdTx_W7vGlGi1mbR0FaI1A-iciZKsg4BslO07NeWI Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:27.163877 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 0c08f61508cf46c8924a66228be80d14 Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'n-d-master-1'} Sep 18 01:00:27.165472 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:27.166708 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 18 01:00:27.167704 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.171507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-18db7393-3412-4782-b9b5-5c50268e6100 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.171507 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-18db7393-3412-4782-b9b5-5c50268e6100 tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.011912 Sep 18 01:00:27.171507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 71/142] 10.222.0.25 () {58 vars in 1191 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:27.178435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e73a006-47ea-45ae-81d2-fbd8bea97841 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Calling method '.version_select at 0x7f7006fc5310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.189454 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6e73a006-47ea-45ae-81d2-fbd8bea97841 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e73a006-47ea-45ae-81d2-fbd8bea97841 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:27.191293 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'nonexistent_hostname'} Sep 18 01:00:27.192709 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:27.194272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 18 01:00:27.195517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e73a006-47ea-45ae-81d2-fbd8bea97841 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.196703 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e73a006-47ea-45ae-81d2-fbd8bea97841 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020568 Sep 18 01:00:27.197511 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 72/143] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:27.206907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae06c819-c188-446d-9a98-e493d64a479d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Action: 'update', calling method: .version_select at 0x7f7006fb3430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae06c819-c188-446d-9a98-e493d64a479d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 51 Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:27.210934 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: {"status": "enable", "maintenance_mode": "invalid"} Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:27.212844 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'disable', Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'Enable', Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'Disable', Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance: Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'invalid' Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.213994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.215728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.217172 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.217172 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:00:27.217172 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:00:27.217172 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.217172 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.217172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae06c819-c188-446d-9a98-e493d64a479d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.217172 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae06c819-c188-446d-9a98-e493d64a479d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.009979 Sep 18 01:00:27.217787 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 72/144] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:00:27 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:00:27.224512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eaa3f46e-f330-4669-91a3-a12b45460b9d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Action: 'update', calling method: .version_select at 0x7f7006fc5e50>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eaa3f46e-f330-4669-91a3-a12b45460b9d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 51 Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:27.249074 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: {"status": "invalid", "maintenance_mode": "enable"} Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:27.250480 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'disable', Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'Enable', Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'Disable', Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance: Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'invalid' Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.251272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.253005 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eaa3f46e-f330-4669-91a3-a12b45460b9d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eaa3f46e-f330-4669-91a3-a12b45460b9d tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.031268 Sep 18 01:00:27.254125 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 73/145] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:00:27 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:00:27.261529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f92739c0-4968-4af3-85e0-3e07686a3e7b tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Action: 'update', calling method: .version_select at 0x7f7006e12160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:27.265898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f92739c0-4968-4af3-85e0-3e07686a3e7b tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '0c08f61508cf46c8924a66228be80d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06230d4c6384f9fbf6204294c87b014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f92739c0-4968-4af3-85e0-3e07686a3e7b tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Request method failure captured: Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 50 Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2nfKotJp2brnzZJGGt-H-ZLttQZSlW1vlm9mFSrLHIa3w-CpsEbX8_3djSmJBxQQFAGwMmRq-CaiHphJYbklZYFR13lGk7NPxz4UxZXltacKI57iXDp0FKgXAPrfeU-Exl3xqdTx_W7vGlGi1mbR0FaI1A-iciZKsg4BslO07NeWI Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:27.267483 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d06230d4c6384f9fbf6204294c87b014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d06230d4c6384f9fbf6204294c87b014 Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1923797360 Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 0c08f61508cf46c8924a66228be80d14 Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1923797360-project Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: {"status": "enable", "maintenance_mode": "enable"} Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 18 01:00:27.268886 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:27.269918 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 18 01:00:27.271229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.272234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f92739c0-4968-4af3-85e0-3e07686a3e7b tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.272234 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f92739c0-4968-4af3-85e0-3e07686a3e7b tempest-HostsAdminNegativeTestJSON-1923797360 tempest-HostsAdminNegativeTestJSON-1923797360-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.012029 Sep 18 01:00:27.272234 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 73/146] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:00:27 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:00:27.279840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f0a1254-845c-4e06-944c-dc50e24200a9 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Action: 'update', calling method: .version_select at 0x7f7007103ca0>, body: {"status": null, "maintenance_mode": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f0a1254-845c-4e06-944c-dc50e24200a9 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 42 Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:27.283905 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: {"status": null, "maintenance_mode": null} Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 18 01:00:27.285336 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'disable', Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'Enable', Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'Disable', Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance: Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi None Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.286489 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.288449 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.290229 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:00:27.290229 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:00:27.290229 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 18 01:00:27.290229 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.290229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f0a1254-845c-4e06-944c-dc50e24200a9 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.290229 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f0a1254-845c-4e06-944c-dc50e24200a9 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.010117 Sep 18 01:00:27.290229 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 74/147] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:00:27 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:00:27.295897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69e55b96-8a45-4d57-9c41-58f572d6bcf4 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Action: 'update', calling method: .version_select at 0x7f7006ece790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:27.299151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.hosts [None req-69e55b96-8a45-4d57-9c41-58f572d6bcf4 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Enabling host nonexistent_hostname. Sep 18 01:00:27.307015 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-69e55b96-8a45-4d57-9c41-58f572d6bcf4 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.307365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.307992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69e55b96-8a45-4d57-9c41-58f572d6bcf4 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Request method failure captured: Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 50 Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2pCcycRcZX0kjHyoeIGuy7ODUwR0XcSV9hTtrTZHVUTe5IP0IEnW0EXXl6rk9Q5dHpAxD7k6Ntf8MsedVMSb9ypWRJo7kuBaPWUO0f-5bIg66gqDI7yIVp2nVrKssYZ1up0OcERwaALLKfb6FCt9ZoH_TNW0blNSzYJtlxmkwzlNE Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:27.308952 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c3b8c774f4b218b4caa48190a7ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 847c3b8c774f4b218b4caa48190a7ec5 Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1279540912 Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 795af09432b546ec92ae2e3720b1fdb8 Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1279540912-project-admin Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: {"status": "enable", "maintenance_mode": "enable"} Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.310339 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 18 01:00:27.311194 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:27.312149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:27.314968 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69e55b96-8a45-4d57-9c41-58f572d6bcf4 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:27.316078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69e55b96-8a45-4d57-9c41-58f572d6bcf4 tempest-HostsAdminNegativeTestJSON-1279540912 tempest-HostsAdminNegativeTestJSON-1279540912-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.019081 Sep 18 01:00:27.316078 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 74/148] 10.222.0.25 () {60 vars in 1211 bytes} [Sun Sep 18 01:00:27 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:27.316769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.316769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.316769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.316981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.317671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.317863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.502186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.510255 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2fb67c12-b1f1-4874-89df-2bdaacfa951e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.207808 Sep 18 01:00:27.511043 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 75/149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:27.527711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.528629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:27.536262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.536739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.537357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.538187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.538908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.539307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.628067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.646494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b37865e-5d2a-46ae-8d40-7ea8d989adab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1319 microversion: 2.1 time: 0.124589 Sep 18 01:00:27.648968 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 75/150] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1319 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:27.890272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.891223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:27.904506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.906317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.906987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.908026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.908809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.909378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.010267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-efe099f9-f619-46de-b43b-538649ed4319 req-de20806c-8cd7-431b-997b-94d5c996cbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4", "name": "network-vif-plugged", "status": "completed", "tag": "2c4c3c6b-a5d0-4260-ae84-15209c209404"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:28.021594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-efe099f9-f619-46de-b43b-538649ed4319 req-de20806c-8cd7-431b-997b-94d5c996cbbd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.022244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-efe099f9-f619-46de-b43b-538649ed4319 req-de20806c-8cd7-431b-997b-94d5c996cbbd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.022828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-efe099f9-f619-46de-b43b-538649ed4319 req-de20806c-8cd7-431b-997b-94d5c996cbbd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.036818 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-efe099f9-f619-46de-b43b-538649ed4319 req-de20806c-8cd7-431b-997b-94d5c996cbbd service nova] Creating event network-vif-plugged:2c4c3c6b-a5d0-4260-ae84-15209c209404 for instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 on n-h1-master-1 Sep 18 01:00:28.047058 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-efe099f9-f619-46de-b43b-538649ed4319 req-de20806c-8cd7-431b-997b-94d5c996cbbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040387 Sep 18 01:00:28.047950 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 76/151] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:28.056904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:28.057653 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:28.064109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.064594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.065234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.065966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.066575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.067158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.084663 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:28.186802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.195695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.200977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.203123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.206822 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe41e7b1-8bec-412e-9713-d2751bbe2257 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.321377 Sep 18 01:00:28.209524 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-476cb3dc-77c6-4a60-a1d0-069f9b46cf1d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1433 microversion: 2.75 time: 0.156852 Sep 18 01:00:28.226257 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 76/152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:28.228036 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 77/153] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:28 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1433 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:00:28.232229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:28.233119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:28.244179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.244939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.245794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.246765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.247635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.248597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.334511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.343115 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19ef369f-6aa1-4198-8248-ebba653d47d9 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1271 microversion: 2.1 time: 0.115232 Sep 18 01:00:28.343711 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 77/154] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:28 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:28.535070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:28.535692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:28.543041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.543535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.544062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.545993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.546477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.546973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.672740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:28.673360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:28.687813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.688538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.689455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.690500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.692019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.692998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.830574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.842781 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4cc19ef0-77df-4fde-88c3-097f32daddda tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1319 microversion: 2.1 time: 0.173877 Sep 18 01:00:28.844344 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 78/155] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:28 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:28.866026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.875316 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-22aa89f7-d02b-42ce-b998-79330b2198eb tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1341 microversion: 2.1 time: 0.344728 Sep 18 01:00:28.877137 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 78/156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:28 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1341 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:29.231663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:29.231663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:29.245726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:29.245726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:29.251767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.254091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.254945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.256214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.257433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.257915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.258566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.258745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.259103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.259534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.260740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.262144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.400872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.418443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.420674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.428061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed27eb19-a02e-41d2-b54b-5c722d1398bc tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1439 microversion: 2.75 time: 0.190145 Sep 18 01:00:29.428858 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 79/157] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:29 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1439 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:00:29.438395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:29.439006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:29.452224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.454712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.455643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.456857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.457635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.458276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.533963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.545341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-df0376a8-e0ba-42cb-82a9-a1097f7d6bce tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.317894 Sep 18 01:00:29.546423 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 79/158] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:29 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:29.573534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.589101 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5883fa7-a815-4deb-9958-c1a4c66b42d7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1271 microversion: 2.1 time: 0.158527 Sep 18 01:00:29.590169 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 80/159] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:29 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:29.870365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:29.870985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:29.881018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.882315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.885541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.886671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.887335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.887976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.906133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:29.911136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:29.923942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.925693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.926291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.927522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.929958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.931129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.967475 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:30.011383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:30.023832 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56af9aba-3aa9-4f29-af7e-87469c6d4280 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1319 microversion: 2.1 time: 0.156894 Sep 18 01:00:30.035015 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 80/160] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:29 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:30.128798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:30.137420 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60bc7cc9-86b1-4f97-a19f-7b00559520bd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1491 microversion: 2.1 time: 0.242827 Sep 18 01:00:30.138843 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 81/161] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:29 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1491 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:30.464707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:30.465912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:30.477085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.477292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:30.477545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.477794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:30.480269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.481009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.481655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.482495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.485741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.486236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.486667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.487375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.487825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.488246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.576017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:30.592893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:30.595385 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:30.595999 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:00:30.602409 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ee0f78c-4130-4feb-b2b4-233bb3c7987b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1439 microversion: 2.75 time: 0.139775 Sep 18 01:00:30.603103 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 82/162] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:30 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1439 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:30.608898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:30.609913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:30.616617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.617309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.618115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.618995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.619606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.620378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.772192 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e28d2273-b0c6-482a-ac2c-d3c2e104f9e7 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 204 len: 0 microversion: 2.1 time: 0.613034 Sep 18 01:00:30.773035 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 81/163] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:00:30 2022] DELETE /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:30.781569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:30.783243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:30.792054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.793653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.794841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.812355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.813726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.815207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.908659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:30.919870 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a8b2ec77-aebd-4656-ba48-70601a480e46 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1339 microversion: 2.1 time: 0.311687 Sep 18 01:00:30.919870 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:30 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1339 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:30.925454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:30.926094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:30.934552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.935871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.936665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.937679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.939025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.939744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.955120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:30.970489 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-770d3573-a52a-470d-af2f-9ef7f4b2a288 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1271 microversion: 2.1 time: 0.195541 Sep 18 01:00:30.971312 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 82/165] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:30 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:31.052694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:31.053410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:31.062389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.063938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.064609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.065524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.066234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.067015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.316593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.327714 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ae2c768-2140-42e8-967a-dc55e403a673 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1497 microversion: 2.1 time: 0.408624 Sep 18 01:00:31.329206 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 84/166] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:30 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1497 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:31.333603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.352535 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bf625ccc-6287-4fcd-94e9-2dad9dc1ecd2 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1319 microversion: 2.1 time: 0.309052 Sep 18 01:00:31.353239 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 83/167] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:31 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:31.637799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:31.639380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:31.649177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.650321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.651084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.652862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.654423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.655499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.751057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.764322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.766297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.780951 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-51c16c94-7fc0-4e70-a105-078601a7f45b tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1439 microversion: 2.75 time: 0.149096 Sep 18 01:00:31.781542 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 85/168] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:31 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1439 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:31.956084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:31.958215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:31.968071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.968961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.969794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.971500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.972245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.972894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.011874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37b517b5-65a4-486f-92f5-f91d27db4033 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Calling method '.version_select at 0x7f7006f66430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.014735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37b517b5-65a4-486f-92f5-f91d27db4033 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '04f00b08a63648c58a78b924b6d23e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55515d4ef6048b88dad6434ee6a155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37b517b5-65a4-486f-92f5-f91d27db4033 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Request method failure captured: Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2uWuTBuHoYdigAg7YN8dzQaYEedosu3AhyOsR2q8mu9bZluZua7nauZZ91oOxeVovy05wjQZXCw7D7x0Kl24-9lpkdubfOjD-c1EL0-J8IAK1VQrUNHIFqoxm04ceWCaNBOdRN-5mlfaKYgH3-vPjE9FcVFFpr21JOdKxH-oSNTDs Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:32.016653 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 04f00b08a63648c58a78b924b6d23e31 Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:00:32.017878 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:32.018589 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 18 01:00:32.019646 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.022305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37b517b5-65a4-486f-92f5-f91d27db4033 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:32.023432 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37b517b5-65a4-486f-92f5-f91d27db4033 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.324579 Sep 18 01:00:32.024171 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 84/169] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 18 01:00:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:00:32.030906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.031913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:32.045853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.048283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.048898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.049870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.050475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.051075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.169077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.182637 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-505ff51b-ab5d-4b69-a7a0-dc7297fa425c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1271 microversion: 2.1 time: 0.156849 Sep 18 01:00:32.183420 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 85/170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:32.202171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19070da2-e4b6-4c1b-9c05-8aa5418df8b5 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Calling method '.version_select at 0x7f70070ed9d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.204383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-19070da2-e4b6-4c1b-9c05-8aa5418df8b5 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '04f00b08a63648c58a78b924b6d23e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55515d4ef6048b88dad6434ee6a155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19070da2-e4b6-4c1b-9c05-8aa5418df8b5 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Request method failure captured: Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2uWuTBuHoYdigAg7YN8dzQaYEedosu3AhyOsR2q8mu9bZluZua7nauZZ91oOxeVovy05wjQZXCw7D7x0Kl24-9lpkdubfOjD-c1EL0-J8IAK1VQrUNHIFqoxm04ceWCaNBOdRN-5mlfaKYgH3-vPjE9FcVFFpr21JOdKxH-oSNTDs Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:32.206442 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 04f00b08a63648c58a78b924b6d23e31 Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:00:32.207747 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:32.208515 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 18 01:00:32.209689 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.211779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19070da2-e4b6-4c1b-9c05-8aa5418df8b5 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:32.212638 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19070da2-e4b6-4c1b-9c05-8aa5418df8b5 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.022563 Sep 18 01:00:32.213343 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 86/171] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:32.237280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.248242 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea3d8054-3c06-44e8-add9-b2c615d063da tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1489 microversion: 2.1 time: 0.298146 Sep 18 01:00:32.248842 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 86/172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:31 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1489 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-599c2691-b52c-4e1e-97b7-a78e92ebcced tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Calling method '.version_select at 0x7f7006e873a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-599c2691-b52c-4e1e-97b7-a78e92ebcced tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '04f00b08a63648c58a78b924b6d23e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55515d4ef6048b88dad6434ee6a155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-599c2691-b52c-4e1e-97b7-a78e92ebcced tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Request method failure captured: Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2uWuTBuHoYdigAg7YN8dzQaYEedosu3AhyOsR2q8mu9bZluZua7nauZZ91oOxeVovy05wjQZXCw7D7x0Kl24-9lpkdubfOjD-c1EL0-J8IAK1VQrUNHIFqoxm04ceWCaNBOdRN-5mlfaKYgH3-vPjE9FcVFFpr21JOdKxH-oSNTDs Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:32.261691 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 04f00b08a63648c58a78b924b6d23e31 Sep 18 01:00:32.262811 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: action_args: {} Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:32.263864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 18 01:00:32.265143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:32.266429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-599c2691-b52c-4e1e-97b7-a78e92ebcced tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:32.266429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-599c2691-b52c-4e1e-97b7-a78e92ebcced tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.008821 Sep 18 01:00:32.266429 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 87/173] 10.222.0.25 () {58 vars in 1179 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:32.296219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1765480671", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:32.367645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:32.434831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Calling method '.version_select at 0x7f7006dfedc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.436758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.437246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.437720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.633361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.634178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.634890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.654718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.655416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.656008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.663452 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4a2c7ebc-0bc5-4102-a93f-61ae3da7074c tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.395272 Sep 18 01:00:32.665370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 88/174] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:32.671042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.671761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:32.682584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.683060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.683848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.684619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.686130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.686627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.701799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:32.702895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:32.703729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:32.704488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:32.705120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:32.725414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.726075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.726632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.728503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.729452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.731172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.760712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:32.767608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:32.788199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:32.791621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:32.853271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7499bf34-12cb-441f-8504-a2ac13ade240 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638419 Sep 18 01:00:32.853805 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 87/175] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:00:32.867776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.868771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:32.885806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.886506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.887053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.888617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.889365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.890411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.361989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.377633 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3885f3a9-79da-4df1-958a-881d5602f77b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1497 microversion: 2.1 time: 0.522429 Sep 18 01:00:33.378583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 88/176] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1497 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:33.394729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:33.395560 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:33.407206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.407706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.408152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.408930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.409389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.409852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.693877 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-827c53b3-dbee-4b06-af7b-79e92af1d507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1640 microversion: 2.1 time: 1.027051 Sep 18 01:00:33.695088 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 89/177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1640 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:33.717068 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6029e48a-9088-4e25-85c2-56f48fb01fae tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Calling method '.version_select at 0x7f7006dfe0d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:33.719051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6029e48a-9088-4e25-85c2-56f48fb01fae tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '04f00b08a63648c58a78b924b6d23e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55515d4ef6048b88dad6434ee6a155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6029e48a-9088-4e25-85c2-56f48fb01fae tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Request method failure captured: Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2uWuTBuHoYdigAg7YN8dzQaYEedosu3AhyOsR2q8mu9bZluZua7nauZZ91oOxeVovy05wjQZXCw7D7x0Kl24-9lpkdubfOjD-c1EL0-J8IAK1VQrUNHIFqoxm04ceWCaNBOdRN-5mlfaKYgH3-vPjE9FcVFFpr21JOdKxH-oSNTDs Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:33.720587 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 04f00b08a63648c58a78b924b6d23e31 Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '1'} Sep 18 01:00:33.722873 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:33.727149 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 18 01:00:33.731020 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:33.733846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6029e48a-9088-4e25-85c2-56f48fb01fae tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:33.733846 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6029e48a-9088-4e25-85c2-56f48fb01fae tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025215 Sep 18 01:00:33.733846 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 90/178] 10.222.0.25 () {58 vars in 1173 bytes} [Sun Sep 18 01:00:33 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:33.733846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:33.733846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:33.741680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.741873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.742272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.742983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.743438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.743859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.885336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.899102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.912246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.916297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.936862 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a92c0daa-6fb6-47c2-a768-f2c3efb319c9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.557147 Sep 18 01:00:33.941179 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 89/179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:33 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:33.943036 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-722169c1-0ba4-4da7-9e11-904f4a960153 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1460 microversion: 2.75 time: 0.214181 Sep 18 01:00:33.943830 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 91/180] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:33 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1460 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:33.950189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:33.954047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:33.954912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:33.957425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:33.965009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.983001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.983423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.984188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.985613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.986430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.987246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.987926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.988278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.988420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.988712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.990502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.020218 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:34.172003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.181998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d96b6a55-f184-422a-b980-18e2436f3ec8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1269 microversion: 2.1 time: 0.239277 Sep 18 01:00:34.183474 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 90/181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:33 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1269 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:34.202926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:34.203771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:34.216426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.216925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.217361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.218523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.219026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.219455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.250884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:00:34.395226 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-762f940a-fd88-4040-bfb3-e79ec8b4f7ea tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 204 len: 0 microversion: 2.1 time: 0.210209 Sep 18 01:00:34.395915 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 91/182] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:00:34 2022] DELETE /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:34.404509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84f20f4b-9a47-4179-9255-db1d6fcdecc4 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Calling method '.version_select at 0x7f7007225550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:34.405674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-84f20f4b-9a47-4179-9255-db1d6fcdecc4 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] HTTP exception thrown: Hypervisor with ID '8234321b-fe9e-4da5-a3c2-a40788d822d7' could not be found. Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84f20f4b-9a47-4179-9255-db1d6fcdecc4 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Request method failure captured: Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hypervisors/8234321b-fe9e-4da5-a3c2-a40788d822d7/uptime HTTP/1.1 Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2vzTt5Svfy0EgJgMzVbk8cv-0G0X_6Jeohq6cTWA9979dT_3ye2zoq-oBszr-Dc158BDAVII_XKrrHFCf2SkxYJQpspxGCylKfe8SQMC7ZB3GCuh5fO0LzapnZyCGmdGrQwvR3ykGrezHCbbfxZQq0qiQZkc4EgwvAblRJlcgqeAY Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 858ed96b147543218f4a8ef73628a8c2 Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1355223683 Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:34.419744 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1355223683 Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 858ed96b147543218f4a8ef73628a8c2 Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1355223683 Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 7b07b110a71d4cf292cb52e876584402 Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: exception: Hypervisor with ID '8234321b-fe9e-4da5-a3c2-a40788d822d7' could not be found. Sep 18 01:00:34.421136 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8234321b-fe9e-4da5-a3c2-a40788d822d7'} Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8234321b-fe9e-4da5-a3c2-a40788d822d7' Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 18 01:00:34.421890 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8234321b-fe9e-4da5-a3c2-a40788d822d7' could not be found. Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:34.424284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8234321b-fe9e-4da5-a3c2-a40788d822d7' could not be found. Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84f20f4b-9a47-4179-9255-db1d6fcdecc4 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Returning 404 to user: Hypervisor with ID '8234321b-fe9e-4da5-a3c2-a40788d822d7' could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-84f20f4b-9a47-4179-9255-db1d6fcdecc4 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/8234321b-fe9e-4da5-a3c2-a40788d822d7/uptime" status: 404 len: 123 microversion: 2.1 time: 0.024151 Sep 18 01:00:34.427394 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 92/183] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 01:00:34 2022] GET /compute/v2.1/os-hypervisors/8234321b-fe9e-4da5-a3c2-a40788d822d7/uptime => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:34.430248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:34.433228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:34.442992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.443778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.444365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.445286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.445923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.446528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.473785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.482511 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7e844c9-8c8e-4970-8446-3a81ea51ee19 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1319 microversion: 2.1 time: 0.536825 Sep 18 01:00:34.498138 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 92/184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:33 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:34.498138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:34.498138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:34.535476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.536159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.538554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.540627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.541523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.542175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.596832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:34.597597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:34.599676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:34.600422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:34.601105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:34.690833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:34.697909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.697909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.699552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.699552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.700215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.700215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.962307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.974863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.977982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.985283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f61cd30b-3168-4bb1-ba63-01be0e3b8192 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "POST /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251/action" status: 202 len: 1517 microversion: 2.75 time: 0.561618 Sep 18 01:00:34.997818 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 93/185] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:00:34 2022] POST /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251/action => generated 1517 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 18 01:00:34.997818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:34.997818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:35.005605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.005605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.005605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.006293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.008290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.008290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.204231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.212963 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f74973f8-62f4-401b-a977-3147dddac8c7 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1455 microversion: 2.1 time: 0.224115 Sep 18 01:00:35.229832 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 94/186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:34 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1455 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:35.234812 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Calling method '.version_select at 0x7f7007301940>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.236606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.237071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.237500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.244269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.251977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.252462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.252894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.255919 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78407da1-74f1-42a4-96c8-2040f0a0aeba tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1495 microversion: 2.1 time: 0.768256 Sep 18 01:00:35.257025 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 93/187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:34 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1495 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:35.262850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.264472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:35.276487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.277505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.277984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.278247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.278778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.279251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.279969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.280480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.281106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.288614 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14710655-26e9-4312-93a3-4b862e0e740e tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057734 Sep 18 01:00:35.289391 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 95/188] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:35.396314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4b8e0170-d38f-4936-a3eb-1b542d6804bb req-cf4db573-92d9-4770-be85-b84fb266eedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93bb6390-00c2-4008-a004-9ef029cc06c1", "tag": "8475792b-ef04-40ae-b8dc-3d688338f395"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:35.414031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b8e0170-d38f-4936-a3eb-1b542d6804bb req-cf4db573-92d9-4770-be85-b84fb266eedb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.415553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b8e0170-d38f-4936-a3eb-1b542d6804bb req-cf4db573-92d9-4770-be85-b84fb266eedb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.416306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b8e0170-d38f-4936-a3eb-1b542d6804bb req-cf4db573-92d9-4770-be85-b84fb266eedb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.445381 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4b8e0170-d38f-4936-a3eb-1b542d6804bb req-cf4db573-92d9-4770-be85-b84fb266eedb service nova] Creating event network-changed:8475792b-ef04-40ae-b8dc-3d688338f395 for instance 93bb6390-00c2-4008-a004-9ef029cc06c1 on n-h2-master-1 Sep 18 01:00:35.453062 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4b8e0170-d38f-4936-a3eb-1b542d6804bb req-cf4db573-92d9-4770-be85-b84fb266eedb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162560 Sep 18 01:00:35.458453 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 96/189] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:35.470527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.471749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:35.480350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.487832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.488637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.489661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.490613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.491493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.687617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.697373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.699039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.707293 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11534732-8a20-41ab-b8b0-7ebd5691e1b2 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1469 microversion: 2.75 time: 0.247104 Sep 18 01:00:35.709330 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 97/190] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:35.720088 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c4674ec9-61fb-40e6-89b7-44e4bb913922 req-7129662a-e7a8-486e-aba6-b94b18fcb7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c510769c-b06f-4952-85ce-5bcc1375b839", "name": "network-vif-deleted", "tag": "13982067-397c-4a69-92dd-d40782cd0fda"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:35.738086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c4674ec9-61fb-40e6-89b7-44e4bb913922 req-7129662a-e7a8-486e-aba6-b94b18fcb7b9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.738864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c4674ec9-61fb-40e6-89b7-44e4bb913922 req-7129662a-e7a8-486e-aba6-b94b18fcb7b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.739545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c4674ec9-61fb-40e6-89b7-44e4bb913922 req-7129662a-e7a8-486e-aba6-b94b18fcb7b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.757518 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c4674ec9-61fb-40e6-89b7-44e4bb913922 req-7129662a-e7a8-486e-aba6-b94b18fcb7b9 service nova] Creating event network-vif-deleted:13982067-397c-4a69-92dd-d40782cd0fda for instance c510769c-b06f-4952-85ce-5bcc1375b839 on n-h1-master-1 Sep 18 01:00:35.773755 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c4674ec9-61fb-40e6-89b7-44e4bb913922 req-7129662a-e7a8-486e-aba6-b94b18fcb7b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062559 Sep 18 01:00:35.777991 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 98/191] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:35.783658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.784363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:35.799337 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:35.807433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.807934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.808378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.809093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.809571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.811642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.864798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.882927 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb978c36-ea3c-415d-8c15-15aea6213d8f tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.624223 Sep 18 01:00:35.884048 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 94/192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:35.889849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9dd099b-ae7e-4132-b79f-66e2ca36a2c3 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Calling method '.version_select at 0x7f7006dfe790>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.891899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f9dd099b-ae7e-4132-b79f-66e2ca36a2c3 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '04f00b08a63648c58a78b924b6d23e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55515d4ef6048b88dad6434ee6a155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9dd099b-ae7e-4132-b79f-66e2ca36a2c3 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Request method failure captured: Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2uWuTBuHoYdigAg7YN8dzQaYEedosu3AhyOsR2q8mu9bZluZua7nauZZ91oOxeVovy05wjQZXCw7D7x0Kl24-9lpkdubfOjD-c1EL0-J8IAK1VQrUNHIFqoxm04ceWCaNBOdRN-5mlfaKYgH3-vPjE9FcVFFpr21JOdKxH-oSNTDs Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:35.893723 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c55515d4ef6048b88dad6434ee6a155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c55515d4ef6048b88dad6434ee6a155a Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175 Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 04f00b08a63648c58a78b924b6d23e31 Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1429245175-project Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '1'} Sep 18 01:00:35.895050 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:35.895800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 18 01:00:35.896970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.899744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9dd099b-ae7e-4132-b79f-66e2ca36a2c3 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:35.900781 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f9dd099b-ae7e-4132-b79f-66e2ca36a2c3 tempest-HypervisorAdminNegativeTestJSON-1429245175 tempest-HypervisorAdminNegativeTestJSON-1429245175-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015642 Sep 18 01:00:35.901716 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 95/193] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:35.907862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.908731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:35.916901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.917685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.918131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.918849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.919559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.920163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.941065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.949708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d53d5666-78c4-4cef-8516-14b68d409e70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1275 microversion: 2.1 time: 0.170188 Sep 18 01:00:35.958145 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 99/194] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:35.958145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e4bdd764-d4f7-47fd-b5d5-e64fee665354 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Calling method '.version_select at 0x7f70073098b0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.960503 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e4bdd764-d4f7-47fd-b5d5-e64fee665354 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] HTTP exception thrown: Hypervisor with ID '9c148313-f125-4567-958b-0b76480e5312' could not be found. Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e4bdd764-d4f7-47fd-b5d5-e64fee665354 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Request method failure captured: Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-hypervisors/9c148313-f125-4567-958b-0b76480e5312 HTTP/1.1 Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2vzTt5Svfy0EgJgMzVbk8cv-0G0X_6Jeohq6cTWA9979dT_3ye2zoq-oBszr-Dc158BDAVII_XKrrHFCf2SkxYJQpspxGCylKfe8SQMC7ZB3GCuh5fO0LzapnZyCGmdGrQwvR3ykGrezHCbbfxZQq0qiQZkc4EgwvAblRJlcgqeAY Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 858ed96b147543218f4a8ef73628a8c2 Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1355223683 Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:35.962917 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/858ed96b147543218f4a8ef73628a8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1355223683 Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 858ed96b147543218f4a8ef73628a8c2 Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1355223683 Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 7b07b110a71d4cf292cb52e876584402 Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: exception: Hypervisor with ID '9c148313-f125-4567-958b-0b76480e5312' could not be found. Sep 18 01:00:35.964471 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '9c148313-f125-4567-958b-0b76480e5312'} Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9c148313-f125-4567-958b-0b76480e5312' Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 18 01:00:35.965281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:00:35.967094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9c148313-f125-4567-958b-0b76480e5312' could not be found. Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9c148313-f125-4567-958b-0b76480e5312' could not be found. Sep 18 01:00:35.968478 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:35.970584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e4bdd764-d4f7-47fd-b5d5-e64fee665354 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] Returning 404 to user: Hypervisor with ID '9c148313-f125-4567-958b-0b76480e5312' could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:35.971680 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e4bdd764-d4f7-47fd-b5d5-e64fee665354 tempest-HypervisorAdminNegativeTestJSON-1355223683 tempest-HypervisorAdminNegativeTestJSON-1355223683-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/9c148313-f125-4567-958b-0b76480e5312" status: 404 len: 123 microversion: 2.1 time: 0.018640 Sep 18 01:00:35.972490 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 100/195] 10.222.0.25 () {58 vars in 1257 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/os-hypervisors/9c148313-f125-4567-958b-0b76480e5312 => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:36.237089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:36.237822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:36.245203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.245894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.246608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.247982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.248556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.248957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.296556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.297079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.298043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.298651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lazy-loading 'fault' on Instance uuid c510769c-b06f-4952-85ce-5bcc1375b839 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:36.416832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:36.427530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-faf6da55-a42e-45f2-b198-711136a3b862 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 200 len: 1331 microversion: 2.1 time: 0.194211 Sep 18 01:00:36.430320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:36.441699 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8b6d7eb-917d-4dfe-bf0d-287ab999807c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1319 microversion: 2.1 time: 0.538479 Sep 18 01:00:36.443449 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 96/196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:36.444389 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 101/197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:36 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 1331 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:36.450585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:36.451479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:36.459914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.460786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.461359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.462887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.463365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.463789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.471720 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:36.740504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:36.741616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:36.767026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.770627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.772932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.774975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.776663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.779694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.785032 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=11 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:37.026421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.038931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.042624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.052958 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52d9507e-974f-4a8d-acda-7dd0210d8743 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1469 microversion: 2.75 time: 0.316394 Sep 18 01:00:37.053587 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 102/198] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:36 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:00:37.060956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:37.062159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:37.069171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.070044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.070637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.071530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.075062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.080363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.085990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.088978 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7cfa5de-22c3-4a59-b985-9f4b3bc09ea5 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1495 microversion: 2.1 time: 0.642892 Sep 18 01:00:37.090120 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 97/199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:36 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1495 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:37.094937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:37.095834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:37.102399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.103099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.103756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.104640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.105450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.106086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.138855 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=30 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:37.279369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.289865 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7f227381-2f97-4a70-9576-d7c128cd6aa1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1275 microversion: 2.1 time: 0.198328 Sep 18 01:00:37.291085 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 98/200] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:37 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:37.452577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:37.453256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:37.459761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.460388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.461377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.462236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.463201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.463778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.485440 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] HTTP exception thrown: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Request method failure captured: Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 HTTP/1.1 Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2HbE71nbOuJ4udjUlIoKdE_rZm2nxz9SpIoBFHhXZI1Sq6g4-AxNyDLEeQBUpbNqBh3DfwjBtt_iDiyiFwl3Ojbufamt-pW8ZumKIQlnLhd9h9-70ZZfWJ_F26c82AKPuhelyPseoa0gQ7d-ZSiUBdKRH6vobgCJgNVDAx7eclkAo Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:37.488082 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 450f5767908346de9e8884f72376614a Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: exception: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:00:37.489694 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'c510769c-b06f-4952-85ce-5bcc1375b839'} Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:37.490634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:00:37.492210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:37.501454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Returning 404 to user: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:37.501454 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fd32e799-96d2-43e1-80af-b09d9863b97b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 404 len: 111 microversion: 2.1 time: 0.041935 Sep 18 01:00:37.501454 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 99/201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:37 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:00:37.503941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:37.504141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:37.518142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.519087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.519756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.520718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.524977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.526288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.576369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.584729 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c6d8c580-7179-48c0-801f-4efd95681fb4 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.529824 Sep 18 01:00:37.597665 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 103/202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:37 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:37.647233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1768504545", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:37.720729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:38.275734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:38.284772 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82a55c79-8cfc-4369-8f00-4b0cd166ddff tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1319 microversion: 2.1 time: 0.787265 Sep 18 01:00:38.285356 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 100/203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:37 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:38.290344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0060c7ae-5bb1-436f-bb93-252df9287919 req-c94b91d8-3d76-4658-bb8a-b55629a768a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb", "tag": "9ef5e8d7-9fc6-42de-a794-b93e06378934"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:38.300993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0060c7ae-5bb1-436f-bb93-252df9287919 req-c94b91d8-3d76-4658-bb8a-b55629a768a8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.301471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0060c7ae-5bb1-436f-bb93-252df9287919 req-c94b91d8-3d76-4658-bb8a-b55629a768a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.301932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0060c7ae-5bb1-436f-bb93-252df9287919 req-c94b91d8-3d76-4658-bb8a-b55629a768a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.316676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0060c7ae-5bb1-436f-bb93-252df9287919 req-c94b91d8-3d76-4658-bb8a-b55629a768a8 service nova] Creating event network-changed:9ef5e8d7-9fc6-42de-a794-b93e06378934 for instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb on n-h2-master-1 Sep 18 01:00:38.323262 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0060c7ae-5bb1-436f-bb93-252df9287919 req-c94b91d8-3d76-4658-bb8a-b55629a768a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036613 Sep 18 01:00:38.324063 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 101/204] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:38.330264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.330797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:38.339416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.339965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.340535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.342058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.342603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.343048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.463896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:38.505349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:38.508945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:38.510272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:38.511070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:38.512890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:38.524344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:38.536000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.537828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.538211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:38.539013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.540775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.542139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.543194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.544801 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2db7da91-eab1-47db-83ee-6bae21cb2ee9 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1469 microversion: 2.75 time: 0.219147 Sep 18 01:00:38.545415 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 102/205] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:38 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:38.553158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.553801 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:38.583141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.583956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.584657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.586667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.587658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.588566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.613726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Getting quotas for project eecbfc5594c74b798ba6eaa2d8c19059. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:38.626180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Getting quotas for user 450f5767908346de9e8884f72376614a and project eecbfc5594c74b798ba6eaa2d8c19059. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:38.638871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.639356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.639812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.640255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lazy-loading 'fault' on Instance uuid e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:38.649071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:38.653176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:38.749354 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-df0a48d2-bfbb-45f8-bb36-bdf1ddc1d466 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106047 Sep 18 01:00:38.749952 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 104/206] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:00:38.753864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198c87e49acc41bcaf1f3e5b4d24ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9933df3eac04c98b2b9d4fc0faf8661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:38.766993 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1f7499a5-6033-4184-8e25-a521d5b0b58d tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 200 len: 1329 microversion: 2.1 time: 0.220129 Sep 18 01:00:38.769382 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 103/207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:38 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 1329 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:38.771118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.773831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:38.779538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.782492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:38.798770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.799447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.799944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.800456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.801140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.801317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.801731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.802155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.803035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.805927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.807079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.808131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.168413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.190588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-488905c8-1f57-48bd-8599-f355f0804d15 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.437476 Sep 18 01:00:39.205987 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 105/208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:38 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:39.214744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3c650f4-3fb0-43aa-a946-aa5256b38c5b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:39.215373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3c650f4-3fb0-43aa-a946-aa5256b38c5b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:39.262394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.288516 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a5c1631-7ce2-4036-b9a7-56bd4a85bfa0 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.514642 Sep 18 01:00:39.291192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 104/209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:38 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:39.314576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:39.314576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:39.351078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.351582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.352024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.361272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.361431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.361900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.516896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3c650f4-3fb0-43aa-a946-aa5256b38c5b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.534048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3c650f4-3fb0-43aa-a946-aa5256b38c5b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1220 microversion: 2.1 time: 0.326605 Sep 18 01:00:39.541854 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 106/210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:39 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:39.604643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:39.605461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:39.623536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.624287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.624508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.625326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.626404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.626404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.779803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.789526 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:39.809100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.812434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.819175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.838500 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1aab80b0-601e-4d57-91fb-b035546fff36 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1469 microversion: 2.75 time: 0.240630 Sep 18 01:00:39.838758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae1a845f-e019-4966-a6ff-2f2e02570bb1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1319 microversion: 2.1 time: 0.532717 Sep 18 01:00:39.840477 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 107/211] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:39 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1469 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:00:39.864443 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 105/212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:39 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:39.864538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:39.866514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:39.887245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.888270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.888728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.889451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.889983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.890654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.915422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] HTTP exception thrown: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Request method failure captured: Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 HTTP/1.1 Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2JAeAs6BOKBAIJlPiY3SRBGRYqIU9raQ1J2uLTzFerKFpazaJIepb40LIk5opfv9rSXppMs3Qo7N29kJKh2P-vbflotap99EmsAoAZfH5y8a7GgkylwE-92kAQkvHOy9f3c2w_CGbr7izGBlAJybtjM0lQMaX5iGoly4sSoZIQvKo Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e9933df3eac04c98b2b9d4fc0faf8661 Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:00:39.918356 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e9933df3eac04c98b2b9d4fc0faf8661 Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AggregatesAdminTestJSON-689481468-project Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 198c87e49acc41bcaf1f3e5b4d24ab7a Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AggregatesAdminTestJSON-689481468-project Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:39.919884 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4'} Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:39.920838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:39.922272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:39.926773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Returning 404 to user: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:39.937273 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adb9bba1-e810-4732-8376-fc294de13d0b tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 404 len: 111 microversion: 2.1 time: 0.094088 Sep 18 01:00:39.938237 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 108/213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:39 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:39.949436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ccf1d9d5-4f64-4cd3-8d1c-a0379e0a4e79 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:39.974453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccf1d9d5-4f64-4cd3-8d1c-a0379e0a4e79 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.975320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccf1d9d5-4f64-4cd3-8d1c-a0379e0a4e79 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.975793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccf1d9d5-4f64-4cd3-8d1c-a0379e0a4e79 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.219969 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ccf1d9d5-4f64-4cd3-8d1c-a0379e0a4e79 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.276530 Sep 18 01:00:40.220239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:40.220833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:40.220969 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 106/214] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:39 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:40.233925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f186d25-83c7-4fc7-873e-efd51882e41b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:40.237101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.237881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.238584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.239528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.240212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.240848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.267990 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f186d25-83c7-4fc7-873e-efd51882e41b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039243 Sep 18 01:00:40.276847 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 107/215] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:40 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:40.290981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80c1ad9f-b140-4dc3-9f50-c8c6d48c15be tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1410540242"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:40.296635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-80c1ad9f-b140-4dc3-9f50-c8c6d48c15be tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid f65b27b6-e0ff-41f2-b8b1-2fcd9d1c6173 for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:40.348274 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80c1ad9f-b140-4dc3-9f50-c8c6d48c15be tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059754 Sep 18 01:00:40.349190 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 108/216] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:40.365123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:40.366036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:40.378356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.379254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.379890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.380828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.381471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.382176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.775206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:40.787450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8e30ab44-2be2-4c41-b777-7898ccb019a8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.570934 Sep 18 01:00:40.788642 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 109/217] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:40 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:40.813942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-71baf1af-a0cb-465e-b85a-fc701022001b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:40.827180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71baf1af-a0cb-465e-b85a-fc701022001b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.828438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71baf1af-a0cb-465e-b85a-fc701022001b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.829231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71baf1af-a0cb-465e-b85a-fc701022001b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.932630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:40.946476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-01f5e7f5-955a-4a56-b06c-2e686e0de1ab tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.595444 Sep 18 01:00:40.947375 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 109/218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:40 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:40.952333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2fac307e-8791-413f-8519-046008b6a30b req-49743d8d-dcdb-4369-bd69-11b395f8bb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4", "name": "network-vif-deleted", "tag": "2c4c3c6b-a5d0-4260-ae84-15209c209404"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:40.962177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2fac307e-8791-413f-8519-046008b6a30b req-49743d8d-dcdb-4369-bd69-11b395f8bb2e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.962725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2fac307e-8791-413f-8519-046008b6a30b req-49743d8d-dcdb-4369-bd69-11b395f8bb2e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.963379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2fac307e-8791-413f-8519-046008b6a30b req-49743d8d-dcdb-4369-bd69-11b395f8bb2e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.977888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-71baf1af-a0cb-465e-b85a-fc701022001b tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.187723 Sep 18 01:00:40.978606 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 110/219] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:40 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:40.985130 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2fac307e-8791-413f-8519-046008b6a30b req-49743d8d-dcdb-4369-bd69-11b395f8bb2e service nova] Creating event network-vif-deleted:2c4c3c6b-a5d0-4260-ae84-15209c209404 for instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 on n-h1-master-1 Sep 18 01:00:40.985452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:40.986400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:40.994380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.994605 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2fac307e-8791-413f-8519-046008b6a30b req-49743d8d-dcdb-4369-bd69-11b395f8bb2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045337 Sep 18 01:00:40.994870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.995207 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 110/220] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:40.995659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.996384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.996986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.997424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.143441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:41.152712 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a75f99d-1b29-4ba6-8cb1-3ecd1fc81b66 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1278 microversion: 2.1 time: 0.172622 Sep 18 01:00:41.155044 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 111/221] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:40 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:41.160919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.161858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:41.171967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.172726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.173351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.174280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.175090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.175568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.181722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6afe24a-3fc7-43b7-a58c-4dfb7b647376 tempest-InstanceUsageAuditLogTestJSON-1684672725 tempest-InstanceUsageAuditLogTestJSON-1684672725-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.203901 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6afe24a-3fc7-43b7-a58c-4dfb7b647376 tempest-InstanceUsageAuditLogTestJSON-1684672725 tempest-InstanceUsageAuditLogTestJSON-1684672725-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-18 01:00:40" status: 200 len: 318 microversion: 2.1 time: 0.207451 Sep 18 01:00:41.205664 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 111/222] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:00:40 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-18%2001%3A00%3A40 => generated 318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:41.226824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.229109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:41.244247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.245271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.246221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.248069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.249098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.249884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.367861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:41.378531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:41.379994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:41.385994 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e6623c7a-a6d7-4a82-b95b-e4a7d2675679 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.178473 Sep 18 01:00:41.387417 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 112/223] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:41 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:41.393717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0a4856b-3a5d-498e-be33-2830f44f7968 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.409480 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0a4856b-3a5d-498e-be33-2830f44f7968 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.020265 Sep 18 01:00:41.410428 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 113/224] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:00:41 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:41.419176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3e6dfa80-2d31-4e7b-80f0-abcebaf860c1 tempest-InstanceUsageAuditLogTestJSON-1684672725 tempest-InstanceUsageAuditLogTestJSON-1684672725-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.433537 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3e6dfa80-2d31-4e7b-80f0-abcebaf860c1 tempest-InstanceUsageAuditLogTestJSON-1684672725 tempest-InstanceUsageAuditLogTestJSON-1684672725-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021617 Sep 18 01:00:41.434557 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 114/225] 10.222.0.25 () {58 vars in 1185 bytes} [Sun Sep 18 01:00:41 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:41.439657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f556d859-f181-40c2-ae95-110e02c80ceb req-855dbf7f-5ce3-44a8-89e3-ddf208ea7809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bb6390-00c2-4008-a004-9ef029cc06c1", "name": "network-vif-plugged", "status": "completed", "tag": "8475792b-ef04-40ae-b8dc-3d688338f395"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:41.453035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f556d859-f181-40c2-ae95-110e02c80ceb req-855dbf7f-5ce3-44a8-89e3-ddf208ea7809 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.453514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f556d859-f181-40c2-ae95-110e02c80ceb req-855dbf7f-5ce3-44a8-89e3-ddf208ea7809 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.454198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f556d859-f181-40c2-ae95-110e02c80ceb req-855dbf7f-5ce3-44a8-89e3-ddf208ea7809 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.467816 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f556d859-f181-40c2-ae95-110e02c80ceb req-855dbf7f-5ce3-44a8-89e3-ddf208ea7809 service nova] Creating event network-vif-plugged:8475792b-ef04-40ae-b8dc-3d688338f395 for instance 93bb6390-00c2-4008-a004-9ef029cc06c1 on n-h2-master-1 Sep 18 01:00:41.474054 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f556d859-f181-40c2-ae95-110e02c80ceb req-855dbf7f-5ce3-44a8-89e3-ddf208ea7809 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038105 Sep 18 01:00:41.475611 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 115/226] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:41.484314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe103d4b-1f31-46a1-911e-f902c3b1b183 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:41.496874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe103d4b-1f31-46a1-911e-f902c3b1b183 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.497742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe103d4b-1f31-46a1-911e-f902c3b1b183 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.498517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe103d4b-1f31-46a1-911e-f902c3b1b183 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.568638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:41.592578 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba0fc344-88ea-4d85-ae76-bac47289cc95 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1319 microversion: 2.1 time: 0.432957 Sep 18 01:00:41.594231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 112/227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:41 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:41.709701 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe103d4b-1f31-46a1-911e-f902c3b1b183 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.232593 Sep 18 01:00:41.710378 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 116/228] 10.222.0.25 () {60 vars in 1191 bytes} [Sun Sep 18 01:00:41 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:41.728070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e19733b-ed98-43c8-89c6-ea2b9f3781a6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.771038 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e19733b-ed98-43c8-89c6-ea2b9f3781a6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.046488 Sep 18 01:00:41.771652 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 113/229] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:41 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:41.784841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4a9d8a5f-5563-479d-970a-5720bb0c6312 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-947641851"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:41.789293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-4a9d8a5f-5563-479d-970a-5720bb0c6312 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid 504978fa-80b0-4215-878a-b24c0ca7efe0 for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:41.810488 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:41.825172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.827248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:41.836262 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4a9d8a5f-5563-479d-970a-5720bb0c6312 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055346 Sep 18 01:00:41.837721 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 117/230] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:41.848491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.850008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.850865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.851738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d640a2d5-672a-480a-bc17-f028eef7c758 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:41.854541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.855325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.855963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.863374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d640a2d5-672a-480a-bc17-f028eef7c758 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.863985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d640a2d5-672a-480a-bc17-f028eef7c758 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.864526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d640a2d5-672a-480a-bc17-f028eef7c758 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.040494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d640a2d5-672a-480a-bc17-f028eef7c758 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.193836 Sep 18 01:00:42.043350 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 118/231] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:41 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:00:42.049953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:42.051636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:42.061296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.062949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.063609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.064906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.065630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.066250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.563458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.573342 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f2d58b6-8912-4b25-a881-76de0e49a6b3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.755011 Sep 18 01:00:42.573955 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 114/232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:41 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:42.579856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d5294cf-613a-465f-98af-9e5a83da940f tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:42.599362 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d5294cf-613a-465f-98af-9e5a83da940f tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.024040 Sep 18 01:00:42.600284 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 115/233] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:00:42 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:42.616271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:42.623467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:42.635550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.636196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.636878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.637676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.638329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.638931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.651958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.665147 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1719dc2c-48d1-447e-abde-2f8651655585 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.619590 Sep 18 01:00:42.668131 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 119/234] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:42 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:42.695440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:42.696335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:42.706914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.707699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.708402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.709454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.710267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.711005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.790964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.800768 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c834fed2-7e8e-40eb-ad9c-c3b45c3a8a1f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1278 microversion: 2.1 time: 0.198482 Sep 18 01:00:42.802003 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 116/235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:42 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:42.809105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:42.810370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:42.817157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.817967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.818098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.818776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.819589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.820103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.820976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.836121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.837754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.846750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-87a5144c-33de-480c-9719-3242174f3267 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.162232 Sep 18 01:00:42.847185 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 120/236] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:42 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:42.861616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-16d255df-399e-4466-9c4f-d45e71fbaf0e tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:42.880476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16d255df-399e-4466-9c4f-d45e71fbaf0e tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.881357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16d255df-399e-4466-9c4f-d45e71fbaf0e tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.882380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16d255df-399e-4466-9c4f-d45e71fbaf0e tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.093819 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-16d255df-399e-4466-9c4f-d45e71fbaf0e tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.241128 Sep 18 01:00:43.107841 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 121/237] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:42 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:43.113446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0b074138-cda5-4864-8a9d-4652e122b7e1 req-94c8e4cb-7b2b-471b-a665-c128de660c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d48a9cd-b662-4a76-a839-5174b05a84ad", "tag": "70d92a14-d071-4798-8f7e-6d813868a5bc"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:43.132649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b074138-cda5-4864-8a9d-4652e122b7e1 req-94c8e4cb-7b2b-471b-a665-c128de660c3e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.133503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b074138-cda5-4864-8a9d-4652e122b7e1 req-94c8e4cb-7b2b-471b-a665-c128de660c3e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.134481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b074138-cda5-4864-8a9d-4652e122b7e1 req-94c8e4cb-7b2b-471b-a665-c128de660c3e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.139050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:43.153061 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c31d0fe1-cfe5-4e96-bda4-e4efb729e8a7 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1319 microversion: 2.1 time: 0.349212 Sep 18 01:00:43.157124 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0b074138-cda5-4864-8a9d-4652e122b7e1 req-94c8e4cb-7b2b-471b-a665-c128de660c3e service nova] Creating event network-changed:70d92a14-d071-4798-8f7e-6d813868a5bc for instance 6d48a9cd-b662-4a76-a839-5174b05a84ad on n-h2-master-1 Sep 18 01:00:43.168611 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0b074138-cda5-4864-8a9d-4652e122b7e1 req-94c8e4cb-7b2b-471b-a665-c128de660c3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053721 Sep 18 01:00:43.169730 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 117/238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:42 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:43.170039 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 122/239] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:43.175113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68bc75c6-f77e-45e3-b6f9-59235a9e72de tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:43.222638 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68bc75c6-f77e-45e3-b6f9-59235a9e72de tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.051178 Sep 18 01:00:43.223372 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 118/240] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:43 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:43.235971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bad0dbea-432e-4e3d-b245-ccf7c01e7157 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-334937636"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:43.241438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-bad0dbea-432e-4e3d-b245-ccf7c01e7157 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid d0685cdb-e245-4a82-aa6c-24cc9f95ca9e for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:43.274186 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bad0dbea-432e-4e3d-b245-ccf7c01e7157 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042087 Sep 18 01:00:43.275531 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 123/241] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:43.288139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f0db3cee-7458-4de3-8023-9c0f11b44b6d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:43.306949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0db3cee-7458-4de3-8023-9c0f11b44b6d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.308119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0db3cee-7458-4de3-8023-9c0f11b44b6d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.309175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0db3cee-7458-4de3-8023-9c0f11b44b6d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.466372 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f0db3cee-7458-4de3-8023-9c0f11b44b6d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.182312 Sep 18 01:00:43.467578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 119/242] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:43.482851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-061d502f-5721-403d-9086-af281e8598a6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:43.496047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-061d502f-5721-403d-9086-af281e8598a6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.496647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-061d502f-5721-403d-9086-af281e8598a6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.497831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-061d502f-5721-403d-9086-af281e8598a6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.524035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-666ea35b-e1fd-4eaa-85ec-2043f00db69d req-18138729-4023-4363-9852-24a91e5ce134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb", "name": "network-vif-plugged", "status": "completed", "tag": "9ef5e8d7-9fc6-42de-a794-b93e06378934"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:43.537403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-666ea35b-e1fd-4eaa-85ec-2043f00db69d req-18138729-4023-4363-9852-24a91e5ce134 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.537897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-666ea35b-e1fd-4eaa-85ec-2043f00db69d req-18138729-4023-4363-9852-24a91e5ce134 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.538554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-666ea35b-e1fd-4eaa-85ec-2043f00db69d req-18138729-4023-4363-9852-24a91e5ce134 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.551627 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-666ea35b-e1fd-4eaa-85ec-2043f00db69d req-18138729-4023-4363-9852-24a91e5ce134 service nova] Creating event network-vif-plugged:9ef5e8d7-9fc6-42de-a794-b93e06378934 for instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb on n-h2-master-1 Sep 18 01:00:43.557082 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-666ea35b-e1fd-4eaa-85ec-2043f00db69d req-18138729-4023-4363-9852-24a91e5ce134 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037201 Sep 18 01:00:43.557935 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 120/243] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:00:43.605522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:43.607020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:43.615485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.616102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.616638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.617868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.618537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.619259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.646837 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-061d502f-5721-403d-9086-af281e8598a6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.170966 Sep 18 01:00:43.647635 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 124/244] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:43.661171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-667f03d7-f6a1-4b6f-af31-eca3f33c4203 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:43.687894 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-667f03d7-f6a1-4b6f-af31-eca3f33c4203 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.030438 Sep 18 01:00:43.688922 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 125/245] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:43 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:43.698840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15227cd5-4aae-4180-85e0-b96034ff9bcd tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-167533603"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:43.703289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-15227cd5-4aae-4180-85e0-b96034ff9bcd tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid cbbc35b4-30cf-4125-8d98-65220f2c3dfd for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:43.732038 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15227cd5-4aae-4180-85e0-b96034ff9bcd tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036298 Sep 18 01:00:43.738838 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 126/246] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:43.748935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:43.749730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:43.761644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.762426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.763543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.764437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.765083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.765739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.782946 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:44.017571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.038507 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9ae0b19-a541-4d2b-8260-31e51e0d0121 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.439582 Sep 18 01:00:44.039119 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 121/247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:43 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:44.046605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee72a8d6-8524-4130-97bb-5e3fd440ff6f tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1389649941"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:44.051944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-ee72a8d6-8524-4130-97bb-5e3fd440ff6f tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid 91264e95-06e9-4004-a967-a236e8bf7863 for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:44.086190 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee72a8d6-8524-4130-97bb-5e3fd440ff6f tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045727 Sep 18 01:00:44.088681 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 122/248] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:44.094522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18c6f970-a393-486b-9e98-32d1e9b8a507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.100762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.109249 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40539103-5315-4ff9-a47a-c28d3edfa6d9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.368266 Sep 18 01:00:44.114236 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 127/249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:43 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:44.124224 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-18c6f970-a393-486b-9e98-32d1e9b8a507 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.034167 Sep 18 01:00:44.126168 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 123/250] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:44.136211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.137205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:44.138257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.142524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:44.146918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.148815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.149313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.150308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.150781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.151256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.156525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.158513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.159050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.160272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.160947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.161644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.197036 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:44.261641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.271590 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.273232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.279143 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5135bf06-7ada-4a0c-a29e-06148eacd693 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.146945 Sep 18 01:00:44.280282 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 124/251] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:44 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:44.295513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b79dcd48-ba9c-4bd1-afc0-55bff2c8aa44 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:44.308507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b79dcd48-ba9c-4bd1-afc0-55bff2c8aa44 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.309055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b79dcd48-ba9c-4bd1-afc0-55bff2c8aa44 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.309528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b79dcd48-ba9c-4bd1-afc0-55bff2c8aa44 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.488480 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b79dcd48-ba9c-4bd1-afc0-55bff2c8aa44 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.207082 Sep 18 01:00:44.490779 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 125/252] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:44 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:44.497762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c365a47-cf5f-4248-a994-0f7c6bf3dfd6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.505859 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-0c365a47-cf5f-4248-a994-0f7c6bf3dfd6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c365a47-cf5f-4248-a994-0f7c6bf3dfd6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Request method failure captured: Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2M5QkmXoqefIJc8pWawxlyB7A-1UIINQ4NYastxv8h2lX3rfbsKO08-9xbqgMHexwHsSf3EIlBYwc5IL8udGyWiCxwWpsWYna4F0xjQciNdasxgvwP4PAyrtD8H0tagDNDW6tiuuUjB8n2lJ0eS-N85HlE4qZuqF40EJCXnM1TdaU Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:44.508954 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 2a088226fad4442aa7be2cc8b5a85836 Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: exception: Aggregate 12 could not be found. Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '12'} Sep 18 01:00:44.510542 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.511549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 18 01:00:44.513925 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.515078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c365a47-cf5f-4248-a994-0f7c6bf3dfd6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:44.515168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.515955 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0c365a47-cf5f-4248-a994-0f7c6bf3dfd6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.024122 Sep 18 01:00:44.522201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 126/253] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:44 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:44.523025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.523756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:44.529711 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-943c6a3f-339b-47ef-b5f1-62d21e64c453 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1320 microversion: 2.1 time: 0.413887 Sep 18 01:00:44.530588 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 128/254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:44 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1320 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:44.532460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.533063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.533819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.534643 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.535206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.535741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.554429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eac719cc-0d63-43da-843a-eb32cf385982 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:44.559785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eac719cc-0d63-43da-843a-eb32cf385982 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c471d1f448fe493d9f1654f3122f9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5063060fcc66473ba0c329aceb560008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eac719cc-0d63-43da-843a-eb32cf385982 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Request method failure captured: Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 42 Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2J8orw7bnZvu7RR8zfliWCh5JDKy_mX0uD621FOwzbn4NNq7uUPBqszuri-F6IqLWUh2LSyr9O2_Ar2letJTAQ_5ZsGVVEMysv6OxYxGnWc5LtJnt7OjoM-tLhe1vNmpLHefqpvqfsWxZ68swP-Z2zvWzoccEj1UWKzk_Rz-tvc1U Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:44.563066 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5063060fcc66473ba0c329aceb560008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5063060fcc66473ba0c329aceb560008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5063060fcc66473ba0c329aceb560008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5063060fcc66473ba0c329aceb560008 Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244726532 Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c471d1f448fe493d9f1654f3122f9a1f Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244726532-project Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: {"remove_host": {"host": "n-h1-master-1"}} Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:44.564665 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:44.565508 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 18 01:00:44.567097 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.572217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eac719cc-0d63-43da-843a-eb32cf385982 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:44.573671 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eac719cc-0d63-43da-843a-eb32cf385982 tempest-AggregatesAdminNegativeTestJSON-244726532 tempest-AggregatesAdminNegativeTestJSON-244726532-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.041625 Sep 18 01:00:44.579139 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 129/255] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:44 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:44.588272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-320e44ab-1836-413d-931f-1f3e61e444eb tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.605378 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-320e44ab-1836-413d-931f-1f3e61e444eb tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-320e44ab-1836-413d-931f-1f3e61e444eb tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Request method failure captured: Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2M5QkmXoqefIJc8pWawxlyB7A-1UIINQ4NYastxv8h2lX3rfbsKO08-9xbqgMHexwHsSf3EIlBYwc5IL8udGyWiCxwWpsWYna4F0xjQciNdasxgvwP4PAyrtD8H0tagDNDW6tiuuUjB8n2lJ0eS-N85HlE4qZuqF40EJCXnM1TdaU Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:44.607465 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 2a088226fad4442aa7be2cc8b5a85836 Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: exception: Aggregate 12 could not be found. Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '12'} Sep 18 01:00:44.608921 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:44.609798 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:44.611070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:44.612561 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:44.612561 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:44.612561 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:44.612561 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 18 01:00:44.612561 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:44.619637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-320e44ab-1836-413d-931f-1f3e61e444eb tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:44.620787 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-320e44ab-1836-413d-931f-1f3e61e444eb tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.040331 Sep 18 01:00:44.622011 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 130/256] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:44.632048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7793283f-085c-4d8d-baa5-32fa193b25c6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:44.649606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7793283f-085c-4d8d-baa5-32fa193b25c6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.650055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7793283f-085c-4d8d-baa5-32fa193b25c6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.650497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7793283f-085c-4d8d-baa5-32fa193b25c6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.806750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7793283f-085c-4d8d-baa5-32fa193b25c6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.182862 Sep 18 01:00:44.807950 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 131/257] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:44 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:44.813435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9967aed-78c7-40b1-a221-ed29042bdd4d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-720604054", "name": "tempest-test_aggregate-2131395995"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:44.836787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-f9967aed-78c7-40b1-a221-ed29042bdd4d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid eaf57fe1-9640-45fa-af1f-92a42a46cd21 for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:44.868939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f9967aed-78c7-40b1-a221-ed29042bdd4d tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.059718 Sep 18 01:00:44.870050 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 132/258] 10.222.0.25 () {60 vars in 1165 bytes} [Sun Sep 18 01:00:44 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:44.876568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-14b5f97f-6ba6-4655-8097-ebf6b3cec0e2 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.909954 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-14b5f97f-6ba6-4655-8097-ebf6b3cec0e2 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.038627 Sep 18 01:00:44.910799 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 133/259] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:44 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:44.916882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c935e1b-b773-4be7-b58d-54164cd11bc8 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.941926 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c935e1b-b773-4be7-b58d-54164cd11bc8 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.029541 Sep 18 01:00:44.943276 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 134/260] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:44 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:44.957245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-44b67a2e-9260-40e8-8a0c-f595073a7bec tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-340961962"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:44.968769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.aggregate [None req-44b67a2e-9260-40e8-8a0c-f595073a7bec tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Generated uuid 94bd5948-4bdb-4b70-8023-2197a1c039e7 for aggregate {{(pid=122373) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:45.005522 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-44b67a2e-9260-40e8-8a0c-f595073a7bec tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060992 Sep 18 01:00:45.012666 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 135/261] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:45.017826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7deee27c-9af3-4c47-a542-03892de96980 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.025841 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-7deee27c-9af3-4c47-a542-03892de96980 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7deee27c-9af3-4c47-a542-03892de96980 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Request method failure captured: Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2M5QkmXoqefIJc8pWawxlyB7A-1UIINQ4NYastxv8h2lX3rfbsKO08-9xbqgMHexwHsSf3EIlBYwc5IL8udGyWiCxwWpsWYna4F0xjQciNdasxgvwP4PAyrtD8H0tagDNDW6tiuuUjB8n2lJ0eS-N85HlE4qZuqF40EJCXnM1TdaU Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:45.027566 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 2a088226fad4442aa7be2cc8b5a85836 Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: exception: Aggregate 14 could not be found. Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '14'} Sep 18 01:00:45.030513 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.033203 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 18 01:00:45.035737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.038040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7deee27c-9af3-4c47-a542-03892de96980 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:45.038040 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7deee27c-9af3-4c47-a542-03892de96980 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.015701 Sep 18 01:00:45.038040 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 136/262] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:45.038469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:45.039530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:45.044088 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af4409a9-57c4-4b52-ae52-a3cef9639f58 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1319 microversion: 2.1 time: 0.525820 Sep 18 01:00:45.044675 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 127/263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:44 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:45.058203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.058203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.058203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.058729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.059398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.059878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.066468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed3cd157-57f8-4bec-8078-feec7355e519 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.068716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.compute.aggregates [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 18 01:00:45.069651 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Request method failure captured: Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 42 Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2LmVGQ2egI6VHR0w7r07PGiOeJeFnFZ9y305hhYU1zV1XXddFJNxQgwZ7RJf_EJ4dGJhFOPHp-RTvcjbrjWPNdsyKyVHaLrQVmNqisgRxAFvBB30DjzmW_2e7tw190_mZm5Sp56MIxX8tDGIb054elKaipncqlyQNe4HeT1fEc07c Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:45.071993 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef66fd5cd9104478a8402ecb7c679694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ef66fd5cd9104478a8402ecb7c679694 Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428 Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 496391e7f8414772a37a8a12ffc2c78f Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: {"remove_host": {"host": "nonexist_host"}} Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:45.073425 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot remove host nonexist_host in aggregate 15 Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 18 01:00:45.074396 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 18 01:00:45.076940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.078402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.079748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.079748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.079748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:45.079748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:45.079748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Sep 18 01:00:45.079748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.083090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:45.084658 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-952d7894-baff-4d18-b508-35cd2a31c6a6 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.053330 Sep 18 01:00:45.093070 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 137/264] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:45 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:45.097608 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ed3cd157-57f8-4bec-8078-feec7355e519 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed3cd157-57f8-4bec-8078-feec7355e519 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Request method failure captured: Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2M5QkmXoqefIJc8pWawxlyB7A-1UIINQ4NYastxv8h2lX3rfbsKO08-9xbqgMHexwHsSf3EIlBYwc5IL8udGyWiCxwWpsWYna4F0xjQciNdasxgvwP4PAyrtD8H0tagDNDW6tiuuUjB8n2lJ0eS-N85HlE4qZuqF40EJCXnM1TdaU Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:00:45.100357 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aed480bbb7a4c35ba6e6ab64c66bd81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1aed480bbb7a4c35ba6e6ab64c66bd81 Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-357642069 Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 2a088226fad4442aa7be2cc8b5a85836 Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AggregatesAdminTestJSON-357642069-project-admin Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: exception: Aggregate 14 could not be found. Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '14'} Sep 18 01:00:45.103263 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:00:45.104161 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.105148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.106275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.106275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:45.106275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:45.106275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 18 01:00:45.106275 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.106275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed3cd157-57f8-4bec-8078-feec7355e519 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:45.106275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed3cd157-57f8-4bec-8078-feec7355e519 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.041476 Sep 18 01:00:45.109111 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 128/265] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:45.112711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.113661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:45.114103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00a5cf53-180b-471e-91ba-9bb788977213 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.124684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.125582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.126353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.127929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.129000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.129814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.152112 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00a5cf53-180b-471e-91ba-9bb788977213 tempest-AggregatesAdminNegativeTestJSON-1441775428 tempest-AggregatesAdminNegativeTestJSON-1441775428-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.041685 Sep 18 01:00:45.153744 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 129/266] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:45.164741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5419df62-4b2c-4e8a-b112-ab5e0139b578 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1845117695"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:45.170759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-5419df62-4b2c-4e8a-b112-ab5e0139b578 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid 5ed0a0bb-f1a0-44d7-a884-841ad64f71d6 for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:45.206877 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5419df62-4b2c-4e8a-b112-ab5e0139b578 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046101 Sep 18 01:00:45.216058 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 130/267] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:45.229169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.230076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:45.241455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.242115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.242689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.244130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.244720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.245263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.798347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:45.811796 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-21afddc9-8207-430d-9b26-54f8c74bd414 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.720791 Sep 18 01:00:45.813119 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 138/268] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:45.827882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b80647a7-bfff-433d-9b9d-125dfe458c69 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.845422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:45.856012 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b80647a7-bfff-433d-9b9d-125dfe458c69 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.039613 Sep 18 01:00:45.858607 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 139/269] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:45.859796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8850106-36c8-4ac0-8ce8-a726dc0481b1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1387 microversion: 2.1 time: 0.642434 Sep 18 01:00:45.860391 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 131/270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1387 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:45.868405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ca2ffacf-02d2-4ffa-90c9-15fbe09d3291 req-cd3c3268-b314-413d-a4d5-079c7770404c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688259fb-cde6-4154-a702-3edad886467d", "tag": "f2b20dd4-d338-4144-9bce-e7713f8e01f2"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:45.874642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.875409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:45.883720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca2ffacf-02d2-4ffa-90c9-15fbe09d3291 req-cd3c3268-b314-413d-a4d5-079c7770404c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.885079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca2ffacf-02d2-4ffa-90c9-15fbe09d3291 req-cd3c3268-b314-413d-a4d5-079c7770404c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.885750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca2ffacf-02d2-4ffa-90c9-15fbe09d3291 req-cd3c3268-b314-413d-a4d5-079c7770404c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.887455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.893097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.893722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.894555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.895412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.895642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.907677 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ca2ffacf-02d2-4ffa-90c9-15fbe09d3291 req-cd3c3268-b314-413d-a4d5-079c7770404c service nova] Creating event network-changed:f2b20dd4-d338-4144-9bce-e7713f8e01f2 for instance 688259fb-cde6-4154-a702-3edad886467d on n-h1-master-1 Sep 18 01:00:45.914900 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ca2ffacf-02d2-4ffa-90c9-15fbe09d3291 req-cd3c3268-b314-413d-a4d5-079c7770404c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054149 Sep 18 01:00:45.915506 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 140/271] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:45.922657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.924687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:45.939679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.941378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.943021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.945192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.946467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.947527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.989704 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:46.020415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:46.040249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:46.042320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:46.051087 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a206860-fe57-46d6-a049-2c7456eb6048 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.189469 Sep 18 01:00:46.052694 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 132/272] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:46.072926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb0e6a59-9e08-437e-ae1f-bd416027088c tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.123154 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb0e6a59-9e08-437e-ae1f-bd416027088c tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.067329 Sep 18 01:00:46.124255 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 133/273] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:00:46 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:46.267680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:46.282891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c764602b-7391-4ba4-b45f-bd9b2399b52b tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1320 microversion: 2.1 time: 0.365918 Sep 18 01:00:46.298731 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 141/274] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:46.303741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:46.305403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:46.324315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.326375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.327616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.329369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.330410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.331331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.365418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3455366e-a123-4e39-b8a1-3029783bb1da tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Action: 'create', calling method: .version_select at 0x7f7006dd1670>, body: {"keypair": {"name": "tempest-keypair-227432096", "type": "ssh", "user_id": "7dcf0906eda94fc3a39a577a9030bc82", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoZEHCg7SGZz8a8HRkupAYT3Dri214c/DSH2THk3i5iw05ahSKzMTjVv9dNlSkrOUQRHqazoaVHImqfNN/NsL5G5+WSodlDx8u75SRXomhc7Jslc50bXKHlK7ChmbaAOQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.383221 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=39 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:46.390520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3455366e-a123-4e39-b8a1-3029783bb1da tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Getting quotas for project ca9352aa2c8f46618819fe5013add23e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:46.395172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3455366e-a123-4e39-b8a1-3029783bb1da tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Getting quotas for user ca6b21f26826472f9ea4e201979ede2b and project ca9352aa2c8f46618819fe5013add23e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:46.426018 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3455366e-a123-4e39-b8a1-3029783bb1da tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.299624 Sep 18 01:00:46.427791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 134/275] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:00:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 303 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:00:46.437480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74ff642e-25c6-41d5-b5c4-50f1e282073c tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:46.451574 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74ff642e-25c6-41d5-b5c4-50f1e282073c tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.022362 Sep 18 01:00:46.459297 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 135/276] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:00:46 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:46.466596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88288afe-a91c-4097-8738-fd47bfdd8a72 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Action: 'create', calling method: .version_select at 0x7f7006fc5430>, body: {"keypair": {"name": "tempest-keypair-1927753244", "type": "ssh", "user_id": "7dcf0906eda94fc3a39a577a9030bc82", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/OqO/nzZMWtSJHs6DUZ4muChQO+8XzUauimtckVZ5YZwTZTX8mYtfiZb1McQQBWE49wBx8QT5aYNaRahNZKiuNEeODGrIYohCxam8w2z/7VmM4tPvITYHbhf/KLrcvqQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.484081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-88288afe-a91c-4097-8738-fd47bfdd8a72 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Getting quotas for project ca9352aa2c8f46618819fe5013add23e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:46.488696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-88288afe-a91c-4097-8738-fd47bfdd8a72 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Getting quotas for user ca6b21f26826472f9ea4e201979ede2b and project ca9352aa2c8f46618819fe5013add23e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:46.531262 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88288afe-a91c-4097-8738-fd47bfdd8a72 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.070080 Sep 18 01:00:46.534789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 136/277] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:00:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:00:46.550679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bcdd0bd9-a8b9-4f22-93ef-56409cdcaeba tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:46.592222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:46.603376 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-609f6f3c-9c3e-498e-b2a7-e03b4947b574 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1469 microversion: 2.1 time: 0.309489 Sep 18 01:00:46.604919 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 142/278] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:46 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1469 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:46.616085 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bcdd0bd9-a8b9-4f22-93ef-56409cdcaeba tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.077442 Sep 18 01:00:46.633174 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 137/279] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:46 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:46.635269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3c4adbae-7846-48c8-88c5-1a78c5547c03 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Calling method '.version_select at 0x7f7006d660d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:46.644940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a1525764-7b7b-4368-a27a-1a3d307dee04 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-319469993", "availability_zone": "tempest-test_az-821913536"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.654983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-a1525764-7b7b-4368-a27a-1a3d307dee04 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid e7b3b089-382a-44de-bce3-7d2b3e1a4fb3 for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:46.665032 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3c4adbae-7846-48c8-88c5-1a78c5547c03 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-227432096?user_id=7dcf0906eda94fc3a39a577a9030bc82" status: 200 len: 511 microversion: 2.10 time: 0.049509 Sep 18 01:00:46.666046 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 143/280] 10.222.0.25 () {60 vars in 1337 bytes} [Sun Sep 18 01:00:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-227432096?user_id=7dcf0906eda94fc3a39a577a9030bc82 => generated 511 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:46.704407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a1525764-7b7b-4368-a27a-1a3d307dee04 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.069608 Sep 18 01:00:46.705732 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 138/281] 10.222.0.25 () {60 vars in 1165 bytes} [Sun Sep 18 01:00:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:46.710794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a77214b-6dc2-4e92-8ed6-d902bfe1af07 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Action: 'create', calling method: .version_select at 0x7f7006d69ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2145796517", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUh4GOvIyQ5cqSrl5tcPIjMNS2x4S3K0UXaGmWPRDQajfnD1wCxB22x5G/vAC6PAkuiJm9Z4iKCQG9D3wucw/uO/G87S5+pu36Ta1aGQQxxaOpm9tRt8J+EL40TD8XAsg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.734275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-9a77214b-6dc2-4e92-8ed6-d902bfe1af07 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Getting quotas for project ca9352aa2c8f46618819fe5013add23e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:46.738954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-9a77214b-6dc2-4e92-8ed6-d902bfe1af07 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Getting quotas for user ca6b21f26826472f9ea4e201979ede2b and project ca9352aa2c8f46618819fe5013add23e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:46.791510 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a77214b-6dc2-4e92-8ed6-d902bfe1af07 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.084230 Sep 18 01:00:46.794321 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 139/282] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:00:46 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:00:46.800459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-25024133-7006-4dee-936f-aa22ae180aa2 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-319469993_new", "availability_zone": "tempest-test_az-821913536_new"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.855848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25024133-7006-4dee-936f-aa22ae180aa2 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.857179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25024133-7006-4dee-936f-aa22ae180aa2 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.857804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25024133-7006-4dee-936f-aa22ae180aa2 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.886980 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:46.905348 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-25024133-7006-4dee-936f-aa22ae180aa2 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.109933 Sep 18 01:00:46.907886 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 140/283] 10.222.0.25 () {60 vars in 1173 bytes} [Sun Sep 18 01:00:46 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:46.917839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2cfb0bbf-3b59-4df5-8043-8e114c559cb4 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Calling method '.version_select at 0x7f7006f23c10>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:46.920528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1574988617", "block_migration": true, "disk_over_commit": false}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.923898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:46.927957 n-d-master-1 devstack@n-api.service[122374]: WARNING oslo_db.sqlalchemy.utils [None req-2cfb0bbf-3b59-4df5-8043-8e114c559cb4 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 18 01:00:46.930904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.931613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.932485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.933465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.934216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.934943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.946564 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2cfb0bbf-3b59-4df5-8043-8e114c559cb4 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=7dcf0906eda94fc3a39a577a9030bc82" status: 200 len: 725 microversion: 2.10 time: 0.036201 Sep 18 01:00:46.955841 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 141/284] 10.222.0.25 () {60 vars in 1259 bytes} [Sun Sep 18 01:00:46 2022] GET /compute/v2.1/os-keypairs?user_id=7dcf0906eda94fc3a39a577a9030bc82 => generated 725 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:46.958663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:46.960415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:46.976462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.977527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.978438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.980576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.981635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.982566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.026514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lazy-loading 'flavor' on Instance uuid 93bb6390-00c2-4008-a004-9ef029cc06c1 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:47.097693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Going to try to live migrate instance to tempest-host-1574988617 {{(pid=122373) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:00:47.107704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] HTTP exception thrown: Compute host tempest-host-1574988617 could not be found. Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Request method failure captured: Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1/action HTTP/1.1 Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 107 Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2m7KcGOQ-ui1KEUK-IToK4JWiwff2tnH3yvpmPTibAY-7dbS0Jo21TCuJzu3E9BWb-z_mp_EDbPhddIVFjpgHDitULIAxiq3X4gtygk-uoNziEA68Sim9GaM2d-NvaVSxupiUzhcZ1h4AM951cU_Z0RPDaJRnVDj5KfqhEOOJSb8Y Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 325768c3525246e791e7cef1c2e8c2c2 Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-LiveMigrationNegativeTest-180530853 Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:00:47.111848 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-LiveMigrationNegativeTest-180530853 Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 325768c3525246e791e7cef1c2e8c2c2 Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-180530853 Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-LiveMigrationNegativeTest-180530853-project-admin Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 04e4f6ad90104efa9a466d0d9d655fbc Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-LiveMigrationNegativeTest-180530853-project-admin Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: {"os-migrateLive": {"host": "tempest-host-1574988617", "block_migration": true, "disk_over_commit": false}} Sep 18 01:00:47.113354 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: exception: Compute host tempest-host-1574988617 could not be found. Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '93bb6390-00c2-4008-a004-9ef029cc06c1', 'body': {'os-migrateLive': {'host': 'tempest-host-1574988617', 'block_migration': True, 'disk_over_commit': False}}} Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:00:47.114206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1574988617 could not be found. Sep 18 01:00:47.115513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1574988617 could not be found. Sep 18 01:00:47.116727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1574988617 could not be found. Sep 18 01:00:47.118034 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:47.119532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Returning 400 to user: Compute host tempest-host-1574988617 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:47.121006 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d4b02af0-e361-4a16-b3ec-50c14e2d1090 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1/action" status: 400 len: 100 microversion: 2.1 time: 0.453606 Sep 18 01:00:47.127956 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 144/285] 10.222.0.25 () {60 vars in 1279 bytes} [Sun Sep 18 01:00:46 2022] POST /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1/action => generated 100 bytes in 461 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:00:47.138326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.139490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:47.150673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.151707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.152968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.154558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.155336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.156151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.260085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.272070 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ef28d7ae-5fb6-4bbc-89f4-fa77aebceab4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.322154 Sep 18 01:00:47.272948 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 142/286] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:46 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:47.293884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a19eed6-b4fd-4fdc-ba25-93c0d9ac0d77 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.302950 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a19eed6-b4fd-4fdc-ba25-93c0d9ac0d77 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.012911 Sep 18 01:00:47.303754 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 143/287] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:00:47 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:47.309421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-779c745c-ef6d-4c5d-aee1-f2a8b017847a tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Calling method '.version_select at 0x7f7007159160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.336270 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-779c745c-ef6d-4c5d-aee1-f2a8b017847a tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2145796517" status: 204 len: 0 microversion: 2.10 time: 0.031234 Sep 18 01:00:47.337689 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 144/288] 10.222.0.25 () {60 vars in 1325 bytes} [Sun Sep 18 01:00:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2145796517 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:00:47.345681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.346581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:47.357459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.358315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.358943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.360346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.361104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.362308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.424512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.442666 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-837caddd-92d2-4907-a2d3-aa133693e649 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1586 microversion: 2.1 time: 0.312724 Sep 18 01:00:47.444411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 145/289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:47 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1586 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:47.453323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.454590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:47.462850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.463917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.464658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.466737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.467816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.468930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.529032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.547689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.549524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.555449 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9b4324fe-7faa-4dc6-bef5-b07cc137b138 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.216836 Sep 18 01:00:47.556154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 145/290] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:47 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:47.568208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.572096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:47.587355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.588365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.588982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.590335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.591471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.592524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.618776 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:47.802196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.815027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9101c5f1-2c05-4374-86d2-b0b049792590 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1469 microversion: 2.1 time: 0.369102 Sep 18 01:00:47.816284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 146/291] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:47 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1469 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:47.830071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-620c60d1-3595-41ea-8a99-0cdfe656f2fd tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.876024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.886951 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0158282b-0870-4cb6-8424-0c66db0cc74e tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1320 microversion: 2.1 time: 0.327903 Sep 18 01:00:47.901584 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 146/292] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:47 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:47.901898 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65a70734-b2dd-4c0a-b2e1-6d29f188f833 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Calling method '.version_select at 0x7f700732b160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.921449 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-620c60d1-3595-41ea-8a99-0cdfe656f2fd tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.100938 Sep 18 01:00:47.923501 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 147/293] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:47 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:00:47.938036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.938791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:47.947770 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65a70734-b2dd-4c0a-b2e1-6d29f188f833 tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927753244?user_id=7dcf0906eda94fc3a39a577a9030bc82" status: 204 len: 0 microversion: 2.10 time: 0.056439 Sep 18 01:00:47.948766 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 147/294] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:00:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927753244?user_id=7dcf0906eda94fc3a39a577a9030bc82 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:00:47.952719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.953364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.953927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.954513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.954961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.955377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.962380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a2949c5b-d03a-4c04-ad6c-028d45b8ce0f tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1368583000"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:47.972687 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-a2949c5b-d03a-4c04-ad6c-028d45b8ce0f tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Generated uuid 0afafc13-bccc-478a-88c8-d883a2f29216 for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:00:48.026371 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a2949c5b-d03a-4c04-ad6c-028d45b8ce0f tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074677 Sep 18 01:00:48.030062 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 148/295] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:00:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:48.036277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0919f3f9-a7bf-4718-a062-7c3cacdecbad tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] Calling method '.version_select at 0x7f70070ed3a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.081378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0919f3f9-a7bf-4718-a062-7c3cacdecbad tempest-KeyPairsV210TestJSON-491473299 tempest-KeyPairsV210TestJSON-491473299-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227432096?user_id=7dcf0906eda94fc3a39a577a9030bc82" status: 204 len: 0 microversion: 2.10 time: 0.049725 Sep 18 01:00:48.087209 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 149/296] 10.222.0.25 () {60 vars in 1340 bytes} [Sun Sep 18 01:00:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227432096?user_id=7dcf0906eda94fc3a39a577a9030bc82 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:00:48.093433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-875178426", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:48.131975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b94c5cd-159d-4baf-b268-7b1154085826 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206999 Sep 18 01:00:48.132698 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 148/297] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:00:47 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:48.138668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c65a9cb4-5051-4e1b-8171-d1938f7778b6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.153625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:48.173903 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c65a9cb4-5051-4e1b-8171-d1938f7778b6 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.039862 Sep 18 01:00:48.174763 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 149/298] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:00:48 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:48.186231 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1cd0dcc-0c8f-4f9c-97a4-1403b7b76e49 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.210872 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1cd0dcc-0c8f-4f9c-97a4-1403b7b76e49 tempest-AggregatesAdminTestJSON-357642069 tempest-AggregatesAdminTestJSON-357642069-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.028105 Sep 18 01:00:48.211774 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 150/299] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:00:48 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 18 01:00:48.224699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.225665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:48.234518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.235113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.235683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.236491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.237043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.237626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.257902 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] HTTP exception thrown: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Request method failure captured: Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 HTTP/1.1 Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2JAeAs6BOKBAIJlPiY3SRBGRYqIU9raQ1J2uLTzFerKFpazaJIepb40LIk5opfv9rSXppMs3Qo7N29kJKh2P-vbflotap99EmsAoAZfH5y8a7GgkylwE-92kAQkvHOy9f3c2w_CGbr7izGBlAJybtjM0lQMaX5iGoly4sSoZIQvKo Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: e9933df3eac04c98b2b9d4fc0faf8661 Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:48.264010 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: e9933df3eac04c98b2b9d4fc0faf8661 Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminTestJSON-689481468-project Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 198c87e49acc41bcaf1f3e5b4d24ab7a Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminTestJSON-689481468-project Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: exception: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.265290 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4'} Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:48.266112 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.272951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.274032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Returning 404 to user: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:48.274032 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77f33e51-0daa-415e-be4e-39420361486a tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 404 len: 111 microversion: 2.1 time: 0.048380 Sep 18 01:00:48.274032 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 151/300] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:00:48 2022] DELETE /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:48.274549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.275323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] [instance: e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:48.281728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.282203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.282870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.283929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.284412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.284830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.304140 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] HTTP exception thrown: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Request method failure captured: Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 HTTP/1.1 Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2JAeAs6BOKBAIJlPiY3SRBGRYqIU9raQ1J2uLTzFerKFpazaJIepb40LIk5opfv9rSXppMs3Qo7N29kJKh2P-vbflotap99EmsAoAZfH5y8a7GgkylwE-92kAQkvHOy9f3c2w_CGbr7izGBlAJybtjM0lQMaX5iGoly4sSoZIQvKo Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: e9933df3eac04c98b2b9d4fc0faf8661 Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:48.306016 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9933df3eac04c98b2b9d4fc0faf8661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: e9933df3eac04c98b2b9d4fc0faf8661 Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-689481468 Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AggregatesAdminTestJSON-689481468-project Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 198c87e49acc41bcaf1f3e5b4d24ab7a Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AggregatesAdminTestJSON-689481468-project Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: exception: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.313204 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4'} Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:48.314209 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. Sep 18 01:00:48.317760 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:48.321305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] Returning 404 to user: Instance e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:48.321305 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54d37da9-6bfe-4c60-9063-92b93bf68086 tempest-AggregatesAdminTestJSON-689481468 tempest-AggregatesAdminTestJSON-689481468-project] 10.222.0.25 "GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4" status: 404 len: 111 microversion: 2.1 time: 0.037223 Sep 18 01:00:48.321305 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 152/301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:48 2022] GET /compute/v2.1/servers/e2c5117c-5db7-4cf5-a2e8-a18ede38f6a4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:48.328383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.328994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:48.340351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.345845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.346532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.347432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.348056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.348487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.567441 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:48.769822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:48.781437 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aed6fcb5-625e-4107-8d99-f0489cecd86b tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.467171 Sep 18 01:00:48.782413 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 153/302] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:48 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:48.789364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.790440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:48.818476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.819435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.821892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.822840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.825957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.826641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.889523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:48.890467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:48.891253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:48.891842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:48.892774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:48.921702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.924272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.924771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.925650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.926299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.926877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.953541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Getting quotas for project 4e98321089b343359e9ae05ad97b8372. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:48.958059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Getting quotas for user c06c8778aeff44d2ba7a3a36336b32a3 and project 4e98321089b343359e9ae05ad97b8372. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:48.971690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:48.974135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:49.036852 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-780aac3f-d99b-40ae-bf86-a0fe9254ae4a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952417 Sep 18 01:00:49.037903 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 150/303] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:00:49.043518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:49.045813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:49.054489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:49.055652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:49.056378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:49.057379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:49.058273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:49.059102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:49.288662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:49.304773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:49.310371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:49.330389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc2b31cf-dc6e-404a-9382-35e4c230d876 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.540564 Sep 18 01:00:49.333254 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 154/304] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:48 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:49.347874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-310137af-16ef-42b8-9b6d-53d39a107892 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:49.348567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-310137af-16ef-42b8-9b6d-53d39a107892 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:49.834824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-310137af-16ef-42b8-9b6d-53d39a107892 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:49.848923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-310137af-16ef-42b8-9b6d-53d39a107892 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1218 microversion: 2.1 time: 0.513756 Sep 18 01:00:49.849736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:49.850934 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 155/305] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:49 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1218 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:49.858608 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-155c5403-0f71-48fc-9980-494e0b3b0cb0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1320 microversion: 2.1 time: 0.819222 Sep 18 01:00:49.874778 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 151/306] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:49 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1320 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:49.880197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d80cbd63-b388-419e-8a17-21d38ee0561f req-c8c073a5-db4b-4881-86c1-f66248d1e779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d48a9cd-b662-4a76-a839-5174b05a84ad", "name": "network-vif-plugged", "status": "completed", "tag": "70d92a14-d071-4798-8f7e-6d813868a5bc"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:49.909956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:49.910642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:49.924632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d80cbd63-b388-419e-8a17-21d38ee0561f req-c8c073a5-db4b-4881-86c1-f66248d1e779 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:49.925052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:49.925583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:49.928869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d80cbd63-b388-419e-8a17-21d38ee0561f req-c8c073a5-db4b-4881-86c1-f66248d1e779 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:49.930159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d80cbd63-b388-419e-8a17-21d38ee0561f req-c8c073a5-db4b-4881-86c1-f66248d1e779 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:49.931224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:49.932132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:49.932597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:49.933018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:49.972089 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d80cbd63-b388-419e-8a17-21d38ee0561f req-c8c073a5-db4b-4881-86c1-f66248d1e779 service nova] Creating event network-vif-plugged:70d92a14-d071-4798-8f7e-6d813868a5bc for instance 6d48a9cd-b662-4a76-a839-5174b05a84ad on n-h2-master-1 Sep 18 01:00:49.987405 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d80cbd63-b388-419e-8a17-21d38ee0561f req-c8c073a5-db4b-4881-86c1-f66248d1e779 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133213 Sep 18 01:00:49.995633 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 156/307] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:50.369629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:50.370665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:50.378148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.379125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.380300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:50.381482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.382167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.382841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:50.406004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:50.414072 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-591c72d7-69ac-4d83-97a5-5fd11406ba99 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.535609 Sep 18 01:00:50.414659 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 152/308] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:49 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:50.498592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:50.514158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:50.515962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:50.522292 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-93c93c48-cc98-4bca-8020-3bd2878fb0fe tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.157258 Sep 18 01:00:50.532231 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 157/309] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:50 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:00:50.884283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:50.885533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:50.894423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:50.896412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:50.899682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.900551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.901211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:50.904074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.905843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.908904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:50.921596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.933254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.933983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:50.935316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.936209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.953078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.232473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:51.254412 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e44657b3-7db6-432a-99cb-4c90227159d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1270 microversion: 2.1 time: 0.376170 Sep 18 01:00:51.259599 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 153/310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:50 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1270 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:51.275210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:51.284345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:51.298343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.299209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.299950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.301195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.307161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.307989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.492175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:51.514755 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e47ca6e-a1ec-4811-af18-c155e76508db tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1320 microversion: 2.1 time: 0.628774 Sep 18 01:00:51.525389 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 158/311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:50 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1320 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:51.536960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-940e57f6-bbe8-4bc7-aa5b-dd8143b23bed req-f7d80511-ceb5-4a89-acaa-b027f7e3290a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb", "tag": "9ef5e8d7-9fc6-42de-a794-b93e06378934"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:51.604214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-940e57f6-bbe8-4bc7-aa5b-dd8143b23bed req-f7d80511-ceb5-4a89-acaa-b027f7e3290a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.605069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-940e57f6-bbe8-4bc7-aa5b-dd8143b23bed req-f7d80511-ceb5-4a89-acaa-b027f7e3290a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.605875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-940e57f6-bbe8-4bc7-aa5b-dd8143b23bed req-f7d80511-ceb5-4a89-acaa-b027f7e3290a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.669168 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-940e57f6-bbe8-4bc7-aa5b-dd8143b23bed req-f7d80511-ceb5-4a89-acaa-b027f7e3290a service nova] Creating event network-changed:9ef5e8d7-9fc6-42de-a794-b93e06378934 for instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb on n-h2-master-1 Sep 18 01:00:51.682891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-940e57f6-bbe8-4bc7-aa5b-dd8143b23bed req-f7d80511-ceb5-4a89-acaa-b027f7e3290a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154180 Sep 18 01:00:51.689695 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 159/312] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:51.803865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:51.819984 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1bb597e8-930e-4efe-ab3d-04c43385e444 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 200 len: 1586 microversion: 2.1 time: 0.558993 Sep 18 01:00:51.821324 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 154/313] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:51 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 1586 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:51.837539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:51.838553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:51.851452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.852294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.852739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.853466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.853967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.854396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.275485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-263854db-d443-47cb-a8c8-475eb55b619e tempest-AZAdminNegativeTestJSON-1510412732 tempest-AZAdminNegativeTestJSON-1510412732-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:52.279698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-263854db-d443-47cb-a8c8-475eb55b619e tempest-AZAdminNegativeTestJSON-1510412732 tempest-AZAdminNegativeTestJSON-1510412732-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'aa820146d99f405f9e0f10e7f50988c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5860f65d57ca457bbd7bf7bcd2d3ba7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-263854db-d443-47cb-a8c8-475eb55b619e tempest-AZAdminNegativeTestJSON-1510412732 tempest-AZAdminNegativeTestJSON-1510412732-project] Request method failure captured: Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3BE9IJc-WyJECHxbyAfYbw6BisCekSzgRplsf98xS2-_H6_2aHRQCWqdBnHxqI0J--BymKkqNV_YisR28ImLGlbDEyFGbjIMSciwZL6hPXW_EmWy9EnK54O89SSFsQOJOWpJJD7JlDpYkD4D9f4OzqQM77x10OFany7NSxS5jRPwg Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5860f65d57ca457bbd7bf7bcd2d3ba7e Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1510412732 Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:00:52.286312 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5860f65d57ca457bbd7bf7bcd2d3ba7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5860f65d57ca457bbd7bf7bcd2d3ba7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5860f65d57ca457bbd7bf7bcd2d3ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5860f65d57ca457bbd7bf7bcd2d3ba7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AZAdminNegativeTestJSON-1510412732 Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5860f65d57ca457bbd7bf7bcd2d3ba7e Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1510412732 Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AZAdminNegativeTestJSON-1510412732-project Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: aa820146d99f405f9e0f10e7f50988c5 Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AZAdminNegativeTestJSON-1510412732-project Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 18 01:00:52.287791 n-d-master-1 devstack@n-api.service[122373]: action_args: {} Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:00:52.288468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 18 01:00:52.289484 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:00:52.293049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-263854db-d443-47cb-a8c8-475eb55b619e tempest-AZAdminNegativeTestJSON-1510412732 tempest-AZAdminNegativeTestJSON-1510412732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:52.294621 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-263854db-d443-47cb-a8c8-475eb55b619e tempest-AZAdminNegativeTestJSON-1510412732 tempest-AZAdminNegativeTestJSON-1510412732-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.602177 Sep 18 01:00:52.295500 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 160/314] 10.222.0.25 () {58 vars in 1185 bytes} [Sun Sep 18 01:00:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 605 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:52.308186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:52.309809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:52.321632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:52.322351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:52.323179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.324913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:52.325626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:52.326389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.532041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:52.555346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:52.560929 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:52.578289 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3a64231-9342-4ee9-a462-cf893d4df3ae tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.275150 Sep 18 01:00:52.598077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:52.610522 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 161/315] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:52 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:52.614984 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac2232c3-e5b5-4a9e-8532-b0aa8d6d1999 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1317 microversion: 2.1 time: 0.789784 Sep 18 01:00:52.618485 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 155/316] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:51 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:52.624093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2383e389-e65e-43c8-b097-e5623a01ec41 req-9a9fc887-1efe-4028-8347-a11ff1e29649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688259fb-cde6-4154-a702-3edad886467d", "name": "network-vif-plugged", "status": "completed", "tag": "f2b20dd4-d338-4144-9bce-e7713f8e01f2"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:52.645456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2383e389-e65e-43c8-b097-e5623a01ec41 req-9a9fc887-1efe-4028-8347-a11ff1e29649 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:52.646164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2383e389-e65e-43c8-b097-e5623a01ec41 req-9a9fc887-1efe-4028-8347-a11ff1e29649 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:52.646731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2383e389-e65e-43c8-b097-e5623a01ec41 req-9a9fc887-1efe-4028-8347-a11ff1e29649 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.652815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:52.657123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:52.659781 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2383e389-e65e-43c8-b097-e5623a01ec41 req-9a9fc887-1efe-4028-8347-a11ff1e29649 service nova] Creating event network-vif-plugged:f2b20dd4-d338-4144-9bce-e7713f8e01f2 for instance 688259fb-cde6-4154-a702-3edad886467d on n-h1-master-1 Sep 18 01:00:52.666849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2383e389-e65e-43c8-b097-e5623a01ec41 req-9a9fc887-1efe-4028-8347-a11ff1e29649 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054394 Sep 18 01:00:52.668108 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 162/317] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:52.680186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:52.681159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:52.692608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:52.693097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:52.693812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.694708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:52.695508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:52.696250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.699528 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:52.704778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:52.705793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:52.708731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.711445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:52.727538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:52.736979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:52.936624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:52.952550 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b56fc997-9c63-4cd4-9e88-cc85632700c2 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1276 microversion: 2.1 time: 0.331349 Sep 18 01:00:52.954521 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 156/318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:52 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1276 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:53.390851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:53.398859 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bed81d65-895b-43b3-a299-9b59b41553b9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1320 microversion: 2.1 time: 0.728400 Sep 18 01:00:53.407245 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 163/319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:52 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1320 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:53.636274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:53.638233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:53.650986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:53.652719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:53.665598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:53.667138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:53.675118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:53.676062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:53.676676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:53.677261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:53.678175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:53.679133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:53.681345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:53.682078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:53.682943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:53.685460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:53.957810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:53.978457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:53.982694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:54.008413 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dd707c61-ede2-4ae7-bb1f-20791fb49074 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.376971 Sep 18 01:00:54.009350 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 157/320] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:53 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:54.026078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:54.026862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:54.042730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:54.050392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.055394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.058387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:54.059368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.060051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.063954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:54.066359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d1c0a3d-c832-44f4-88de-2603dc7ea654 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1466 microversion: 2.1 time: 0.419766 Sep 18 01:00:54.070348 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 164/321] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:53 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1466 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:54.471121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:54.475682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:54.491306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.491914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.498291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:54.499216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.500753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.502302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:55.059057 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:55.169001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:55.183068 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a6d8d1a-99c7-49c8-9805-70c6754ed680 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 1.172214 Sep 18 01:00:55.189000 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 158/322] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:54 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:55.198513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:55.200591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:55.209838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:55.210708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:55.211428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:55.212564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:55.213875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:55.215112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:55.747805 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-429f4da1-70f3-4eff-9579-2eb065b91243 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1617 microversion: 2.1 time: 1.658806 Sep 18 01:00:55.765907 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 165/323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:54 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1617 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:55.843153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:55.852909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b5840e5-31bf-4ad2-aaba-feea447a2979 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1470 microversion: 2.1 time: 0.661233 Sep 18 01:00:55.872510 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 159/324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:55 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1470 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:55.879298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:55.880369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:55.887218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:55.888568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:55.889148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:55.890052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:55.890653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:55.891212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:56.099455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:56.112982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:56.119704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:56.132847 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-daf99ef3-98dd-4de1-8eec-c4e7e2deadea tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.259032 Sep 18 01:00:56.133831 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 160/325] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:55 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:56.138982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-506ea765-6c0d-4704-bab4-33d57a4f12c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: .version_select at 0x7f70071f9af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1206620419", "policies": ["affinity"]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:56.194549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-506ea765-6c0d-4704-bab4-33d57a4f12c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:56.199197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-506ea765-6c0d-4704-bab4-33d57a4f12c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:56.288475 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:56.318411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-506ea765-6c0d-4704-bab4-33d57a4f12c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:56.327873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-506ea765-6c0d-4704-bab4-33d57a4f12c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:56.332323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e6cb6c5-66e5-4c25-9529-e65c0281ab74 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-565856917", "id": 1079792871, "os-flavor-access:is_public": "True"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:56.354744 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-506ea765-6c0d-4704-bab4-33d57a4f12c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.219828 Sep 18 01:00:56.355858 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 161/326] 10.222.0.25 () {60 vars in 1174 bytes} [Sun Sep 18 01:00:56 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:56.361097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:56.376301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:56.382607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:56.383284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:56.383908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:56.388008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:56.388662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:56.389254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:56.404991 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e6cb6c5-66e5-4c25-9529-e65c0281ab74 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.636977 Sep 18 01:00:56.408539 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 166/327] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:55 2022] POST /compute/v2.1/flavors => generated 429 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:56.430191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:56.432019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:56.443686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:56.444976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:56.453808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:56.455787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:56.456830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:56.458149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:56.611775 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d66deab-1269-48ed-98c9-0b720085d613 tempest-DeleteServersAdminTestJSON-120071135 tempest-DeleteServersAdminTestJSON-120071135-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d/action" status: 202 len: 0 microversion: 2.1 time: 0.253851 Sep 18 01:00:56.613743 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 162/328] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:00:56 2022] POST /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:00:56.623964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8942d1d8-26b9-4041-87a5-76664e7ae9cf tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:56.671633 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8942d1d8-26b9-4041-87a5-76664e7ae9cf tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1079792871" status: 202 len: 0 microversion: 2.1 time: 0.054569 Sep 18 01:00:56.675078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 163/329] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:00:56 2022] DELETE /compute/v2.1/flavors/1079792871 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:00:56.691866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2077221453", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "084bc720-50cf-480b-8f0d-59acb60d5aa9"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:56.814449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:56.955453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:57.021319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e569e151-4bd6-41fb-ac7b-6477ea34b0c0 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 0.610849 Sep 18 01:00:57.046066 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 167/330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:56 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:57.057452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:57.058369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:57.079733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:57.080242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:57.080699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.081451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:57.082193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:57.082887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.172577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:57.174114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:57.174967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.175929 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lazy-loading 'fault' on Instance uuid 688259fb-cde6-4154-a702-3edad886467d {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:57.532752 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:57.543017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-29065f88-2136-405f-bf56-e0384391e96d tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1453 microversion: 2.1 time: 0.493069 Sep 18 01:00:57.544171 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 168/331] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:57 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1453 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:57.557774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-361c385b-e54b-4424-a211-381e2b838f68 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:57.653916 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-361c385b-e54b-4424-a211-381e2b838f68 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.106650 Sep 18 01:00:57.662874 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 169/332] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:57 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:57.696766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:57.711604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:57.736109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:57.736899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:57.738353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.740047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:57.740591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:57.741232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.898200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:57.916788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:57.919421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:57.926698 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c9a62a4e-9730-405b-abfa-55e653ca8faa tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.262656 Sep 18 01:00:57.949247 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 170/333] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:57 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:57.955063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:57.955926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:57.965731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:57.966642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:57.967294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.968235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:57.968894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:57.969708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.995561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:57.996324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:57.997579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:57.997579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:57.999073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:58.050983 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:00:58.071324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.073799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.074318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.075714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.080109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.080710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.127288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:58.131903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:58.174469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Going to run 2 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:58.186885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:58.228550 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fa7ac9df-4e7a-4531-aa12-ef49143ac70f tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 204 len: 0 microversion: 2.1 time: 0.277556 Sep 18 01:00:58.229444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 171/334] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:00:57 2022] DELETE /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:58.235139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8fe2a81d-a265-47e8-9db0-2427b337992b tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-137015255", "id": 1295634342, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:58.248943 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:58.266446 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8fe2a81d-a265-47e8-9db0-2427b337992b tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.034760 Sep 18 01:00:58.268606 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 172/335] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:58 2022] POST /compute/v2.1/flavors => generated 416 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:58.275693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c0615b65-2b17-4a18-bc92-9e7b85fe93a4 req-ba5c459b-d764-4611-bbdf-b4cc0be8bdfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba90c59c-d715-413b-9337-c7b7dec88ca7", "tag": "8e4beaff-2f6c-4190-82d2-d98bc44a57a9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:58.290421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c0615b65-2b17-4a18-bc92-9e7b85fe93a4 req-ba5c459b-d764-4611-bbdf-b4cc0be8bdfd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.290978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c0615b65-2b17-4a18-bc92-9e7b85fe93a4 req-ba5c459b-d764-4611-bbdf-b4cc0be8bdfd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.291527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c0615b65-2b17-4a18-bc92-9e7b85fe93a4 req-ba5c459b-d764-4611-bbdf-b4cc0be8bdfd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.304733 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c0615b65-2b17-4a18-bc92-9e7b85fe93a4 req-ba5c459b-d764-4611-bbdf-b4cc0be8bdfd service nova] Creating event network-changed:8e4beaff-2f6c-4190-82d2-d98bc44a57a9 for instance ba90c59c-d715-413b-9337-c7b7dec88ca7 on n-h1-master-1 Sep 18 01:00:58.305248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122374) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 18 01:00:58.310674 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c0615b65-2b17-4a18-bc92-9e7b85fe93a4 req-ba5c459b-d764-4611-bbdf-b4cc0be8bdfd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040222 Sep 18 01:00:58.311537 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 173/336] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:58.318389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:58.319350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:58.326701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.327504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.328148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.329120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.329831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.330466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.331483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:58.337343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:58.417125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:58.423536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:58.442375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=fc220ad8-f059-4a53-86a5-ee792b74597f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:58.565527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:58.578145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:58.579027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:58.587937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c4ff833a-990b-43ca-a603-8312faa4d6cf tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 0.274857 Sep 18 01:00:58.588857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 174/337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:58 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:58.616795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:58.617938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:58.636112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.639856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.640632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.641921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.646122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.646952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:58.651863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.654648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:58.719977 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1babe1c5-1ca2-4aed-97a1-f09ca9276783 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.041553 Sep 18 01:00:58.722368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 164/338] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 2046 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:00:58.734523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8d3bb5e-7ac3-4e5f-af0a-caff3b2e3126 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:58.768907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.769779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.770742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.771975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lazy-loading 'fault' on Instance uuid 688259fb-cde6-4154-a702-3edad886467d {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:58.806095 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8d3bb5e-7ac3-4e5f-af0a-caff3b2e3126 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.082165 Sep 18 01:00:58.827238 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 165/339] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:58 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:58.846826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:58.852221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:58.852889 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Searching by: {'deleted': False, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:00:58.876011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.876573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.877105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.877867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:58.881292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:58.894745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:58.992029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:59.004804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcae5e8d-8a3a-4295-95e3-ad7d61741f56 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1459 microversion: 2.1 time: 0.400480 Sep 18 01:00:59.020838 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 175/340] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:58 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1459 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:59.041494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:00:59.171708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4be9aafb-ee82-4dfc-ab44-db678381fbdc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.341567 Sep 18 01:00:59.181878 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 166/341] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:00:58 2022] GET /compute/v2.1/servers => generated 1004 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:59.190666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06200d31-9d46-4eac-976d-e3113a98dfe1 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:59.220778 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:59.228811 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06200d31-9d46-4eac-976d-e3113a98dfe1 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1295634342" status: 202 len: 0 microversion: 2.1 time: 0.046134 Sep 18 01:00:59.229827 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 167/342] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:00:59 2022] DELETE /compute/v2.1/flavors/1295634342 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:00:59.240861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:59.242312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:59.252710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.253510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.254989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.256089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.256814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.257813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.399671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7f336a9-2de9-42d5-bab5-642ac6cf6e53 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-588875691", "id": 1643338891, "os-flavor-access:is_public": "False"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:59.467104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:59.475379 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d7f336a9-2de9-42d5-bab5-642ac6cf6e53 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.441018 Sep 18 01:00:59.476284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 176/343] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:59 2022] POST /compute/v2.1/flavors => generated 430 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:59.487493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:59.493160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:59.496051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20670c56-d3f8-432f-994d-673ceb5e7637 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:59.496909 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20670c56-d3f8-432f-994d-673ceb5e7637 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:59.507793 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5746425-ab04-4702-85fd-7f6af530167d tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.276808 Sep 18 01:00:59.523497 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 168/344] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:59 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:59.545430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-215c1cd7-98a5-4d10-9ca8-0d1540c667e1 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:59.633633 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-215c1cd7-98a5-4d10-9ca8-0d1540c667e1 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.108180 Sep 18 01:00:59.645603 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 169/345] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:59 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:59.645901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b530a73-c143-4e9a-a69e-6bbda9d09fe2 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4a1fa00a92ba4d44bb0ee55264582611"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:59.736051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-20670c56-d3f8-432f-994d-673ceb5e7637 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:59.754077 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20670c56-d3f8-432f-994d-673ceb5e7637 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1219 microversion: 2.1 time: 0.267639 Sep 18 01:00:59.755817 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 177/346] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:59 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:59.779599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:59.784251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:59.792307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.793129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.793891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.794853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.795528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.796198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.830441 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b530a73-c143-4e9a-a69e-6bbda9d09fe2 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1643338891/action" status: 200 len: 97 microversion: 2.1 time: 0.192913 Sep 18 01:00:59.837109 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 170/347] 10.222.0.25 () {60 vars in 1200 bytes} [Sun Sep 18 01:00:59 2022] POST /compute/v2.1/flavors/1643338891/action => generated 97 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:00:59.849943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a6952289-c8e9-431d-83da-e0e40781b199 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-29936527", "id": 1372087061, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:59.895049 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a6952289-c8e9-431d-83da-e0e40781b199 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.058457 Sep 18 01:00:59.898292 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 171/348] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:59 2022] POST /compute/v2.1/flavors => generated 427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:00.133323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:00.143675 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4d7ea57-3ab9-4217-81c6-5b280885ce7f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 0.384608 Sep 18 01:01:00.150419 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 178/349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:59 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:00.171611 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26877b29-72cc-4ed5-8d5a-15d75eadf356 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.200096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9b86d660-1a4d-4f50-b7a3-05cf418ef521 tempest-FlavorsAccessTestJSON-1871425467 tempest-FlavorsAccessTestJSON-1871425467-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.222447 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26877b29-72cc-4ed5-8d5a-15d75eadf356 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1372087061" status: 202 len: 0 microversion: 2.1 time: 0.070167 Sep 18 01:01:00.224180 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 179/350] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:00 2022] DELETE /compute/v2.1/flavors/1372087061 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:00.232215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.234066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:00.244777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.247535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.247990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.248819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.249159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.251104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.253218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9b86d660-1a4d-4f50-b7a3-05cf418ef521 tempest-FlavorsAccessTestJSON-1871425467 tempest-FlavorsAccessTestJSON-1871425467-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6657 microversion: 2.1 time: 0.352300 Sep 18 01:01:00.254316 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 172/351] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:00:59 2022] GET /compute/v2.1/flavors/detail => generated 6657 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:00.263720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-994f3447-cb6f-4a9d-abed-fce8128f1826 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.303111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.305792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.306281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.306757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lazy-loading 'fault' on Instance uuid 688259fb-cde6-4154-a702-3edad886467d {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:00.314888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-994f3447-cb6f-4a9d-abed-fce8128f1826 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.058282 Sep 18 01:01:00.316719 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 173/352] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:00.327527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-637f9b0d-a14b-4a63-af10-9da367edcc3d tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4a1fa00a92ba4d44bb0ee55264582611"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:00.465108 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-637f9b0d-a14b-4a63-af10-9da367edcc3d tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1643338891/action" status: 200 len: 21 microversion: 2.1 time: 0.145798 Sep 18 01:01:00.467133 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 174/353] 10.222.0.25 () {60 vars in 1200 bytes} [Sun Sep 18 01:01:00 2022] POST /compute/v2.1/flavors/1643338891/action => generated 21 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:00.480745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82b9c5df-dd87-4af2-8f76-00206045bd0d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1052750692", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:00.520970 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82b9c5df-dd87-4af2-8f76-00206045bd0d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.047095 Sep 18 01:01:00.531429 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 175/354] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:00 2022] POST /compute/v2.1/flavors => generated 507 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:00.531741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3949864-aa4c-4c49-986b-cd4e01568434 tempest-FlavorsAccessTestJSON-1871425467 tempest-FlavorsAccessTestJSON-1871425467-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.591663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3949864-aa4c-4c49-986b-cd4e01568434 tempest-FlavorsAccessTestJSON-1871425467 tempest-FlavorsAccessTestJSON-1871425467-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6317 microversion: 2.1 time: 0.068053 Sep 18 01:01:00.606144 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 176/355] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/flavors/detail => generated 6317 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:00.606144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f85b8a46-e488-4df2-99ee-e94eca12e4be tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.625610 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f85b8a46-e488-4df2-99ee-e94eca12e4be tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/c91117cd-ce5c-4f9f-9ac5-ce5186c08874" status: 202 len: 0 microversion: 2.1 time: 0.028343 Sep 18 01:01:00.626031 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 177/356] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:00 2022] DELETE /compute/v2.1/flavors/c91117cd-ce5c-4f9f-9ac5-ce5186c08874 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:00.636545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.636545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:00.643652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.645339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.645822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.648812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.649599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.650034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.683905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:00.698658 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50936b6c-dc7b-4a8a-9e77-33bf5fc83d27 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1459 microversion: 2.1 time: 0.472135 Sep 18 01:01:00.699969 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 180/357] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1459 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:00.705138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8876ae8-1623-4bd3-9fca-2bd9756e2331 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.752364 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8876ae8-1623-4bd3-9fca-2bd9756e2331 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.050576 Sep 18 01:01:00.753869 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 181/358] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:00.764997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8527866d-15b5-424f-a076-620a479903f6 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.796832 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8527866d-15b5-424f-a076-620a479903f6 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1643338891" status: 202 len: 0 microversion: 2.1 time: 0.040169 Sep 18 01:01:00.798468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 182/359] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:00 2022] DELETE /compute/v2.1/flavors/1643338891 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:00.805315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.806304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:00.811670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:00.816905 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:00.824232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.825498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.827251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.829193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.830294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.831381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:00.831866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.832990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:00.843100 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9305b4ed-8fb2-421e-a80e-45dc95dae56c tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.215713 Sep 18 01:01:00.857593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 178/360] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:00.857593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a816b639-b078-4976-ae58-cb956611523f tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-723194246", "id": "04399a63-5145-429d-90f3-e855ff7da32f", "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:00.882736 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a816b639-b078-4976-ae58-cb956611523f tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.037038 Sep 18 01:01:00.891627 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 179/361] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:00 2022] POST /compute/v2.1/flavors => generated 506 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:00.906552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a415542c-f7d9-4f06-a40b-0a0d3fc4c84b tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.991084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:00.996001 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a415542c-f7d9-4f06-a40b-0a0d3fc4c84b tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6316 microversion: 2.1 time: 0.102466 Sep 18 01:01:00.998368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 180/362] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/flavors/detail => generated 6316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:01.003431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2793a35c-f73d-4bff-987b-7eea88b1bc7c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.028337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2793a35c-f73d-4bff-987b-7eea88b1bc7c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/04399a63-5145-429d-90f3-e855ff7da32f" status: 202 len: 0 microversion: 2.1 time: 0.028025 Sep 18 01:01:01.029686 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 181/363] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:00 2022] DELETE /compute/v2.1/flavors/04399a63-5145-429d-90f3-e855ff7da32f => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:01.035764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27b79ca3-1aa3-4cdc-82f2-38d25dea817e tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-18900449", "id": 1647378100, "os-flavor-access:is_public": "False"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:01.038492 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ddbda47c-f2f4-4218-8e62-4ed581f6ebb4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1215 microversion: 2.1 time: 0.237922 Sep 18 01:01:01.046934 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 183/364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:01.056531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-678d7c9d-065c-4e6a-8e2c-4529b0eeeb1c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.076693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27b79ca3-1aa3-4cdc-82f2-38d25dea817e tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.045696 Sep 18 01:01:01.078070 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 182/365] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:01.092934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52e9bf2c-b805-43f9-b569-486963b3bfe4 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.100003 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-678d7c9d-065c-4e6a-8e2c-4529b0eeeb1c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.051344 Sep 18 01:01:01.131173 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52e9bf2c-b805-43f9-b569-486963b3bfe4 tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1647378100/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.044789 Sep 18 01:01:01.131346 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 184/366] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:01.134151 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 183/367] 10.222.0.25 () {58 vars in 1209 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/flavors/1647378100/os-flavor-access => generated 21 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:01:01.149235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-83469c07-f007-4684-ac6c-40e68ea0eeea tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.156848 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f56abcd7-a7bd-49cf-bbaf-df581303fcde tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-891835530", "id": 971449095, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:01.185371 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f56abcd7-a7bd-49cf-bbaf-df581303fcde tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.034544 Sep 18 01:01:01.190244 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-83469c07-f007-4684-ac6c-40e68ea0eeea tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1647378100" status: 202 len: 0 microversion: 2.1 time: 0.044456 Sep 18 01:01:01.191576 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 185/368] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:01 2022] DELETE /compute/v2.1/flavors/1647378100 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:01.198307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.200626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:01.205959 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 184/369] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:01 2022] POST /compute/v2.1/flavors => generated 410 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:01.210782 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91570fe1-0508-45da-a318-fe3b2236c21a tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.216808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.217750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.218422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.219502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.220182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.220818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.260722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91570fe1-0508-45da-a318-fe3b2236c21a tempest-FlavorsAccessTestJSON-1577557418 tempest-FlavorsAccessTestJSON-1577557418-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.053533 Sep 18 01:01:01.261334 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 185/370] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:01.296033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76518825-e093-4696-b364-0f8ad639964e tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.308769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76518825-e093-4696-b364-0f8ad639964e tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/971449095" status: 200 len: 410 microversion: 2.1 time: 0.021771 Sep 18 01:01:01.312263 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 186/371] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/flavors/971449095 => generated 410 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:01.606566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dcebcc05-0d20-4a8e-b957-4bebdd3213ee tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.695660 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dcebcc05-0d20-4a8e-b957-4bebdd3213ee tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.374881 Sep 18 01:01:01.710767 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 187/372] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:01.733899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b21174e-a987-4347-b658-c6221ae11c6c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.765162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b21174e-a987-4347-b658-c6221ae11c6c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/971449095" status: 202 len: 0 microversion: 2.1 time: 0.040596 Sep 18 01:01:01.772844 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 188/373] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:01:01 2022] DELETE /compute/v2.1/flavors/971449095 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:01.788281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.789879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:01.817462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.818691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.819980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.823455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.826107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.827038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.914486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.915766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.916834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.917459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lazy-loading 'fault' on Instance uuid 688259fb-cde6-4154-a702-3edad886467d {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:02.346584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:02.365643 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-478159ef-111f-4c19-a13a-499eac85ef32 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 1.171339 Sep 18 01:01:02.366526 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 186/374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:02.394504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-594afddf-f130-4948-9dd6-d422b1f9c2cd tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:02.476405 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-594afddf-f130-4948-9dd6-d422b1f9c2cd tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.108354 Sep 18 01:01:02.477714 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 187/375] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:02.483474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:02.484395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:02.495898 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:02.515953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.515953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.518180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.519082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.520457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.520874 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aecfd878-d450-4662-9958-76172dbbf1dd tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1459 microversion: 2.1 time: 0.749831 Sep 18 01:01:02.530183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.530297 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 189/376] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1459 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:02.530789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:02.531481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:02.552549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.553048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.553484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.555260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.561811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.564005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.833496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:02.843438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:02.843702 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02c4146a-5a03-46cc-9a02-5d8a78186381 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1271 microversion: 2.1 time: 0.318477 Sep 18 01:01:02.846232 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:02.863199 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 190/377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:02 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:02.887469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:02.887795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3042b02b-a652-462c-9570-71ecbd5c371d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1574049831", "id": 265951341, "os-flavor-access:is_public": "False"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:02.892912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:02.920493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c575acc5-4779-4b2f-988e-abd16ffffce8 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1447 microversion: 2.75 time: 0.440410 Sep 18 01:01:02.937904 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 188/378] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:02 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1447 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:02.951998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3042b02b-a652-462c-9570-71ecbd5c371d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.087294 Sep 18 01:01:02.963305 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 191/379] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:02 2022] POST /compute/v2.1/flavors => generated 427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:02.969980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-af8b1af1-ad7e-4927-8ee9-358c87ace139 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "265951341"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:02.991296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-af8b1af1-ad7e-4927-8ee9-358c87ace139 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] HTTP exception thrown: Flavor 265951341 could not be found. Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-af8b1af1-ad7e-4927-8ee9-358c87ace139 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] Request method failure captured: Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 106 Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3FN4AcsxQU_znLKLIq70ntBJNNR_jU7avVxY8QtIH2i3RJN3KZV-4uz0ShASXXzspp-ji1rHtf3lH2XKv1o4TmydbCaFLZobGfwMMNj9Zz4UFu1d3b-UuyO4BW4NkukbRWg4CDEap9mAa_BEUlpLoPa3uXOzNZqMJq3ht9JoBGjog Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c2b2b7acdb324b91a4ccac3d1adc6d39 Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FlavorsAdminTestJSON-893550142 Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:02.993933 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c2b2b7acdb324b91a4ccac3d1adc6d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c2b2b7acdb324b91a4ccac3d1adc6d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c2b2b7acdb324b91a4ccac3d1adc6d39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c2b2b7acdb324b91a4ccac3d1adc6d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FlavorsAdminTestJSON-893550142 Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c2b2b7acdb324b91a4ccac3d1adc6d39 Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-893550142 Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FlavorsAdminTestJSON-893550142-project Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 06f0631037704b7ab51cf8be724cce3d Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FlavorsAdminTestJSON-893550142-project Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "test", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "265951341"}} Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:01:02.995503 n-d-master-1 devstack@n-api.service[122373]: exception: Flavor 265951341 could not be found. Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '265951341'}}} Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 265951341 could not be found. Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:02.996983 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 265951341 could not be found. Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:02.998388 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 265951341 could not be found. Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-af8b1af1-ad7e-4927-8ee9-358c87ace139 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] Returning 400 to user: Flavor 265951341 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-af8b1af1-ad7e-4927-8ee9-358c87ace139 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.033525 Sep 18 01:01:03.000344 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 189/380] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:02 2022] POST /compute/v2.1/servers => generated 80 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:01:03.004975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88132679-cbde-4ad3-95ff-bedae00647e8 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.033003 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=11 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:03.043055 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88132679-cbde-4ad3-95ff-bedae00647e8 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/265951341" status: 202 len: 0 microversion: 2.1 time: 0.040981 Sep 18 01:01:03.047969 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 192/381] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:01:03 2022] DELETE /compute/v2.1/flavors/265951341 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:03.053927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-966acc38-925c-4488-9db6-16c66a500fc7 req-2f0b2c1f-9b58-49f4-a501-4cd556551236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688259fb-cde6-4154-a702-3edad886467d", "name": "network-vif-deleted", "tag": "f2b20dd4-d338-4144-9bce-e7713f8e01f2"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:03.058701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e69cb5de-c914-4f1e-a2f8-40b6a0ff20ef tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.078360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-966acc38-925c-4488-9db6-16c66a500fc7 req-2f0b2c1f-9b58-49f4-a501-4cd556551236 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.078845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-966acc38-925c-4488-9db6-16c66a500fc7 req-2f0b2c1f-9b58-49f4-a501-4cd556551236 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.079274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-966acc38-925c-4488-9db6-16c66a500fc7 req-2f0b2c1f-9b58-49f4-a501-4cd556551236 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.094403 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-966acc38-925c-4488-9db6-16c66a500fc7 req-2f0b2c1f-9b58-49f4-a501-4cd556551236 service nova] Creating event network-vif-deleted:f2b20dd4-d338-4144-9bce-e7713f8e01f2 for instance 688259fb-cde6-4154-a702-3edad886467d on n-h1-master-1 Sep 18 01:01:03.104943 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e69cb5de-c914-4f1e-a2f8-40b6a0ff20ef tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.053912 Sep 18 01:01:03.105522 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-966acc38-925c-4488-9db6-16c66a500fc7 req-2f0b2c1f-9b58-49f4-a501-4cd556551236 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056864 Sep 18 01:01:03.107672 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 190/382] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.135499 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 193/383] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:03.151175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ad7bac4-eec6-4f89-953f-f86b11fcd208 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1436411642", "id": 1220428520, "os-flavor-access:is_public": "False"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:03.212782 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ad7bac4-eec6-4f89-953f-f86b11fcd208 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.076064 Sep 18 01:01:03.214546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 191/384] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:03 2022] POST /compute/v2.1/flavors => generated 415 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.231734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2efbf03d-a062-45d2-a70d-ad75ac30556d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-20254394", "id": 1228259531, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:03.304348 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2efbf03d-a062-45d2-a70d-ad75ac30556d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.080284 Sep 18 01:01:03.316567 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 194/385] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:03 2022] POST /compute/v2.1/flavors => generated 412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.326458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe1f4d18-9b26-4668-bb4e-f5d97a1f77af tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.377286 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe1f4d18-9b26-4668-bb4e-f5d97a1f77af tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.058708 Sep 18 01:01:03.390744 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 192/386] 10.222.0.25 () {58 vars in 1169 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.414754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.415848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:03.417318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f604311-37e5-48b9-84c5-b6e5b96ae709 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.450000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.451462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.452840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.453439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.454300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.455057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.515903 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f604311-37e5-48b9-84c5-b6e5b96ae709 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.114922 Sep 18 01:01:03.518342 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 195/387] 10.222.0.25 () {58 vars in 1177 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.545307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7c7bbd58-acac-49b4-8a78-5c67e99757a3 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.580801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7c7bbd58-acac-49b4-8a78-5c67e99757a3 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.052253 Sep 18 01:01:03.587179 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 196/388] 10.222.0.25 () {58 vars in 1171 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.599825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.607226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:03.650206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.651183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.655268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.657736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.658585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.659343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.761809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.762660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.763517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.776064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lazy-loading 'fault' on Instance uuid 688259fb-cde6-4154-a702-3edad886467d {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:03.859981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:03.891562 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-268813a4-37c9-453a-bbf7-4d9d5817a958 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1310 microversion: 2.1 time: 0.302605 Sep 18 01:01:03.892512 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 197/389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1310 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:03.919369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc05f3cf-6cc2-4c41-b03d-92618e35ad5f tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.941824 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc05f3cf-6cc2-4c41-b03d-92618e35ad5f tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.040035 Sep 18 01:01:03.953383 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 198/390] 10.222.0.25 () {58 vars in 1169 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.970331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.970972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:03.979975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.980462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.981495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.982309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.982758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.983173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.143461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:04.161306 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-604eb381-5bb7-4a60-b54b-29e763995836 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1289 microversion: 2.1 time: 0.203924 Sep 18 01:01:04.162245 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 199/391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1289 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.172342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.186422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:04.210493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.211573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.212700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.214408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.216031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.217146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.223523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:04.236219 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ca47c62-a67e-4485-857b-dae9a884e8a6 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 0.826255 Sep 18 01:01:04.236810 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 193/392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.249122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f53cf77-9830-468e-86d9-26d9cf2a4f31 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.329399 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f53cf77-9830-468e-86d9-26d9cf2a4f31 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6222 microversion: 2.1 time: 0.084093 Sep 18 01:01:04.342862 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 194/393] 10.222.0.25 () {58 vars in 1169 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.383638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33c7a08b-1a73-40d9-ae44-ad688c66fccd tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.451159 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33c7a08b-1a73-40d9-ae44-ad688c66fccd tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6222 microversion: 2.1 time: 0.080672 Sep 18 01:01:04.454966 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 195/394] 10.222.0.25 () {58 vars in 1175 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.490048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c6a0edd-9b43-453f-a37b-3cefea5f440c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.515857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:04.538631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:04.540802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:04.542817 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c6a0edd-9b43-453f-a37b-3cefea5f440c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6222 microversion: 2.1 time: 0.056430 Sep 18 01:01:04.552100 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 196/395] 10.222.0.25 () {58 vars in 1173 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.555478 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-befb3ddd-874b-41cf-9434-2171f2a7a240 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1453 microversion: 2.75 time: 0.391817 Sep 18 01:01:04.574210 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 200/396] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1453 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:04.584161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db0c5e12-379e-40ef-b069-f46b476aa0b0 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.626493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-db0c5e12-379e-40ef-b069-f46b476aa0b0 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6222 microversion: 2.1 time: 0.057105 Sep 18 01:01:04.628210 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 197/397] 10.222.0.25 () {58 vars in 1169 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6222 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.671465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a67852d-a24e-4a80-9ae8-5d3664831b0b tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.703161 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a67852d-a24e-4a80-9ae8-5d3664831b0b tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1228259531" status: 202 len: 0 microversion: 2.1 time: 0.036907 Sep 18 01:01:04.704088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 201/398] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:04 2022] DELETE /compute/v2.1/flavors/1228259531 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:04.713897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40a62879-8da3-480c-8d45-c1fdb02e7af8 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.768318 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40a62879-8da3-480c-8d45-c1fdb02e7af8 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.058249 Sep 18 01:01:04.778705 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 198/399] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.812117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-99747175-03d2-4b18-a435-411a3b572db9 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.838037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-99747175-03d2-4b18-a435-411a3b572db9 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1220428520" status: 202 len: 0 microversion: 2.1 time: 0.028134 Sep 18 01:01:04.839667 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 202/400] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:04 2022] DELETE /compute/v2.1/flavors/1220428520 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:04.848294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4352f9b2-1e14-4742-8b73-ddeb21d6c46d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.886470 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4352f9b2-1e14-4742-8b73-ddeb21d6c46d tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041868 Sep 18 01:01:04.889039 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 199/401] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.933689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.935444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:04.935569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1192e68c-a4e5-403d-8009-ed24090bacd9 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-503450469", "id": 1677747506, "os-flavor-access:is_public": "False"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:04.946920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.947981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.949500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.952681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.953846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.955324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.961081 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1192e68c-a4e5-403d-8009-ed24090bacd9 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029695 Sep 18 01:01:04.973930 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 200/402] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:04.979953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a0353c4f-929c-45e9-a8f4-bd222963a48b tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.018438 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a0353c4f-929c-45e9-a8f4-bd222963a48b tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.042157 Sep 18 01:01:05.019069 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 201/403] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:05.041065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13b71f0d-2f72-4537-bdd1-dc92f2617ae2 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.043110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.045308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.047893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.050220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lazy-loading 'fault' on Instance uuid 688259fb-cde6-4154-a702-3edad886467d {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:05.079296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13b71f0d-2f72-4537-bdd1-dc92f2617ae2 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041745 Sep 18 01:01:05.080986 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 202/404] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:05 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:05.109930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-890839c3-9f99-4356-8f5e-92192d81fc17 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.141476 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:05.147124 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-890839c3-9f99-4356-8f5e-92192d81fc17 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1677747506" status: 202 len: 0 microversion: 2.1 time: 0.041731 Sep 18 01:01:05.155901 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 203/405] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:05 2022] DELETE /compute/v2.1/flavors/1677747506 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:01:05.174288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87dcf89b-7a97-48de-89b3-3ca97fd66a88 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.282189 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-87dcf89b-7a97-48de-89b3-3ca97fd66a88 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.122770 Sep 18 01:01:05.287270 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 204/406] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:05 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:05.294277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f5767908346de9e8884f72376614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecbfc5594c74b798ba6eaa2d8c19059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:05.298753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.300229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:05.314824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.317870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.319162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.320743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.321924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.323678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.337352 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7aca30d-b93c-4081-ac3a-25501c0922f3 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 200 len: 1310 microversion: 2.1 time: 0.407156 Sep 18 01:01:05.354170 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 203/407] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 1310 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:05.354170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.369459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:05.406166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.407013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.407752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.409175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.409978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.410689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.624150 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:05.636894 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f925f552-3145-4a46-ab7b-0cff0b835560 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1277 microversion: 2.1 time: 0.347570 Sep 18 01:01:05.639134 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 205/408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:05 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:05.683458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1e2c1de-60b0-4502-8f0f-3c967bff4a5c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1228034490", "id": 1979629841, "os-flavor-access:is_public": "True"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:05.749790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1e2c1de-60b0-4502-8f0f-3c967bff4a5c tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.093232 Sep 18 01:01:05.753508 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 206/409] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:05 2022] POST /compute/v2.1/flavors => generated 414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:05.787148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.788503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:05.816966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.817849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.818642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.826699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.827714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.828506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.045621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:06.062637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:06.064129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:06.086814 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eeb92169-185f-4b38-9e7f-8466b5c97a5a tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1453 microversion: 2.75 time: 0.330855 Sep 18 01:01:06.106848 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 207/410] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:05 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1453 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:06.116424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a4125f2-a51f-43bd-bfe6-ab3c8ac464d7 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.141799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a4125f2-a51f-43bd-bfe6-ab3c8ac464d7 tempest-FlavorsAdminTestJSON-893550142 tempest-FlavorsAdminTestJSON-893550142-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.033585 Sep 18 01:01:06.145614 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 208/411] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:06.187951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e356bdbf-96c2-41c9-8c13-24da6283dd22 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.234631 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e356bdbf-96c2-41c9-8c13-24da6283dd22 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1979629841" status: 202 len: 0 microversion: 2.1 time: 0.059187 Sep 18 01:01:06.235817 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 209/412] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:06 2022] DELETE /compute/v2.1/flavors/1979629841 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:06.251289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1102e03a-4c56-462e-9e89-d33d561904b9 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.279283 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1102e03a-4c56-462e-9e89-d33d561904b9 tempest-FlavorsAdminTestJSON-139210198 tempest-FlavorsAdminTestJSON-139210198-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032018 Sep 18 01:01:06.286090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:06.295434 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 210/413] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:06.304223 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b44ceda7-eccb-46f6-87a6-f4698bda8c89 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 0.957340 Sep 18 01:01:06.310102 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 204/414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:05 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:06.386359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.387757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.401842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.403934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.404389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.405117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.407153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.408283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.450645 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] HTTP exception thrown: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Request method failure captured: Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d HTTP/1.1 Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2HbE71nbOuJ4udjUlIoKdE_rZm2nxz9SpIoBFHhXZI1Sq6g4-AxNyDLEeQBUpbNqBh3DfwjBtt_iDiyiFwl3Ojbufamt-pW8ZumKIQlnLhd9h9-70ZZfWJ_F26c82AKPuhelyPseoa0gQ7d-ZSiUBdKRH6vobgCJgNVDAx7eclkAo Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:06.455882 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 450f5767908346de9e8884f72376614a Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.457450 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '688259fb-cde6-4154-a702-3edad886467d'} Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:06.458334 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.459818 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.464912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Returning 404 to user: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:06.466581 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6feb0be8-caff-4512-b963-ef510c6c7004 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 404 len: 111 microversion: 2.1 time: 0.084608 Sep 18 01:01:06.467992 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 211/415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:06.480950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.482190 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.492524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.493639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.494581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.495879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.497600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.498429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.518516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b902cdd8-1817-459f-9762-9fec219c695d req-b4a2229e-9189-4645-8f88-ad1aea5bf462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba90c59c-d715-413b-9337-c7b7dec88ca7", "name": "network-vif-plugged", "status": "completed", "tag": "8e4beaff-2f6c-4190-82d2-d98bc44a57a9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:06.596429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b902cdd8-1817-459f-9762-9fec219c695d req-b4a2229e-9189-4645-8f88-ad1aea5bf462 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.598382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b902cdd8-1817-459f-9762-9fec219c695d req-b4a2229e-9189-4645-8f88-ad1aea5bf462 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.600050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b902cdd8-1817-459f-9762-9fec219c695d req-b4a2229e-9189-4645-8f88-ad1aea5bf462 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.601254 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] HTTP exception thrown: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Request method failure captured: Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d HTTP/1.1 Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2HbE71nbOuJ4udjUlIoKdE_rZm2nxz9SpIoBFHhXZI1Sq6g4-AxNyDLEeQBUpbNqBh3DfwjBtt_iDiyiFwl3Ojbufamt-pW8ZumKIQlnLhd9h9-70ZZfWJ_F26c82AKPuhelyPseoa0gQ7d-ZSiUBdKRH6vobgCJgNVDAx7eclkAo Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:06.609121 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 450f5767908346de9e8884f72376614a Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.611143 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '688259fb-cde6-4154-a702-3edad886467d'} Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:06.612132 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.613755 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.619881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Returning 404 to user: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:06.624043 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6a26ee6-7c1c-480c-8f0d-b8c454d060b4 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 404 len: 111 microversion: 2.1 time: 0.147066 Sep 18 01:01:06.625332 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 205/416] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:06 2022] DELETE /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:06.640837 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b902cdd8-1817-459f-9762-9fec219c695d req-b4a2229e-9189-4645-8f88-ad1aea5bf462 service nova] Creating event network-vif-plugged:8e4beaff-2f6c-4190-82d2-d98bc44a57a9 for instance ba90c59c-d715-413b-9337-c7b7dec88ca7 on n-h1-master-1 Sep 18 01:01:06.647513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.650672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b902cdd8-1817-459f-9762-9fec219c695d req-b4a2229e-9189-4645-8f88-ad1aea5bf462 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140713 Sep 18 01:01:06.654058 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 212/417] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:06.660172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: 688259fb-cde6-4154-a702-3edad886467d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.680652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.681816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.691635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.692219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.693017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.697045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.699756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.700221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.710189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.710938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.711540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.718365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.719294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.721912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.731575 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] HTTP exception thrown: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Request method failure captured: Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d HTTP/1.1 Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2HbE71nbOuJ4udjUlIoKdE_rZm2nxz9SpIoBFHhXZI1Sq6g4-AxNyDLEeQBUpbNqBh3DfwjBtt_iDiyiFwl3Ojbufamt-pW8ZumKIQlnLhd9h9-70ZZfWJ_F26c82AKPuhelyPseoa0gQ7d-ZSiUBdKRH6vobgCJgNVDAx7eclkAo Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:06.734767 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 450f5767908346de9e8884f72376614a Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.736131 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '688259fb-cde6-4154-a702-3edad886467d'} Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:06.736872 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. Sep 18 01:01:06.738122 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.739187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Returning 404 to user: Instance 688259fb-cde6-4154-a702-3edad886467d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:06.739187 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd4b2ac5-9f24-4d40-9f2d-ccf14fd9f7f9 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d" status: 404 len: 111 microversion: 2.1 time: 0.105845 Sep 18 01:01:06.744415 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 206/418] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/servers/688259fb-cde6-4154-a702-3edad886467d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:06.769957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.771375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.783800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.785333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.786276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.787019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.787474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.787892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.853307 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] HTTP exception thrown: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Request method failure captured: Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 HTTP/1.1 Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2HbE71nbOuJ4udjUlIoKdE_rZm2nxz9SpIoBFHhXZI1Sq6g4-AxNyDLEeQBUpbNqBh3DfwjBtt_iDiyiFwl3Ojbufamt-pW8ZumKIQlnLhd9h9-70ZZfWJ_F26c82AKPuhelyPseoa0gQ7d-ZSiUBdKRH6vobgCJgNVDAx7eclkAo Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:06.856720 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 450f5767908346de9e8884f72376614a Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: exception: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.858206 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'c510769c-b06f-4952-85ce-5bcc1375b839'} Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:06.859000 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.860284 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.861374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Returning 404 to user: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:06.861374 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2dd13d88-92ea-4cbb-8424-1a8bb625f4e0 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 404 len: 111 microversion: 2.1 time: 0.113571 Sep 18 01:01:06.868326 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 207/419] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:06 2022] DELETE /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:06.885170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.886127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] [instance: c510769c-b06f-4952-85ce-5bcc1375b839] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.914244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.915246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.916174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.917128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.918188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.920286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.943410 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] HTTP exception thrown: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Request method failure captured: Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 HTTP/1.1 Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2HbE71nbOuJ4udjUlIoKdE_rZm2nxz9SpIoBFHhXZI1Sq6g4-AxNyDLEeQBUpbNqBh3DfwjBtt_iDiyiFwl3Ojbufamt-pW8ZumKIQlnLhd9h9-70ZZfWJ_F26c82AKPuhelyPseoa0gQ7d-ZSiUBdKRH6vobgCJgNVDAx7eclkAo Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:06.946932 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eecbfc5594c74b798ba6eaa2d8c19059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: eecbfc5594c74b798ba6eaa2d8c19059 Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-798568941 Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 450f5767908346de9e8884f72376614a Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersAdminTestJSON-798568941-project Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: exception: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.948323 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'c510769c-b06f-4952-85ce-5bcc1375b839'} Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:06.949008 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. Sep 18 01:01:06.950633 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:06.958015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] Returning 404 to user: Instance c510769c-b06f-4952-85ce-5bcc1375b839 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:06.959196 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bdaa9871-cb00-4394-838e-e6f53eff6944 tempest-DeleteServersAdminTestJSON-798568941 tempest-DeleteServersAdminTestJSON-798568941-project] 10.222.0.25 "GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839" status: 404 len: 111 microversion: 2.1 time: 0.089722 Sep 18 01:01:06.961198 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 208/420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/servers/c510769c-b06f-4952-85ce-5bcc1375b839 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:07.087322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:07.111257 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07083809-e2d2-4028-a31d-5a4b950439c3 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1277 microversion: 2.1 time: 0.448296 Sep 18 01:01:07.125580 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 213/421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1277 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:07.125785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:07.125785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:07.133579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:07.134075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:07.140256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:07.141263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:07.141939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:07.142731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:07.306457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:07.319843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:07.324181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:07.344546 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa750928-a321-4c98-8f73-828e27338895 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1438 microversion: 2.75 time: 0.226865 Sep 18 01:01:07.345147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 209/422] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:07 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1438 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:07.351995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:07.352478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:07.368394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:07.368878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:07.373711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:07.374893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:07.376479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:07.377236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.056139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:08.059989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:08.071418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.072379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.072989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.073966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.075147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.082820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.258574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:01:08.260376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:01:08.265914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:01:08.267699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:01:08.269180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:01:08.495277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:08.505920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.506778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.507373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.508402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.509409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.510936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.681468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:08.700591 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1be116b-73af-4a59-b657-3d30fddfb4d1 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1318 microversion: 2.1 time: 1.351839 Sep 18 01:01:08.721981 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 214/423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:07 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1318 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:08.732995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:08.735338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:08.749304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.754279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.754989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.755922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.756576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.760468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.841267 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=47 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:08.977583 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:09.567896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:09.740286 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fff9c418-e1fa-4ee7-b2a6-b03603416011 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251/action" status: 202 len: 1942 microversion: 2.75 time: 2.365813 Sep 18 01:01:09.754373 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:09.755730 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 210/424] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:01:07 2022] POST /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251/action => generated 1942 bytes in 2382 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 18 01:01:09.771734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:09.772673 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:09.780015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:09.780844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:09.781481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:09.782459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:09.783101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:09.783715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:10.161052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:10.187975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4f834369-ba41-4159-ba74-f3b105d1c059 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 1.464332 Sep 18 01:01:10.188819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 215/425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:08 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:10.221151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:10.222104 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:10.248117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:10.248831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:10.266190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:10.267335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:10.268051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:10.268688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:10.756282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:10.836937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:10.853438 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-51890e92-9429-42f8-abb0-d67245dac401 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1468 microversion: 2.1 time: 1.085638 Sep 18 01:01:10.854128 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 211/426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:09 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1468 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:10.986505 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-63a98523-4454-4304-a69f-d708d1be1da2 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.793358 Sep 18 01:01:11.004779 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 216/427] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:10 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:11.057238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:11.058409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:11.075067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.077156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.079253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.081203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.082810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.084598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.295373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lazy-loading 'flavor' on Instance uuid ba90c59c-d715-413b-9337-c7b7dec88ca7 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:11.297201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-730cd5e2-89f5-489b-bf62-ec069e79fde2 tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1723843450", "id": 1937492592, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:11.361712 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-730cd5e2-89f5-489b-bf62-ec069e79fde2 tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.504159 Sep 18 01:01:11.364226 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 212/428] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:01:10 2022] POST /compute/v2.1/flavors => generated 468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:01:11.379366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-362506fe-dfdd-4454-b9aa-be7bb4f49cd1 req-662bc2ce-773d-4a87-845d-73a0db517ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc220ad8-f059-4a53-86a5-ee792b74597f", "tag": "3df39045-3c0b-4322-8a83-12731bd21bc2"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:11.404217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-362506fe-dfdd-4454-b9aa-be7bb4f49cd1 req-662bc2ce-773d-4a87-845d-73a0db517ae3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.405774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-362506fe-dfdd-4454-b9aa-be7bb4f49cd1 req-662bc2ce-773d-4a87-845d-73a0db517ae3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.409112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-362506fe-dfdd-4454-b9aa-be7bb4f49cd1 req-662bc2ce-773d-4a87-845d-73a0db517ae3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.437692 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-362506fe-dfdd-4454-b9aa-be7bb4f49cd1 req-662bc2ce-773d-4a87-845d-73a0db517ae3 service nova] Creating event network-changed:3df39045-3c0b-4322-8a83-12731bd21bc2 for instance fc220ad8-f059-4a53-86a5-ee792b74597f on n-h2-master-1 Sep 18 01:01:11.449491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-362506fe-dfdd-4454-b9aa-be7bb4f49cd1 req-662bc2ce-773d-4a87-845d-73a0db517ae3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082557 Sep 18 01:01:11.450987 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 213/429] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:11.464358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:11.466301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:11.484389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.486477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.488127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.496027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.497170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.497532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.525618 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6c5d5b9b-a19d-4bfe-be0d-bd949870b517 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7/action" status: 202 len: 0 microversion: 2.1 time: 0.461192 Sep 18 01:01:11.526268 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 217/430] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:01:11 2022] POST /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:12.000480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2953b3e3-9f75-44c9-b54d-7465ec375346 tempest-FlavorsV261TestJSON-569660263 tempest-FlavorsV261TestJSON-569660263-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:12.058378 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2953b3e3-9f75-44c9-b54d-7465ec375346 tempest-FlavorsV261TestJSON-569660263 tempest-FlavorsV261TestJSON-569660263-project] 10.222.0.25 "GET /compute/v2.1/flavors/1937492592" status: 200 len: 468 microversion: 2.61 time: 0.514174 Sep 18 01:01:12.064663 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 218/431] 10.222.0.25 () {60 vars in 1199 bytes} [Sun Sep 18 01:01:11 2022] GET /compute/v2.1/flavors/1937492592 => generated 468 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:01:12.102478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:12.107738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:12.156686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:12.162790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:12.163232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:12.166463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:12.169109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:12.171440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:12.278926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:12.301088 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-18af0c5d-541f-4de6-85bb-65d97202be1f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 0.847671 Sep 18 01:01:12.311857 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 214/432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:11 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:12.335085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:12.337072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:12.358538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:12.360365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:12.361177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:12.364413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:12.365199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:12.367064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:12.381414 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:13.071844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:13.152861 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c4ee9978-f9fb-4f4f-9b02-76a7ff2c1561 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.839069 Sep 18 01:01:13.157577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 215/433] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:12 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:13.165414 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74a4ba66-9f8f-4bd1-bdda-888bec337bfb tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:13.297585 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74a4ba66-9f8f-4bd1-bdda-888bec337bfb tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1937492592" status: 200 len: 469 microversion: 2.61 time: 0.138181 Sep 18 01:01:13.302469 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 216/434] 10.222.0.25 () {62 vars in 1219 bytes} [Sun Sep 18 01:01:13 2022] PUT /compute/v2.1/flavors/1937492592 => generated 469 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:01:13.329504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce5368c7-3dea-41d7-a281-c2f4ac8ad02e tempest-FlavorsV261TestJSON-569660263 tempest-FlavorsV261TestJSON-569660263-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:13.420367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:13.429792 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7aa691e1-f0a1-443e-ae09-2853bbac218f tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1459 microversion: 2.1 time: 1.363084 Sep 18 01:01:13.450415 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 219/435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:12 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1459 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:13.455839 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce5368c7-3dea-41d7-a281-c2f4ac8ad02e tempest-FlavorsV261TestJSON-569660263 tempest-FlavorsV261TestJSON-569660263-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 7159 microversion: 2.61 time: 0.140568 Sep 18 01:01:13.462375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:13.467015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:13.470756 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 217/436] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:01:13 2022] GET /compute/v2.1/flavors/detail => generated 7159 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:13.487267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:13.488048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:13.488676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:13.489591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:13.490193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:13.490766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:13.502387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:13.503549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:13.508272 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=89,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:13.528548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:13.531834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:13.532630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:13.533892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:13.534694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:13.535435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.012430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:14.021323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2cc19eab-9b23-4e67-b78f-9235494fe11c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 0.569506 Sep 18 01:01:14.022663 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 220/437] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:13 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:14.028457 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b1f7f166-2813-46ea-a915-f7971d3b6b5a tempest-FlavorsV261TestJSON-569660263 tempest-FlavorsV261TestJSON-569660263-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:14.086438 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b1f7f166-2813-46ea-a915-f7971d3b6b5a tempest-FlavorsV261TestJSON-569660263 tempest-FlavorsV261TestJSON-569660263-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.61 time: 0.062013 Sep 18 01:01:14.093393 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 221/438] 10.222.0.25 () {60 vars in 1166 bytes} [Sun Sep 18 01:01:14 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:14.110158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-7de0b16c-0d01-427a-bcd2-1fadae18c7a5 req-85d1edbe-f5d7-4d79-be1d-f5e9e2aaa102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb91f594-076a-4e8a-8fc7-64374e6a940c", "tag": "9fbacf54-4217-4dc3-9491-f2614a46bca3"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:14.151594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7de0b16c-0d01-427a-bcd2-1fadae18c7a5 req-85d1edbe-f5d7-4d79-be1d-f5e9e2aaa102 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.155711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7de0b16c-0d01-427a-bcd2-1fadae18c7a5 req-85d1edbe-f5d7-4d79-be1d-f5e9e2aaa102 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.158629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7de0b16c-0d01-427a-bcd2-1fadae18c7a5 req-85d1edbe-f5d7-4d79-be1d-f5e9e2aaa102 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.196765 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-7de0b16c-0d01-427a-bcd2-1fadae18c7a5 req-85d1edbe-f5d7-4d79-be1d-f5e9e2aaa102 service nova] Creating event network-changed:9fbacf54-4217-4dc3-9491-f2614a46bca3 for instance eb91f594-076a-4e8a-8fc7-64374e6a940c on n-h2-master-1 Sep 18 01:01:14.211891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-7de0b16c-0d01-427a-bcd2-1fadae18c7a5 req-85d1edbe-f5d7-4d79-be1d-f5e9e2aaa102 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116635 Sep 18 01:01:14.213363 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 222/439] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:14.237250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c8c967b-bcd6-48bc-9bfd-4690a3c805b2 tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:14.274594 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c8c967b-bcd6-48bc-9bfd-4690a3c805b2 tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1937492592" status: 202 len: 0 microversion: 2.61 time: 0.058143 Sep 18 01:01:14.276514 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 223/440] 10.222.0.25 () {60 vars in 1202 bytes} [Sun Sep 18 01:01:14 2022] DELETE /compute/v2.1/flavors/1937492592 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:14.293943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:14.306827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:14.315408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.316508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.317184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.318372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.319366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.320824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.361290 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2fc15949-54d3-4408-8a98-c996915a40b9 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1610 microversion: 2.1 time: 0.888869 Sep 18 01:01:14.393305 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 218/441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:13 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1610 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:14.516710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:14.548750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff4be704-6765-44d2-97cf-c7d91cf5d8b5 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.269573 Sep 18 01:01:14.550730 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 224/442] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:14 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:14.566464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e865c8e7-5c44-432d-836f-41421674d16b tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:14.622147 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e865c8e7-5c44-432d-836f-41421674d16b tempest-FlavorsV261TestJSON-917005942 tempest-FlavorsV261TestJSON-917005942-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.069141 Sep 18 01:01:14.623867 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 225/443] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:01:14 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:14.633923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:14.642214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.643463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.644420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.646390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.647221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.647663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.687625 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2f8a2b1-74f2-4ada-abdb-6c4c086d0377 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061693 Sep 18 01:01:14.688697 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 226/444] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:01:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:14.732842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:14.744431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:14.764490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.782849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.783746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.788507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.789235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.789931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.880896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Lazy-loading 'flavor' on Instance uuid ba90c59c-d715-413b-9337-c7b7dec88ca7 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:14.939220 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance ba90c59c-d715-413b-9337-c7b7dec88ca7 while it is in vm_state suspended Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Request method failure captured: Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7/action HTTP/1.1 Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 97 Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2m7KcGOQ-ui1KEUK-IToK4JWiwff2tnH3yvpmPTibAY-7dbS0Jo21TCuJzu3E9BWb-z_mp_EDbPhddIVFjpgHDitULIAxiq3X4gtygk-uoNziEA68Sim9GaM2d-NvaVSxupiUzhcZ1h4AM951cU_Z0RPDaJRnVDj5KfqhEOOJSb8Y Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 325768c3525246e791e7cef1c2e8c2c2 Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-LiveMigrationNegativeTest-180530853 Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:01:14.946669 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/325768c3525246e791e7cef1c2e8c2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-LiveMigrationNegativeTest-180530853 Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 325768c3525246e791e7cef1c2e8c2c2 Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-180530853 Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-LiveMigrationNegativeTest-180530853-project-admin Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 04e4f6ad90104efa9a466d0d9d655fbc Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-LiveMigrationNegativeTest-180530853-project-admin Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Sep 18 01:01:14.948309 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot 'os-migrateLive' instance ba90c59c-d715-413b-9337-c7b7dec88ca7 while it is in vm_state suspended Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'ba90c59c-d715-413b-9337-c7b7dec88ca7', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 18 01:01:14.949067 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba90c59c-d715-413b-9337-c7b7dec88ca7 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:14.950208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance ba90c59c-d715-413b-9337-c7b7dec88ca7 while it is in vm_state suspended Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance ba90c59c-d715-413b-9337-c7b7dec88ca7 while it is in vm_state suspended Sep 18 01:01:14.951375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:14.952969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance ba90c59c-d715-413b-9337-c7b7dec88ca7 while it is in vm_state suspended {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:14.953917 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6aea754c-dd4e-4700-b981-b8c72051f798 tempest-LiveMigrationNegativeTest-180530853 tempest-LiveMigrationNegativeTest-180530853-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7/action" status: 409 len: 155 microversion: 2.1 time: 0.254404 Sep 18 01:01:14.961417 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 227/445] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:01:14 2022] POST /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7/action => generated 155 bytes in 265 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:14.975808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:14.976329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:14.995043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.995650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.999392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.000823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.001905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.004281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.048477 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:15.058238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:15.083939 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0a142a7-11d4-4b9c-b648-07d71d186f51 tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1684810770", "id": 1706982659, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:15.123891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0a142a7-11d4-4b9c-b648-07d71d186f51 tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.728177 Sep 18 01:01:15.124514 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 219/446] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:01:14 2022] POST /compute/v2.1/flavors => generated 471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:01:15.134038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:15.135090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:15.148056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.148927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.150205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.151783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.154217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.155527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.281266 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-516539cf-2e65-4bab-95d0-c90de0bbf31c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 204 len: 0 microversion: 2.1 time: 0.316783 Sep 18 01:01:15.281979 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 228/447] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:14 2022] DELETE /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:15.305748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-74dcb0d7-3769-4610-a24e-0df4d5de49b0 tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:15.816877 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-74dcb0d7-3769-4610-a24e-0df4d5de49b0 tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1706982659/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.528454 Sep 18 01:01:15.826469 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 229/448] 10.222.0.25 () {62 vars in 1265 bytes} [Sun Sep 18 01:01:15 2022] POST /compute/v2.1/flavors/1706982659/os-extra_specs => generated 62 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:15.838329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:15.840505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:15.851667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.852410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.853142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.854143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.857383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.858422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.207975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:16.230634 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-497f474e-0094-4960-b38b-0726cc092661 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 1.104012 Sep 18 01:01:16.232037 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 220/449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:15 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:16.240567 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:16.241786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:16.258392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:16.260218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:16.261273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.267088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:16.267766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:16.271036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.485732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:16.507534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:16.536318 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8dfaa27-ee95-4f42-8efb-c558a3820b59 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1465 microversion: 2.1 time: 0.703828 Sep 18 01:01:16.540217 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 230/450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:15 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1465 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:16.553926 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-748b0e4c-543c-4c4d-8285-cd629afdb0d6 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.320190 Sep 18 01:01:16.555024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c109faf-354e-426d-8e2a-d3081c9ff458 tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:16.581096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 221/451] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:16 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:16.597921 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:16.650623 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c109faf-354e-426d-8e2a-d3081c9ff458 tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1706982659" status: 202 len: 0 microversion: 2.86 time: 0.105346 Sep 18 01:01:16.655275 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 231/452] 10.222.0.25 () {60 vars in 1202 bytes} [Sun Sep 18 01:01:16 2022] DELETE /compute/v2.1/flavors/1706982659 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:16.665805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5d55e67b-7e20-4949-a2b4-e63cf66897fd tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:16.754297 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5d55e67b-7e20-4949-a2b4-e63cf66897fd tempest-FlavorMetadataValidation-12541927 tempest-FlavorMetadataValidation-12541927-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.094891 Sep 18 01:01:16.755752 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 232/453] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:01:16 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:17.106904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b9721022-10bd-4b8c-bfcb-82a1a0c7d117 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-727546657", "id": 161403073, "os-flavor-access:is_public": "False"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:17.137503 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b9721022-10bd-4b8c-bfcb-82a1a0c7d117 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.554881 Sep 18 01:01:17.141811 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 222/454] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:16 2022] POST /compute/v2.1/flavors => generated 435 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:17.166088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48d97f00-fd7d-4932-8dde-490896366a95 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:17.270028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:17.273723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:17.294333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.295471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.298777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:17.299937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.300646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.301963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:17.913676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-48d97f00-fd7d-4932-8dde-490896366a95 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/161403073/action" status: 200 len: 96 microversion: 2.1 time: 0.762503 Sep 18 01:01:17.917374 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 233/455] 10.222.0.25 () {60 vars in 1197 bytes} [Sun Sep 18 01:01:17 2022] POST /compute/v2.1/flavors/161403073/action => generated 96 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:17.937784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:17.946532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:17.965667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.966616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.967316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:17.969492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.972226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.973320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:18.242421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:18.256497 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb5afa6a-8978-41c8-b5cf-a99d9166f1b4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 1.000721 Sep 18 01:01:18.257825 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 223/456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:17 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:18.269528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:18.270178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:18.279639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:18.280144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:18.280586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:18.281350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:18.281858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:18.282288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:18.839469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:18.917183 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-57227666-9e14-42db-a954-d6469a8c0567 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.657498 Sep 18 01:01:18.918648 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 224/457] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:18 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:18.926705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55cc341c-2474-4c0b-a023-47150063156e tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:19.083300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:19.092358 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a99b8e7b-77f8-4719-92b4-14c6b5a66791 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 200 len: 1465 microversion: 2.1 time: 1.172785 Sep 18 01:01:19.106411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 234/458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:17 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 1465 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:19.111375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4b48309a-0862-4775-ae5f-fe2ac634b1a4 req-c6ed3fd1-3d74-4273-9cca-4f9dcc9458bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba90c59c-d715-413b-9337-c7b7dec88ca7", "name": "network-vif-deleted", "tag": "8e4beaff-2f6c-4190-82d2-d98bc44a57a9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:19.134677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4b48309a-0862-4775-ae5f-fe2ac634b1a4 req-c6ed3fd1-3d74-4273-9cca-4f9dcc9458bb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.136737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4b48309a-0862-4775-ae5f-fe2ac634b1a4 req-c6ed3fd1-3d74-4273-9cca-4f9dcc9458bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.138387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4b48309a-0862-4775-ae5f-fe2ac634b1a4 req-c6ed3fd1-3d74-4273-9cca-4f9dcc9458bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.171732 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4b48309a-0862-4775-ae5f-fe2ac634b1a4 req-c6ed3fd1-3d74-4273-9cca-4f9dcc9458bb service nova] Creating event network-vif-deleted:8e4beaff-2f6c-4190-82d2-d98bc44a57a9 for instance ba90c59c-d715-413b-9337-c7b7dec88ca7 on n-h1-master-1 Sep 18 01:01:19.187137 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4b48309a-0862-4775-ae5f-fe2ac634b1a4 req-c6ed3fd1-3d74-4273-9cca-4f9dcc9458bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078951 Sep 18 01:01:19.194657 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 235/459] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:19.300519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:19.309904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:19.323671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.324467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.330065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.331714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.341398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.342619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.431786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-55cc341c-2474-4c0b-a023-47150063156e tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project f2e917048611412c8c0e484427bd6888 combination. Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55cc341c-2474-4c0b-a023-47150063156e tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Request method failure captured: Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/flavors/161403073/action HTTP/1.1 Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 67 Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm3a5NDA2f9Vdwv4msUMhLlg4vwxYX5uO_8Ha7ZikWVDjgHiOBo4bgAy7jTlEVEiwuwSmN2_p4-z0iK1akodyacecNnYS2qlOzfmziD-LGV_unLqabGVxhSA-cAMHHjb9xmjEI9-1bxQsRb9zO21srjNpFPHpJPWmxkJcZbDzuweyl8 Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 2de5026b90634e82929655006e280dda Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:01:19.471410 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2de5026b90634e82929655006e280dda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2de5026b90634e82929655006e280dda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2de5026b90634e82929655006e280dda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2de5026b90634e82929655006e280dda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 2de5026b90634e82929655006e280dda Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: ca38c94dbbcd460e9ce653d972507b0e Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: {"addTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} Sep 18 01:01:19.473287 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: exception: Flavor access already exists for flavor 33 and project f2e917048611412c8c0e484427bd6888 combination. Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '161403073', 'body': {'addTenantAccess': {'tenant': 'f2e917048611412c8c0e484427bd6888'}}} Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result.read() Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 01:01:19.474033 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-f2e917048611412c8c0e484427bd6888' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi session.flush() Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 01:01:19.475179 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 01:01:19.477104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 01:01:19.478558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result.read() Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-f2e917048611412c8c0e484427bd6888' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 18, 1, 1, 19, 389330), 'updated_at': None, 'flavor_id': 33, 'project_id': 'f2e917048611412c8c0e484427bd6888'}] Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:19.479542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project f2e917048611412c8c0e484427bd6888 combination. Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:19.480864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project f2e917048611412c8c0e484427bd6888 combination. Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:19.486817 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:19.489343 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project f2e917048611412c8c0e484427bd6888 combination. Sep 18 01:01:19.489343 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:19.493298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55cc341c-2474-4c0b-a023-47150063156e tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project f2e917048611412c8c0e484427bd6888 combination. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:19.495087 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55cc341c-2474-4c0b-a023-47150063156e tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/161403073/action" status: 409 len: 152 microversion: 2.1 time: 0.574450 Sep 18 01:01:19.503212 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 225/460] 10.222.0.25 () {60 vars in 1197 bytes} [Sun Sep 18 01:01:18 2022] POST /compute/v2.1/flavors/161403073/action => generated 152 bytes in 584 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:19.508673 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a3682a2-b3bf-4778-8a4a-7b2b79d6f7cf tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:19.697799 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a3682a2-b3bf-4778-8a4a-7b2b79d6f7cf tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/161403073/action" status: 200 len: 21 microversion: 2.1 time: 0.188682 Sep 18 01:01:19.699647 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 226/461] 10.222.0.25 () {60 vars in 1197 bytes} [Sun Sep 18 01:01:19 2022] POST /compute/v2.1/flavors/161403073/action => generated 21 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:19.712947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4bf43684-7c0c-4d86-abd8-08d983ad2932 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:19.767585 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4bf43684-7c0c-4d86-abd8-08d983ad2932 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/161403073" status: 202 len: 0 microversion: 2.1 time: 0.059799 Sep 18 01:01:19.784201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 227/462] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:01:19 2022] DELETE /compute/v2.1/flavors/161403073 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:19.810246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b60f2f43-9f42-4658-bced-c602a7ad8936 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:19.905128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b60f2f43-9f42-4658-bced-c602a7ad8936 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.113361 Sep 18 01:01:19.939024 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 228/463] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:19 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:19.947327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ef31158-c1b2-4dc0-85f8-6d12f3ee9d70 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1848874153", "id": 899561510, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:20.005674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ef31158-c1b2-4dc0-85f8-6d12f3ee9d70 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.064641 Sep 18 01:01:20.020554 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 229/464] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:19 2022] POST /compute/v2.1/flavors => generated 435 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:20.030717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.032026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:20.038642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.039494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.040413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.041514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.042540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.043257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.047388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:20.057672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-abe0d430-29f3-452d-8c8a-03e18d08feb7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 0.765175 Sep 18 01:01:20.061223 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 236/465] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:19 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:20.077805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1be338ec-2479-4152-acc1-62a3bc6ac36a tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.108089 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-1be338ec-2479-4152-acc1-62a3bc6ac36a tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1be338ec-2479-4152-acc1-62a3bc6ac36a tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Request method failure captured: Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/flavors/899561510/os-flavor-access HTTP/1.1 Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3a5NDA2f9Vdwv4msUMhLlg4vwxYX5uO_8Ha7ZikWVDjgHiOBo4bgAy7jTlEVEiwuwSmN2_p4-z0iK1akodyacecNnYS2qlOzfmziD-LGV_unLqabGVxhSA-cAMHHjb9xmjEI9-1bxQsRb9zO21srjNpFPHpJPWmxkJcZbDzuweyl8 Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 2de5026b90634e82929655006e280dda Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:01:20.112407 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2de5026b90634e82929655006e280dda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2de5026b90634e82929655006e280dda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2de5026b90634e82929655006e280dda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2de5026b90634e82929655006e280dda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 2de5026b90634e82929655006e280dda Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: ca38c94dbbcd460e9ce653d972507b0e Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: exception: Access list not available for public flavors. Sep 18 01:01:20.113871 n-d-master-1 devstack@n-api.service[122373]: action_args: {'flavor_id': '899561510'} Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 18 01:01:20.114566 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.118247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1be338ec-2479-4152-acc1-62a3bc6ac36a tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:20.119342 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1be338ec-2479-4152-acc1-62a3bc6ac36a tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/899561510/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.056497 Sep 18 01:01:20.120455 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 237/466] 10.222.0.25 () {58 vars in 1206 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/flavors/899561510/os-flavor-access => generated 91 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:20.136440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.143346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: ba90c59c-d715-413b-9337-c7b7dec88ca7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:20.155033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.156265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.156851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.159453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.167146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.173479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.197452 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] HTTP exception thrown: Instance ba90c59c-d715-413b-9337-c7b7dec88ca7 could not be found. Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Request method failure captured: Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 HTTP/1.1 Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2kDo_0zc2LyPxUH7CGouw2uCxk2MXcHFV23dEJXpcNKN1-h4ffRjScCU3VJTNS2YReTWqkt0gQRaYoDuYsqGQWKwOqZc9FidQD9AaDODmdeavs7YdqnKvqIuV1VHqv0u3RM4mboeaZM_0Ce0KpUpkEqSfhe_sKo53hHPBA_MPrxag Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4e98321089b343359e9ae05ad97b8372 Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-LiveMigrationNegativeTest-362150345 Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:20.201750 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e98321089b343359e9ae05ad97b8372"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e98321089b343359e9ae05ad97b8372"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e98321089b343359e9ae05ad97b8372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e98321089b343359e9ae05ad97b8372"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-LiveMigrationNegativeTest-362150345 Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4e98321089b343359e9ae05ad97b8372 Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-362150345 Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-LiveMigrationNegativeTest-362150345-project Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c06c8778aeff44d2ba7a3a36336b32a3 Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-LiveMigrationNegativeTest-362150345-project Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: exception: Instance ba90c59c-d715-413b-9337-c7b7dec88ca7 could not be found. Sep 18 01:01:20.203162 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'ba90c59c-d715-413b-9337-c7b7dec88ca7'} Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba90c59c-d715-413b-9337-c7b7dec88ca7 could not be found. Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:20.203949 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba90c59c-d715-413b-9337-c7b7dec88ca7 could not be found. Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba90c59c-d715-413b-9337-c7b7dec88ca7 could not be found. Sep 18 01:01:20.205027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:20.208837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Returning 404 to user: Instance ba90c59c-d715-413b-9337-c7b7dec88ca7 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:20.209986 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de938fa7-f7e1-43cf-84bd-9bd1b47024c4 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7" status: 404 len: 111 microversion: 2.1 time: 0.086269 Sep 18 01:01:20.212892 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 238/467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/servers/ba90c59c-d715-413b-9337-c7b7dec88ca7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:20.222158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3be2b66-48bb-49e5-90da-85d617bd7084 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.257398 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3be2b66-48bb-49e5-90da-85d617bd7084 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/899561510" status: 202 len: 0 microversion: 2.1 time: 0.041942 Sep 18 01:01:20.265167 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 239/468] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:01:20 2022] DELETE /compute/v2.1/flavors/899561510 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:20.279733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.280633 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:20.309054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.311052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.312611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.314244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.315233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.315988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.390274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:20.469860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:20.557632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb3e83f1-82fe-4ee5-97bb-93cb2a9a2a09 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 204 len: 0 microversion: 2.1 time: 0.289588 Sep 18 01:01:20.564437 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-004e4239-0c84-4d6a-861e-b8912d2ece7a tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.540797 Sep 18 01:01:20.566328 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 240/469] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:20 2022] DELETE /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:20.566674 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 230/470] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:20.597751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.599211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:20.615896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.616403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-faceb437-4316-4308-968c-f20275c7fc33 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.617071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.619690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.622312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.627308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.628184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.756645 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-faceb437-4316-4308-968c-f20275c7fc33 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.163940 Sep 18 01:01:20.758597 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 241/471] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:20.811685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e2e16e8-9a50-44ec-bc9f-c712ad9d16a9 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-883154730", "id": 1069602564, "os-flavor-access:is_public": "False"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:20.940990 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e2e16e8-9a50-44ec-bc9f-c712ad9d16a9 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.149295 Sep 18 01:01:20.946827 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 242/472] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:20 2022] POST /compute/v2.1/flavors => generated 438 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:20.982024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:21.004429 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e3ce5549-5cbd-44fa-85b3-2100be11eb2a tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1475 microversion: 2.1 time: 0.435236 Sep 18 01:01:21.005947 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 231/473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1475 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:21.100406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.107628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:21.124816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.125698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.126445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.127672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.139496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.140480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.686168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cfcbc80-f9ac-44e3-b949-cdacd48b31cd tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:21.701286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7cfcbc80-f9ac-44e3-b949-cdacd48b31cd tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd224c1ace26b4ea28e4cebe3c8fbbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e917048611412c8c0e484427bd6888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cfcbc80-f9ac-44e3-b949-cdacd48b31cd tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Request method failure captured: Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/flavors/1069602564/action HTTP/1.1 Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 67 Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3YXaMw29I_6VSCfbNjy4ZwjiWujK0cqpz-Bt0vMq39q4kKvF3o3elT4QEF7jG4sXVvtAbMRBKIuSlotIvwfpbtz_5S46Ihv-pLD0Rdt_Hur71d6WEp8DpWhZRtwnmQT7fFxh5tZd1QRfw-Cav8LiSQWmasqFF8UBsoPgfnfUDwHP8 Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f2e917048611412c8c0e484427bd6888 Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1381871940 Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:21.709598 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2e917048611412c8c0e484427bd6888"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2e917048611412c8c0e484427bd6888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2e917048611412c8c0e484427bd6888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2e917048611412c8c0e484427bd6888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1381871940 Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f2e917048611412c8c0e484427bd6888 Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1381871940 Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FlavorsAccessNegativeTestJSON-1381871940-project Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d224c1ace26b4ea28e4cebe3c8fbbd4a Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1381871940-project Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: {"addTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} Sep 18 01:01:21.712209 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '1069602564', 'body': {'addTenantAccess': {'tenant': 'f2e917048611412c8c0e484427bd6888'}}} Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:01:21.713410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 18 01:01:21.715823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.718237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cfcbc80-f9ac-44e3-b949-cdacd48b31cd tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:21.724276 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7cfcbc80-f9ac-44e3-b949-cdacd48b31cd tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] 10.222.0.25 "POST /compute/v2.1/flavors/1069602564/action" status: 403 len: 130 microversion: 2.1 time: 0.755203 Sep 18 01:01:21.726277 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 243/474] 10.222.0.25 () {60 vars in 1200 bytes} [Sun Sep 18 01:01:20 2022] POST /compute/v2.1/flavors/1069602564/action => generated 130 bytes in 770 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:21.743077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.744917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:21.761680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:21.780633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.783208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.784534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.785685 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb3fda20-348b-4600-83c9-ef865afc633d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 0.700788 Sep 18 01:01:21.786400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.787594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.788705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.790806 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 232/475] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:21 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:21.799002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d67e792a-7dad-4d63-8695-90ac1336cfaa tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.826845 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d67e792a-7dad-4d63-8695-90ac1336cfaa tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1069602564" status: 202 len: 0 microversion: 2.1 time: 0.033309 Sep 18 01:01:21.832529 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 233/476] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:21 2022] DELETE /compute/v2.1/flavors/1069602564 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:21.842985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-98819e64-f1da-4645-a4a5-97afb8f58200 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.932513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-98819e64-f1da-4645-a4a5-97afb8f58200 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.095002 Sep 18 01:01:21.955740 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 234/477] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:21 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:21.974289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-efcae293-4598-4552-9e08-ca7c30510e00 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1522217269", "id": 1748689690, "os-flavor-access:is_public": "False"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:22.021433 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-efcae293-4598-4552-9e08-ca7c30510e00 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.051205 Sep 18 01:01:22.028163 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 235/478] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:21 2022] POST /compute/v2.1/flavors => generated 439 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:22.050616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81c9b49a-f1a8-48b4-ae98-b0ee38cb77a7 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:22.056389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:22.111005 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20b7fcd9-3657-402d-9946-e9c047ae0e11 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.382837 Sep 18 01:01:22.133671 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 244/479] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:21 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:22.164831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:22.175858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:22.184970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:22.185473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:22.196644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:22.197467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:22.197979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:22.198435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:22.642891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-81c9b49a-f1a8-48b4-ae98-b0ee38cb77a7 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1748689690/action" status: 200 len: 97 microversion: 2.1 time: 0.604995 Sep 18 01:01:22.647506 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 236/480] 10.222.0.25 () {60 vars in 1200 bytes} [Sun Sep 18 01:01:22 2022] POST /compute/v2.1/flavors/1748689690/action => generated 97 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:22.670634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4888da0-c23a-4d17-99e4-1343fffc8e95 tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:22.682164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4888da0-c23a-4d17-99e4-1343fffc8e95 tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd224c1ace26b4ea28e4cebe3c8fbbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e917048611412c8c0e484427bd6888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4888da0-c23a-4d17-99e4-1343fffc8e95 tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Request method failure captured: Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/flavors/1748689690/action HTTP/1.1 Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 70 Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm3YXaMw29I_6VSCfbNjy4ZwjiWujK0cqpz-Bt0vMq39q4kKvF3o3elT4QEF7jG4sXVvtAbMRBKIuSlotIvwfpbtz_5S46Ihv-pLD0Rdt_Hur71d6WEp8DpWhZRtwnmQT7fFxh5tZd1QRfw-Cav8LiSQWmasqFF8UBsoPgfnfUDwHP8 Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: f2e917048611412c8c0e484427bd6888 Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1381871940 Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:22.684695 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2e917048611412c8c0e484427bd6888"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2e917048611412c8c0e484427bd6888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2e917048611412c8c0e484427bd6888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2e917048611412c8c0e484427bd6888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1381871940 Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: f2e917048611412c8c0e484427bd6888 Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1381871940 Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsAccessNegativeTestJSON-1381871940-project Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d224c1ace26b4ea28e4cebe3c8fbbd4a Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1381871940-project Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: {"removeTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} Sep 18 01:01:22.686651 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1748689690', 'body': {'removeTenantAccess': {'tenant': 'f2e917048611412c8c0e484427bd6888'}}} Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can( Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:01:22.687909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 18 01:01:22.690695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:22.694527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4888da0-c23a-4d17-99e4-1343fffc8e95 tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:22.696763 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4888da0-c23a-4d17-99e4-1343fffc8e95 tempest-FlavorsAccessNegativeTestJSON-1381871940 tempest-FlavorsAccessNegativeTestJSON-1381871940-project] 10.222.0.25 "POST /compute/v2.1/flavors/1748689690/action" status: 403 len: 133 microversion: 2.1 time: 0.038790 Sep 18 01:01:22.698517 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 237/481] 10.222.0.25 () {60 vars in 1200 bytes} [Sun Sep 18 01:01:22 2022] POST /compute/v2.1/flavors/1748689690/action => generated 133 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:22.713868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64af6eda-01d9-4b8c-91f4-07075cb9110f tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f2e917048611412c8c0e484427bd6888"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:23.014538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:23.033448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc882acc-872e-4438-b8bb-a3d2a1fe55d3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1475 microversion: 2.1 time: 0.898055 Sep 18 01:01:23.035599 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 245/482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:22 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1475 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:23.041143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:23.044690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:23.063259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.066808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.067788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.069943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.070663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.071298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.399239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:23.424024 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f0cb129-c4fd-442e-a8e7-2bbd1e4e43c7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 0.386578 Sep 18 01:01:23.424994 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 246/483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:23 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:23.430612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-944e7981-92b3-4b04-9316-f404407d2ca3 req-a8a652c0-3afe-4e07-8035-4fcc5bf3b71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc220ad8-f059-4a53-86a5-ee792b74597f", "name": "network-vif-plugged", "status": "completed", "tag": "3df39045-3c0b-4322-8a83-12731bd21bc2"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:23.452405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-944e7981-92b3-4b04-9316-f404407d2ca3 req-a8a652c0-3afe-4e07-8035-4fcc5bf3b71b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.453308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-944e7981-92b3-4b04-9316-f404407d2ca3 req-a8a652c0-3afe-4e07-8035-4fcc5bf3b71b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.454252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-944e7981-92b3-4b04-9316-f404407d2ca3 req-a8a652c0-3afe-4e07-8035-4fcc5bf3b71b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.472622 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-944e7981-92b3-4b04-9316-f404407d2ca3 req-a8a652c0-3afe-4e07-8035-4fcc5bf3b71b service nova] Creating event network-vif-plugged:3df39045-3c0b-4322-8a83-12731bd21bc2 for instance fc220ad8-f059-4a53-86a5-ee792b74597f on n-h2-master-1 Sep 18 01:01:23.482734 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-944e7981-92b3-4b04-9316-f404407d2ca3 req-a8a652c0-3afe-4e07-8035-4fcc5bf3b71b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055814 Sep 18 01:01:23.487587 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 247/484] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:23.497665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:23.498793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:23.505722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.506583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.507077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.507802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.508452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.508887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.626506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:23.665637 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d1e4c39d-f519-4b42-a3b8-b9fddb8c6109 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.175857 Sep 18 01:01:23.676464 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 248/485] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:23 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:23.752750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64af6eda-01d9-4b8c-91f4-07075cb9110f tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1748689690/action" status: 200 len: 21 microversion: 2.1 time: 1.045165 Sep 18 01:01:23.754259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 238/486] 10.222.0.25 () {60 vars in 1200 bytes} [Sun Sep 18 01:01:22 2022] POST /compute/v2.1/flavors/1748689690/action => generated 21 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:23.765954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b06f70bb-f729-4573-8def-7a7ad05b3ff2 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:23.810309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b06f70bb-f729-4573-8def-7a7ad05b3ff2 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1748689690" status: 202 len: 0 microversion: 2.1 time: 0.048720 Sep 18 01:01:23.810909 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 239/487] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:23 2022] DELETE /compute/v2.1/flavors/1748689690 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:23.821003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f489c33b-2114-45a3-b688-fe5867f81ae0 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:23.877913 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f489c33b-2114-45a3-b688-fe5867f81ae0 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.061842 Sep 18 01:01:23.881226 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 240/488] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:23 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:23.904911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f241d36a-d6fa-4541-9b13-9f3e64ef8331 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-277584588", "id": 1179041147, "os-flavor-access:is_public": "False"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:23.951275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f241d36a-d6fa-4541-9b13-9f3e64ef8331 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.050385 Sep 18 01:01:23.965935 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 241/489] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:23 2022] POST /compute/v2.1/flavors => generated 438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:23.974987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b96a0339-8cec-483f-85b8-72a4ebdc66b4 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cc3533ce843b449ab6388a658bf26aae"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:24.221737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1424474360", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "cdfd9210-2a2b-4d14-ac9e-64814397e610"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:24.343410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] validate_networks() for [('cdfd9210-2a2b-4d14-ac9e-64814397e610', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:01:24.659577 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:24.691155 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b96a0339-8cec-483f-85b8-72a4ebdc66b4 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] HTTP exception thrown: Flavor access not found for 37 / cc3533ce843b449ab6388a658bf26aae combination. Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b96a0339-8cec-483f-85b8-72a4ebdc66b4 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Request method failure captured: Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/flavors/1179041147/action HTTP/1.1 Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 70 Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm3a5NDA2f9Vdwv4msUMhLlg4vwxYX5uO_8Ha7ZikWVDjgHiOBo4bgAy7jTlEVEiwuwSmN2_p4-z0iK1akodyacecNnYS2qlOzfmziD-LGV_unLqabGVxhSA-cAMHHjb9xmjEI9-1bxQsRb9zO21srjNpFPHpJPWmxkJcZbDzuweyl8 Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 2de5026b90634e82929655006e280dda Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:01:24.704243 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2de5026b90634e82929655006e280dda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2de5026b90634e82929655006e280dda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2de5026b90634e82929655006e280dda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2de5026b90634e82929655006e280dda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 2de5026b90634e82929655006e280dda Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864 Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: ca38c94dbbcd460e9ce653d972507b0e Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: {"removeTenantAccess": {"tenant": "cc3533ce843b449ab6388a658bf26aae"}} Sep 18 01:01:24.706705 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: exception: Flavor access not found for 37 / cc3533ce843b449ab6388a658bf26aae combination. Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1179041147', 'body': {'removeTenantAccess': {'tenant': 'cc3533ce843b449ab6388a658bf26aae'}}} Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 18 01:01:24.707615 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / cc3533ce843b449ab6388a658bf26aae combination. Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / cc3533ce843b449ab6388a658bf26aae combination. Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:24.708619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:24.709730 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:24.709730 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:24.709730 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:24.709730 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:24.709730 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / cc3533ce843b449ab6388a658bf26aae combination. Sep 18 01:01:24.709730 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:24.711236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b96a0339-8cec-483f-85b8-72a4ebdc66b4 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Returning 404 to user: Flavor access not found for 37 / cc3533ce843b449ab6388a658bf26aae combination. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:24.712604 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b96a0339-8cec-483f-85b8-72a4ebdc66b4 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1179041147/action" status: 404 len: 124 microversion: 2.1 time: 0.745101 Sep 18 01:01:24.713446 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 242/490] 10.222.0.25 () {60 vars in 1200 bytes} [Sun Sep 18 01:01:23 2022] POST /compute/v2.1/flavors/1179041147/action => generated 124 bytes in 747 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:24.733492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:24.736772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:24.752161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.755050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.756173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.757112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.760760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.761538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.839957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.840761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.841510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.842329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lazy-loading 'fault' on Instance uuid 93bb6390-00c2-4008-a004-9ef029cc06c1 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:25.016384 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:25.032218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5436b9ba-fa24-4c6e-aa22-46afdadab97b tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1309 microversion: 2.1 time: 0.316464 Sep 18 01:01:25.035695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 243/491] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:24 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:25.041318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-288ccbed-449d-4a0a-8980-a2335d20b762 req-2c54bfa2-d842-4fc2-9c73-38c894f74de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bb6390-00c2-4008-a004-9ef029cc06c1", "name": "network-vif-deleted", "tag": "8475792b-ef04-40ae-b8dc-3d688338f395"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:25.048399 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:25.053398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-288ccbed-449d-4a0a-8980-a2335d20b762 req-2c54bfa2-d842-4fc2-9c73-38c894f74de0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.054427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-288ccbed-449d-4a0a-8980-a2335d20b762 req-2c54bfa2-d842-4fc2-9c73-38c894f74de0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.054937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-288ccbed-449d-4a0a-8980-a2335d20b762 req-2c54bfa2-d842-4fc2-9c73-38c894f74de0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.068890 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-288ccbed-449d-4a0a-8980-a2335d20b762 req-2c54bfa2-d842-4fc2-9c73-38c894f74de0 service nova] Creating event network-vif-deleted:8475792b-ef04-40ae-b8dc-3d688338f395 for instance 93bb6390-00c2-4008-a004-9ef029cc06c1 on n-h2-master-1 Sep 18 01:01:25.075945 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-288ccbed-449d-4a0a-8980-a2335d20b762 req-2c54bfa2-d842-4fc2-9c73-38c894f74de0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038361 Sep 18 01:01:25.077204 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 244/492] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:25.083346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:25.084582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:25.092580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.093279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.094476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.095260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.095854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.096401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.434094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:01:25.434869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:01:25.435229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:25.435388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:01:25.435868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:01:25.436362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:01:25.456699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.458089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.458089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.458872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.459313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.459838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.481642 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4913d054-2f01-49df-b0d0-5da547fd6cc5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 0.398955 Sep 18 01:01:25.488121 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 245/493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:25 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:25.502553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:25.508319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for user cf8f60e6d52b498c90dd1ace5418ae13 and project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:25.520214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:25.520920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:25.531117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:01:25.536602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:01:25.540305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.541014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.542738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.550025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.553672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.554422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.658050 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2fbfbd1a-b713-4c3f-a656-04cc95c5bbea tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977206 Sep 18 01:01:25.658748 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 249/494] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:01:25.692180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1da08cec-6b64-495b-b93d-f3fec066a8bc tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:25.754408 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1da08cec-6b64-495b-b93d-f3fec066a8bc tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1179041147" status: 202 len: 0 microversion: 2.1 time: 0.090894 Sep 18 01:01:25.761203 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 250/495] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:01:25 2022] DELETE /compute/v2.1/flavors/1179041147 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:25.783476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b3a09a9f-5ac1-4566-b7ca-31ff16803902 req-4998b211-39d0-4986-8eb8-128f0926caa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb91f594-076a-4e8a-8fc7-64374e6a940c", "name": "network-vif-plugged", "status": "completed", "tag": "9fbacf54-4217-4dc3-9491-f2614a46bca3"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:25.813171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b3a09a9f-5ac1-4566-b7ca-31ff16803902 req-4998b211-39d0-4986-8eb8-128f0926caa7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.819717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b3a09a9f-5ac1-4566-b7ca-31ff16803902 req-4998b211-39d0-4986-8eb8-128f0926caa7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.820556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b3a09a9f-5ac1-4566-b7ca-31ff16803902 req-4998b211-39d0-4986-8eb8-128f0926caa7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.820730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:25.846715 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b3a09a9f-5ac1-4566-b7ca-31ff16803902 req-4998b211-39d0-4986-8eb8-128f0926caa7 service nova] Creating event network-vif-plugged:9fbacf54-4217-4dc3-9491-f2614a46bca3 for instance eb91f594-076a-4e8a-8fc7-64374e6a940c on n-h2-master-1 Sep 18 01:01:25.869596 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b3a09a9f-5ac1-4566-b7ca-31ff16803902 req-4998b211-39d0-4986-8eb8-128f0926caa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102408 Sep 18 01:01:25.874722 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 251/496] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:25.890020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1e6577e1-576f-4177-80dc-94de32d48cbb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:25.891477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1e6577e1-576f-4177-80dc-94de32d48cbb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:25.930545 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-687be213-d857-4f33-a546-1478370d06e7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.419429 Sep 18 01:01:25.933833 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 246/497] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:25 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:25.970908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50dc6dfc-74be-4f51-b63e-609cb14afa58 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:26.040897 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50dc6dfc-74be-4f51-b63e-609cb14afa58 tempest-FlavorsAccessNegativeTestJSON-1753215864 tempest-FlavorsAccessNegativeTestJSON-1753215864-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.100788 Sep 18 01:01:26.041871 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 247/498] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:25 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:26.072211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:26.075623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:26.125005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.129420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.130771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.132580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.136382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.140253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.218722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1e6577e1-576f-4177-80dc-94de32d48cbb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:26.228843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1e6577e1-576f-4177-80dc-94de32d48cbb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1211 microversion: 2.1 time: 0.351830 Sep 18 01:01:26.231716 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 252/499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:25 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1211 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:26.290980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.291738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.292186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.292705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lazy-loading 'fault' on Instance uuid 93bb6390-00c2-4008-a004-9ef029cc06c1 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:26.474196 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06c8778aeff44d2ba7a3a36336b32a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e98321089b343359e9ae05ad97b8372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:26.514817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:26.515640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:26.520081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f33a47c-879a-4648-a930-9c5a33c2f53c tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 200 len: 1309 microversion: 2.1 time: 0.452603 Sep 18 01:01:26.530763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 248/500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:26 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:26.536493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.538656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.541490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.543132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.546774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.548865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.174760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:27.193531 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f361ecd-53b9-4d73-80f8-30a74ea5b79d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 0.685020 Sep 18 01:01:27.196823 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 253/501] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:26 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:27.205629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:27.208543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:27.239172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.243357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.245083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.250267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.253968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.257008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.371677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31a78433-aa0e-45ee-b988-b5207f8d94be tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-890363907", "ram": 512, "vcpus": 1, "disk": 10, "id": 605062199, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:27.419091 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31a78433-aa0e-45ee-b988-b5207f8d94be tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.847264 Sep 18 01:01:27.423434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:27.424276 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 249/502] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:26 2022] POST /compute/v2.1/flavors => generated 412 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:27.448436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:27.453748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:27.467750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d22f3546-b4d7-4828-9574-b484d429acc4 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.269325 Sep 18 01:01:27.472957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.473673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.474239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.475100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.475609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.476198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.482562 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 254/503] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:27.495096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a236515-0732-4f08-99f4-2bebd1eb393c tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:27.585536 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=7,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:27.622602 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a236515-0732-4f08-99f4-2bebd1eb393c tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/605062199/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.138793 Sep 18 01:01:27.623400 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 255/504] 10.222.0.25 () {60 vars in 1221 bytes} [Sun Sep 18 01:01:27 2022] POST /compute/v2.1/flavors/605062199/os-extra_specs => generated 66 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:27.672415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:27.676996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] [instance: 93bb6390-00c2-4008-a004-9ef029cc06c1] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:27.717736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:27.727330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.733643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.733807 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5eaf292-d850-4762-a0f3-147f44046413 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1207 microversion: 2.1 time: 0.307828 Sep 18 01:01:27.734401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.739386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.740450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.744240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.750679 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 250/505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1207 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:27.802621 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:27.809227 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] HTTP exception thrown: Instance 93bb6390-00c2-4008-a004-9ef029cc06c1 could not be found. Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Request method failure captured: Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 HTTP/1.1 Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2kDo_0zc2LyPxUH7CGouw2uCxk2MXcHFV23dEJXpcNKN1-h4ffRjScCU3VJTNS2YReTWqkt0gQRaYoDuYsqGQWKwOqZc9FidQD9AaDODmdeavs7YdqnKvqIuV1VHqv0u3RM4mboeaZM_0Ce0KpUpkEqSfhe_sKo53hHPBA_MPrxag Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4e98321089b343359e9ae05ad97b8372 Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-LiveMigrationNegativeTest-362150345 Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:27.811198 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e98321089b343359e9ae05ad97b8372"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e98321089b343359e9ae05ad97b8372"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e98321089b343359e9ae05ad97b8372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e98321089b343359e9ae05ad97b8372"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-LiveMigrationNegativeTest-362150345 Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4e98321089b343359e9ae05ad97b8372 Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-362150345 Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-LiveMigrationNegativeTest-362150345-project Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c06c8778aeff44d2ba7a3a36336b32a3 Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-LiveMigrationNegativeTest-362150345-project Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 93bb6390-00c2-4008-a004-9ef029cc06c1 could not be found. Sep 18 01:01:27.812540 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '93bb6390-00c2-4008-a004-9ef029cc06c1'} Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93bb6390-00c2-4008-a004-9ef029cc06c1 could not be found. Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:27.813382 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93bb6390-00c2-4008-a004-9ef029cc06c1 could not be found. Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93bb6390-00c2-4008-a004-9ef029cc06c1 could not be found. Sep 18 01:01:27.814732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:27.817109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] Returning 404 to user: Instance 93bb6390-00c2-4008-a004-9ef029cc06c1 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:27.818232 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a517bfa4-da16-4b75-b480-599941d7afc3 tempest-LiveMigrationNegativeTest-362150345 tempest-LiveMigrationNegativeTest-362150345-project] 10.222.0.25 "GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1" status: 404 len: 111 microversion: 2.1 time: 0.163903 Sep 18 01:01:27.819373 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 256/506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/servers/93bb6390-00c2-4008-a004-9ef029cc06c1 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:28.112640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6dd1bdc4-d4ac-42ea-80ba-5292b30075bd tempest-FlavorsExtraSpecsTestJSON-904913861 tempest-FlavorsExtraSpecsTestJSON-904913861-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:28.155077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6dd1bdc4-d4ac-42ea-80ba-5292b30075bd tempest-FlavorsExtraSpecsTestJSON-904913861 tempest-FlavorsExtraSpecsTestJSON-904913861-project] 10.222.0.25 "GET /compute/v2.1/flavors/605062199/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.402794 Sep 18 01:01:28.157245 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 251/507] 10.222.0.25 () {58 vars in 1200 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/flavors/605062199/os-extra_specs => generated 66 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:28.175142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36aeb5b3-12ca-4cc2-bf97-b0be0554d4cb tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:28.223792 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36aeb5b3-12ca-4cc2-bf97-b0be0554d4cb tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/605062199/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054282 Sep 18 01:01:28.230327 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 257/508] 10.222.0.25 () {60 vars in 1221 bytes} [Sun Sep 18 01:01:28 2022] POST /compute/v2.1/flavors/605062199/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:28.236186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f6f444c-a841-487f-a9ac-45dca897d791 tempest-FlavorsExtraSpecsTestJSON-904913861 tempest-FlavorsExtraSpecsTestJSON-904913861-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:28.249284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:28.250308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:28.275021 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f6f444c-a841-487f-a9ac-45dca897d791 tempest-FlavorsExtraSpecsTestJSON-904913861 tempest-FlavorsExtraSpecsTestJSON-904913861-project] 10.222.0.25 "GET /compute/v2.1/flavors/605062199/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.042941 Sep 18 01:01:28.275894 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 258/509] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:01:28 2022] GET /compute/v2.1/flavors/605062199/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:28.292253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f762c99-4c8c-4663-a123-f7f5bea1bf72 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:28.300565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:28.307593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:28.319487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:28.323100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:28.327435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:28.332096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:28.379363 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:28.407351 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f762c99-4c8c-4663-a123-f7f5bea1bf72 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/605062199/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.119229 Sep 18 01:01:28.418228 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 259/510] 10.222.0.25 () {60 vars in 1221 bytes} [Sun Sep 18 01:01:28 2022] POST /compute/v2.1/flavors/605062199/os-extra_specs => generated 66 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:28.439390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2890307-ff4d-4dd9-ba54-192d1e2186e7 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:28.485939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a2890307-ff4d-4dd9-ba54-192d1e2186e7 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/605062199/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060013 Sep 18 01:01:28.496507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 260/511] 10.222.0.25 () {58 vars in 1200 bytes} [Sun Sep 18 01:01:28 2022] GET /compute/v2.1/flavors/605062199/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:28.513030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:28.518499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:28.551083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:28.552593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:28.556036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:28.560261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:28.561645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:28.563959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:29.034172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:29.097347 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7cdaf645-0b8b-4d36-a5fe-c08db9cc3ee7 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.598765 Sep 18 01:01:29.098277 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 261/512] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:28 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:29.103283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7955280-b11b-411f-869a-f0960018c22f tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:29.164632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7955280-b11b-411f-869a-f0960018c22f tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/605062199/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.065111 Sep 18 01:01:29.174653 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 262/513] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:01:29 2022] PUT /compute/v2.1/flavors/605062199/os-extra_specs/hw:numa_nodes => generated 22 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:29.180963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.181608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:29.208900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:29.209378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:29.210233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:29.211691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:29.222299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:29.223012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:29.514308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:29.531267 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1d8d750e-e42f-4ebf-a64c-cc027be799f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1269 microversion: 2.1 time: 0.355222 Sep 18 01:01:29.531613 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 263/514] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:29 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1269 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:29.540733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:29.551787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f151f51b-f9c4-4f19-90be-718f17b4da65 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.554469 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5337ac3d-7593-4a57-9736-fba6ea0dc54d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1319 microversion: 2.1 time: 1.338417 Sep 18 01:01:29.559515 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 252/515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:28 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1319 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:29.581103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f151f51b-f9c4-4f19-90be-718f17b4da65 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/605062199/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035445 Sep 18 01:01:29.581993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 264/516] 10.222.0.25 () {58 vars in 1200 bytes} [Sun Sep 18 01:01:29 2022] GET /compute/v2.1/flavors/605062199/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:29.613820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63ab1086-ae3f-47f9-b280-a0989ccb000e tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.679488 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63ab1086-ae3f-47f9-b280-a0989ccb000e tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/605062199/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.071580 Sep 18 01:01:29.681488 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 253/517] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:29 2022] DELETE /compute/v2.1/flavors/605062199/os-extra_specs/hw:numa_nodes => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:01:29.691076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c564645d-2dcd-4974-8874-8f7682ad3187 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.741501 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c564645d-2dcd-4974-8874-8f7682ad3187 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/605062199/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.054210 Sep 18 01:01:29.743487 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 265/518] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:29 2022] DELETE /compute/v2.1/flavors/605062199/os-extra_specs/hw:cpu_policy => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:01:29.759623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-810ced71-943e-4d78-a019-af94a912c49e tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.780078 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-810ced71-943e-4d78-a019-af94a912c49e tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/605062199/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027264 Sep 18 01:01:29.782521 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 254/519] 10.222.0.25 () {58 vars in 1200 bytes} [Sun Sep 18 01:01:29 2022] GET /compute/v2.1/flavors/605062199/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:29.799666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cae5bc7a-933c-47d7-b3b1-4fdf75575ee1 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.858155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cae5bc7a-933c-47d7-b3b1-4fdf75575ee1 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/605062199" status: 202 len: 0 microversion: 2.1 time: 0.065404 Sep 18 01:01:29.864035 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 266/520] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:01:29 2022] DELETE /compute/v2.1/flavors/605062199 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:29.871943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51dfd177-44c6-4be8-bf71-18c532432fe0 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.915592 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-51dfd177-44c6-4be8-bf71-18c532432fe0 tempest-FlavorsExtraSpecsTestJSON-1443626552 tempest-FlavorsExtraSpecsTestJSON-1443626552-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048228 Sep 18 01:01:29.917206 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 255/521] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:01:29 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:30.135645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:30.137335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:30.175957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.176454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.176890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:30.177626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.178079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.178496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:30.344218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:30.379808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d1c4750-e184-48b0-895c-18cad8ee5ecf tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.256103 Sep 18 01:01:30.380409 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 267/522] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:30 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:30.572595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:30.574237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:30.588893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.605026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.605729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:30.606858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.607810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.608518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:30.622811 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:30.623761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:30.640699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.643214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.644057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:30.648410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.649374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.655599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.070491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:31.084673 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9dbe2e3d-6a98-4088-a6d7-384461dd82ed tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1469 microversion: 2.1 time: 0.470699 Sep 18 01:01:31.086029 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 268/523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:30 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:31.133402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:31.137386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:31.150817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:31.166421 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ccf97602-67be-42fd-93fd-9d357a98d324 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1311 microversion: 2.1 time: 0.599971 Sep 18 01:01:31.167022 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 256/524] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:30 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1311 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:31.171771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.172451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.173757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.175186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.175837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.176582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.432840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:31.434937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:31.467402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.469977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.471523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.473019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.474231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.475248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.491546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:31.501081 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d56e342-fea5-4dfb-9e3e-4281879f05d8 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1469 microversion: 2.1 time: 0.376338 Sep 18 01:01:31.505210 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 269/525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:31 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1469 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:31.529802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:31.536139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:31.537161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Searching by: {'reservation_id': 'r-bq4dw6ls', 'deleted': False, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:01:31.547031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.547628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.548170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.549017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.549642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.550205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.662307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:31.720724 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f5c4a643-01ca-4acf-a015-bac4ce2f7f07 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.294660 Sep 18 01:01:31.723254 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 257/526] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:31 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:31.880114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:01:32.205406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:32.208669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:32.236954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.238850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.239722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:32.242988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.246665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.260688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:32.270422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:32.301178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.303441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.304297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:32.624567 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7e8883c5-e446-4cf3-a038-02ca4e563f60 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-bq4dw6ls" status: 200 len: 2931 microversion: 2.1 time: 1.101274 Sep 18 01:01:32.625168 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 270/527] 10.222.0.25 () {58 vars in 1197 bytes} [Sun Sep 18 01:01:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bq4dw6ls => generated 2931 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:32.702325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:32.711250 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ba4fb2d-e353-4a9d-8e02-84e11180a1fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1311 microversion: 2.1 time: 0.516193 Sep 18 01:01:32.727944 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 258/528] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:32 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1311 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:32.732988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c17e15da-5c7a-405e-85c9-f9bf2045d32c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:32.774965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.server_groups [None req-c17e15da-5c7a-405e-85c9-f9bf2045d32c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Querying cell bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) for 2 instances {{(pid=122374) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 18 01:01:32.778509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c17e15da-5c7a-405e-85c9-f9bf2045d32c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.779361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c17e15da-5c7a-405e-85c9-f9bf2045d32c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.780124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c17e15da-5c7a-405e-85c9-f9bf2045d32c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:32.833457 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c17e15da-5c7a-405e-85c9-f9bf2045d32c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/084bc720-50cf-480b-8f0d-59acb60d5aa9" status: 200 len: 266 microversion: 2.1 time: 0.112026 Sep 18 01:01:32.834499 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 259/529] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:01:32 2022] GET /compute/v2.1/os-server-groups/084bc720-50cf-480b-8f0d-59acb60d5aa9 => generated 266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:32.843471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:32.844911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:32.859795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.861027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.862031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:32.863781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.864606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.865353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.028199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:33.057341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7be30462-6f70-4097-8d0c-8e0a2d4d915e tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.221031 Sep 18 01:01:33.058648 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 260/530] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:32 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:33.063849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5ef4c9f2-82b4-4321-bd2d-dba8b492b439 req-74cf6972-dee7-48ac-9c8d-7a838ab167ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b6c25c-39a7-43a3-89ba-8fd79568ba47", "tag": "454f8554-c3b3-44bd-96a8-a67b7c7bf570"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:33.097105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5ef4c9f2-82b4-4321-bd2d-dba8b492b439 req-74cf6972-dee7-48ac-9c8d-7a838ab167ad service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.100010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5ef4c9f2-82b4-4321-bd2d-dba8b492b439 req-74cf6972-dee7-48ac-9c8d-7a838ab167ad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.100890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5ef4c9f2-82b4-4321-bd2d-dba8b492b439 req-74cf6972-dee7-48ac-9c8d-7a838ab167ad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.145048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5ef4c9f2-82b4-4321-bd2d-dba8b492b439 req-74cf6972-dee7-48ac-9c8d-7a838ab167ad service nova] Creating event network-changed:454f8554-c3b3-44bd-96a8-a67b7c7bf570 for instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 on n-h1-master-1 Sep 18 01:01:33.166037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5ef4c9f2-82b4-4321-bd2d-dba8b492b439 req-74cf6972-dee7-48ac-9c8d-7a838ab167ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105260 Sep 18 01:01:33.167215 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 261/531] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:33.175238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:33.176244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:33.183708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.184227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.184678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.186248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.186912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.187579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.252935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f74ed378-efb2-4b4f-806a-2fc08eb276d8 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Calling method '.version_select at 0x7f7006b330d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:33.296967 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f74ed378-efb2-4b4f-806a-2fc08eb276d8 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] HTTP exception thrown: Image not found. Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f74ed378-efb2-4b4f-806a-2fc08eb276d8 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Request method failure captured: Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/5e906424-42b6-43a2-9451-b5c0747b57ac/metadata/os_distro HTTP/1.1 Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3sOvlLmg04yyvI5B9cUgeGgn_gHGQOEeYqms0jtN3KxziyPq673qXwMowCBAHwXc5YjOyBJER-hCpClYQeF2l8SerjqCK-1z2uFcdVFTbVU5Nv0ks6e2cfGwmsM2i1S-6F8lDfMX54eQJILH1eytrUctpV1fZIhSauNDbTv1CPO7w Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:33.309149 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02a1b175d9b54ce196e654aef243db96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d30a0a15dd754683a046120b8a978b44 Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: action_args: {'image_id': '5e906424-42b6-43a2-9451-b5c0747b57ac', 'id': 'os_distro'} Sep 18 01:01:33.311577 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.312804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e906424-42b6-43a2-9451-b5c0747b57ac Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.316141 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e906424-42b6-43a2-9451-b5c0747b57ac could not be found. Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:33.317940 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.319310 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f74ed378-efb2-4b4f-806a-2fc08eb276d8 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:33.320509 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f74ed378-efb2-4b4f-806a-2fc08eb276d8 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] 10.222.0.25 "DELETE /compute/v2.1/images/5e906424-42b6-43a2-9451-b5c0747b57ac/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.692648 Sep 18 01:01:33.320509 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 271/532] 10.222.0.25 () {58 vars in 1293 bytes} [Sun Sep 18 01:01:32 2022] DELETE /compute/v2.1/images/5e906424-42b6-43a2-9451-b5c0747b57ac/metadata/os_distro => generated 62 bytes in 694 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:33.338747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5424ac29-0efb-4296-8bb0-47efa50b91e7 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Calling method '.version_select at 0x7f700692d3a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:33.375493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-5424ac29-0efb-4296-8bb0-47efa50b91e7 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] HTTP exception thrown: Image not found. Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5424ac29-0efb-4296-8bb0-47efa50b91e7 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Request method failure captured: Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/images/3615486a-bba0-495c-b0f2-d277a93bb572/metadata/os_version HTTP/1.1 Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3sOvlLmg04yyvI5B9cUgeGgn_gHGQOEeYqms0jtN3KxziyPq673qXwMowCBAHwXc5YjOyBJER-hCpClYQeF2l8SerjqCK-1z2uFcdVFTbVU5Nv0ks6e2cfGwmsM2i1S-6F8lDfMX54eQJILH1eytrUctpV1fZIhSauNDbTv1CPO7w Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:33.378131 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02a1b175d9b54ce196e654aef243db96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d30a0a15dd754683a046120b8a978b44 Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: action_args: {'image_id': '3615486a-bba0-495c-b0f2-d277a93bb572', 'id': 'os_version'} Sep 18 01:01:33.379495 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.380500 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3615486a-bba0-495c-b0f2-d277a93bb572 Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.381748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3615486a-bba0-495c-b0f2-d277a93bb572 could not be found. Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:33.383197 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:33.384620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.387202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5424ac29-0efb-4296-8bb0-47efa50b91e7 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:33.388280 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5424ac29-0efb-4296-8bb0-47efa50b91e7 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] 10.222.0.25 "GET /compute/v2.1/images/3615486a-bba0-495c-b0f2-d277a93bb572/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.059343 Sep 18 01:01:33.389288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 272/533] 10.222.0.25 () {58 vars in 1293 bytes} [Sun Sep 18 01:01:33 2022] GET /compute/v2.1/images/3615486a-bba0-495c-b0f2-d277a93bb572/metadata/os_version => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:33.400772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07e1dad4-3784-41f1-b796-1aff53f7c683 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Calling method '.version_select at 0x7f700692d670>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:33.429510 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-07e1dad4-3784-41f1-b796-1aff53f7c683 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] HTTP exception thrown: Image not found. Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07e1dad4-3784-41f1-b796-1aff53f7c683 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Request method failure captured: Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/images/d1d6a1b2-9429-47d0-bb4d-38993c4e9c58/metadata HTTP/1.1 Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3sOvlLmg04yyvI5B9cUgeGgn_gHGQOEeYqms0jtN3KxziyPq673qXwMowCBAHwXc5YjOyBJER-hCpClYQeF2l8SerjqCK-1z2uFcdVFTbVU5Nv0ks6e2cfGwmsM2i1S-6F8lDfMX54eQJILH1eytrUctpV1fZIhSauNDbTv1CPO7w Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:33.431892 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02a1b175d9b54ce196e654aef243db96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d30a0a15dd754683a046120b8a978b44 Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: action_args: {'image_id': 'd1d6a1b2-9429-47d0-bb4d-38993c4e9c58'} Sep 18 01:01:33.433736 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.434609 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d1d6a1b2-9429-47d0-bb4d-38993c4e9c58 Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.435783 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1d6a1b2-9429-47d0-bb4d-38993c4e9c58 could not be found. Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:33.437234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:33.438744 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.443216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07e1dad4-3784-41f1-b796-1aff53f7c683 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:33.443216 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07e1dad4-3784-41f1-b796-1aff53f7c683 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] 10.222.0.25 "GET /compute/v2.1/images/d1d6a1b2-9429-47d0-bb4d-38993c4e9c58/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047634 Sep 18 01:01:33.443765 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 273/534] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:01:33 2022] GET /compute/v2.1/images/d1d6a1b2-9429-47d0-bb4d-38993c4e9c58/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:33.460401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c17fc1f2-3ce1-4da0-a161-00e3536e5200 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Action: 'update_all', calling method: .version_select at 0x7f70067310d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:33.497017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-c17fc1f2-3ce1-4da0-a161-00e3536e5200 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] HTTP exception thrown: Image not found. Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c17fc1f2-3ce1-4da0-a161-00e3536e5200 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Request method failure captured: Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: request: PUT /compute/v2.1/images/13ba61fc-4b33-4a60-be35-ab659064237c/metadata HTTP/1.1 Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 57 Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3sOvlLmg04yyvI5B9cUgeGgn_gHGQOEeYqms0jtN3KxziyPq673qXwMowCBAHwXc5YjOyBJER-hCpClYQeF2l8SerjqCK-1z2uFcdVFTbVU5Nv0ks6e2cfGwmsM2i1S-6F8lDfMX54eQJILH1eytrUctpV1fZIhSauNDbTv1CPO7w Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:33.502921 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02a1b175d9b54ce196e654aef243db96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d30a0a15dd754683a046120b8a978b44 Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:33.508377 n-d-master-1 devstack@n-api.service[122373]: action_args: {'image_id': '13ba61fc-4b33-4a60-be35-ab659064237c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.514980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 13ba61fc-4b33-4a60-be35-ab659064237c Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.516998 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13ba61fc-4b33-4a60-be35-ab659064237c could not be found. Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:33.519317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:33.521911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.525603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c17fc1f2-3ce1-4da0-a161-00e3536e5200 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:33.525603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c17fc1f2-3ce1-4da0-a161-00e3536e5200 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] 10.222.0.25 "PUT /compute/v2.1/images/13ba61fc-4b33-4a60-be35-ab659064237c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.053615 Sep 18 01:01:33.525603 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 274/535] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:01:33 2022] PUT /compute/v2.1/images/13ba61fc-4b33-4a60-be35-ab659064237c/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:33.532401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38b4ff43-0249-462c-9300-3a2edb1d1ff4 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Action: 'update', calling method: .version_select at 0x7f700692d670>, body: {"meta": {"os_distro": "alt"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:33.571673 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-38b4ff43-0249-462c-9300-3a2edb1d1ff4 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] HTTP exception thrown: Image not found. Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38b4ff43-0249-462c-9300-3a2edb1d1ff4 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Request method failure captured: Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: request: PUT /compute/v2.1/images/bb44bb04-b60e-4d4d-bd9d-55a5c58fecb4/metadata/os_distro HTTP/1.1 Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 30 Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3sOvlLmg04yyvI5B9cUgeGgn_gHGQOEeYqms0jtN3KxziyPq673qXwMowCBAHwXc5YjOyBJER-hCpClYQeF2l8SerjqCK-1z2uFcdVFTbVU5Nv0ks6e2cfGwmsM2i1S-6F8lDfMX54eQJILH1eytrUctpV1fZIhSauNDbTv1CPO7w Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:33.576188 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02a1b175d9b54ce196e654aef243db96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d30a0a15dd754683a046120b8a978b44 Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: {"meta": {"os_distro": "alt"}} Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:33.577829 n-d-master-1 devstack@n-api.service[122373]: action_args: {'image_id': 'bb44bb04-b60e-4d4d-bd9d-55a5c58fecb4', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.578984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bb44bb04-b60e-4d4d-bd9d-55a5c58fecb4 Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.581301 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb44bb04-b60e-4d4d-bd9d-55a5c58fecb4 could not be found. Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:33.582800 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:33.584615 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.591386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38b4ff43-0249-462c-9300-3a2edb1d1ff4 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:33.591386 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-38b4ff43-0249-462c-9300-3a2edb1d1ff4 tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] 10.222.0.25 "PUT /compute/v2.1/images/bb44bb04-b60e-4d4d-bd9d-55a5c58fecb4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.050645 Sep 18 01:01:33.591386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 275/536] 10.222.0.25 () {60 vars in 1310 bytes} [Sun Sep 18 01:01:33 2022] PUT /compute/v2.1/images/bb44bb04-b60e-4d4d-bd9d-55a5c58fecb4/metadata/os_distro => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:33.602244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a40b0d4f-3de0-48f8-9e12-cc44c5b71e9e tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Action: 'create', calling method: .version_select at 0x7f7006740430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:33.629893 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82ecefb4-0ebd-4f7e-a273-037868d5cf87 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 200 len: 1620 microversion: 2.1 time: 0.460882 Sep 18 01:01:33.630826 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 262/537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:33 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 1620 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:33.656065 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a40b0d4f-3de0-48f8-9e12-cc44c5b71e9e tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] HTTP exception thrown: Image not found. Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a40b0d4f-3de0-48f8-9e12-cc44c5b71e9e tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Request method failure captured: Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/images/3aaff40f-84ed-4be3-9532-cae7312c8e69/metadata HTTP/1.1 Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 57 Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3sOvlLmg04yyvI5B9cUgeGgn_gHGQOEeYqms0jtN3KxziyPq673qXwMowCBAHwXc5YjOyBJER-hCpClYQeF2l8SerjqCK-1z2uFcdVFTbVU5Nv0ks6e2cfGwmsM2i1S-6F8lDfMX54eQJILH1eytrUctpV1fZIhSauNDbTv1CPO7w Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:33.658407 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02a1b175d9b54ce196e654aef243db96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02a1b175d9b54ce196e654aef243db96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 02a1b175d9b54ce196e654aef243db96 Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-586003282 Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d30a0a15dd754683a046120b8a978b44 Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-586003282-project Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:33.659855 n-d-master-1 devstack@n-api.service[122373]: action_args: {'image_id': '3aaff40f-84ed-4be3-9532-cae7312c8e69', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.661052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3aaff40f-84ed-4be3-9532-cae7312c8e69 Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:01:33.667049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3aaff40f-84ed-4be3-9532-cae7312c8e69 could not be found. Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:33.668881 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:33.670258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:33.671891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a40b0d4f-3de0-48f8-9e12-cc44c5b71e9e tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:33.671891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a40b0d4f-3de0-48f8-9e12-cc44c5b71e9e tempest-ImagesMetadataNegativeTestJSON-586003282 tempest-ImagesMetadataNegativeTestJSON-586003282-project] 10.222.0.25 "POST /compute/v2.1/images/3aaff40f-84ed-4be3-9532-cae7312c8e69/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071608 Sep 18 01:01:33.671891 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 276/538] 10.222.0.25 () {60 vars in 1281 bytes} [Sun Sep 18 01:01:33 2022] POST /compute/v2.1/images/3aaff40f-84ed-4be3-9532-cae7312c8e69/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:33.677184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:33.678340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:33.687740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.688596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.689381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.690673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.691505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.692452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.758019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:33.759179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:33.780069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.781396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.782858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.784491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.786842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.788600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:34.146473 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9ca6b3a9-b740-436a-bdb7-7f3bc38b0564 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1620 microversion: 2.1 time: 0.483695 Sep 18 01:01:34.153391 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 263/539] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:33 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1620 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:34.158304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:34.159142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:34.169457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:34.171262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:34.171517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:34.172380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:34.172652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:34.173074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:34.203182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:34.220158 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dcdb108f-a199-48fa-a6a5-9e140d83b2ab tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1311 microversion: 2.1 time: 0.478013 Sep 18 01:01:34.238789 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 277/540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:33 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1311 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:34.248004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aca789b9-e8ad-4dfa-9ac4-9ecda2561cd2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: .version_select at 0x7f7006731ee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-4221326", "policies": ["anti-affinity"]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:34.263723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:34.284887 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a651195-c432-4412-9330-676b0d2cb473 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.130078 Sep 18 01:01:34.285431 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 264/541] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:34 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:34.288087 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-aca789b9-e8ad-4dfa-9ac4-9ecda2561cd2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:34.295122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-aca789b9-e8ad-4dfa-9ac4-9ecda2561cd2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:34.358035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-aca789b9-e8ad-4dfa-9ac4-9ecda2561cd2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:34.363294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-aca789b9-e8ad-4dfa-9ac4-9ecda2561cd2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:34.365665 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:RELEASE=7,nova_api:SELECT=80,nova_api:SAVEPOINT=6,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:34.383197 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aca789b9-e8ad-4dfa-9ac4-9ecda2561cd2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 190 microversion: 2.1 time: 0.141035 Sep 18 01:01:34.383197 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 278/542] 10.222.0.25 () {60 vars in 1174 bytes} [Sun Sep 18 01:01:34 2022] POST /compute/v2.1/os-server-groups => generated 190 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:34.753161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-221139021", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0ba66605-aa03-4eb2-a33f-9843a900efb9"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:34.889137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:01:35.293339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:01:35.295016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:01:35.296531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:01:35.297540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:01:35.298396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:01:35.299004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-51dd2bd6-4437-4138-903e-96e22e230b66 tempest-NetworksTest-233736595 tempest-NetworksTest-233736595-project-admin] Calling method '.version_select at 0x7f7006731ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.336185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.337149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.338030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.339549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.340798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.341706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.368805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:35.374426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:35.386604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Going to run 2 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:01:35.389260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:01:35.456718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:35.465477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:35.518427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:35.521434 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:35.524027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:35.546492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=2356100a-11ad-4f3b-8a64-96d04a0079d0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:01:35.585513 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-51dd2bd6-4437-4138-903e-96e22e230b66 tempest-NetworksTest-233736595 tempest-NetworksTest-233736595-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 4683 microversion: 2.1 time: 0.716534 Sep 18 01:01:35.591084 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 279/543] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:01:34 2022] GET /compute/v2.1/os-networks => generated 4683 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:35.598146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.599140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:35.610399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.611596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.612652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.615099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.616135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.617327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.632265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:35.639914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:35.702726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:35.708918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'server_group_members'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:35.804701 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-12598baa-46f7-4c88-890b-a7d2197e8781 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.060371 Sep 18 01:01:35.805894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 265/544] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:34 2022] POST /compute/v2.1/servers => generated 32 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:01:35.826202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.834000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:35.851140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:35.855225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.857506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.858328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.859685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.860686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.862109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.864952 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7de9a843-29e4-4d90-8486-bd099e74e70a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1311 microversion: 2.1 time: 0.272755 Sep 18 01:01:35.889610 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 280/545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:35.896268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9aa8a5a1-2594-4a65-a6d5-2729625b8a84 tempest-NetworksTest-233736595 tempest-NetworksTest-233736595-project-admin] Calling method '.version_select at 0x7f70068aadc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:36.108883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:36.166098 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a77ae71d-79f4-48a7-96d4-25b843ad1618 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1929 microversion: 2.75 time: 0.354289 Sep 18 01:01:36.170546 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 266/546] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1929 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:36.184699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:36.212113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:36.222316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Searching by: {'deleted': False, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:01:36.270143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:36.270902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:36.271635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:36.273036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:36.281933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:36.287360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:36.350959 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9aa8a5a1-2594-4a65-a6d5-2729625b8a84 tempest-NetworksTest-233736595 tempest-NetworksTest-233736595-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/240606ee-92d0-43ce-a525-7d5ea98509b1" status: 200 len: 652 microversion: 2.1 time: 0.470473 Sep 18 01:01:36.352833 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 281/547] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/os-networks/240606ee-92d0-43ce-a525-7d5ea98509b1 => generated 652 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:36.372138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9cc4cf11-6715-49ce-b9e3-5563046ccdf5 tempest-NetworksTest-233736595 tempest-NetworksTest-233736595-project-admin] Calling method '.version_select at 0x7f7006740ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:36.479908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:01:36.577068 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f531ca8b-fe24-4e38-87ea-eb21df771cde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.403755 Sep 18 01:01:36.578545 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 267/548] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:01:36 2022] GET /compute/v2.1/servers => generated 1664 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:36.600613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-132e9acf-97d0-4705-8648-a54f6718b091 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:36.609584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-132e9acf-97d0-4705-8648-a54f6718b091 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:36.748256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-132e9acf-97d0-4705-8648-a54f6718b091 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:36.765131 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-132e9acf-97d0-4705-8648-a54f6718b091 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1218 microversion: 2.1 time: 0.171035 Sep 18 01:01:36.766533 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 268/549] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:36 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:36.815508 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9cc4cf11-6715-49ce-b9e3-5563046ccdf5 tempest-NetworksTest-233736595 tempest-NetworksTest-233736595-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 4683 microversion: 2.1 time: 0.454338 Sep 18 01:01:36.816733 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 282/550] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:01:36 2022] GET /compute/v2.1/os-networks => generated 4683 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:36.908207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:36.909678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:36.919263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:36.920553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:36.920982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:36.921941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:36.922396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:36.922974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:37.202402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:37.213070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:37.213713 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:37.226119 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64d836d0-074d-44fa-b5d0-d3977afe3a5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1311 microversion: 2.1 time: 0.323310 Sep 18 01:01:37.233020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:37.237847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:37.239312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:37.240532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:37.241738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:37.242047 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 269/551] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:36 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1311 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:37.242963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:37.348782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:37.394369 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a4891be-7591-424e-9c35-00b756206ac9 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1935 microversion: 2.75 time: 0.186773 Sep 18 01:01:37.396523 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 283/552] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:37 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1935 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:37.809318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:37.811421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:37.841323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:37.842423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:37.843500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:37.845283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:37.862300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:37.863468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.025133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:38.042411 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-947f33c1-0cf8-43d7-b47e-ca9eaa6c7c5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1214 microversion: 2.1 time: 0.242476 Sep 18 01:01:38.043592 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 284/553] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:37 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:38.075708 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.078578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:38.086221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.087420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.088036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.088931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.090697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.092114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.146747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:38.230908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Calling method '.version_select at 0x7f70067c7670>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.235885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.236387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.236828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.293096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.293527 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60b2b8a3-c17d-44b3-bbae-4e9232b25616 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 204 len: 0 microversion: 2.1 time: 0.247838 Sep 18 01:01:38.304889 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 285/554] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:38 2022] DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:38.305249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.305249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.312607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.313707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:38.322714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.323212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.324432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.325147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.326237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.326676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.331738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.332424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.333298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.342698 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-526d14e2-9692-4cb6-aab8-12ce9bf555bd tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.735000 Sep 18 01:01:38.343863 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 270/555] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:01:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:01:38.365175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Calling method '.version_select at 0x7f700680ab80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.370789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.371976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.373429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.395671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.396554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.397509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.412108 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-85a47b4c-1ed8-44bc-9e89-c70bab4fbc4b tempest-HypervisorAdminV228Test-893239999 tempest-HypervisorAdminV228Test-893239999-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.052517 Sep 18 01:01:38.412999 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 271/556] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 18 01:01:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:01:38.432188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.433037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:38.443298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.444891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.445761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.446953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.447997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.449475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.999949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:39.010000 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:39.039337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4593f8d0-1c53-4bbd-a715-59e0b9b11b70 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1935 microversion: 2.75 time: 0.610575 Sep 18 01:01:39.040225 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 272/557] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:38 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1935 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:39.055944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1101219637", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "2123573806", "adminPass": "***", "networks": [{"uuid": "f0bf96a5-f47b-4e66-a279-b85a45861654"}], "security_groups": [{"name": "tempest-securitygroup--1604510097"}], "key_name": "tempest-keypair-8537872", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:39.185056 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:39.204615 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b87f5d4-2aba-47de-915c-5cb790d7e0d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1311 microversion: 2.1 time: 0.908727 Sep 18 01:01:39.209001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 286/558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:38 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1311 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:39.363627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] validate_networks() for [('f0bf96a5-f47b-4e66-a279-b85a45861654', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:01:39.754518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6c6a14c-476b-4a90-a6f5-bd409168424d tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.542481 Sep 18 01:01:39.756973 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 287/559] 10.222.0.25 () {58 vars in 1128 bytes} [Sun Sep 18 01:01:39 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 547 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 18 01:01:39.759524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6c6a14c-476b-4a90-a6f5-bd409168424d tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:39.761599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6c6a14c-476b-4a90-a6f5-bd409168424d tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002696 Sep 18 01:01:39.762715 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 288/560] 10.222.0.25 () {56 vars in 886 bytes} [Sun Sep 18 01:01:39 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 18 01:01:39.773220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:39.774596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:39.788694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:39.790536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:39.791681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:39.792971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:39.793655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:39.794281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.007859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:40.021948 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fee2d1e9-09d7-4e79-b4e8-46f35c0120be tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1270 microversion: 2.1 time: 0.257841 Sep 18 01:01:40.022918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 289/561] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:39 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:40.034811 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5f1897f1-ce5d-40e7-8836-305c5276b6dc req-830808ba-e4c2-4c8a-9bd7-d87b257e7db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b6c25c-39a7-43a3-89ba-8fd79568ba47", "name": "network-vif-plugged", "status": "completed", "tag": "454f8554-c3b3-44bd-96a8-a67b7c7bf570"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:40.066656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5f1897f1-ce5d-40e7-8836-305c5276b6dc req-830808ba-e4c2-4c8a-9bd7-d87b257e7db6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:40.067442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5f1897f1-ce5d-40e7-8836-305c5276b6dc req-830808ba-e4c2-4c8a-9bd7-d87b257e7db6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:40.067884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5f1897f1-ce5d-40e7-8836-305c5276b6dc req-830808ba-e4c2-4c8a-9bd7-d87b257e7db6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.071435 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:40.090320 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5f1897f1-ce5d-40e7-8836-305c5276b6dc req-830808ba-e4c2-4c8a-9bd7-d87b257e7db6 service nova] Creating event network-vif-plugged:454f8554-c3b3-44bd-96a8-a67b7c7bf570 for instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 on n-h1-master-1 Sep 18 01:01:40.095647 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5f1897f1-ce5d-40e7-8836-305c5276b6dc req-830808ba-e4c2-4c8a-9bd7-d87b257e7db6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070873 Sep 18 01:01:40.096700 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 290/562] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:40.104296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80f3cddc-28b4-4146-b370-e82f5ae855e1 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Calling method '.version_select at 0x7f700692d700>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:40.147388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-80f3cddc-28b4-4146-b370-e82f5ae855e1 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] HTTP exception thrown: Image not found. Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80f3cddc-28b4-4146-b370-e82f5ae855e1 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Request method failure captured: Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3ys0LzDQmwMMO17eIIITd266BTDIsbu0gV7HhlgOlH_YoAzp4_oEMTWbz3ywyC7jWaPzU0WGIvCJPgMnzf23tDwOiCPEfr9IomqkTc0GjG13WXjXjxsyfPdHwdxCRJCMPojeSNIFFq-WfGz68XFWGcTfTZgn_xsuO8oZN_8rrycD8 Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:40.155490 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 3f996a6af5d14687b990141a80a3d45e Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '-1'} Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:40.157733 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.158752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:40.160911 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80f3cddc-28b4-4146-b370-e82f5ae855e1 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80f3cddc-28b4-4146-b370-e82f5ae855e1 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.059629 Sep 18 01:01:40.175352 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 291/563] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Sep 18 01:01:40 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:40.198434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:40.203066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:40.230955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:40.234805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:40.237054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.239053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:40.244943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:40.247056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.456486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] Lazy-loading 'services' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:40.494846 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-16fd18da-7d3e-4e78-a1ab-da62b4c3b364 tempest-ServersAdmin275Test-1018430640 tempest-ServersAdmin275Test-1018430640-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1920 microversion: 2.75 time: 0.321293 Sep 18 01:01:40.496992 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 292/564] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:40 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1920 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:40.509575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7db7c06-559a-4bf3-8197-493726fbfa6c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Calling method '.version_select at 0x7f70068aa8b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:40.565736 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d7db7c06-559a-4bf3-8197-493726fbfa6c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] HTTP exception thrown: Image not found. Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7db7c06-559a-4bf3-8197-493726fbfa6c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Request method failure captured: Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/c46f4437-0a14-41bc-bf38-32949c46d53j HTTP/1.1 Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3ys0LzDQmwMMO17eIIITd266BTDIsbu0gV7HhlgOlH_YoAzp4_oEMTWbz3ywyC7jWaPzU0WGIvCJPgMnzf23tDwOiCPEfr9IomqkTc0GjG13WXjXjxsyfPdHwdxCRJCMPojeSNIFFq-WfGz68XFWGcTfTZgn_xsuO8oZN_8rrycD8 Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:40.569925 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 3f996a6af5d14687b990141a80a3d45e Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'c46f4437-0a14-41bc-bf38-32949c46d53j'} Sep 18 01:01:40.572364 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c46f4437-0a14-41bc-bf38-32949c46d53j to delete Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:40.574431 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c46f4437-0a14-41bc-bf38-32949c46d53j could not be found. Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:40.576579 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:40.581224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7db7c06-559a-4bf3-8197-493726fbfa6c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:40.584485 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d7db7c06-559a-4bf3-8197-493726fbfa6c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] 10.222.0.25 "DELETE /compute/v2.1/images/c46f4437-0a14-41bc-bf38-32949c46d53j" status: 404 len: 62 microversion: 2.1 time: 0.081120 Sep 18 01:01:40.584485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 293/565] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:40 2022] DELETE /compute/v2.1/images/c46f4437-0a14-41bc-bf38-32949c46d53j => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:40.595591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:40.596988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:40.609892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:40.610618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:40.612003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.613299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:40.614316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:40.615205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.951684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:40.965697 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aa7d8213-ac76-4534-8c89-42678bc72e16 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1311 microversion: 2.1 time: 0.381318 Sep 18 01:01:40.981282 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 294/566] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:40 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:40.992612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:41.001845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:41.016294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.022938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.023397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.026055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.027075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.030693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.146041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:41.423700 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65ecc3eb-036d-4b4a-872b-a47ea54d367e tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 204 len: 0 microversion: 2.75 time: 0.440534 Sep 18 01:01:41.438339 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 295/567] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:01:40 2022] DELETE /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:01:41.451281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8da80e44-74f4-48c5-b7ea-936bb5ea5e8c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Calling method '.version_select at 0x7f700670ce50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:41.480704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-8da80e44-74f4-48c5-b7ea-936bb5ea5e8c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] HTTP exception thrown: Image not found. Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8da80e44-74f4-48c5-b7ea-936bb5ea5e8c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Request method failure captured: Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/7f643961-4042-4fe1-9e4a-7cbdd79f718e1 HTTP/1.1 Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3ys0LzDQmwMMO17eIIITd266BTDIsbu0gV7HhlgOlH_YoAzp4_oEMTWbz3ywyC7jWaPzU0WGIvCJPgMnzf23tDwOiCPEfr9IomqkTc0GjG13WXjXjxsyfPdHwdxCRJCMPojeSNIFFq-WfGz68XFWGcTfTZgn_xsuO8oZN_8rrycD8 Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:41.483141 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 3f996a6af5d14687b990141a80a3d45e Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '7f643961-4042-4fe1-9e4a-7cbdd79f718e1'} Sep 18 01:01:41.484888 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f643961-4042-4fe1-9e4a-7cbdd79f718e1 to delete Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:41.485854 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f643961-4042-4fe1-9e4a-7cbdd79f718e1 could not be found. Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:41.487163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:41.488548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8da80e44-74f4-48c5-b7ea-936bb5ea5e8c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:41.490663 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8da80e44-74f4-48c5-b7ea-936bb5ea5e8c tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] 10.222.0.25 "DELETE /compute/v2.1/images/7f643961-4042-4fe1-9e4a-7cbdd79f718e1" status: 404 len: 62 microversion: 2.1 time: 0.050497 Sep 18 01:01:41.497194 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 296/568] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:41 2022] DELETE /compute/v2.1/images/7f643961-4042-4fe1-9e4a-7cbdd79f718e1 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:41.504668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:41.507206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:41.532582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.533677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.534372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.535513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.536141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.537780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.666800 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:41.824257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:41.847490 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a1875dc-9429-4b5b-af14-0886dad01384 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1278 microversion: 2.1 time: 0.353759 Sep 18 01:01:41.902656 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 297/569] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:41 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1278 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:41.910138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:41.912162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:41.925682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.927769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.930638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.932269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.934379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.936774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.116592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:01:42.117997 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:01:42.118708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:01:42.119907 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:01:42.121082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:01:42.138882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:42.190112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:42.192174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:42.206531 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9bc63e2f-70af-4cfb-817b-7a6ff2955f49 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1444 microversion: 2.75 time: 0.299539 Sep 18 01:01:42.207301 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 298/570] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:41 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1444 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:42.208278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.211099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.212578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.216164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.216903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.218930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.220652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d598593-6e2b-4a1e-8ed4-c59be634d801 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Calling method '.version_select at 0x7f7006e12dc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:42.288462 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9d598593-6e2b-4a1e-8ed4-c59be634d801 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] HTTP exception thrown: Image not found. Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d598593-6e2b-4a1e-8ed4-c59be634d801 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Request method failure captured: Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/tempest-invalid-2032223103 HTTP/1.1 Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3ys0LzDQmwMMO17eIIITd266BTDIsbu0gV7HhlgOlH_YoAzp4_oEMTWbz3ywyC7jWaPzU0WGIvCJPgMnzf23tDwOiCPEfr9IomqkTc0GjG13WXjXjxsyfPdHwdxCRJCMPojeSNIFFq-WfGz68XFWGcTfTZgn_xsuO8oZN_8rrycD8 Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:01:42.291337 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 3f996a6af5d14687b990141a80a3d45e Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'tempest-invalid-2032223103'} Sep 18 01:01:42.293352 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2032223103 to delete Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:42.294290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2032223103 could not be found. Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:42.295374 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d598593-6e2b-4a1e-8ed4-c59be634d801 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:42.298282 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d598593-6e2b-4a1e-8ed4-c59be634d801 tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-2032223103" status: 404 len: 62 microversion: 2.1 time: 0.085720 Sep 18 01:01:42.300229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 299/571] 10.222.0.25 () {58 vars in 1206 bytes} [Sun Sep 18 01:01:42 2022] DELETE /compute/v2.1/images/tempest-invalid-2032223103 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:42.306050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:42.310710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:42.314848 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Getting quotas for project 1bf7634e26214d1592e971399bc13360. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:42.327847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.328381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.328823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.329576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.331372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.331633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Getting quotas for user fad1db1d4f7a41559b0cb1e57ba9c12d and project 1bf7634e26214d1592e971399bc13360. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:42.331817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.364573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:01:42.367583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:01:42.483374 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14bd3762-d976-40f6-8d78-c15ae08e3458 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.441600 Sep 18 01:01:42.486629 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 273/572] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 3446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:01:42.501366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e13a9e0e-3400-43b9-a0fe-b027807c402f tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Calling method '.version_select at 0x7f7006a00310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:42.559294 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e13a9e0e-3400-43b9-a0fe-b027807c402f tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] HTTP exception thrown: Image not found. Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e13a9e0e-3400-43b9-a0fe-b027807c402f tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Request method failure captured: Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/images/81d6d37e-8f8a-445d-abcc-6b7014b805f6 HTTP/1.1 Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm3ys0LzDQmwMMO17eIIITd266BTDIsbu0gV7HhlgOlH_YoAzp4_oEMTWbz3ywyC7jWaPzU0WGIvCJPgMnzf23tDwOiCPEfr9IomqkTc0GjG13WXjXjxsyfPdHwdxCRJCMPojeSNIFFq-WfGz68XFWGcTfTZgn_xsuO8oZN_8rrycD8 Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:42.574973 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23798c129f14f1ca0ec103575f5d58f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d23798c129f14f1ca0ec103575f5d58f Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011 Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 3f996a6af5d14687b990141a80a3d45e Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1124051011-project Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: exception: Image not found. Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '81d6d37e-8f8a-445d-abcc-6b7014b805f6'} Sep 18 01:01:42.577365 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 81d6d37e-8f8a-445d-abcc-6b7014b805f6 to delete Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:42.579648 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81d6d37e-8f8a-445d-abcc-6b7014b805f6 could not be found. Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:42.583525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e13a9e0e-3400-43b9-a0fe-b027807c402f tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] Returning 404 to user: Image not found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:42.588235 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e13a9e0e-3400-43b9-a0fe-b027807c402f tempest-ImagesDeleteNegativeTestJSON-1124051011 tempest-ImagesDeleteNegativeTestJSON-1124051011-project] 10.222.0.25 "DELETE /compute/v2.1/images/81d6d37e-8f8a-445d-abcc-6b7014b805f6" status: 404 len: 62 microversion: 2.1 time: 0.088495 Sep 18 01:01:42.592181 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 274/573] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:42 2022] DELETE /compute/v2.1/images/81d6d37e-8f8a-445d-abcc-6b7014b805f6 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:01:42.596968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-533f3c7c-29c8-450f-9991-9b44928b6249 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:42.597690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-533f3c7c-29c8-450f-9991-9b44928b6249 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:43.094459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-533f3c7c-29c8-450f-9991-9b44928b6249 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:43.102516 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-533f3c7c-29c8-450f-9991-9b44928b6249 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1262 microversion: 2.1 time: 0.523986 Sep 18 01:01:43.107123 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 275/574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:42 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1262 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:43.137356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:43.139129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:43.147508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.156700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.157430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:43.158381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.158986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.159560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:43.465484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:43.516178 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b2852b4-fb58-46a2-9fe2-e5ab5d8a8a0e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1276 microversion: 2.1 time: 0.406041 Sep 18 01:01:43.520024 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 276/575] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:43 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1276 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:43.562186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:43.565120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:43.595270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.596478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.597232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:43.598776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.599486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.600339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:43.633675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:43.649597 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ba52edd-1fbe-4a45-abb8-5aa45aa05d8f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1494 microversion: 2.1 time: 1.352081 Sep 18 01:01:43.665814 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 300/576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:42 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1494 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:43.896630 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:43.916258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:43.928463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:43.946370 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37bbf4eb-7869-4842-842f-4135979eaa38 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1444 microversion: 2.75 time: 0.402367 Sep 18 01:01:43.947619 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 277/577] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:43 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1444 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:44.151247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:44.153198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:44.175984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.176435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.176724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.177591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.178237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.179001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.358224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:44.359341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:44.368317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:44.371651 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=18 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:44.375247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.376135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.376646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.377418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.378845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.379814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.383304 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04c73ac4-2076-49de-a758-ba532be87f7d tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1314 microversion: 2.1 time: 0.238796 Sep 18 01:01:44.402787 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 278/578] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:44 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:44.555074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:44.556488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:44.585192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.585495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.587173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.588707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.590497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.591516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.989194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.017379 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3295b4a0-badf-4476-b168-cefa8521db22 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1276 microversion: 2.1 time: 0.471890 Sep 18 01:01:45.023819 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 279/579] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:44 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1276 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:45.041980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:45.050715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:45.069991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.072956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.075468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.076464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.083842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.085963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.147794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.148630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.149610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.152591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lazy-loading 'fault' on Instance uuid 6a4eabe5-b9d8-4a47-a91a-26d817696251 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:45.284272 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-22a6c6b4-3ba2-44d9-81b6-9a793469adb9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1645 microversion: 2.1 time: 1.587108 Sep 18 01:01:45.285920 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 301/580] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:43 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1645 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:45.311386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:45.312250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:45.323584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.324385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.324993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.326426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.334959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.335672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.379297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.391319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.398756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c836023cd5b84ceea65cba0c68e62e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d791f5670a647538efc012d0d2407b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.422277 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4868c750-f202-46dc-90f1-97496ef51647 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 200 len: 1449 microversion: 2.75 time: 0.396580 Sep 18 01:01:45.437579 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 280/581] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:45 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 1449 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:45.437579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:45.437579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:45.444127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.445972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.447602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.450129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.450962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.452089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.640808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.658133 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf47587b-fcc8-461c-a3bf-5c8e8b3f0866 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1320 microversion: 2.1 time: 0.233636 Sep 18 01:01:45.670620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 281/582] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:45 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:45.887557 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef03a740-377c-47d8-87f2-e80f562c3764 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1645 microversion: 2.1 time: 0.580449 Sep 18 01:01:45.888695 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 302/583] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:45 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1645 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:45.916179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:45.920313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.920800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.921239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.922012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.922465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.928019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.983800 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34b488c1-8621-433d-9e04-a70f3096bc11 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071669 Sep 18 01:01:45.988775 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 282/584] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:01:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:46.007266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:46.020979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:46.044619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.045399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.046890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.048184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.051052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:46.051528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.052175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.052600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:46.056039 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:46.067056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.069198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.069787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.070812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.072450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.072894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.100586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lazy-loading 'flavor' on Instance uuid 71b6c25c-39a7-43a3-89ba-8fd79568ba47 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:46.131122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Going to try to live migrate instance to n-h2-master-1 {{(pid=122373) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:01:46.428195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:46.439141 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-73378ea5-31df-4b4d-978b-35f88022b264 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1276 microversion: 2.1 time: 0.393198 Sep 18 01:01:46.440248 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 283/585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:46 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1276 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:46.459570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:46.461173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] [instance: 6a4eabe5-b9d8-4a47-a91a-26d817696251] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:46.473710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.474560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.475190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.486621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.487426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.487942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.523765 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] HTTP exception thrown: Instance 6a4eabe5-b9d8-4a47-a91a-26d817696251 could not be found. Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Request method failure captured: Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 HTTP/1.1 Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2nmiS7uxdh0HOQ1PXjxO3o_9omlUMnpfHA7zhWpFmfBHgOPevGQ2LwqD03O59Tiup-PBB4TsSHlV7Psk_BMtsmJ_iSzQaG2oCjsW_l0yNpPsXwGv0zSvbzSSTnRbXbPUKJpJajpHwfjaYvbxlPsP__N-Sg0wsqEc4N39K0LCxYPUw Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.75 Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4d791f5670a647538efc012d0d2407b6 Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersAdmin275Test-1861488685 Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:46.525338 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d791f5670a647538efc012d0d2407b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d791f5670a647538efc012d0d2407b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d791f5670a647538efc012d0d2407b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d791f5670a647538efc012d0d2407b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersAdmin275Test-1861488685 Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4d791f5670a647538efc012d0d2407b6 Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersAdmin275Test-1861488685 Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersAdmin275Test-1861488685-project Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: c836023cd5b84ceea65cba0c68e62e3d Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersAdmin275Test-1861488685-project Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 6a4eabe5-b9d8-4a47-a91a-26d817696251 could not be found. Sep 18 01:01:46.527907 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6a4eabe5-b9d8-4a47-a91a-26d817696251'} Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4eabe5-b9d8-4a47-a91a-26d817696251 could not be found. Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:46.532837 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4eabe5-b9d8-4a47-a91a-26d817696251 could not be found. Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4eabe5-b9d8-4a47-a91a-26d817696251 could not be found. Sep 18 01:01:46.535754 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:46.540978 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] Returning 404 to user: Instance 6a4eabe5-b9d8-4a47-a91a-26d817696251 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:46.540978 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b8b23862-b06c-4cc8-b97b-7e4460522e53 tempest-ServersAdmin275Test-1861488685 tempest-ServersAdmin275Test-1861488685-project] 10.222.0.25 "GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251" status: 404 len: 111 microversion: 2.75 time: 0.071648 Sep 18 01:01:46.540978 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 284/586] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:46 2022] GET /compute/v2.1/servers/6a4eabe5-b9d8-4a47-a91a-26d817696251 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:01:46.683041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:46.683653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:46.691186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.696491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.697023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.697850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.698846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.699267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:47.080450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:47.117132 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-681e224b-4752-4fa5-9efd-d162d55ef4d6 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1320 microversion: 2.1 time: 0.437015 Sep 18 01:01:47.129760 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 285/587] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:46 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:47.161377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c6e91387-107d-49d6-87f1-83b887f2af9a req-ee5c8f41-0681-4d01-8e8b-4d33cdbdfa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb", "name": "network-vif-deleted", "tag": "9ef5e8d7-9fc6-42de-a794-b93e06378934"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:47.200544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c6e91387-107d-49d6-87f1-83b887f2af9a req-ee5c8f41-0681-4d01-8e8b-4d33cdbdfa19 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:47.201041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c6e91387-107d-49d6-87f1-83b887f2af9a req-ee5c8f41-0681-4d01-8e8b-4d33cdbdfa19 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:47.201625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c6e91387-107d-49d6-87f1-83b887f2af9a req-ee5c8f41-0681-4d01-8e8b-4d33cdbdfa19 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:47.259030 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c6e91387-107d-49d6-87f1-83b887f2af9a req-ee5c8f41-0681-4d01-8e8b-4d33cdbdfa19 service nova] Creating event network-vif-deleted:9ef5e8d7-9fc6-42de-a794-b93e06378934 for instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb on n-h2-master-1 Sep 18 01:01:47.282026 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c6e91387-107d-49d6-87f1-83b887f2af9a req-ee5c8f41-0681-4d01-8e8b-4d33cdbdfa19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150678 Sep 18 01:01:47.284814 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 286/588] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:47.476061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:47.477668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:47.494976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:47.500672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:47.503333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:47.510521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:47.514125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:47.515036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:48.853131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:48.894449 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f556c63-d62b-4677-8270-8bbc8b8c0469 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 1.422172 Sep 18 01:01:48.897653 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 287/589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:47 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:48.936314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:48.938586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:48.970286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.971024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.971711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:48.978953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.980167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.980701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:49.753338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:49.763529 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e63dc697-a15a-4e6f-8f56-42d90573d1ce tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 0.863802 Sep 18 01:01:49.769962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 288/590] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:48 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:49.779139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e5e7635e-188a-46d8-817d-74abf45048e2 req-d4e45722-2afa-48e6-aa49-458d0064d465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2356100a-11ad-4f3b-8a64-96d04a0079d0", "tag": "9e0ad0f5-7db1-4649-86a9-c4bc9368ef0f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:49.814669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5e7635e-188a-46d8-817d-74abf45048e2 req-d4e45722-2afa-48e6-aa49-458d0064d465 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:49.815336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5e7635e-188a-46d8-817d-74abf45048e2 req-d4e45722-2afa-48e6-aa49-458d0064d465 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:49.815912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5e7635e-188a-46d8-817d-74abf45048e2 req-d4e45722-2afa-48e6-aa49-458d0064d465 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:49.835223 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e5e7635e-188a-46d8-817d-74abf45048e2 req-d4e45722-2afa-48e6-aa49-458d0064d465 service nova] Creating event network-changed:9e0ad0f5-7db1-4649-86a9-c4bc9368ef0f for instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 on n-h1-master-1 Sep 18 01:01:49.852071 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e5e7635e-188a-46d8-817d-74abf45048e2 req-d4e45722-2afa-48e6-aa49-458d0064d465 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080043 Sep 18 01:01:49.853287 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 289/591] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:49.941397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:49.942337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:49.960298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:49.961060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:49.961688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:49.968138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:49.968849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:49.969430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:50.316225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:50.330279 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6984233d-1f77-45e9-ae31-b5c65e978713 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 0.392905 Sep 18 01:01:50.337440 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 290/592] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:49 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:50.916928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3dc39291-824a-47ea-b45a-076eaf4b9552 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:50.920870 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-3dc39291-824a-47ea-b45a-076eaf4b9552 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3dc39291-824a-47ea-b45a-076eaf4b9552 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442-project-admin] Request method failure captured: Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm39UH493CV0DRNFGwRviNEbE69HVqHvB5P_a-H5XA5dVbDbe5CWNL4-J1Qpk9j-vTsLtrC1_tHVYaBB6U2GL5B2PXf90Oc8Ch-G3a-IUx1vqk_hr2cjak4TOXrPMW51xwD4zEyu2O-qZoIxjcmDHv13KtfAw-5YmnDcjUkGqEu7bIU Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: af3c1539cec44e47b7aa0b180ac1be13 Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:01:50.931292 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af3c1539cec44e47b7aa0b180ac1be13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af3c1539cec44e47b7aa0b180ac1be13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af3c1539cec44e47b7aa0b180ac1be13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af3c1539cec44e47b7aa0b180ac1be13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: af3c1539cec44e47b7aa0b180ac1be13 Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-778784442-project-admin Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 517f5505901746e68172f96d41b7fb3a Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-778784442-project-admin Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:50.933271 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid timestamp for date invalid_time Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'invalid_time'} Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:50.933995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 18 01:01:50.935140 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:50.937403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3dc39291-824a-47ea-b45a-076eaf4b9552 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:50.938634 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3dc39291-824a-47ea-b45a-076eaf4b9552 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442 tempest-InstanceUsageAuditLogNegativeTestJSON-778784442-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.599874 Sep 18 01:01:50.940360 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 291/593] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Sep 18 01:01:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 602 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:01:50.949196 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:50.952386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:50.968803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:50.970828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:50.973870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:50.975842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:50.976461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:50.977884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.591674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:51.605908 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0abc024d-d6b9-4116-99a5-e0116e354acb tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 0.663393 Sep 18 01:01:51.607886 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 292/594] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:50 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:52.307053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f7bd3fc-6f58-4fe2-aa8c-edcdf0d9fd67 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:52.312389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f7bd3fc-6f58-4fe2-aa8c-edcdf0d9fd67 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '61c3067efce444348d154272be92e72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcb36a7b6b14256b0e5dafe633664c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f7bd3fc-6f58-4fe2-aa8c-edcdf0d9fd67 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Request method failure captured: Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm36gsTmj7e5YMCCphMtOc_SfVF4iSNQ2oXX8UlyPqraCGwLmERVltiq1P_oRnsR_OTVH2poNmuLweZpQj6xfnnwOjFmgIUtIcKtPRDLIRjy_ulPsegeOBcXoKgTLoLfZNjm6HtlWkYM0iFExKpKZdg-7GmZ8WxFHbE9ecBnwJr59sE Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ffcb36a7b6b14256b0e5dafe633664c2 Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:52.315635 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ffcb36a7b6b14256b0e5dafe633664c2 Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 61c3067efce444348d154272be92e72f Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project Sep 18 01:01:52.317409 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:01:52.318598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 18 01:01:52.320087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:52.322713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f7bd3fc-6f58-4fe2-aa8c-edcdf0d9fd67 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:52.322713 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f7bd3fc-6f58-4fe2-aa8c-edcdf0d9fd67 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.708215 Sep 18 01:01:52.322713 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 293/595] 10.222.0.25 () {58 vars in 1185 bytes} [Sun Sep 18 01:01:51 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 709 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:52.325968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-01f05dcd-9887-43a1-b7dc-de9fec9ac724 req-d5f51448-1578-490c-8b56-807cf0179cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a92b97-f5e4-47ec-8e50-d4539e2b908a", "tag": "9adbbcba-b835-4f0d-9d6c-606a19b3cad5"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:52.345385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-01f05dcd-9887-43a1-b7dc-de9fec9ac724 req-d5f51448-1578-490c-8b56-807cf0179cef service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.345985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-01f05dcd-9887-43a1-b7dc-de9fec9ac724 req-d5f51448-1578-490c-8b56-807cf0179cef service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.346487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-01f05dcd-9887-43a1-b7dc-de9fec9ac724 req-d5f51448-1578-490c-8b56-807cf0179cef service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.365020 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-01f05dcd-9887-43a1-b7dc-de9fec9ac724 req-d5f51448-1578-490c-8b56-807cf0179cef service nova] Creating event network-changed:9adbbcba-b835-4f0d-9d6c-606a19b3cad5 for instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a on n-h1-master-1 Sep 18 01:01:52.389231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-01f05dcd-9887-43a1-b7dc-de9fec9ac724 req-d5f51448-1578-490c-8b56-807cf0179cef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070121 Sep 18 01:01:52.392483 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 294/596] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:52.403577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:52.404757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:52.412443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.413055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.413617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.414413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.415065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.415683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.831888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:52.843427 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e27831b2-7ff8-45b7-9432-1f7723ba2069 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 0.449079 Sep 18 01:01:52.858542 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 295/597] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:52 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:52.873913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-95402c3a-9f61-4e24-8571-305bb03d8764 req-ce9fed92-0194-43d3-ac50-b3ddf7921195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6df15fb-1858-49de-81d5-60a7bdac3261", "tag": "f6f6dadf-9e4d-492a-b773-c58fd6f6d91d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:52.888123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95402c3a-9f61-4e24-8571-305bb03d8764 req-ce9fed92-0194-43d3-ac50-b3ddf7921195 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.889008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95402c3a-9f61-4e24-8571-305bb03d8764 req-ce9fed92-0194-43d3-ac50-b3ddf7921195 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.889493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95402c3a-9f61-4e24-8571-305bb03d8764 req-ce9fed92-0194-43d3-ac50-b3ddf7921195 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.913414 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-95402c3a-9f61-4e24-8571-305bb03d8764 req-ce9fed92-0194-43d3-ac50-b3ddf7921195 service nova] Creating event network-changed:f6f6dadf-9e4d-492a-b773-c58fd6f6d91d for instance d6df15fb-1858-49de-81d5-60a7bdac3261 on n-h2-master-1 Sep 18 01:01:52.920683 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-95402c3a-9f61-4e24-8571-305bb03d8764 req-ce9fed92-0194-43d3-ac50-b3ddf7921195 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060474 Sep 18 01:01:52.922352 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 296/598] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:52.999931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87446642-33bb-4c68-b12e-933b0701875e tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Calling method '.version_select at 0x7f7006811a60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:53.100268 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=32 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:53.210666 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-87446642-33bb-4c68-b12e-933b0701875e tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac" status: 200 len: 371 microversion: 2.1 time: 0.286695 Sep 18 01:01:53.221320 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 297/599] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:01:52 2022] GET /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:53.226402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61464f36-cb5b-425e-a4a7-e3d61ee2f23b tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:53.244048 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61464f36-cb5b-425e-a4a7-e3d61ee2f23b tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '61c3067efce444348d154272be92e72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcb36a7b6b14256b0e5dafe633664c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61464f36-cb5b-425e-a4a7-e3d61ee2f23b tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Request method failure captured: Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-18%2001:01:52 HTTP/1.1 Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm36gsTmj7e5YMCCphMtOc_SfVF4iSNQ2oXX8UlyPqraCGwLmERVltiq1P_oRnsR_OTVH2poNmuLweZpQj6xfnnwOjFmgIUtIcKtPRDLIRjy_ulPsegeOBcXoKgTLoLfZNjm6HtlWkYM0iFExKpKZdg-7GmZ8WxFHbE9ecBnwJr59sE Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ffcb36a7b6b14256b0e5dafe633664c2 Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:01:53.253338 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffcb36a7b6b14256b0e5dafe633664c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ffcb36a7b6b14256b0e5dafe633664c2 Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 61c3067efce444348d154272be92e72f Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project Sep 18 01:01:53.254674 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2022-09-18 01:01:52'} Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:01:53.255305 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 18 01:01:53.256436 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:01:53.257422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61464f36-cb5b-425e-a4a7-e3d61ee2f23b tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:53.261184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61464f36-cb5b-425e-a4a7-e3d61ee2f23b tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934 tempest-InstanceUsageAuditLogNegativeTestJSON-1931923934-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-18 01:01:52" status: 403 len: 128 microversion: 2.1 time: 0.045077 Sep 18 01:01:53.275083 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aa99c8cd-2637-4d43-a8a9-0c63aac0afa5 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47/action" status: 202 len: 0 microversion: 2.1 time: 7.276132 Sep 18 01:01:53.275720 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 303/600] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:01:45 2022] POST /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47/action => generated 0 bytes in 7280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:53.283739 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 298/601] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:01:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-18%2001%3A01%3A52 => generated 128 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:53.284401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:53.285031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:53.299413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.302348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.303317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.305785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.306478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.307091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.309638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Action: 'update', calling method: .version_select at 0x7f7006767d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:53.459911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.460414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.460992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.462114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.462790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.468295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.612993 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a17ebdf6-64ec-428b-b414-dfa9b71be585 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac" status: 200 len: 328 microversion: 2.1 time: 0.326968 Sep 18 01:01:53.616804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 299/602] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:01:53 2022] PUT /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac => generated 328 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:53.634174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:53.646573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:53.655994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.656749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.657392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.658703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.659343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.664457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.688625 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:54.349462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:54.377544 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-99475713-2d6c-4e49-871c-9b9b3c31f2e9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 1.098800 Sep 18 01:01:54.384174 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 304/603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:53 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:54.399831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1426d5c3-f6b6-4763-bede-ab117b4534a3 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:54.439243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1426d5c3-f6b6-4763-bede-ab117b4534a3 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac" status: 202 len: 0 microversion: 2.1 time: 0.051573 Sep 18 01:01:54.447476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 305/604] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:54 2022] DELETE /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:54.475547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:54.480133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:54.503316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:54.505992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:54.509653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:54.512170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:54.513923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:54.518263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:54.577695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:54.585990 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1ad13ad1-fd23-474f-b79e-0442ffa4df7b tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 0.965087 Sep 18 01:01:54.602271 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 300/605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:53 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:54.612527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f68ee98b-3885-40d9-b1a2-245c56be1f4d tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Calling method '.version_select at 0x7f700678be50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:55.399426 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f68ee98b-3885-40d9-b1a2-245c56be1f4d tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac" status: 200 len: 371 microversion: 2.1 time: 0.788601 Sep 18 01:01:55.400204 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 301/606] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:01:54 2022] GET /compute/v2.1/os-quota-sets/3517ea7458a743b3b39438a16a50beac => generated 371 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:55.426688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:55.437484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:55.475574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.524960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.529927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.535634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.543525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.546624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:56.408127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:56.422055 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1a4fc5f9-3d8a-40f3-b00b-830b88b37c51 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 1.010159 Sep 18 01:01:56.423578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 302/607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:55 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:56.428540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:56.431773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:56.455222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:56.455731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:56.456163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:56.456878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:56.457460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:56.458122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:56.583660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:56.598600 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d287437-fd41-4bc4-ac45-d59baec0fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 2.145470 Sep 18 01:01:56.601216 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 306/608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:54 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:56.609805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69635cee-bb93-4ec3-bf60-e761479d09b6 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Calling method '.version_select at 0x7f700692daf0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:56.889221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:56.913703 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0c915d84-367c-47a7-9fff-ce8aad7bb52f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 0.488697 Sep 18 01:01:56.919691 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 303/609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:56 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:57.036086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69635cee-bb93-4ec3-bf60-e761479d09b6 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.431802 Sep 18 01:01:57.047992 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 307/610] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:01:56 2022] GET /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c/defaults => generated 371 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:57.140587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-959556444", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:57.274892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:01:57.451709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:57.453332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:57.480964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.481830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.483810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.486147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.488005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.490449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.327300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.336550 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-109ff551-6b7f-43c5-b99b-a5bd86b1e019 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 0.889591 Sep 18 01:01:58.353190 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 308/611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:57 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:58.358635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:58.359795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.367429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.368274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.368905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.370550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.371201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.371788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.396378 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:58.624532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:01:58.625916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:01:58.626803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:01:58.627471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:01:58.628113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:01:58.649771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.650764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.651590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.652905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.657232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.658153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.703153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Getting quotas for project 9e1212dcbcc24b82ba47a5e11c57881e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:58.711126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.715430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Getting quotas for user 88f666ed768b4bd89b59b7608b30a030 and project 9e1212dcbcc24b82ba47a5e11c57881e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:58.720070 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b6129bf0-9b28-4ca3-a5ee-d852b24b8fda tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 0.365303 Sep 18 01:01:58.731243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:01:58.734141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:01:58.734356 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 309/612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:58 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:58.757674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Action: 'update', calling method: .version_select at 0x7f70066d0dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:58.799798 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2d153210-31dc-4fb3-9c97-b1727c1c85c2 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875963 Sep 18 01:01:58.801599 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 304/613] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:01:58.808334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:58.810500 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.825134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.826024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.827001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.828065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.829247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.830754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.055217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:59.067712 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5473e003-b9b1-4ecd-8427-fc144c6216da tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 0.264230 Sep 18 01:01:59.069293 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 305/614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:58 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:59.075541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4beabaef-1b5f-49ca-b449-66bfbe2b0b32 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:59.076667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4beabaef-1b5f-49ca-b449-66bfbe2b0b32 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:59.181062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4beabaef-1b5f-49ca-b449-66bfbe2b0b32 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:59.193209 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4beabaef-1b5f-49ca-b449-66bfbe2b0b32 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1221 microversion: 2.1 time: 0.121688 Sep 18 01:01:59.194468 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 306/615] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:59 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:59.308569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.309059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.309496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.310267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.310728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.315966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.363698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:59.364476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:59.376603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.377849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.379457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.381795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.383652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.384214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.476407 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d4facf90-fb72-408e-9470-5da1d87524f0 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013" status: 200 len: 328 microversion: 2.1 time: 0.740642 Sep 18 01:01:59.489591 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 310/616] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:01:58 2022] PUT /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013 => generated 328 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:59.497606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Calling method '.version_select at 0x7f7006731ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:59.736732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:59.749936 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26783d44-9d92-429d-bc5c-a0dc577986d1 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 0.390554 Sep 18 01:01:59.751443 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 307/617] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:59 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:59.756392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3ae5ad57-7446-4658-9ba3-27a21e4222ca req-c89c396e-b334-44d3-93a2-e9531de431e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2356100a-11ad-4f3b-8a64-96d04a0079d0", "name": "network-vif-plugged", "status": "completed", "tag": "9e0ad0f5-7db1-4649-86a9-c4bc9368ef0f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:59.769896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3ae5ad57-7446-4658-9ba3-27a21e4222ca req-c89c396e-b334-44d3-93a2-e9531de431e3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.770377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3ae5ad57-7446-4658-9ba3-27a21e4222ca req-c89c396e-b334-44d3-93a2-e9531de431e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.770810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3ae5ad57-7446-4658-9ba3-27a21e4222ca req-c89c396e-b334-44d3-93a2-e9531de431e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.790606 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3ae5ad57-7446-4658-9ba3-27a21e4222ca req-c89c396e-b334-44d3-93a2-e9531de431e3 service nova] Creating event network-vif-plugged:9e0ad0f5-7db1-4649-86a9-c4bc9368ef0f for instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 on n-h1-master-1 Sep 18 01:01:59.798518 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3ae5ad57-7446-4658-9ba3-27a21e4222ca req-c89c396e-b334-44d3-93a2-e9531de431e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045773 Sep 18 01:01:59.799801 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 308/618] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:59.809278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:59.810160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:59.819047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.819714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.820286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.821975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.822478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.823510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.030084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.031374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.032462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.034630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.035866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.036465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.082408 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7f360a5f-a54a-44f8-aa4c-f4860cbb4905 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013/detail" status: 200 len: 916 microversion: 2.1 time: 0.590304 Sep 18 01:02:00.083713 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 311/619] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:01:59 2022] GET /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013/detail => generated 916 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:00.104029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:00.106009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:00.115751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.116255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.116739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.117701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.118172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.118792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.511500 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.524286 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a869c52-e62b-4f77-8189-41060f61faf6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 0.722608 Sep 18 01:02:00.525246 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 309/620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:59 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:00.539455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:00.540574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:00.549845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.550752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.551468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.552634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.553807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.554567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.582171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.591790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf5cbf4d-b039-447e-a7e5-7826f8c8807e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 0.492298 Sep 18 01:02:00.606131 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 312/621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:00 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:00.614079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Action: 'update', calling method: .version_select at 0x7f70067310d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:00.662480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.671761 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5af28070-b3df-4f63-9051-fe4c982591a3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1273 microversion: 2.1 time: 0.142140 Sep 18 01:02:00.674652 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 310/622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:00 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:00.793843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:00.794499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:00.805800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.806679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.807936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.810808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.811771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.812434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.868350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.869605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.870407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.871367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.872003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.872587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.947338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.948367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.948816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.950275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.950771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.951207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.977125 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:01.047128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:01.054888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-555485d4-d5bd-4964-969a-97e03eb1074f tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013?user_id=8d0e539e9ffa4ddaa7f8aa015321e266" status: 200 len: 328 microversion: 2.1 time: 0.447257 Sep 18 01:02:01.057593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5bb161be-c0fe-453a-ae36-84cc7812931c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 0.273883 Sep 18 01:02:01.058854 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 311/623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:00 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:01.064715 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 313/624] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:02:00 2022] PUT /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013?user_id=8d0e539e9ffa4ddaa7f8aa015321e266 => generated 328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:01.085992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84f3bb1e-06e7-472f-a4c6-28ac8c4eb5da tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Calling method '.version_select at 0x7f700680a9d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:01.220530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-84f3bb1e-06e7-472f-a4c6-28ac8c4eb5da tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013?user_id=8d0e539e9ffa4ddaa7f8aa015321e266" status: 200 len: 370 microversion: 2.1 time: 0.153504 Sep 18 01:02:01.235199 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 312/625] 10.222.0.25 () {58 vars in 1323 bytes} [Sun Sep 18 01:02:01 2022] GET /compute/v2.1/os-quota-sets/9c51d7fed4214eee81a7f984c9759013?user_id=8d0e539e9ffa4ddaa7f8aa015321e266 => generated 370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:01.553235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:01.554724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:01.565184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.566362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.567725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.569093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.570154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.571425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.643527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:01.648251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:01.704573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.705436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.706201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.707253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.723769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.723769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.041472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.066683 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dd298e3c-9f77-4ab6-84d8-c0c64425adde tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 0.521536 Sep 18 01:02:02.083545 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 314/626] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:01 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:02.090123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-431832f3-94fc-4f4c-a851-48cb5807702c req-3acd09ce-4797-44de-be11-1ab998474003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b6c25c-39a7-43a3-89ba-8fd79568ba47", "name": "network-vif-unplugged", "status": "completed", "tag": "454f8554-c3b3-44bd-96a8-a67b7c7bf570"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:02.122054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-431832f3-94fc-4f4c-a851-48cb5807702c req-3acd09ce-4797-44de-be11-1ab998474003 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.123136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-431832f3-94fc-4f4c-a851-48cb5807702c req-3acd09ce-4797-44de-be11-1ab998474003 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.124087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-431832f3-94fc-4f4c-a851-48cb5807702c req-3acd09ce-4797-44de-be11-1ab998474003 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.141537 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-431832f3-94fc-4f4c-a851-48cb5807702c req-3acd09ce-4797-44de-be11-1ab998474003 service nova] Creating event network-vif-unplugged:454f8554-c3b3-44bd-96a8-a67b7c7bf570 for instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 on n-h1-master-1 Sep 18 01:02:02.166383 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-431832f3-94fc-4f4c-a851-48cb5807702c req-3acd09ce-4797-44de-be11-1ab998474003 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080519 Sep 18 01:02:02.167540 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 315/627] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:02.175354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:02.178636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:02.192050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.195569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.196140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.196977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.205399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.206283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.343082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.361111 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8001f8a-154c-43d2-8623-c48fd4fc5967 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 0.744684 Sep 18 01:02:02.364234 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 313/628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:01 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:02.395289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-44759201-3235-4268-99c7-4434195c9315 req-b84c2c9f-693f-4eab-90b7-1f761bc9e2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6df15fb-1858-49de-81d5-60a7bdac3261", "name": "network-vif-plugged", "status": "completed", "tag": "f6f6dadf-9e4d-492a-b773-c58fd6f6d91d"}, {"server_uuid": "71a92b97-f5e4-47ec-8e50-d4539e2b908a", "name": "network-vif-plugged", "status": "completed", "tag": "9adbbcba-b835-4f0d-9d6c-606a19b3cad5"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:02.416487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-44759201-3235-4268-99c7-4434195c9315 req-b84c2c9f-693f-4eab-90b7-1f761bc9e2c3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.417487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-44759201-3235-4268-99c7-4434195c9315 req-b84c2c9f-693f-4eab-90b7-1f761bc9e2c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.418239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-44759201-3235-4268-99c7-4434195c9315 req-b84c2c9f-693f-4eab-90b7-1f761bc9e2c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.450764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.458808 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-44759201-3235-4268-99c7-4434195c9315 req-b84c2c9f-693f-4eab-90b7-1f761bc9e2c3 service nova] Creating event network-vif-plugged:f6f6dadf-9e4d-492a-b773-c58fd6f6d91d for instance d6df15fb-1858-49de-81d5-60a7bdac3261 on n-h2-master-1 Sep 18 01:02:02.459313 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-44759201-3235-4268-99c7-4434195c9315 req-b84c2c9f-693f-4eab-90b7-1f761bc9e2c3 service nova] Creating event network-vif-plugged:9adbbcba-b835-4f0d-9d6c-606a19b3cad5 for instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a on n-h1-master-1 Sep 18 01:02:02.470323 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-44759201-3235-4268-99c7-4434195c9315 req-b84c2c9f-693f-4eab-90b7-1f761bc9e2c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104659 Sep 18 01:02:02.471127 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-878c0606-68e5-46cc-b15e-25c6e6cf02b3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1279 microversion: 2.1 time: 0.297382 Sep 18 01:02:02.472176 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 314/629] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:02.472394 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 316/630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:02 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1279 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:02.482799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:02.484512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:02.486235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-657504fa-d205-48ba-9867-03295604cd16 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Calling method '.version_select at 0x7f70066d0790>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:02.495102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.496042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.496688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.497655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.498308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.498945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.848026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.861901 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8d253d70-6d9e-4ead-8645-a27f7c2c5518 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1388 microversion: 2.1 time: 0.386249 Sep 18 01:02:02.863678 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 315/631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:02 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1388 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:03.074428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1390725905", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "ce7051d4-da13-4653-b912-b3eb0bcc70a0"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:03.128151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-657504fa-d205-48ba-9867-03295604cd16 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.650438 Sep 18 01:02:03.129083 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 317/632] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:02:02 2022] GET /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c/defaults => generated 371 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:03.143113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:03.147796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:03.159400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:03.161946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:03.162779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.165152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:03.168134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:03.168997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.199046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] validate_networks() for [('ce7051d4-da13-4653-b912-b3eb0bcc70a0', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:03.869164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:03.899023 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-752d4dd7-9afc-462e-ac49-4e7c937fa8e9 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1318 microversion: 2.1 time: 0.768454 Sep 18 01:02:03.913971 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 318/633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:03 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:03.918735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Action: 'update', calling method: .version_select at 0x7f70067395e0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:04.388804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.394338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.395590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.397899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.398815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.400686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.473983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:04.475768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:04.475768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:04.475768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:04.476213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:04.506252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.506758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.507244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.508326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.509075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.509779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.524049 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=13 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:04.532029 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:04.545597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for project c9ce34433498444b8058b1354aed0f78. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:04.552853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for user 62dbad162d74407a891f11c9e972ada0 and project c9ce34433498444b8058b1354aed0f78. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:04.590862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:02:04.597886 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:02:04.745827 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07c01027-3c6e-4fac-bfce-8c6932d2d1e9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878892 Sep 18 01:02:04.747866 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 316/634] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:02:04.760446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:04.761979 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:04.781499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.783026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.784188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.786408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.787732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.789347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.918428 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-849e8e41-e612-4002-a4a9-b4792e2ecb14 tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c" status: 200 len: 329 microversion: 2.1 time: 1.016341 Sep 18 01:02:04.920325 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 319/635] 10.222.0.25 () {60 vars in 1263 bytes} [Sun Sep 18 01:02:03 2022] PUT /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c => generated 329 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:04.932533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:04.936170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:04.957410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.958781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.960301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.967354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.968501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.969791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.449373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:06.460799 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b80334fc-c903-46fa-8789-7e011ca60310 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 1.710745 Sep 18 01:02:06.464519 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 317/636] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:04 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:06.473527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:06.488001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:06.501776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:06.502652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:06.503288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.504220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:06.504855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:06.505470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.803716 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:06.821766 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f88f095-b943-4c76-a53d-d6b4adfd2eba tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1321 microversion: 2.1 time: 1.900133 Sep 18 01:02:06.825925 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 320/637] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:04 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1321 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:06.836761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b65b0881-3d03-4556-8ceb-d997c385bbc5 req-49ddfcb4-f3a9-40bc-a434-57c10431c15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b6c25c-39a7-43a3-89ba-8fd79568ba47", "tag": "454f8554-c3b3-44bd-96a8-a67b7c7bf570"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:06.881993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b65b0881-3d03-4556-8ceb-d997c385bbc5 req-49ddfcb4-f3a9-40bc-a434-57c10431c15b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:06.884365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b65b0881-3d03-4556-8ceb-d997c385bbc5 req-49ddfcb4-f3a9-40bc-a434-57c10431c15b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:06.886286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b65b0881-3d03-4556-8ceb-d997c385bbc5 req-49ddfcb4-f3a9-40bc-a434-57c10431c15b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.935744 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b65b0881-3d03-4556-8ceb-d997c385bbc5 req-49ddfcb4-f3a9-40bc-a434-57c10431c15b service nova] Creating event network-changed:454f8554-c3b3-44bd-96a8-a67b7c7bf570 for instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 on n-h1-master-1 Sep 18 01:02:06.960858 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b65b0881-3d03-4556-8ceb-d997c385bbc5 req-49ddfcb4-f3a9-40bc-a434-57c10431c15b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129665 Sep 18 01:02:06.961881 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 321/638] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:06.984048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:06.985502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:07.012978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.013821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.014863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.023729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.026033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.027554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.493685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:07.524089 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ebc3b35c-3f52-4379-9123-6146534be9dc tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1586 microversion: 2.1 time: 1.057948 Sep 18 01:02:07.525072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 318/639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:06 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1586 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:07.540814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:07.548105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:07.561521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.562338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.562956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.563864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.564499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.565079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.668688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:07.683225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a25252f9-399a-4c61-b04e-3d23b6441897 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1277 microversion: 2.1 time: 0.715233 Sep 18 01:02:07.684228 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 322/640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:06 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1277 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:07.705292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Action: 'update', calling method: .version_select at 0x7f70068aaaf0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:07.985128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.986109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.986711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.988071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.988880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.992270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.456840 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=21,nova_api:UPDATE=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:08.783156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:08.810047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3af76aa6-9243-41f3-94d2-302bb8829383 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1468 microversion: 2.1 time: 1.276206 Sep 18 01:02:08.818052 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 319/641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:07 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1468 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:08.833974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:08.834930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:08.844531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.850379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.851098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.852082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.854701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.856243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.903528 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2da94559-f707-4edc-b610-9c283ebbf3ba tempest-QuotasAdminTestJSON-745246268 tempest-QuotasAdminTestJSON-745246268-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c" status: 200 len: 329 microversion: 2.1 time: 1.216393 Sep 18 01:02:08.906584 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 323/642] 10.222.0.25 () {60 vars in 1263 bytes} [Sun Sep 18 01:02:07 2022] PUT /compute/v2.1/os-quota-sets/ffa1cda3553a4a8ca2864910bb74585c => generated 329 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:08.947577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:08.948717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:08.982548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.991687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.993172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.995651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:09.000925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:09.001819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:09.769368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d60aea64-83fa-424f-90e8-c25c2f933b94 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.846566 Sep 18 01:02:09.770852 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 324/643] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:02:08 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a/os-interface => generated 284 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:09.788875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:09.794750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:09.826333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:09.829181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:09.830858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:09.833310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:09.834453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:09.837084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:10.319382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:10.389463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-350ac6fa-502d-4750-bb5f-642195a7f86c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 1.562036 Sep 18 01:02:10.392867 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 320/644] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:08 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:10.429368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:10.431029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:10.444046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:10.445911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:10.447112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:10.449043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:10.450035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:10.453460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:10.911001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:10.985525 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63464a6f-f325-426c-b144-a6638fcfb2bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1283 microversion: 2.1 time: 0.580416 Sep 18 01:02:10.996834 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 321/645] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:10 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1283 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:11.022167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:11.031868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:11.033732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:11.039791 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8aac75a-33e6-4e00-ad5f-bd5fb8622b2f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1321 microversion: 2.1 time: 1.267341 Sep 18 01:02:11.040397 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 325/646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:09 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1321 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:11.052515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.053728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.054900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.067577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-06f903ce-b73c-4fbe-9e17-7db8080fc06f req-5c22cb2d-3864-4d07-a1b9-1206a9273e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866710a8-e463-4bd4-93f1-478b92c88029", "tag": "4061eeef-6e2b-4ccc-a170-46f285f558b7"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:11.068712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.069639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.070413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.096197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-06f903ce-b73c-4fbe-9e17-7db8080fc06f req-5c22cb2d-3864-4d07-a1b9-1206a9273e83 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.100205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-06f903ce-b73c-4fbe-9e17-7db8080fc06f req-5c22cb2d-3864-4d07-a1b9-1206a9273e83 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.101116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-06f903ce-b73c-4fbe-9e17-7db8080fc06f req-5c22cb2d-3864-4d07-a1b9-1206a9273e83 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.140803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-06f903ce-b73c-4fbe-9e17-7db8080fc06f req-5c22cb2d-3864-4d07-a1b9-1206a9273e83 service nova] Creating event network-changed:4061eeef-6e2b-4ccc-a170-46f285f558b7 for instance 866710a8-e463-4bd4-93f1-478b92c88029 on n-h1-master-1 Sep 18 01:02:11.157349 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-06f903ce-b73c-4fbe-9e17-7db8080fc06f req-5c22cb2d-3864-4d07-a1b9-1206a9273e83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115427 Sep 18 01:02:11.161680 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 326/647] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:11.430485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:11.431374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:11.448991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.453301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.453799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.457069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.457607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.458076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.631617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:11.634598 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:11.647498 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-18a159af-e765-4057-bc28-ef1a8da8f336 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0" status: 200 len: 1468 microversion: 2.1 time: 0.649232 Sep 18 01:02:11.649784 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 322/648] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:10 2022] GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 => generated 1468 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:11.690123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:11.695689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:11.699141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Searching by: {'reservation_id': 'r-dqjualpn', 'deleted': False, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:02:11.708924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.713453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.714104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.715066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.715713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.716296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.926942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:02:12.195486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:12.211758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.212748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.213456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:12.787706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:12.801865 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7e015dec-8163-44e4-8b88-3622370ff8ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 1.378084 Sep 18 01:02:12.804478 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 327/649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:11 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:12.812439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:12.816795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:12.835346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.835858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.836424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:12.837160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.839819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.840475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.206688 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2202b32b-fdcb-422a-975a-db4f7d2a2a20 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-dqjualpn" status: 200 len: 2929 microversion: 2.1 time: 1.522535 Sep 18 01:02:13.222403 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 323/650] 10.222.0.25 () {58 vars in 1197 bytes} [Sun Sep 18 01:02:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-dqjualpn => generated 2929 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:13.239390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:13.247155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:13.268409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:13.269729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:13.270851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.274012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:13.279077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:13.283380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.363472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:13.372634 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b6c7c06c-9c7f-4219-9474-79efc69bcc05 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1283 microversion: 2.1 time: 0.566680 Sep 18 01:02:13.380879 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 328/651] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:12 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1283 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:13.389990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a4d8221-bbef-444d-ba22-fd0c056b8cae tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:13.466328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.compute.server_groups [None req-8a4d8221-bbef-444d-ba22-fd0c056b8cae tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Querying cell bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) for 2 instances {{(pid=122373) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 18 01:02:13.467104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4d8221-bbef-444d-ba22-fd0c056b8cae tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:13.467586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4d8221-bbef-444d-ba22-fd0c056b8cae tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:13.468668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4d8221-bbef-444d-ba22-fd0c056b8cae tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.538172 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a4d8221-bbef-444d-ba22-fd0c056b8cae tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/0ba66605-aa03-4eb2-a33f-9843a900efb9" status: 200 len: 268 microversion: 2.1 time: 0.155549 Sep 18 01:02:13.539694 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 329/652] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:02:13 2022] GET /compute/v2.1/os-server-groups/0ba66605-aa03-4eb2-a33f-9843a900efb9 => generated 268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:13.552475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:13.553375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:13.564571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:13.573704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:13.574826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.575738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:13.576362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:13.576974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.090278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:14.112022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-45c60448-f48f-40a0-af77-d1f95ad79832 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1321 microversion: 2.1 time: 0.887916 Sep 18 01:02:14.122560 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 324/653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:13 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1321 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:14.139259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:14.142854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:14.164322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.169140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.170290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.171794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.180619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.181644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.434159 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d5be29a4-00d1-408d-9240-d93f6a920db7 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0" status: 200 len: 1619 microversion: 2.1 time: 0.885647 Sep 18 01:02:14.434985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 330/654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:13 2022] GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 => generated 1619 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:14.439621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:14.442382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:14.455145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.455642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.456081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.456791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.457251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.457696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.817832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:14.836196 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28c3b707-e9ba-4121-9858-4f2b2a07fe89 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 0.711310 Sep 18 01:02:14.838000 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 325/655] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:14 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:14.847707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:14.849655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:14.861829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.863361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.864432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.866097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.885159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.885877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.914617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:14.943831 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-176751f5-8980-43ff-9662-deb19ac109bd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1325 microversion: 2.1 time: 0.507042 Sep 18 01:02:14.945481 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 331/656] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:14 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1325 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:15.153044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:15.155139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:15.169872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.171227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.172930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.175051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.176256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.177784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.221970 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:15.693162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-236ef506-a577-4984-8534-8f80b097f92b tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1619 microversion: 2.1 time: 0.852439 Sep 18 01:02:15.694902 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 326/657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:14 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1619 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:15.789139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:15.848672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6eac5092-36ee-4a89-9925-220901fe6771 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1321 microversion: 2.1 time: 0.700725 Sep 18 01:02:15.874790 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 332/658] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:15 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1321 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:15.898241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:15.901275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:15.914706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1859602417", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "6d48a9cd-b662-4a76-a839-5174b05a84ad"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:15.929844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.932897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.935664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.936440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.936913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.939975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.010742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:16.534975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:16.546519 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7ad38606-15bd-4eb2-8493-70c9a4cbd600 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 0.671140 Sep 18 01:02:16.549962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 327/659] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:15 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:16.568128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:16.568941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:16.583706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.584489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.584932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.585892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.586917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.587512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.932067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:16.933094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:16.933787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:16.934503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:16.935133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:16.955101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.955791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.956384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.957267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.970403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.971134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:17.019109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:17.032402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:17.050877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:17.058079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:02:17.067461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:02:17.070891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d135dfd4-d436-44a5-b137-1713eeb0274d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1325 microversion: 2.1 time: 0.511841 Sep 18 01:02:17.071586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 328/660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:16 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1325 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:17.190421 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4cd9c439-f8b8-42ee-b426-e733f4bae159 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283736 Sep 18 01:02:17.194573 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 333/661] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:02:17.225175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:17.233912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:17.252112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:17.254420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:17.259043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:17.260124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:17.263278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:17.264969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:17.885582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8dfa3ab-f7c0-4a63-9656-4865d14882f8 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Action: 'create', calling method: .version_select at 0x7f7006712ee0>, body: {"keypair": {"name": "tempest-keypair-1048361840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc1Rmwl3G7vSqHrg/ro5fbL67it24X8KM6Eu61DhWOfFSZjTBfKb3i+PflJ2x36bYuDKbfm6551cXZ3JvXZ+ANhcN0riGWbFRGlFSk6Rbft7TjTkpgqCylfVDINXl4vZw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:17.935499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-e8dfa3ab-f7c0-4a63-9656-4865d14882f8 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Getting quotas for project cb58c52b4e6a451a880af6c63eb3ff4c. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:17.951994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-e8dfa3ab-f7c0-4a63-9656-4865d14882f8 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Getting quotas for user dad79b8d173143c7aeaf4804e3949ca5 and project cb58c52b4e6a451a880af6c63eb3ff4c. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:18.003649 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8dfa3ab-f7c0-4a63-9656-4865d14882f8 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.913600 Sep 18 01:02:18.004559 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 329/662] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:02:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:18.012934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:18.020678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:18.058450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.060910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.062093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.066970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.073024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.077388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.229885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:18.260799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c06e6e0-ee0c-465b-9d76-d0fa0c5c73e3 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1321 microversion: 2.1 time: 1.064245 Sep 18 01:02:18.261966 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 334/663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:17 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1321 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:18.268070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2950e3b4-422b-4416-837f-6b8b8286aeb8 req-d9f5e4d7-2b69-4d77-9731-8d8cd13d1453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a92b97-f5e4-47ec-8e50-d4539e2b908a", "tag": "9adbbcba-b835-4f0d-9d6c-606a19b3cad5"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:18.300207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2950e3b4-422b-4416-837f-6b8b8286aeb8 req-d9f5e4d7-2b69-4d77-9731-8d8cd13d1453 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.300697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2950e3b4-422b-4416-837f-6b8b8286aeb8 req-d9f5e4d7-2b69-4d77-9731-8d8cd13d1453 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.301138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2950e3b4-422b-4416-837f-6b8b8286aeb8 req-d9f5e4d7-2b69-4d77-9731-8d8cd13d1453 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.345111 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2950e3b4-422b-4416-837f-6b8b8286aeb8 req-d9f5e4d7-2b69-4d77-9731-8d8cd13d1453 service nova] Creating event network-changed:9adbbcba-b835-4f0d-9d6c-606a19b3cad5 for instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a on n-h1-master-1 Sep 18 01:02:18.357213 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2950e3b4-422b-4416-837f-6b8b8286aeb8 req-d9f5e4d7-2b69-4d77-9731-8d8cd13d1453 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094076 Sep 18 01:02:18.364225 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 335/664] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:18.374086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:18.374833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:18.396111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.397638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.398756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.400325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.401896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.403718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.676238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:18.693388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f9bd2f70-1e65-4b30-aa1b-213fb2fe982e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1221 microversion: 2.1 time: 0.327796 Sep 18 01:02:18.696597 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 336/665] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:18 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1221 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:18.710211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:18.722538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:18.723631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:18.730306 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fee8ba66-c6a2-47b2-a471-f18141b33a3e tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1586 microversion: 2.1 time: 0.723527 Sep 18 01:02:18.744068 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 330/666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:18 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1586 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:18.757514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.758410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.759053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.761344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.762064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.762610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:18.763308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.764148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:18.788573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.794318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.795092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.796071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.796740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.797470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.357261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:20.382246 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e4b2aa6-f60c-4130-a2e4-96927537e497 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1325 microversion: 2.1 time: 1.635894 Sep 18 01:02:20.396686 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 331/667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:18 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1325 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:20.396686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:20.396686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:20.410819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.411592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.412354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.413535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.414410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.415202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.493379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:20.504654 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68c4ca4b-9add-4317-a8ee-e9c995b999a9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1504 microversion: 2.1 time: 1.806508 Sep 18 01:02:20.505244 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 337/668] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:18 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1504 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:20.531285 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:20.532471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:20.540082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.540943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.541890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.544933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.546005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.546652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.852230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:20.907764 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d7cbc08-67c2-41c1-9f80-dbc540f57c9f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1275 microversion: 2.1 time: 0.372978 Sep 18 01:02:20.908507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 338/669] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:20 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1275 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:20.924235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-556e844d-bc5e-4b6b-8efa-55835eb7f65e req-3597ca80-0f91-4c77-bd84-7af29b2a21e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7e561f-2415-4705-9c53-b67f9c67cafc", "tag": "9a7c6f29-b3e0-4d09-a477-4812f81f898d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:20.980296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-556e844d-bc5e-4b6b-8efa-55835eb7f65e req-3597ca80-0f91-4c77-bd84-7af29b2a21e5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.981385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-556e844d-bc5e-4b6b-8efa-55835eb7f65e req-3597ca80-0f91-4c77-bd84-7af29b2a21e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.982232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-556e844d-bc5e-4b6b-8efa-55835eb7f65e req-3597ca80-0f91-4c77-bd84-7af29b2a21e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.040757 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-556e844d-bc5e-4b6b-8efa-55835eb7f65e req-3597ca80-0f91-4c77-bd84-7af29b2a21e5 service nova] Creating event network-changed:9a7c6f29-b3e0-4d09-a477-4812f81f898d for instance cf7e561f-2415-4705-9c53-b67f9c67cafc on n-h2-master-1 Sep 18 01:02:21.060185 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-556e844d-bc5e-4b6b-8efa-55835eb7f65e req-3597ca80-0f91-4c77-bd84-7af29b2a21e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150188 Sep 18 01:02:21.068193 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 339/670] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:21.429800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-338561fb-6c34-4696-84d4-b76826fb9ab7 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Calling method '.version_select at 0x7f700663a3a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:21.481461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:21.489472 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bbaecf1f-cb3c-45f3-a7af-dd4356fd7061 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1321 microversion: 2.1 time: 1.104997 Sep 18 01:02:21.490081 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 332/671] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:20 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1321 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:21.495378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:21.507152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:21.532240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.532987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.533780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.534471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.534949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.535383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.594831 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-338561fb-6c34-4696-84d4-b76826fb9ab7 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 371 microversion: 2.1 time: 0.524390 Sep 18 01:02:21.596614 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 340/672] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:02:21 2022] GET /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:21.615904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f0d31f1b-f082-4ea0-85a6-ab5b77c6fb79 req-e47e6c6a-2edc-4d51-ad32-401590b9fafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866710a8-e463-4bd4-93f1-478b92c88029", "name": "network-vif-plugged", "status": "completed", "tag": "4061eeef-6e2b-4ccc-a170-46f285f558b7"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:21.834211 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:21.946644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f0d31f1b-f082-4ea0-85a6-ab5b77c6fb79 req-e47e6c6a-2edc-4d51-ad32-401590b9fafa service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.948070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f0d31f1b-f082-4ea0-85a6-ab5b77c6fb79 req-e47e6c6a-2edc-4d51-ad32-401590b9fafa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.948859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f0d31f1b-f082-4ea0-85a6-ab5b77c6fb79 req-e47e6c6a-2edc-4d51-ad32-401590b9fafa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.969728 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f0d31f1b-f082-4ea0-85a6-ab5b77c6fb79 req-e47e6c6a-2edc-4d51-ad32-401590b9fafa service nova] Creating event network-vif-plugged:4061eeef-6e2b-4ccc-a170-46f285f558b7 for instance 866710a8-e463-4bd4-93f1-478b92c88029 on n-h1-master-1 Sep 18 01:02:21.977347 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f0d31f1b-f082-4ea0-85a6-ab5b77c6fb79 req-e47e6c6a-2edc-4d51-ad32-401590b9fafa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377660 Sep 18 01:02:21.978070 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 341/673] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:21.983900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:21.985193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:21.993845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.994511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.995105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.996228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.997034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.997828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.327508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:22.350697 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92c7acf9-bb06-43dd-9312-9ac0d676f6ba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1325 microversion: 2.1 time: 0.859392 Sep 18 01:02:22.351933 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 333/674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:21 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1325 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:22.370892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Action: 'update', calling method: .version_select at 0x7f70067dc3a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:22.552484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.556400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.557534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.559157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.561277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.561972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.685788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc3984a9-11c0-4d16-ace9-21a073a1262d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 328 microversion: 2.1 time: 0.331185 Sep 18 01:02:22.687484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 334/675] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:02:22 2022] PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:22.695962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:22.697982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:22.707588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.708754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.710091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.711542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.712549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.713589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:23.084498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:23.103122 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6501e17f-61d5-4ba8-9289-52381dd1577a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1494 microversion: 2.1 time: 1.123210 Sep 18 01:02:23.110006 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 342/676] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:21 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1494 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:23.121809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:23.127246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:23.143898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:23.144785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:23.145449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:23.146453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:23.155690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:23.156389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:23.200127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:23.223613 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9464eb02-48bb-408c-af3a-965b25e6de1a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1275 microversion: 2.1 time: 0.533563 Sep 18 01:02:23.224905 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 335/677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:22 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1275 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:23.348373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-132503145", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:23.499750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:24.454420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:24.477982 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f37a0807-f58c-42fa-b998-579a1d4f964d tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1321 microversion: 2.1 time: 1.366327 Sep 18 01:02:24.479709 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 343/678] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:23 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1321 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:24.497987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c1503e0-8a6f-4f1c-ab3b-addcc0a35f31 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '.version_select at 0x7f700663a940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:24.502488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c1503e0-8a6f-4f1c-ab3b-addcc0a35f31 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:24.502488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c1503e0-8a6f-4f1c-ab3b-addcc0a35f31 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:24.502488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c1503e0-8a6f-4f1c-ab3b-addcc0a35f31 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:24.554498 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c1503e0-8a6f-4f1c-ab3b-addcc0a35f31 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.072626 Sep 18 01:02:24.556196 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 344/679] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:02:24 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:24.564046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:24.570512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:24.602336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:24.603458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:24.604507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:24.605789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:24.606641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:24.607434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.128501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:25.130394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:25.131509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:25.132579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:25.133872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:25.157085 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=45 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:25.182861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.183732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.184507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.191505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.192622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.193668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.254014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Getting quotas for project e4d5c4dd5b7c418aa3f8632acdd0e33f. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:25.267705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Getting quotas for user c2f3ae28ff374c32804296d340310c28 and project e4d5c4dd5b7c418aa3f8632acdd0e33f. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:25.295102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.utils [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] cores quota exceeded for e4d5c4dd5b7c418aa3f8632acdd0e33f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122374) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 18 01:02:25.297699 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Request method failure captured: Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 144 Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4a9LUAi6LcFloP8N3ikqsjHdhQg3Vvw9E6j1WBioPOVWaoC6x16Of8PW-VSaC6cyC7QhFsfJfSP2Wu9UJxa-_h35ToxfZYhfZw5fA87u4pJ08ssBZFWOnsJ8IgTdotAqCHFJPGnkrUu7yAv_i4PfuV6S_H30WcufjcIkn2gQMeYt8 Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:02:25.308576 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: c2f3ae28ff374c32804296d340310c28 Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-132503145", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} Sep 18 01:02:25.316477 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-132503145', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452'}}} Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 18 01:02:25.320307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:25.323936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:25.330695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed36d7a2-f240-4dfb-bd4b-9fa4e0c31184 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.082073 Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 336/680] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:23 2022] POST /compute/v2.1/servers => generated 111 bytes in 2084 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:25.335144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:25.336221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:25.336221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.336221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.336221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.336808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.336808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.336808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.545311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:25.554972 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3344430-91ef-4638-b284-20faa3cf2f4a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1325 microversion: 2.1 time: 0.997396 Sep 18 01:02:25.562672 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 345/681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:24 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1325 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:25.567892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:25.571280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:25.585822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.586302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.586737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.587453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.588287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.588794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.043401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:26.076096 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2eecc30-a31c-4272-bb7b-21fea92d7598 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1317 microversion: 2.1 time: 0.765604 Sep 18 01:02:26.079853 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 337/682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:25 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:26.086427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Action: 'update', calling method: .version_select at 0x7f70068113a0>, body: {"quota_set": {"cores": 20}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:26.104902 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1514ec32-cf44-458b-925b-e483753fc004 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1645 microversion: 2.1 time: 0.540249 Sep 18 01:02:26.105837 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 346/683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:25 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1645 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:26.129160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:26.136522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:26.163652 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:UPDATE=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:26.178934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.180686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.183239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.189978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.192575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.194481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.527258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.530223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.530730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.533686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.534953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.535399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.582731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:26.603087 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e462784-5b25-4a7a-8723-3a8f4830219f tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1471 microversion: 2.1 time: 0.490909 Sep 18 01:02:26.604783 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 347/684] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:26 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:26.621737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:26.622394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:26.648487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.650168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.650660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.653817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.656440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.656929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.676192 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:26.725805 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f3b739d4-e492-4830-9a27-4b7fd8d60529 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 329 microversion: 2.1 time: 0.643926 Sep 18 01:02:26.726849 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 338/685] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:02:26 2022] PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 329 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:26.732035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1116218823", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "cdfd9210-2a2b-4d14-ac9e-64814397e610"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:26.836142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] validate_networks() for [('cdfd9210-2a2b-4d14-ac9e-64814397e610', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:26.980902 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=15 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:27.323806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:27.348703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4e332423-0401-4f65-bd29-0244ed40e71f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1325 microversion: 2.1 time: 0.742507 Sep 18 01:02:27.383819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 348/686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:26 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1325 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:28.300344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b94dbf2-8ec9-4de7-a03e-63550c3395b4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:28.301718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2b94dbf2-8ec9-4de7-a03e-63550c3395b4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] [instance: dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:28.315801 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-2b94dbf2-8ec9-4de7-a03e-63550c3395b4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] HTTP exception thrown: Instance dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8 could not be found. Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b94dbf2-8ec9-4de7-a03e-63550c3395b4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Request method failure captured: Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8/action HTTP/1.1 Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 15 Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4E_CzG6NzJ0QDMG7fjZBeBueDjNo0Rno2JPg28BdT7R6Ls2DNnCwT_CWdQqnGCUzgFB1xEsCmGhzEmWZns1oHcHPJmXWSIwRZBe2NrEWhWCNExtYvUqqPYPt8Pmcb4AOKJir-EhvIbNboTyKLfRRT8lgD2-9x-_I9l12Iq5NEC-ds Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:02:28.317842 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 79636ea80acb4913a90425091dc08868 Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: {"migrate": {}} Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:02:28.319521 n-d-master-1 devstack@n-api.service[122373]: exception: Instance dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8 could not be found. Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8', 'body': {'migrate': {}}} Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8 could not be found. Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:28.320547 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8 could not be found. Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8 could not be found. Sep 18 01:02:28.322200 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:28.324269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b94dbf2-8ec9-4de7-a03e-63550c3395b4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Returning 404 to user: Instance dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:28.325309 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2b94dbf2-8ec9-4de7-a03e-63550c3395b4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8/action" status: 404 len: 111 microversion: 2.1 time: 0.939216 Sep 18 01:02:28.338888 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 349/687] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:02:27 2022] POST /compute/v2.1/servers/dbf7a697-3bd7-42f9-8aa3-c2d2db9591b8/action => generated 111 bytes in 954 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:28.345140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b017b134-b57e-4cc0-a37e-c6375275c17d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Calling method '.version_select at 0x7f70067564c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:28.522259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:28.523340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:28.523998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:28.524770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:28.526017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:28.541351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:28.542642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:28.543490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:28.544403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:28.545033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:28.545676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:28.565410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:28.571122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for user cf8f60e6d52b498c90dd1ace5418ae13 and project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:28.587486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:02:28.590035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:02:28.677498 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=99 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:28.705957 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b017b134-b57e-4cc0-a37e-c6375275c17d tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 371 microversion: 2.1 time: 0.365209 Sep 18 01:02:28.707038 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 350/688] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:02:28 2022] GET /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:28.730857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:28.734705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:28.742609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f58a37c-05cd-4e42-9b0b-ce982223d33e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012182 Sep 18 01:02:28.745806 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 339/689] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:02:28.747527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:28.748418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:28.749018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:28.750198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:28.750841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:28.751519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:28.765484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f89aa345-e4bd-4ee8-9259-5b11b847cb86 req-5c2a2104-8eb8-4786-bc4a-276739c59df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3602d686-ef2d-4b39-b08f-673e0a1c5d0e", "tag": "9c62e587-dd92-4793-b6cf-263e3a8f025f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:28.847582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f89aa345-e4bd-4ee8-9259-5b11b847cb86 req-5c2a2104-8eb8-4786-bc4a-276739c59df7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:28.851528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f89aa345-e4bd-4ee8-9259-5b11b847cb86 req-5c2a2104-8eb8-4786-bc4a-276739c59df7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:28.853927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f89aa345-e4bd-4ee8-9259-5b11b847cb86 req-5c2a2104-8eb8-4786-bc4a-276739c59df7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:28.940263 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f89aa345-e4bd-4ee8-9259-5b11b847cb86 req-5c2a2104-8eb8-4786-bc4a-276739c59df7 service nova] Creating event network-changed:9c62e587-dd92-4793-b6cf-263e3a8f025f for instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e on n-h1-master-1 Sep 18 01:02:28.962523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f89aa345-e4bd-4ee8-9259-5b11b847cb86 req-5c2a2104-8eb8-4786-bc4a-276739c59df7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200328 Sep 18 01:02:28.966609 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 340/690] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:28.976304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ee1d1272-3e54-4ff2-8562-2fc6f050bf51 req-cf03e5e9-9b5d-4da8-a8a8-88cd0f4611e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7e561f-2415-4705-9c53-b67f9c67cafc", "name": "network-vif-plugged", "status": "completed", "tag": "9a7c6f29-b3e0-4d09-a477-4812f81f898d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:28.991731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee1d1272-3e54-4ff2-8562-2fc6f050bf51 req-cf03e5e9-9b5d-4da8-a8a8-88cd0f4611e6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:28.992876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee1d1272-3e54-4ff2-8562-2fc6f050bf51 req-cf03e5e9-9b5d-4da8-a8a8-88cd0f4611e6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:28.994225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee1d1272-3e54-4ff2-8562-2fc6f050bf51 req-cf03e5e9-9b5d-4da8-a8a8-88cd0f4611e6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:29.020092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ee1d1272-3e54-4ff2-8562-2fc6f050bf51 req-cf03e5e9-9b5d-4da8-a8a8-88cd0f4611e6 service nova] Creating event network-vif-plugged:9a7c6f29-b3e0-4d09-a477-4812f81f898d for instance cf7e561f-2415-4705-9c53-b67f9c67cafc on n-h2-master-1 Sep 18 01:02:29.030792 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ee1d1272-3e54-4ff2-8562-2fc6f050bf51 req-cf03e5e9-9b5d-4da8-a8a8-88cd0f4611e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059210 Sep 18 01:02:29.031981 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 341/691] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:29.085024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:29.086388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:29.101241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:29.102263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:29.108793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:29.111005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:29.112060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:29.112695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:29.178002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:29.201030 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e48962ef-1f0b-46b8-954d-5a67ddb5a3d6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1317 microversion: 2.1 time: 0.488160 Sep 18 01:02:29.201764 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 351/692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:28 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:29.214277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-618021526", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:29.346872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:29.896954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:29.907569 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64c010c0-a778-41e7-83f3-17690f5d3ecc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1325 microversion: 2.1 time: 0.867908 Sep 18 01:02:29.922014 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 342/693] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:29 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1325 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:29.945457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Action: 'update', calling method: .version_select at 0x7f700663f700>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:30.086649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.090495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.091138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.092152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.092634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.093062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.222241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bef1d785-faa0-42f6-a72d-6dfd20fcee61 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 328 microversion: 2.1 time: 0.298719 Sep 18 01:02:30.223953 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 343/694] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:02:29 2022] PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 328 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:30.230962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:30.231432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:30.231963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:30.232520 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:30.233029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:30.243642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:30.244871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:30.258226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.261190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.261745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.264056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.265049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.265880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.266509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.267453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.268182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.268673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.271076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.271942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.324590 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:30.328122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Getting quotas for project 9e1212dcbcc24b82ba47a5e11c57881e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:30.363277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Getting quotas for user 88f666ed768b4bd89b59b7608b30a030 and project 9e1212dcbcc24b82ba47a5e11c57881e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:30.423730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:02:30.428813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:02:30.499374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:30.515980 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2c16aca-8a0a-48b8-a612-f44c79284594 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1263 microversion: 2.1 time: 0.287389 Sep 18 01:02:30.520700 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 344/695] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:30 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1263 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:30.536241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:30.536869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:30.550142 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e19e50c3-2ecb-4953-9533-3035c3bb07dc tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346039 Sep 18 01:02:30.551378 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 352/696] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:02:30.559371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.559873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.562545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d21bd56-5d76-49cd-9e69-5f3fc576fad1 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:30.563164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6d21bd56-5d76-49cd-9e69-5f3fc576fad1 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:30.564742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.566789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.568525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.570582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.720308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6d21bd56-5d76-49cd-9e69-5f3fc576fad1 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:30.727595 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d21bd56-5d76-49cd-9e69-5f3fc576fad1 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1221 microversion: 2.1 time: 0.168800 Sep 18 01:02:30.728541 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 353/697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:30 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:30.748789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-640591567", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:30.870774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:31.741390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:31.755932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:31.756557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:31.759915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:31.760323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:31.804745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:31.805341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:31.805868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:31.807110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:31.807693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:31.809976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:31.841200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Getting quotas for project e4d5c4dd5b7c418aa3f8632acdd0e33f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:31.848687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Getting quotas for user c2f3ae28ff374c32804296d340310c28 and project e4d5c4dd5b7c418aa3f8632acdd0e33f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:31.877278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.utils [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] instances quota exceeded for e4d5c4dd5b7c418aa3f8632acdd0e33f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122373) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 18 01:02:31.878701 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Request method failure captured: Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 144 Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4a9LUAi6LcFloP8N3ikqsjHdhQg3Vvw9E6j1WBioPOVWaoC6x16Of8PW-VSaC6cyC7QhFsfJfSP2Wu9UJxa-_h35ToxfZYhfZw5fA87u4pJ08ssBZFWOnsJ8IgTdotAqCHFJPGnkrUu7yAv_i4PfuV6S_H30WcufjcIkn2gQMeYt8 Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:02:31.889501 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c2f3ae28ff374c32804296d340310c28 Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-640591567", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} Sep 18 01:02:31.891284 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-640591567', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452'}}} Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 18 01:02:31.892192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:31.893574 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.895208 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:31.896770 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d1e7bd7-30bd-4a26-acf5-c0fceda1e34b tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.161895 Sep 18 01:02:31.904773 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 354/698] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:30 2022] POST /compute/v2.1/servers => generated 119 bytes in 1175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:31.911260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:31.916287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:31.942682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:31.943178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:31.943792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:31.944875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:31.945319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:31.945771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.484759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:32.502146 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb6fb214-e2ae-44fb-9268-24238a9fe343 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1317 microversion: 2.1 time: 1.978601 Sep 18 01:02:32.502747 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 345/699] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:30 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1317 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:32.507455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:32.508327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:32.526014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.535318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.536050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.536981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.537645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.538576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.611247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:32.651338 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ada2d51c-0c06-4414-a07e-aa294ef6415d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.743454 Sep 18 01:02:32.652606 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 355/700] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:31 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:32.670215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:32.680257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:32.686350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:32.699544 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14f9493c-2bfe-4e26-8b19-505f327066d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1269 microversion: 2.1 time: 0.181882 Sep 18 01:02:32.700225 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 346/701] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:32 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:32.721159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Action: 'update', calling method: .version_select at 0x7f70067141f0>, body: {"quota_set": {"instances": 10}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:32.739858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.743383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.747657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.748746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.750090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.754367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.863587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.877616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.878403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.879496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.885683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.886541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.902923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:32.916237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1aa7f1b-d8b9-4ed0-b929-434a02e70b49 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1273 microversion: 2.1 time: 0.260234 Sep 18 01:02:32.920911 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 356/702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:32 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:32.927234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:32.928540 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:32.937964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.938995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.939649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.940651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.947527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.948394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:33.086231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4f628c1-80db-458d-9b1b-4475de38cb85 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 329 microversion: 2.1 time: 0.377907 Sep 18 01:02:33.114600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 347/703] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:02:32 2022] PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 329 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:33.146129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ee69ad9-e3a8-4dad-8c22-e834bf1c272e tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Calling method '.version_select at 0x7f7006714310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:33.323989 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ee69ad9-e3a8-4dad-8c22-e834bf1c272e tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 371 microversion: 2.1 time: 0.204845 Sep 18 01:02:33.328292 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 348/704] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:02:33 2022] GET /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:33.346420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Action: 'update', calling method: .version_select at 0x7f70068119d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:33.467435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:33.471634 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:33.488508 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5061ca41-6974-4eb9-b9a1-1760f585f017 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.565960 Sep 18 01:02:33.499869 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 357/705] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:32 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:33.542551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4fa3c909-7913-48b0-90fa-639b3ecbf257 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1758486393", "metadata": {"": ""}}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:33.548762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:33.549350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:33.549609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:33.550361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4fa3c909-7913-48b0-90fa-639b3ecbf257 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action HTTP/1.1 Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 107 Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:02:33.564797 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1758486393", "metadata": {"": ""}}} Sep 18 01:02:33.566230 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'cf7e561f-2415-4705-9c53-b67f9c67cafc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1758486393', 'metadata': {'': ''}}}} Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'': ''} Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:33.566985 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:33.568246 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4fa3c909-7913-48b0-90fa-639b3ecbf257 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:33.569411 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4fa3c909-7913-48b0-90fa-639b3ecbf257 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action" status: 400 len: 170 microversion: 2.1 time: 0.050607 Sep 18 01:02:33.569953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:33.569953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:33.573388 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 358/706] 10.222.0.25 () {60 vars in 1279 bytes} [Sun Sep 18 01:02:33 2022] POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action => generated 170 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:02:33.632644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:33.636563 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:33.710488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:33.711361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:33.712630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:33.723546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:33.725165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:33.725817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:33.841241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-947ab73f-8afe-44b6-be06-a644d7c92432 tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 325 microversion: 2.1 time: 0.504345 Sep 18 01:02:33.844165 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 349/707] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:02:33 2022] PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 325 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:33.880093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:33.920010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:33.958195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:33.960458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:33.962840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:33.973934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:33.977474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:33.983545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:34.311023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:34.326270 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb3a9d34-a24d-41d3-b6cc-6398b014d465 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1317 microversion: 2.1 time: 0.751739 Sep 18 01:02:34.327211 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 359/708] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:33 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:34.333735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:34.336486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:34.357529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:34.358156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:34.358551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:34.359261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:34.359714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:34.360127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:34.549093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:34.562632 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d075ffc0-ab2b-4439-b515-5e1cb81b3eee tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.716634 Sep 18 01:02:34.563218 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 350/709] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:33 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:34.578796 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:34.580342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:34.597371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:34.598102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:34.598739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:34.599914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:34.600542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:34.602157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:34.614072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:34.633391 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c3886bf-2167-46a7-a61d-592b33afb4d4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1269 microversion: 2.1 time: 0.303853 Sep 18 01:02:34.637947 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 360/710] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:34 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1269 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:34.656771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-740138324", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:34.791946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:34.861968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:34.874256 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5cd2024c-1431-4753-b048-fb28d4b3b9fa tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1279 microversion: 2.1 time: 0.309014 Sep 18 01:02:34.885587 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 351/711] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:34 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1279 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:34.888505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:34.889166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:34.900844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:34.901335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:34.901805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:34.907165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:34.907656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:34.908099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:35.696986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:35.713296 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78fa72c8-f57e-4812-b708-664acac389af tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.835923 Sep 18 01:02:35.713848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 352/712] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:34 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:35.745802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:35.746527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:35.763162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:35.763952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:35.764407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:35.765161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:35.765659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:35.766097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:35.903928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:35.905162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:35.905646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:35.906172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:35.906866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:35.929985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:35.930478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:35.930915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:35.932191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:35.932649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:35.933072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:35.988983 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Getting quotas for project e4d5c4dd5b7c418aa3f8632acdd0e33f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:36.007890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Getting quotas for user c2f3ae28ff374c32804296d340310c28 and project e4d5c4dd5b7c418aa3f8632acdd0e33f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:36.029972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.utils [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] ram quota exceeded for e4d5c4dd5b7c418aa3f8632acdd0e33f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122373) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 18 01:02:36.032990 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Request method failure captured: Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 144 Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4a9LUAi6LcFloP8N3ikqsjHdhQg3Vvw9E6j1WBioPOVWaoC6x16Of8PW-VSaC6cyC7QhFsfJfSP2Wu9UJxa-_h35ToxfZYhfZw5fA87u4pJ08ssBZFWOnsJ8IgTdotAqCHFJPGnkrUu7yAv_i4PfuV6S_H30WcufjcIkn2gQMeYt8 Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:02:36.035944 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c2f3ae28ff374c32804296d340310c28 Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-740138324", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} Sep 18 01:02:36.037693 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-740138324', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452'}}} Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 18 01:02:36.038629 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:36.040255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.041984 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.043474 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:36.043474 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:36.043474 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:36.043474 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:36.043474 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 18 01:02:36.043474 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.046498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:36.047927 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f036266b-0d27-45fe-a025-cb1ad19c7e70 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.408798 Sep 18 01:02:36.049350 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 361/713] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:34 2022] POST /compute/v2.1/servers => generated 110 bytes in 1410 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:36.057364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:36.060252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:36.069863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.070492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.071661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.074264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.076292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.077044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.276724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:36.289335 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b555143f-9129-47dc-8e01-a21a89c7c85a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1317 microversion: 2.1 time: 0.552605 Sep 18 01:02:36.291848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 353/714] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:35 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:36.301036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38f17177-a917-4b09-9c51-2a9fb7edf659 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1758904395", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38f17177-a917-4b09-9c51-2a9fb7edf659 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action HTTP/1.1 Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 619 Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:02:36.323534 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:36.325582 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:02:36.326786 n-d-master-1 devstack@n-api.service[122374]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1758904395", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 18 01:02:36.326786 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:02:36.326786 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'cf7e561f-2415-4705-9c53-b67f9c67cafc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1758904395', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 18 01:02:36.327196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:36.328587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.332858 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.334944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:36.334944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:36.334944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:02:36.334944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:02:36.334944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:02:36.334944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.344069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38f17177-a917-4b09-9c51-2a9fb7edf659 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:36.346188 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-38f17177-a917-4b09-9c51-2a9fb7edf659 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action" status: 400 len: 938 microversion: 2.1 time: 0.052109 Sep 18 01:02:36.346343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:36.348273 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 354/715] 10.222.0.25 () {60 vars in 1279 bytes} [Sun Sep 18 01:02:36 2022] POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action => generated 938 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:02:36.356873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:36.358021 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d625b3e4-b7f1-4da7-917a-f14759e3ffbe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 0.306480 Sep 18 01:02:36.358648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:36.365943 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 362/716] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:36 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:36.379068 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Action: 'update', calling method: .version_select at 0x7f70068aa040>, body: {"quota_set": {"ram": 51200}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:36.404922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.414006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.416218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.418244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.419056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.420552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.527197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.528016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.528851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.529997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.537331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.538366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.612849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:36.630868 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-73508740-c3fa-4742-8bfd-110e2ab08ab4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1279 microversion: 2.1 time: 0.280751 Sep 18 01:02:36.638270 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 355/717] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:36 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:36.664538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6eecf1c5-7f55-44d7-b5af-53f2aaa81094 req-7554b1f2-ef49-4d95-b15a-3b80417d1281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3602d686-ef2d-4b39-b08f-673e0a1c5d0e", "name": "network-vif-plugged", "status": "completed", "tag": "9c62e587-dd92-4793-b6cf-263e3a8f025f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:36.693669 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07d4173c-43e5-4a85-9573-4c52fa67a2fc tempest-QuotasAdminNegativeTest-610190765 tempest-QuotasAdminNegativeTest-610190765-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 200 len: 329 microversion: 2.1 time: 0.326324 Sep 18 01:02:36.694686 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 363/718] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:02:36 2022] PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 329 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:36.709203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6eecf1c5-7f55-44d7-b5af-53f2aaa81094 req-7554b1f2-ef49-4d95-b15a-3b80417d1281 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.714246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6eecf1c5-7f55-44d7-b5af-53f2aaa81094 req-7554b1f2-ef49-4d95-b15a-3b80417d1281 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.714699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6eecf1c5-7f55-44d7-b5af-53f2aaa81094 req-7554b1f2-ef49-4d95-b15a-3b80417d1281 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.724043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:36.726582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:36.742612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.744370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.745418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.747031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:36.748134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:36.749134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:36.753536 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6eecf1c5-7f55-44d7-b5af-53f2aaa81094 req-7554b1f2-ef49-4d95-b15a-3b80417d1281 service nova] Creating event network-vif-plugged:9c62e587-dd92-4793-b6cf-263e3a8f025f for instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e on n-h1-master-1 Sep 18 01:02:36.795288 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6eecf1c5-7f55-44d7-b5af-53f2aaa81094 req-7554b1f2-ef49-4d95-b15a-3b80417d1281 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154440 Sep 18 01:02:36.795941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 356/719] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:36.822052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36c75fa5-acc5-471d-be1d-594b5fe1e285 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Action: 'update', calling method: .version_select at 0x7f70067dcdc0>, body: {"quota_set": {"ram": 0}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:36.831786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-36c75fa5-acc5-471d-be1d-594b5fe1e285 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c2f3ae28ff374c32804296d340310c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5c4dd5b7c418aa3f8632acdd0e33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36c75fa5-acc5-471d-be1d-594b5fe1e285 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Request method failure captured: Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f HTTP/1.1 Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 25 Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4a9LUAi6LcFloP8N3ikqsjHdhQg3Vvw9E6j1WBioPOVWaoC6x16Of8PW-VSaC6cyC7QhFsfJfSP2Wu9UJxa-_h35ToxfZYhfZw5fA87u4pJ08ssBZFWOnsJ8IgTdotAqCHFJPGnkrUu7yAv_i4PfuV6S_H30WcufjcIkn2gQMeYt8 Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:02:36.849629 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4d5c4dd5b7c418aa3f8632acdd0e33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e4d5c4dd5b7c418aa3f8632acdd0e33f Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-145675188 Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: c2f3ae28ff374c32804296d340310c28 Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-QuotasAdminNegativeTest-145675188-project Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: {"quota_set": {"ram": 0}} Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 18 01:02:36.851602 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e4d5c4dd5b7c418aa3f8632acdd0e33f', 'body': {'quota_set': {'ram': 0}}} Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:36.852652 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.855230 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36c75fa5-acc5-471d-be1d-594b5fe1e285 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36c75fa5-acc5-471d-be1d-594b5fe1e285 tempest-QuotasAdminNegativeTest-145675188 tempest-QuotasAdminNegativeTest-145675188-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f" status: 403 len: 116 microversion: 2.1 time: 0.055879 Sep 18 01:02:36.857022 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 357/720] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:02:36 2022] PUT /compute/v2.1/os-quota-sets/e4d5c4dd5b7c418aa3f8632acdd0e33f => generated 116 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:37.329720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:37.330652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:37.351005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:37.351515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:37.351962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:37.352698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:37.353197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:37.357405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:37.436962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:37.452960 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8896608a-300a-44b3-9d9c-2a5c1ec1c604 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.738386 Sep 18 01:02:37.462046 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 364/721] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:36 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:37.467509 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:37.482862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:37.502830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:37.511558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:37.512618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:37.513641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:37.515769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:37.526524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:38.626924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:38.645873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9ef64b1-409a-4f5e-acd7-c3d04e5eaad4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 1.181511 Sep 18 01:02:38.663090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 365/722] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:37 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:38.668840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:38.669667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:38.671950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:38.679394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:38.680183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:38.680836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:38.683277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:38.684021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:38.684650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:38.689307 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-67279217-e7c3-4db2-8502-8bf1b128c734 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1317 microversion: 2.1 time: 1.364908 Sep 18 01:02:38.704172 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 358/723] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:37 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1317 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:38.720885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:38.726695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:38.741972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:38.743022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:38.744521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:38.746507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:38.747328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:38.748036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:39.143822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:39.171434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-653ef06a-df50-4f3c-8250-5f750aa32fc9 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 0.450717 Sep 18 01:02:39.188808 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 359/724] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:38 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:39.202099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-912aec56-c9bf-4068-bd07-1ff86aeba132 req-1cc67733-c400-4cc4-84a7-cd8d1374f075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c7b5a9-2058-4743-b221-e1a277fbff9a", "tag": "f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:39.228687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-912aec56-c9bf-4068-bd07-1ff86aeba132 req-1cc67733-c400-4cc4-84a7-cd8d1374f075 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:39.231946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-912aec56-c9bf-4068-bd07-1ff86aeba132 req-1cc67733-c400-4cc4-84a7-cd8d1374f075 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:39.232944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-912aec56-c9bf-4068-bd07-1ff86aeba132 req-1cc67733-c400-4cc4-84a7-cd8d1374f075 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:39.270939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:39.271977 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-912aec56-c9bf-4068-bd07-1ff86aeba132 req-1cc67733-c400-4cc4-84a7-cd8d1374f075 service nova] Creating event network-changed:f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193 for instance 63c7b5a9-2058-4743-b221-e1a277fbff9a on n-h1-master-1 Sep 18 01:02:39.290035 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3f23b2a-efc2-475e-a308-e3a32c7dfc8a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.624393 Sep 18 01:02:39.291767 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 366/725] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:38 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:39.313188 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-912aec56-c9bf-4068-bd07-1ff86aeba132 req-1cc67733-c400-4cc4-84a7-cd8d1374f075 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119190 Sep 18 01:02:39.319795 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 360/726] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:39.333610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8be35686-8ce2-42b8-98cf-a8d6b9b8d8d7 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8be35686-8ce2-42b8-98cf-a8d6b9b8d8d7 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action HTTP/1.1 Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 285 Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:02:39.341605 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:02:39.343038 n-d-master-1 devstack@n-api.service[122373]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'cf7e561f-2415-4705-9c53-b67f9c67cafc', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:02:39.343739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:02:39.344428 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:02:39.346317 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:02:39.347206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:02:39.347206 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:39.347206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8be35686-8ce2-42b8-98cf-a8d6b9b8d8d7 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:39.350284 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8be35686-8ce2-42b8-98cf-a8d6b9b8d8d7 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action" status: 400 len: 619 microversion: 2.1 time: 0.031358 Sep 18 01:02:39.365143 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 367/727] 10.222.0.25 () {60 vars in 1279 bytes} [Sun Sep 18 01:02:39 2022] POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action => generated 619 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:02:39.373938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:39.374839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:39.406979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:39.407583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:39.407943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:39.408869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:39.409110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:39.409535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:39.670941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:39.672763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:39.703825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:39.704298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:39.704746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:39.705526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:39.705923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:39.709879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:40.168254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:40.182633 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f9d30991-43b9-4060-9bdc-127cd76c95dd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.817320 Sep 18 01:02:40.186076 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 361/728] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:39 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:40.193836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:40.198476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:40.214766 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:40.222313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:40.223722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:40.226331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:40.229297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:40.229984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:40.230736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:40.300300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:40.326742 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed971264-1f62-4c00-a8f0-4c802c1c9f74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 0.660738 Sep 18 01:02:40.330962 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 368/729] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:39 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:40.624662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:40.645267 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-77479bae-9658-4a07-a016-44554465774e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1466 microversion: 2.1 time: 0.456205 Sep 18 01:02:40.676791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 362/730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:40 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1466 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:40.697669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:40.701787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:40.722069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:40.726200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:40.727027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:40.728065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:40.732645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:40.733382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:40.948264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-676737449", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "3946aa63-a4f2-4eee-aaa3-ec460267890e"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:41.046202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] validate_networks() for [('3946aa63-a4f2-4eee-aaa3-ec460267890e', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:41.086625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:41.102432 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f822c9f-be4b-4272-9b1d-1044ded91cd4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 0.424337 Sep 18 01:02:41.103645 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 363/731] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:40 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:41.109061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.122662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:41.129270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:41.130006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:41.130603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:41.131319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:41.131775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:41.132203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:41.528664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:41.545963 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1e7f3d5e-bb1b-499c-9ac5-5507153bcfa4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.440748 Sep 18 01:02:41.546900 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 364/732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:41.552420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.557480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:41.568593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:41.569087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:41.569526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:41.570262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:41.570751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:41.571174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:41.987221 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b69499e-c7c6-4f11-ae34-9aa25edaf6b1 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1617 microversion: 2.1 time: 0.438679 Sep 18 01:02:41.991788 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 365/733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1617 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:42.026188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:42.030752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:42.042034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.042898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.043439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.044287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.045153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.045752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.398485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:42.399028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:42.399354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:42.400628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:42.401047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:42.417952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.418449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.418884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.419615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.424916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.425452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.466479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:42.478731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for user bb1c3f4298d34bb2a820ec5de46a76c2 and project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:42.486784 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:42.510233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:42.512472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:02:42.514126 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:42.526837 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a2eb01a-1343-4ae7-b5ec-6d7316c232a5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 0.533894 Sep 18 01:02:42.527101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:02:42.534677 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 366/734] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:42.539585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e0074bd6-d60c-44a1-bbf7-ca592903068b req-1f8513d0-7fa1-49fb-9d8a-5451c5b49764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ab2bf9-08d5-4191-9253-a7f0d52fe320", "tag": "b5d0d741-ab03-4a78-8cd5-cae07f91175f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:42.560820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e0074bd6-d60c-44a1-bbf7-ca592903068b req-1f8513d0-7fa1-49fb-9d8a-5451c5b49764 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.574323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e0074bd6-d60c-44a1-bbf7-ca592903068b req-1f8513d0-7fa1-49fb-9d8a-5451c5b49764 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.574776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e0074bd6-d60c-44a1-bbf7-ca592903068b req-1f8513d0-7fa1-49fb-9d8a-5451c5b49764 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.599925 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e0074bd6-d60c-44a1-bbf7-ca592903068b req-1f8513d0-7fa1-49fb-9d8a-5451c5b49764 service nova] Creating event network-changed:b5d0d741-ab03-4a78-8cd5-cae07f91175f for instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 on n-h2-master-1 Sep 18 01:02:42.606415 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e0074bd6-d60c-44a1-bbf7-ca592903068b req-1f8513d0-7fa1-49fb-9d8a-5451c5b49764 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070177 Sep 18 01:02:42.607385 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 367/735] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:42.613046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-301798203"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:42.621712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:42.626393 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7cdea445-3583-4569-92a5-19b0f881fcfa tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.292829 Sep 18 01:02:42.633437 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 369/736] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:02:42.650671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.650671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.650671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.650671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.651010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.651010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.657536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:42.658192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:42.668888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.669833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.670532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:42.672310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:42.673101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:42.673751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:43.093816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53003975-57fb-4a65-9282-e47330e38745 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action" status: 202 len: 0 microversion: 2.1 time: 0.484676 Sep 18 01:02:43.100216 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 368/737] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:02:42 2022] POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:02:43.112348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-732401923", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["6d48a9cd-b662-4a76-a839-5174b05a84ad"]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:43.176607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:02:43.612040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:43.617515 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=14 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:43.626966 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2a8290f1-ee0d-41dc-afe4-585812a9bb0a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 0.991422 Sep 18 01:02:43.646958 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 370/738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:42 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:43.655525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:43.656617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:43.663926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:43.664657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:43.665288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:43.666198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:43.666968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:43.667712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:43.823395 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=45 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:43.869608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:43.893418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:43.907323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:43.909038 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-614ad4d0-276e-4b64-be32-e115cb792f45 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1265 microversion: 2.25 time: 0.260821 Sep 18 01:02:43.937844 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 371/739] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:43 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:43.944350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-646060605"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:43.947262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:43.954015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:43.955438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:43.956153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:43.957117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:43.957852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:43.959133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:44.056524 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Cannot 'createImage' instance cf7e561f-2415-4705-9c53-b67f9c67cafc while it is in task_state image_snapshot_pending Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action HTTP/1.1 Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 84 Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:02:44.058661 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-646060605"}} Sep 18 01:02:44.061066 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot 'createImage' instance cf7e561f-2415-4705-9c53-b67f9c67cafc while it is in task_state image_snapshot_pending Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'cf7e561f-2415-4705-9c53-b67f9c67cafc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-646060605'}}} Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:44.062391 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance cf7e561f-2415-4705-9c53-b67f9c67cafc while it is in task_state image_snapshot_pending Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance cf7e561f-2415-4705-9c53-b67f9c67cafc while it is in task_state image_snapshot_pending Sep 18 01:02:44.065585 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:02:44.069154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 409 to user: Cannot 'createImage' instance cf7e561f-2415-4705-9c53-b67f9c67cafc while it is in task_state image_snapshot_pending {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:44.069154 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2767033-e02c-4744-bbb3-cf5d143e9119 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action" status: 409 len: 167 microversion: 2.1 time: 0.120944 Sep 18 01:02:44.069154 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 372/740] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:02:43 2022] POST /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc/action => generated 167 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:02:44.069154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:44.069154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:44.081913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:44.082561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:44.084063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:44.085085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:44.085944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:44.086598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:44.198837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:02:44.202561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:02:44.203287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:02:44.204109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:02:44.204680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:02:44.247848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:44.249200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:44.250341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:44.251589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:44.253710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:44.254357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:44.296807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:02:44.301882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:02:44.335451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:02:44.340810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:02:44.443556 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56b084d5-ef2f-43e6-8632-e51c753cd3de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345422 Sep 18 01:02:44.445154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 369/741] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:02:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:02:44.450951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:44.465603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f76a6a02-1693-49fc-8451-463b9857ebdd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 0.399604 Sep 18 01:02:44.466590 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 373/742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:44 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:44.473432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6289b343-3784-476b-8860-cb3b5c9eead6 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '.version_select at 0x7f7006811c10>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:44.863072 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6289b343-3784-476b-8860-cb3b5c9eead6 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/images/4e28afa2-d47f-45e1-af35-bc33813480f8" status: 204 len: 0 microversion: 2.1 time: 0.416435 Sep 18 01:02:44.864411 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 370/743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:44 2022] DELETE /compute/v2.1/images/4e28afa2-d47f-45e1-af35-bc33813480f8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:02:44.888077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46ee1cdb-bafb-46a2-985d-485f5b8c71c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:44.891485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46ee1cdb-bafb-46a2-985d-485f5b8c71c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:44.964582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:44.970925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:44.971445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:44.971864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:44.982955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:44.983790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:44.984433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:44.998189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46ee1cdb-bafb-46a2-985d-485f5b8c71c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:45.019375 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46ee1cdb-bafb-46a2-985d-485f5b8c71c5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1216 microversion: 2.1 time: 0.151873 Sep 18 01:02:45.023759 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 371/744] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:44 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:45.038898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c9113a7f-2b20-4a21-9302-29ae2723b642 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.557992 Sep 18 01:02:45.038898 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 374/745] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:02:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:45.038898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:45.038898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:45.049332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:45.049873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:45.050316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:45.051035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:45.051496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:45.051702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:45.051937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:45.053249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:45.067789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:45.072323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:45.072913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:45.081064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:45.081753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:45.082241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:45.660443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:45.675664 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c1a35bf-7843-4baf-b460-2e6dbb2018bf tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1534 microversion: 2.1 time: 0.640154 Sep 18 01:02:45.678992 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 372/746] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:45 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1534 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:45.721390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:45.729715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:45.742437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:45.746064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:45.747662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:45.749541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:45.751225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:45.752586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.072688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:46.076803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:46.099224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:46.103631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:46.106223 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eef9b827-2e7b-4ece-9f49-b6a77798c1a7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1319 microversion: 2.25 time: 0.399766 Sep 18 01:02:46.107504 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 373/747] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:45 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:46.112264 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a56b358-9af5-4a4f-a4b5-4811b368e7f7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 1.079480 Sep 18 01:02:46.122609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:46.128136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.128941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.130271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.131479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.132181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.141612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.149153 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 375/748] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:45 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:46.164358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:46.166868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:46.190407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.191408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.192446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.193330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.193969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.194574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.216523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4004e8c2-7817-423c-8c9b-9cdae31a5a94 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.107649 Sep 18 01:02:46.223027 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 374/749] 10.222.0.25 () {58 vars in 1172 bytes} [Sun Sep 18 01:02:46 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:46.251249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:46.252128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:46.267038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.267901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.269008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.271359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.272565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.273257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.467636 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:46.481863 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3fd3874-8a93-4849-8bc1-1908da33a94a tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1268 microversion: 2.1 time: 0.250110 Sep 18 01:02:46.483741 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 375/750] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:46 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:46.504837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:46.509856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.510356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.511402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.511630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.512582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.513587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.554268 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7ca96938-4df0-4721-9eae-e9b722e91dc7 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061467 Sep 18 01:02:46.557715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 376/751] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:02:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:46.574292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:46.578604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.579225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.579732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.580715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.581172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.581619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.609315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:46.625702 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c8c36984-a146-4c38-8a80-4444efcef267 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 0.475251 Sep 18 01:02:46.626341 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 376/752] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:46 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:46.647795 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-162265bf-d14a-4f5d-bb12-ced301866fb4 tempest-ServicesAdminTestJSON-479943135 tempest-ServicesAdminTestJSON-479943135-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082418 Sep 18 01:02:46.659965 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 377/753] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:02:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:02:46.708693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:46.709411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:46.719373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.720187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.720833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:46.721784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:46.722467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:46.722917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.076577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:47.108863 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a71b1c2e-07e6-4b72-adfc-0a21ddb1af08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1540 microversion: 2.1 time: 0.405624 Sep 18 01:02:47.111398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 377/754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:46 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1540 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:47.146712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:47.148650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:47.150013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:47.151029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:47.161684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.163905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.164860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.167437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.168604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.170362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.177465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.183278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.183950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.184733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.185213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.185670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.424405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:47.447785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:47.451774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:47.457638 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad66c740-ff0f-48c6-b276-8620b7333f83 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1319 microversion: 2.25 time: 0.317671 Sep 18 01:02:47.469581 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 378/755] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:47 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:47.515274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:47.516145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:47.538704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.539975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.542108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.543479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.544338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.544887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.714133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:47.730082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:47.742020 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eda44e73-f806-403e-9bf7-e4f75229be53 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1274 microversion: 2.1 time: 0.223670 Sep 18 01:02:47.761585 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a39b0bab-88cb-4188-a202-3d3d0abb85f4 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 0.603925 Sep 18 01:02:47.769851 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 379/756] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:47 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:47.773080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 378/757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:47 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:47.784473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:47.785310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:47.795819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.796511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.797114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:47.798085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:47.798696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:47.799276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:48.136643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:48.137398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:48.153181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:48.153736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:48.159102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:48.160942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:48.161629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:48.162539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:48.168449 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:48.234409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:48.251918 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f9f28eb8-b1e6-40d9-90dc-aff15e340d79 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 0.476249 Sep 18 01:02:48.252719 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 380/758] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:47 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:48.300043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c0e08b2e-4bfa-46b1-bc19-bdad962d73d3 req-8e8ec7c5-5575-4c36-a91d-e0d0325ef76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c7b5a9-2058-4743-b221-e1a277fbff9a", "name": "network-vif-plugged", "status": "completed", "tag": "f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:48.323561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c0e08b2e-4bfa-46b1-bc19-bdad962d73d3 req-8e8ec7c5-5575-4c36-a91d-e0d0325ef76a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:48.324458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c0e08b2e-4bfa-46b1-bc19-bdad962d73d3 req-8e8ec7c5-5575-4c36-a91d-e0d0325ef76a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:48.324919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c0e08b2e-4bfa-46b1-bc19-bdad962d73d3 req-8e8ec7c5-5575-4c36-a91d-e0d0325ef76a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:48.352234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c0e08b2e-4bfa-46b1-bc19-bdad962d73d3 req-8e8ec7c5-5575-4c36-a91d-e0d0325ef76a service nova] Creating event network-vif-plugged:f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193 for instance 63c7b5a9-2058-4743-b221-e1a277fbff9a on n-h1-master-1 Sep 18 01:02:48.384576 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c0e08b2e-4bfa-46b1-bc19-bdad962d73d3 req-8e8ec7c5-5575-4c36-a91d-e0d0325ef76a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088737 Sep 18 01:02:48.387063 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 381/759] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:02:48.489944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:48.490840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:48.505623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:48.526174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:48.527081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:48.532290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:48.533584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:48.534651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:49.017738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:49.074202 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9bf5b2ec-3b5d-42c2-b173-1b8d5392a122 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1540 microversion: 2.1 time: 0.930958 Sep 18 01:02:49.075169 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 379/760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:48 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1540 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:49.097145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:49.106707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:49.145385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:49.147549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:49.150847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:49.158849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:49.159469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:49.159910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:49.570318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:49.588458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:49.590367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:49.591758 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a658e61e-23b7-481b-ae73-0751cc9e414c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 1.106461 Sep 18 01:02:49.592836 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 382/761] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:48 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:49.603248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:49.614611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:49.634931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:49.635538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:49.636141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:49.637127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:49.637922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:49.640632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:49.727167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:49.742382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7ece711c-296c-48da-a67a-d4a491e692e6 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.661233 Sep 18 01:02:49.743453 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 380/762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:49 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:49.752523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:49.753691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:49.766431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:49.772657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:49.773375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:49.774663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:49.775526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:49.776518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:49.833658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:02:50.037577 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b61bc8ee-9537-4bfb-8574-3643ecf5f00c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 204 len: 0 microversion: 2.1 time: 0.291920 Sep 18 01:02:50.038239 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 381/763] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:49 2022] DELETE /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:02:50.044474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:50.046732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:50.063003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:50.063856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:50.064913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:50.067614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:50.068351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:50.069728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:50.500572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:50.513121 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4786681b-f156-4bfa-b5b7-b144a4f86f24 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 0.918914 Sep 18 01:02:50.515319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 383/764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:49 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:50.533618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:50.535147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:50.551867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:50.552641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:50.553269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:50.562252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:50.562987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:50.563575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.019848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:51.037920 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6997aeff-7794-444c-aa67-d8383ed123c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1311 microversion: 2.1 time: 0.997855 Sep 18 01:02:51.038712 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 382/765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:50 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1311 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:51.054797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:51.055589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:51.079881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.080388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.080953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.082144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.083174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.084175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.264805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:51.279406 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48bce2b2-8de3-431d-83cd-6bd02b4f99b9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1711 microversion: 2.1 time: 0.760544 Sep 18 01:02:51.280378 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 384/766] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:50 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1711 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:51.288394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b0cdd2ad-c12f-476e-9f49-04c99adf892a req-1c07cc0a-1f75-4aa1-9bad-363c042c3f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84de09eb-4f7f-4e7a-b718-1db6db5f3dd2", "tag": "74874a6a-d953-4266-b50c-a1ed31ba0569"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:51.312929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b0cdd2ad-c12f-476e-9f49-04c99adf892a req-1c07cc0a-1f75-4aa1-9bad-363c042c3f17 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.313657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b0cdd2ad-c12f-476e-9f49-04c99adf892a req-1c07cc0a-1f75-4aa1-9bad-363c042c3f17 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.314123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b0cdd2ad-c12f-476e-9f49-04c99adf892a req-1c07cc0a-1f75-4aa1-9bad-363c042c3f17 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.341393 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b0cdd2ad-c12f-476e-9f49-04c99adf892a req-1c07cc0a-1f75-4aa1-9bad-363c042c3f17 service nova] Creating event network-changed:74874a6a-d953-4266-b50c-a1ed31ba0569 for instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 on n-h1-master-1 Sep 18 01:02:51.351149 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b0cdd2ad-c12f-476e-9f49-04c99adf892a req-1c07cc0a-1f75-4aa1-9bad-363c042c3f17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069486 Sep 18 01:02:51.354946 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 385/767] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:51.366163 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:51.373665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:51.388266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.388993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.389347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.390046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.390503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.390930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.532536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:51.571961 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11517796-e8c1-407a-9a0a-23bebfd3b8c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1522 microversion: 2.1 time: 0.531435 Sep 18 01:02:51.573303 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 383/768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:51 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:51.584556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:51.585415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:51.599041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.600234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.601223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.604579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.605719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.606325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.660860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:51.677738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:51.686323 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:51.688037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0303825c-2cb0-43bd-be62-f1eff1e3854a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 0.331160 Sep 18 01:02:51.692328 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 386/769] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:51 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:51.703080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d1dc1dec-0abc-4750-8bd5-063468d8487b req-5de327a0-9df8-4880-82d2-ca5f7bcec1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b4f360-e61a-4fea-8b7d-05c20f3f0743", "tag": "da3bd35c-65ba-4bd4-a22d-f10bb6509b6d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:51.714641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d1dc1dec-0abc-4750-8bd5-063468d8487b req-5de327a0-9df8-4880-82d2-ca5f7bcec1b7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.715391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d1dc1dec-0abc-4750-8bd5-063468d8487b req-5de327a0-9df8-4880-82d2-ca5f7bcec1b7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.716248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d1dc1dec-0abc-4750-8bd5-063468d8487b req-5de327a0-9df8-4880-82d2-ca5f7bcec1b7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.738700 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d1dc1dec-0abc-4750-8bd5-063468d8487b req-5de327a0-9df8-4880-82d2-ca5f7bcec1b7 service nova] Creating event network-changed:da3bd35c-65ba-4bd4-a22d-f10bb6509b6d for instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 on n-h1-master-1 Sep 18 01:02:51.747876 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d1dc1dec-0abc-4750-8bd5-063468d8487b req-5de327a0-9df8-4880-82d2-ca5f7bcec1b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053746 Sep 18 01:02:51.749574 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 387/770] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:51.761086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:51.762401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:51.781679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.782740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.783754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:51.784935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:51.785819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:51.786849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.053511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:52.072514 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-593635df-79e4-49f6-ab54-c0b778fd8109 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.494259 Sep 18 01:02:52.091411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 384/771] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:51 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:52.111072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4fab16a1-4e5b-4c49-ae2d-fbc33743bfb9 req-ce6ad3e8-8b1c-47f2-8c0f-e2fc0004e2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ab2bf9-08d5-4191-9253-a7f0d52fe320", "name": "network-vif-plugged", "status": "completed", "tag": "b5d0d741-ab03-4a78-8cd5-cae07f91175f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:52.146319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4fab16a1-4e5b-4c49-ae2d-fbc33743bfb9 req-ce6ad3e8-8b1c-47f2-8c0f-e2fc0004e2ad service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.154358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4fab16a1-4e5b-4c49-ae2d-fbc33743bfb9 req-ce6ad3e8-8b1c-47f2-8c0f-e2fc0004e2ad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.155597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4fab16a1-4e5b-4c49-ae2d-fbc33743bfb9 req-ce6ad3e8-8b1c-47f2-8c0f-e2fc0004e2ad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.158959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:52.171971 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b4390ed-40f9-469d-a3dd-8a7974e90bd5 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 0.419990 Sep 18 01:02:52.175337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 388/772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:51 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:52.179223 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4fab16a1-4e5b-4c49-ae2d-fbc33743bfb9 req-ce6ad3e8-8b1c-47f2-8c0f-e2fc0004e2ad service nova] Creating event network-vif-plugged:b5d0d741-ab03-4a78-8cd5-cae07f91175f for instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 on n-h2-master-1 Sep 18 01:02:52.182748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:52.183515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:52.190631 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4fab16a1-4e5b-4c49-ae2d-fbc33743bfb9 req-ce6ad3e8-8b1c-47f2-8c0f-e2fc0004e2ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088468 Sep 18 01:02:52.191881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.192690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.193862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.194300 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 385/773] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:52.195538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.196377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.197527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.222137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:52.223109 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:52.223496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:52.232806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:02:52.234317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.235603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.236463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.237581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.238431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.239259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.410583 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-da114c8f-594f-4cfe-b5fe-aabdeb3ff86a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 204 len: 0 microversion: 2.1 time: 0.233241 Sep 18 01:02:52.417258 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 389/774] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:52 2022] DELETE /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:02:52.424857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:52.432786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:52.454459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.455387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.458829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.463691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.468097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.469117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.500333 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=35 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:52.807484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:52.810936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:52.830064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c352bce8-9c30-4cd0-99eb-807511f17111 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1711 microversion: 2.1 time: 0.410291 Sep 18 01:02:52.831848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 390/775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:52 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1711 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:52.834637 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9a05d89-ad47-4cad-921d-a60cdf2eb167 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1493 microversion: 2.1 time: 0.634854 Sep 18 01:02:52.835273 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 386/776] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:52 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1493 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:52.858720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:52.862824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:52.874733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:52.876290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:52.893677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.894639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.895587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.897790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.898483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.899074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.926610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.927307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.932781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:52.933749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:52.939726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:52.942099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:53.665847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:53.675998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce3cea2c-d644-4d32-ad3d-31acb78f6076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1528 microversion: 2.1 time: 0.842230 Sep 18 01:02:53.677397 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 391/777] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:52 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1528 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:53.703194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:53.703194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:53.735404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:53.736467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:53.740257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:53.742024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:53.744402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:53.747356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:53.938610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:53.952096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:53.954860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:53.957095 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91f208ee-c7a5-465c-b663-9176d1767047 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 1.113914 Sep 18 01:02:53.958747 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 387/778] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:52 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:53.967242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:53.968553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:53.979807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:53.980790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:53.981616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:53.983108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:53.984175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:53.985180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:54.140090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2f3889e-c8b2-4b67-a92d-f0907ef2782b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1644 microversion: 2.1 time: 0.461166 Sep 18 01:02:54.140881 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 392/779] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:53 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1644 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:54.170087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:54.171815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:54.188649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:54.189522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:54.190805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:54.192141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:54.192988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:54.193812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:54.508265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:54.523511 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2dbd9ea-b7be-4d79-a414-36c6ef79969f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.562717 Sep 18 01:02:54.524194 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 388/780] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:53 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:54.530502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:54.531381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:54.557732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:54.558529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:54.559865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:54.560815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:54.561634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:54.562389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:54.644632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:54.656411 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a365bca7-e082-4e71-b7a1-3ed1128e8139 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1321 microversion: 2.1 time: 0.506124 Sep 18 01:02:54.678164 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 393/781] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:54 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:54.692482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:54.693151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:54.703110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:54.703676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:54.706160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:54.706350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:54.706709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:54.707370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:54.995911 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:55.003584 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:55.709987 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-378bb74d-e1d9-4d7f-9b44-56ada5392929 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1644 microversion: 2.1 time: 1.030298 Sep 18 01:02:55.711617 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 394/782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:54 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1644 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:55.718565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:55.719843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:55.755437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:55.756438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:55.757879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:55.761998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:55.762750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:55.763390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:55.956904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:55.970856 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8efd5ba3-2988-4bb0-9634-d01b6284f22c tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1711 microversion: 2.1 time: 1.444835 Sep 18 01:02:55.971951 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 389/783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:54 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1711 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:55.986889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:55.988709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:56.005751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:56.008468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:56.019640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:56.026500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:56.027635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:56.028275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:56.590561 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:57.519182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:57.545217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f07543d6-ad4d-4841-b57e-2e083f7d1203 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1528 microversion: 2.1 time: 1.831546 Sep 18 01:02:57.548280 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 395/784] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:55 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1528 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:57.570849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:57.573134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:57.600308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:57.600922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:57.601364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:57.602155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:57.616249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:57.617874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:57.705441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:57.725897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:57.730302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:57.733273 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-254f7f75-6a9e-4166-a647-7a7da58937c4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 1.758449 Sep 18 01:02:57.734995 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 390/785] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:55 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:57.748924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:57.750130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:57.783326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:57.784981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:57.785530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:57.786870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:57.787807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:57.788206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.232525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:58.259348 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d8da373-fe48-49b2-9a4e-c9ef7b3fa28a tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1470 microversion: 2.1 time: 0.522897 Sep 18 01:02:58.264259 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 391/786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:57 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1470 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:58.269748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:58.281135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.282342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.283106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.284148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.298052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:58.301920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.302872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.316690 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7361806a-4cc1-492f-bd3f-f1066497cda2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.764208 Sep 18 01:02:58.320633 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 396/787] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:57 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:58.330953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6f4d66d2-2b09-4193-b63c-3b494a780322 req-a5e06b67-3594-43cf-8514-558e621b5cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a92b97-f5e4-47ec-8e50-d4539e2b908a", "name": "network-vif-deleted", "tag": "9adbbcba-b835-4f0d-9d6c-606a19b3cad5"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:58.356075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6f4d66d2-2b09-4193-b63c-3b494a780322 req-a5e06b67-3594-43cf-8514-558e621b5cc5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.357594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6f4d66d2-2b09-4193-b63c-3b494a780322 req-a5e06b67-3594-43cf-8514-558e621b5cc5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.361055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6f4d66d2-2b09-4193-b63c-3b494a780322 req-a5e06b67-3594-43cf-8514-558e621b5cc5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.385119 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f31f64f-471e-4ed9-83c1-a94150bf2ac0 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.118890 Sep 18 01:02:58.390816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6f4d66d2-2b09-4193-b63c-3b494a780322 req-a5e06b67-3594-43cf-8514-558e621b5cc5 service nova] Creating event network-vif-deleted:9adbbcba-b835-4f0d-9d6c-606a19b3cad5 for instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a on n-h1-master-1 Sep 18 01:02:58.391372 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 392/788] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:02:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:58.401294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ee9b0aa5-552f-40cd-90e4-2756efcdd892 req-69e6890a-d11b-4bde-8996-aa8429467508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7e561f-2415-4705-9c53-b67f9c67cafc", "name": "network-vif-plugged", "status": "completed", "tag": "9a7c6f29-b3e0-4d09-a477-4812f81f898d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:58.406927 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6f4d66d2-2b09-4193-b63c-3b494a780322 req-a5e06b67-3594-43cf-8514-558e621b5cc5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079116 Sep 18 01:02:58.415029 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 397/789] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:58.424835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:58.434777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.440160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ee9b0aa5-552f-40cd-90e4-2756efcdd892 req-69e6890a-d11b-4bde-8996-aa8429467508 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.443710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ee9b0aa5-552f-40cd-90e4-2756efcdd892 req-69e6890a-d11b-4bde-8996-aa8429467508 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.445982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ee9b0aa5-552f-40cd-90e4-2756efcdd892 req-69e6890a-d11b-4bde-8996-aa8429467508 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.448304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.448805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.449245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.451453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.451950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.452390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.468646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ee9b0aa5-552f-40cd-90e4-2756efcdd892 req-69e6890a-d11b-4bde-8996-aa8429467508 service nova] Creating event network-vif-plugged:9a7c6f29-b3e0-4d09-a477-4812f81f898d for instance cf7e561f-2415-4705-9c53-b67f9c67cafc on n-h2-master-1 Sep 18 01:02:58.483500 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ee9b0aa5-552f-40cd-90e4-2756efcdd892 req-69e6890a-d11b-4bde-8996-aa8429467508 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090596 Sep 18 01:02:58.486248 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 393/790] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:58.504722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-dd0c4ac3-447d-4543-a225-faf7a8081091 req-cdd075a2-207a-4f03-a267-85d588c0bf36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7e561f-2415-4705-9c53-b67f9c67cafc", "name": "network-vif-deleted", "tag": "9a7c6f29-b3e0-4d09-a477-4812f81f898d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:58.532860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dd0c4ac3-447d-4543-a225-faf7a8081091 req-cdd075a2-207a-4f03-a267-85d588c0bf36 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.533371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dd0c4ac3-447d-4543-a225-faf7a8081091 req-cdd075a2-207a-4f03-a267-85d588c0bf36 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.534148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dd0c4ac3-447d-4543-a225-faf7a8081091 req-cdd075a2-207a-4f03-a267-85d588c0bf36 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.540188 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:58.548390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.549343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.550064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.550777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lazy-loading 'fault' on Instance uuid 71a92b97-f5e4-47ec-8e50-d4539e2b908a {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:02:58.584235 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-dd0c4ac3-447d-4543-a225-faf7a8081091 req-cdd075a2-207a-4f03-a267-85d588c0bf36 service nova] Creating event network-vif-deleted:9a7c6f29-b3e0-4d09-a477-4812f81f898d for instance cf7e561f-2415-4705-9c53-b67f9c67cafc on n-h2-master-1 Sep 18 01:02:58.606773 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-dd0c4ac3-447d-4543-a225-faf7a8081091 req-cdd075a2-207a-4f03-a267-85d588c0bf36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116351 Sep 18 01:02:58.609777 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 394/791] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:58.636819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:58.637702 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.645994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.646829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.647473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.648377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.649246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.650241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.660241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:58.674579 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5b453cc-b78c-4c52-ae8c-9c9fc3e3ea82 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1352 microversion: 2.1 time: 0.256552 Sep 18 01:02:58.675777 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 398/792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:58 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1352 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:58.686270 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:58.687094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.695411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.696615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.697322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.698363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.699160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.699854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.712599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lazy-loading 'flavor' on Instance uuid 45ab2bf9-08d5-4191-9253-a7f0d52fe320 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:02:58.797147 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:58.816009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4bb86656-55f8-4e18-afd7-5d369daef7ce tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a/action" status: 202 len: 0 microversion: 2.1 time: 0.138248 Sep 18 01:02:58.817114 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 399/793] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:02:58 2022] POST /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:02:58.829300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:58.831565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.845674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.846334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.847118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.848477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.849265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.850407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.864797 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-37a8c16f-79b6-4842-97f5-ec4e8c3e7be2 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320/action" status: 202 len: 0 microversion: 2.1 time: 0.246109 Sep 18 01:02:58.865468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 395/794] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:02:58 2022] POST /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:02:58.888415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:58.889375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.903912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.904708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.907161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.909660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.911353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.911790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.939340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.940029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.940683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.941308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lazy-loading 'fault' on Instance uuid cf7e561f-2415-4705-9c53-b67f9c67cafc {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:02:59.016011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.033680 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c7c7816-5d71-43ba-8be1-b99ca2cb03d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1315 microversion: 2.1 time: 0.214737 Sep 18 01:02:59.046078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 400/795] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:58 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:59.062649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:59.063261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:59.078123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.079884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.081913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.084726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.086555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.089344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.454089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.464431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.469728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.471155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67a563ac-33de-45ee-871b-7cfc8da55ab1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 0.598749 Sep 18 01:02:59.471766 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 396/796] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:58 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:59.485353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:59.487272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:59.499961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.502276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.502945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.506423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.507088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.507715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.545245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9633a825-abbf-498c-a780-900a9b285df6 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1649 microversion: 2.1 time: 0.497886 Sep 18 01:02:59.552208 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 401/797] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:59 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1649 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:59.562880 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:59.564399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:59.582639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.584340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.586817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.592753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.594668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.597873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.942252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.955198 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8c90948-dbe5-483c-982d-f04e49de6c33 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.401138 Sep 18 01:02:59.959146 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 402/798] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:59 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:59.968067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:59.970343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:59.984736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.988256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.988801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.991057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:59.991612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:59.993992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.047077 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:00.079147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.079930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.081271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.082038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lazy-loading 'fault' on Instance uuid 71a92b97-f5e4-47ec-8e50-d4539e2b908a {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:00.138937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad1db1d4f7a41559b0cb1e57ba9c12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf7634e26214d1592e971399bc13360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.147233 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f8ec8de1-b941-4cdf-b3ef-15e91d2b567b tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 200 len: 1352 microversion: 2.1 time: 0.186613 Sep 18 01:03:00.150605 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 403/799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:59 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 1352 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:00.161187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:00.165654 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:00.177383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.180024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.182583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.186928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.188000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.188694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.246851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.247587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.248240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.248910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lazy-loading 'fault' on Instance uuid cf7e561f-2415-4705-9c53-b67f9c67cafc {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:00.342534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.350964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa82fbc4-36bd-4888-8b0f-cfbde4503b5e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 200 len: 1315 microversion: 2.1 time: 0.197622 Sep 18 01:03:00.352896 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 404/800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:00 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:00.393017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5fdcbe99-82ca-4323-980c-cdc9a232dff4 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1629 microversion: 2.1 time: 0.919438 Sep 18 01:03:00.395231 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 397/801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:59 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1629 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:00.508312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:00.510331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:00.519470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.521629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.522694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.524794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.525589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.526449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.578729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:00.579413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:00.592271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.595850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.596402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.598544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.606281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.607053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.781287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.796678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.799814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.801809 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-40d08112-83ca-4ede-b47d-e5ad8a664c69 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 0.301461 Sep 18 01:03:00.802949 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 405/802] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:00 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:00.817325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98a9dc91-4ae4-42f1-8a02-1c7daf7a9568 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1629 microversion: 2.1 time: 0.242612 Sep 18 01:03:00.836895 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 398/803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:00 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1629 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:00.846258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:00.850981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:00.859523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.860249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.860713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.861445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.861940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.862399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.958180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lazy-loading 'flavor' on Instance uuid 63c7b5a9-2058-4743-b221-e1a277fbff9a {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:00.986243 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:00.987172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:00.994421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.995441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.996157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.997097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.998479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.999149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:01.047117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Going to try to live migrate instance to n-h2-master-1 {{(pid=122374) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:03:01.339299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:01.350234 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-49a11927-43b4-4f75-922d-9897387cf73d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.367910 Sep 18 01:03:01.351867 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 399/804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:00 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:01.359534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:01.365093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:01.379585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:01.385200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:01.386161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:01.388594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:01.389739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:01.393939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:01.412751 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] HTTP exception thrown: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Request method failure captured: Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a HTTP/1.1 Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2PRhtY0Ygu7wJtTOQIS0AhGo06m0CTWZRAu78n5xtaIu_yOGFcdUmk7A5mTQGqw1DSB79untCzzZB6TXhIu50CyaUUe3Khtu9sDmeDe_kWM5jOsm8m9cDtrpmhv59s0k5VCHK7stw8AeoMyneUyFjaCn3S_2iDQOJQ5E5Eb9dP1yk Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:03:01.416071 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bf7634e26214d1592e971399bc13360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bf7634e26214d1592e971399bc13360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fad1db1d4f7a41559b0cb1e57ba9c12d Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:01.417490 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '71a92b97-f5e4-47ec-8e50-d4539e2b908a'} Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:01.418401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:01.419676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:01.422384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Returning 404 to user: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:01.423602 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0c06322-412e-49c7-934a-7616ea86dc80 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 404 len: 111 microversion: 2.1 time: 0.067861 Sep 18 01:03:01.425001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 400/805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:01 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:01.430905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-21922833", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6c9bbfcd-7cb6-467e-bfa9-de771cb06b43"}], "security_groups": [{"name": "tempest-securitygroup--1137961369"}], "key_name": "tempest-keypair-1048361840", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "38cd27d2-05ee-4fc8-9e93-d4fcc78e4208", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:01.885649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] validate_networks() for [('6c9bbfcd-7cb6-467e-bfa9-de771cb06b43', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:02.778287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Getting quotas for project cb58c52b4e6a451a880af6c63eb3ff4c. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:02.792984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Getting quotas for user dad79b8d173143c7aeaf4804e3949ca5 and project cb58c52b4e6a451a880af6c63eb3ff4c. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:02.815679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:02.816272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:02.816754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:02.817162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:02.817615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:02.826323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:02.827016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:02.827633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:02.828430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:02.828948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:02.829433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:02.850614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Getting quotas for project cb58c52b4e6a451a880af6c63eb3ff4c. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:02.856336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Getting quotas for user dad79b8d173143c7aeaf4804e3949ca5 and project cb58c52b4e6a451a880af6c63eb3ff4c. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:02.866878 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:02.933144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:02.935468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38cd27d2-05ee-4fc8-9e93-d4fcc78e4208',volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:03.187589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2f8930f-ad6d-4fb6-a102-2febe03da167 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a/action" status: 202 len: 0 microversion: 2.1 time: 2.346457 Sep 18 01:03:03.188740 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 406/806] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:03:00 2022] POST /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a/action => generated 0 bytes in 2349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:03:03.216446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:03.217429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:03.243729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.245929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.248466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.251533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.254674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.255364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.309622 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2607f174-7ba7-466c-9191-6a0e20137f75 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.883148 Sep 18 01:03:03.312281 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc HTTP/1.1 Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:03.319147 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: exception: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:03:03.321720 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'cf7e561f-2415-4705-9c53-b67f9c67cafc'} Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:03.322560 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:03:03.323997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.325265 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 401/807] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:01 2022] POST /compute/v2.1/servers => generated 407 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:03.332205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:03.334485 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dd64070c-7f91-425d-ac0c-cb12b7c2fdab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 404 len: 111 microversion: 2.1 time: 0.144790 Sep 18 01:03:03.343187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:03.343646 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 407/808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:03 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:03.345710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:03.355562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.356411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.356846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.357744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.358571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.359006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.370996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:03.376061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:03.387127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.387936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.388633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.389656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.390309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.390950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.434456 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] HTTP exception thrown: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Request method failure captured: Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb HTTP/1.1 Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2PRhtY0Ygu7wJtTOQIS0AhGo06m0CTWZRAu78n5xtaIu_yOGFcdUmk7A5mTQGqw1DSB79untCzzZB6TXhIu50CyaUUe3Khtu9sDmeDe_kWM5jOsm8m9cDtrpmhv59s0k5VCHK7stw8AeoMyneUyFjaCn3S_2iDQOJQ5E5Eb9dP1yk Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:03.439606 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bf7634e26214d1592e971399bc13360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bf7634e26214d1592e971399bc13360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fad1db1d4f7a41559b0cb1e57ba9c12d Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: exception: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:03.440896 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb'} Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:03.441929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:03.443095 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:03.447152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Returning 404 to user: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:03.448142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c2c51b2-d81f-4c7f-8147-b794bf9f6f07 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 404 len: 111 microversion: 2.1 time: 0.100756 Sep 18 01:03:03.449178 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 408/809] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:03 2022] DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:03.454230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:03.455029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:03.463815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.464435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.464963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.466130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.467110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.467750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.801118 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e75f46cd-666b-42da-b7fe-ec27fc8d2208 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1612 microversion: 2.1 time: 0.473732 Sep 18 01:03:03.801920 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 402/810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:03 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1612 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:03.815610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:03.817300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:03.831205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.831700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.832175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.833282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.833843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.836586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.860666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:03.880017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:03.883310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:03.887361 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31e8354e-2220-4d2d-a8d0-ffb3695d83d0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 0.436946 Sep 18 01:03:03.896362 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 409/811] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:03 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:03.901961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b09e9d0f-dc1b-4c73-a6bf-0ed28ea09ab9 req-280a92f5-287c-4efb-9752-6733b1cccd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84de09eb-4f7f-4e7a-b718-1db6db5f3dd2", "name": "network-vif-plugged", "status": "completed", "tag": "74874a6a-d953-4266-b50c-a1ed31ba0569"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:03.919293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b09e9d0f-dc1b-4c73-a6bf-0ed28ea09ab9 req-280a92f5-287c-4efb-9752-6733b1cccd66 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.920329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b09e9d0f-dc1b-4c73-a6bf-0ed28ea09ab9 req-280a92f5-287c-4efb-9752-6733b1cccd66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.920776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b09e9d0f-dc1b-4c73-a6bf-0ed28ea09ab9 req-280a92f5-287c-4efb-9752-6733b1cccd66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.933918 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b09e9d0f-dc1b-4c73-a6bf-0ed28ea09ab9 req-280a92f5-287c-4efb-9752-6733b1cccd66 service nova] Creating event network-vif-plugged:74874a6a-d953-4266-b50c-a1ed31ba0569 for instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 on n-h1-master-1 Sep 18 01:03:03.939016 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b09e9d0f-dc1b-4c73-a6bf-0ed28ea09ab9 req-280a92f5-287c-4efb-9752-6733b1cccd66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041361 Sep 18 01:03:03.940392 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 410/812] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:03.947276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:03.948381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:03.955611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.956321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.956938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:03.958062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:03.958698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:03.959289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.277028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:04.287215 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e965c02-dd3c-4f98-b2ac-0c139d793ae5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.484341 Sep 18 01:03:04.294305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:04.302563 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 403/813] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:03 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:04.304138 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15c63612-e8d8-46bf-9fcd-6445acae0d50 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1503 microversion: 2.1 time: 0.362160 Sep 18 01:03:04.304791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 411/814] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:03 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:04.312212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f278d59a-d7b2-45e4-8df6-bd7a729d1231 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'create', calling method: .version_select at 0x7f70073124c0>, body: {"keypair": {"name": "tempest-keypair-1185449018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUghungoXCImKnRDdY9RvvUUmktB+EzKz+wTQtpeBv8VI0EULLv7mZS3bPFWGumdpXWUx/elUrbILSxbW6sZ0OB8LpcpWbykfirso7hwEl8QQKDhhNoUGjJKvKaVaIiXQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:04.317298 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.318245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.347096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.351596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.354498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.356119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.356244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f278d59a-d7b2-45e4-8df6-bd7a729d1231 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for project c9ce34433498444b8058b1354aed0f78. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:04.359230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.360694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.373478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f278d59a-d7b2-45e4-8df6-bd7a729d1231 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for user 62dbad162d74407a891f11c9e972ada0 and project c9ce34433498444b8058b1354aed0f78. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:04.414593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f278d59a-d7b2-45e4-8df6-bd7a729d1231 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107641 Sep 18 01:03:04.424892 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 412/815] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:03:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:04.433793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.434419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.451924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.452415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.452849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.453605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.454031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.454453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.490940 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] HTTP exception thrown: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Request method failure captured: Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb HTTP/1.1 Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2PRhtY0Ygu7wJtTOQIS0AhGo06m0CTWZRAu78n5xtaIu_yOGFcdUmk7A5mTQGqw1DSB79untCzzZB6TXhIu50CyaUUe3Khtu9sDmeDe_kWM5jOsm8m9cDtrpmhv59s0k5VCHK7stw8AeoMyneUyFjaCn3S_2iDQOJQ5E5Eb9dP1yk Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:04.498292 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bf7634e26214d1592e971399bc13360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bf7634e26214d1592e971399bc13360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fad1db1d4f7a41559b0cb1e57ba9c12d Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: exception: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:04.499777 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb'} Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:04.500491 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:04.502722 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.507573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Returning 404 to user: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:04.507573 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56f1445d-ab40-4dbb-978d-1d55e69d486a tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 404 len: 111 microversion: 2.1 time: 0.074115 Sep 18 01:03:04.507573 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 413/816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:04 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:04.508505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:04.509260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.530224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.530727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.531161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.535694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.536738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.538380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.594687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:04.613094 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c683c0bb-725f-41a0-8470-b2aed1f4f445 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1162 microversion: 2.1 time: 0.303319 Sep 18 01:03:04.618782 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 404/817] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:04 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1162 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:04.640220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ad385c1-6759-4acb-9e98-17fa770f2bc9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '.version_select at 0x7f70065b64c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.701157 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ad385c1-6759-4acb-9e98-17fa770f2bc9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-8537872" status: 202 len: 0 microversion: 2.1 time: 0.080777 Sep 18 01:03:04.707409 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 405/818] 10.222.0.25 () {58 vars in 1212 bytes} [Sun Sep 18 01:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-8537872 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:03:04.749516 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] HTTP exception thrown: Cannot 'migrate' instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 while it is in vm_state suspended Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Request method failure captured: Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320/action HTTP/1.1 Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 15 Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4E_CzG6NzJ0QDMG7fjZBeBueDjNo0Rno2JPg28BdT7R6Ls2DNnCwT_CWdQqnGCUzgFB1xEsCmGhzEmWZns1oHcHPJmXWSIwRZBe2NrEWhWCNExtYvUqqPYPt8Pmcb4AOKJir-EhvIbNboTyKLfRRT8lgD2-9x-_I9l12Iq5NEC-ds Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:03:04.753582 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 79636ea80acb4913a90425091dc08868 Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: {"migrate": {}} Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:04.754957 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'migrate' instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 while it is in vm_state suspended Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '45ab2bf9-08d5-4191-9253-a7f0d52fe320', 'body': {'migrate': {}}} Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 in vm_state suspended. Cannot resize while the instance is in this state. Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.755756 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 while it is in vm_state suspended Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.758055 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.759887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:04.759887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:04.759887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 while it is in vm_state suspended Sep 18 01:03:04.759887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.759887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Returning 409 to user: Cannot 'migrate' instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 while it is in vm_state suspended {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:04.759887 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb37cda0-3370-40f2-a29c-e25fed536038 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320/action" status: 409 len: 148 microversion: 2.1 time: 0.250464 Sep 18 01:03:04.761830 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 414/819] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:03:04 2022] POST /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320/action => generated 148 bytes in 257 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:03:04.769668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82b5f338-b422-462f-9f4c-85932306ba5e tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82b5f338-b422-462f-9f4c-85932306ba5e tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Request method failure captured: Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029/action HTTP/1.1 Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 39 Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4E_CzG6NzJ0QDMG7fjZBeBueDjNo0Rno2JPg28BdT7R6Ls2DNnCwT_CWdQqnGCUzgFB1xEsCmGhzEmWZns1oHcHPJmXWSIwRZBe2NrEWhWCNExtYvUqqPYPt8Pmcb4AOKJir-EhvIbNboTyKLfRRT8lgD2-9x-_I9l12Iq5NEC-ds Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:03:04.776039 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 79636ea80acb4913a90425091dc08868 Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: {"os-resetState": {"state": "invalid"}} Sep 18 01:03:04.778121 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '866710a8-e463-4bd4-93f1-478b92c88029', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'invalid' Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.778864 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:03:04.780167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 18 01:03:04.782970 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.782970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82b5f338-b422-462f-9f4c-85932306ba5e tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:04.782970 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82b5f338-b422-462f-9f4c-85932306ba5e tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029/action" status: 400 len: 144 microversion: 2.1 time: 0.016523 Sep 18 01:03:04.782970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 406/820] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:03:04 2022] POST /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:03:04.789497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe340dff-f1c4-40ab-a76d-69817a52d099 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe340dff-f1c4-40ab-a76d-69817a52d099 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Request method failure captured: Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029/action HTTP/1.1 Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 31 Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4E_CzG6NzJ0QDMG7fjZBeBueDjNo0Rno2JPg28BdT7R6Ls2DNnCwT_CWdQqnGCUzgFB1xEsCmGhzEmWZns1oHcHPJmXWSIwRZBe2NrEWhWCNExtYvUqqPYPt8Pmcb4AOKJir-EhvIbNboTyKLfRRT8lgD2-9x-_I9l12Iq5NEC-ds Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:03:04.795176 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 79636ea80acb4913a90425091dc08868 Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: {"os-resetState": {"state": 1}} Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:04.796471 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '866710a8-e463-4bd4-93f1-478b92c88029', 'body': {'os-resetState': {'state': 1}}} Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 1 Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:04.797233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 18 01:03:04.799673 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.801702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe340dff-f1c4-40ab-a76d-69817a52d099 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:04.801702 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe340dff-f1c4-40ab-a76d-69817a52d099 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029/action" status: 400 len: 120 microversion: 2.1 time: 0.011119 Sep 18 01:03:04.801702 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 415/821] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:03:04 2022] POST /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029/action => generated 120 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:03:04.809727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c094d52d-b0ee-4043-b78c-39cf8b0c0c41 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:04.811879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c094d52d-b0ee-4043-b78c-39cf8b0c0c41 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Failed to fetch instance by id 999 {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 01:03:04.812881 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-c094d52d-b0ee-4043-b78c-39cf8b0c0c41 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c094d52d-b0ee-4043-b78c-39cf8b0c0c41 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Request method failure captured: Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 37 Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4E_CzG6NzJ0QDMG7fjZBeBueDjNo0Rno2JPg28BdT7R6Ls2DNnCwT_CWdQqnGCUzgFB1xEsCmGhzEmWZns1oHcHPJmXWSIwRZBe2NrEWhWCNExtYvUqqPYPt8Pmcb4AOKJir-EhvIbNboTyKLfRRT8lgD2-9x-_I9l12Iq5NEC-ds Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:03:04.814763 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b5bcbb99c7e40efa09c0bc192eaec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 8b5bcbb99c7e40efa09c0bc192eaec45 Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1480893680 Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 79636ea80acb4913a90425091dc08868 Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1480893680-project-admin Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: {"os-resetState": {"state": "error"}} Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:04.816078 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 999 could not be found. Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:03:04.817437 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c094d52d-b0ee-4043-b78c-39cf8b0c0c41 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:04.819827 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c094d52d-b0ee-4043-b78c-39cf8b0c0c41 tempest-ServersAdminNegativeTestJSON-1480893680 tempest-ServersAdminNegativeTestJSON-1480893680-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.013707 Sep 18 01:03:04.821011 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 407/822] 10.222.0.25 () {60 vars in 1179 bytes} [Sun Sep 18 01:03:04 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:03:04.826220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.828387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.840777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.841266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.841805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.842734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.843622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.844566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.873216 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:04.919735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.920339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.945712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.946516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.949280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.951487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.954728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.956745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.113801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37ced45a-d936-468e-8850-024b6aa9cfc6 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "DELETE /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 204 len: 0 microversion: 2.1 time: 0.291421 Sep 18 01:03:05.114408 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 416/823] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:04 2022] DELETE /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:05.123374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:05.124124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:05.149613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.150123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.150564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.151317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.151722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.152149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.384548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:05.407049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:05.411389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:05.414518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2b50ea2b-6651-430b-85f5-c6340eb8cb3e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 0.499566 Sep 18 01:03:05.418314 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 408/824] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:04 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:03:05.432114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ea11c101-cfe2-407e-b090-7240b8f47031 req-e2268d29-d397-4d51-8730-547ef0f85b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c7b5a9-2058-4743-b221-e1a277fbff9a", "name": "network-vif-unplugged", "status": "completed", "tag": "f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:05.459244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ea11c101-cfe2-407e-b090-7240b8f47031 req-e2268d29-d397-4d51-8730-547ef0f85b10 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.459725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ea11c101-cfe2-407e-b090-7240b8f47031 req-e2268d29-d397-4d51-8730-547ef0f85b10 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.460146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ea11c101-cfe2-407e-b090-7240b8f47031 req-e2268d29-d397-4d51-8730-547ef0f85b10 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.494649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ea11c101-cfe2-407e-b090-7240b8f47031 req-e2268d29-d397-4d51-8730-547ef0f85b10 service nova] Creating event network-vif-unplugged:f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193 for instance 63c7b5a9-2058-4743-b221-e1a277fbff9a on n-h1-master-1 Sep 18 01:03:05.502687 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ea11c101-cfe2-407e-b090-7240b8f47031 req-e2268d29-d397-4d51-8730-547ef0f85b10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082620 Sep 18 01:03:05.504537 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 409/825] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:05.515712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:05.516545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:05.526550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.527647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.529293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.530255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.530910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.531620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.733166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:05.744737 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80d4f315-5be7-4890-86e5-5b09e7374f77 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1467 microversion: 2.1 time: 0.625881 Sep 18 01:03:05.745444 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 417/826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:05 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1467 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:05.758232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:05.758232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:05.772849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.773750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.774555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.775524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.776555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.777207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.821557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:05.835315 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d3e62453-9857-4a83-b676-998aa4ee2571 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1316 microversion: 2.1 time: 0.329063 Sep 18 01:03:05.855138 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 410/827] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:05 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:05.870180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:05.871151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:05.885209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.886145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.886952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.888126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.890412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.891484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:06.063622 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:06.082356 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f6b1f35-0d6a-440b-84b0-135d0bfa3bca tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1218 microversion: 2.1 time: 0.221967 Sep 18 01:03:06.097398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 411/828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:05 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:06.097398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-33e421d1-4b81-4471-9af2-b509f315dfde req-6ddeccf4-4093-48d0-a69b-cd4c9326a2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b4f360-e61a-4fea-8b7d-05c20f3f0743", "name": "network-vif-plugged", "status": "completed", "tag": "da3bd35c-65ba-4bd4-a22d-f10bb6509b6d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:06.106669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-33e421d1-4b81-4471-9af2-b509f315dfde req-6ddeccf4-4093-48d0-a69b-cd4c9326a2c0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:06.107312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-33e421d1-4b81-4471-9af2-b509f315dfde req-6ddeccf4-4093-48d0-a69b-cd4c9326a2c0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:06.107853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-33e421d1-4b81-4471-9af2-b509f315dfde req-6ddeccf4-4093-48d0-a69b-cd4c9326a2c0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:06.118695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:06.132617 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d0136c58-0f95-4554-bc0b-2a3d7b682638 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1503 microversion: 2.1 time: 0.381378 Sep 18 01:03:06.135791 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-33e421d1-4b81-4471-9af2-b509f315dfde req-6ddeccf4-4093-48d0-a69b-cd4c9326a2c0 service nova] Creating event network-vif-plugged:da3bd35c-65ba-4bd4-a22d-f10bb6509b6d for instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 on n-h1-master-1 Sep 18 01:03:06.136097 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 418/829] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:05 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1503 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:06.158580 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-33e421d1-4b81-4471-9af2-b509f315dfde req-6ddeccf4-4093-48d0-a69b-cd4c9326a2c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073507 Sep 18 01:03:06.159192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 412/830] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:06.448959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:06.450093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:06.460344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:06.462636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:06.463354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:06.464884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:06.466197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:06.467148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:06.776681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:06.777687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:06.790739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:06.791231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:06.791906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:06.792755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:06.793352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:06.794002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.253366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:07.257199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:07.269843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aa105dbd-3f10-4064-acad-433b59fc5eef tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1467 microversion: 2.1 time: 0.499776 Sep 18 01:03:07.282133 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 413/831] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:06 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1467 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:07.292998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:07.294201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:07.302467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.303400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.304085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.305138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.306435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.307361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.308920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:07.313883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:07.315293 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aab8bd66-d509-4902-aff6-8bdcfadbce0a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1361 microversion: 2.25 time: 0.871714 Sep 18 01:03:07.322880 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 419/832] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:06 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1361 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:03:07.328492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-daae9cca-da19-45ba-9a18-ce2027229c6a tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:07.372180 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-daae9cca-da19-45ba-9a18-ce2027229c6a tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1309193408" status: 202 len: 0 microversion: 2.1 time: 0.047662 Sep 18 01:03:07.376789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 420/833] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:03:07 2022] DELETE /compute/v2.1/flavors/1309193408 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:03:07.391816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:07.392463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:07.402209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.403205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.403817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.404622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.405090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.406807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.632046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:07.638206 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:07.670691 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3c44cc50-7c82-4183-b226-18e4a48ef399 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1226 microversion: 2.1 time: 0.292004 Sep 18 01:03:07.672782 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 421/834] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:07 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1226 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:07.684280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:07.686013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:07.706282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.708061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.709248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.711612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.712975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.714401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.942370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:07.973339 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ecbe0b5f-c910-4d6a-9fba-ca1cf5328a84 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1466 microversion: 2.1 time: 0.688172 Sep 18 01:03:07.974120 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 414/835] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:07 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1466 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:08.003062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c5f06940-0eef-4fa3-ab03-9602a91d6303 tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:08.084237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c5f06940-0eef-4fa3-ab03-9602a91d6303 tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.104511 Sep 18 01:03:08.101793 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 415/836] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:03:07 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:08.113044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9eaf5197-bd95-4a67-bd7f-e95e86702d8b req-8aab8237-0210-4bcc-acb7-8a3acaed340a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c7b5a9-2058-4743-b221-e1a277fbff9a", "tag": "f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:08.135797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9eaf5197-bd95-4a67-bd7f-e95e86702d8b req-8aab8237-0210-4bcc-acb7-8a3acaed340a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:08.136287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9eaf5197-bd95-4a67-bd7f-e95e86702d8b req-8aab8237-0210-4bcc-acb7-8a3acaed340a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:08.136722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9eaf5197-bd95-4a67-bd7f-e95e86702d8b req-8aab8237-0210-4bcc-acb7-8a3acaed340a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:08.162117 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9eaf5197-bd95-4a67-bd7f-e95e86702d8b req-8aab8237-0210-4bcc-acb7-8a3acaed340a service nova] Creating event network-changed:f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193 for instance 63c7b5a9-2058-4743-b221-e1a277fbff9a on n-h1-master-1 Sep 18 01:03:08.175746 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9eaf5197-bd95-4a67-bd7f-e95e86702d8b req-8aab8237-0210-4bcc-acb7-8a3acaed340a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076054 Sep 18 01:03:08.178090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 416/837] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:08.183825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:08.193432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:08.218790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:08.219288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:08.219727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:08.220438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:08.220896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:08.228889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:08.396543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:08.419448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4cd348e3-739d-40ee-a8d3-35c9a9f4017f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1503 microversion: 2.1 time: 0.744504 Sep 18 01:03:08.422546 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 422/838] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:07 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1503 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:08.437679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a05c93b-8647-4cba-bedb-d585bfefda0d tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:08.496159 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a05c93b-8647-4cba-bedb-d585bfefda0d tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2123573806" status: 202 len: 0 microversion: 2.1 time: 0.072248 Sep 18 01:03:08.496763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 423/839] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:03:08 2022] DELETE /compute/v2.1/flavors/2123573806 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:03:08.505648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:08.516762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:08.531427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:08.532162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:08.535742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:08.536755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:08.537463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:08.538108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:08.970138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:08.984152 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9ff5366d-2683-4baf-9eac-3a5cb233a988 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 200 len: 1425 microversion: 2.1 time: 0.483522 Sep 18 01:03:08.996668 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 424/840] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:08 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 1425 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:09.012167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:09.015043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:09.037535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.038410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.039088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.040334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.041269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.042318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.043783 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8baeca08-8598-48c9-bc0b-8448f434b13d tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1617 microversion: 2.1 time: 0.858280 Sep 18 01:03:09.047820 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 417/841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:08 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1617 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:09.073580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ea031ca-d1f6-4e30-8b51-d31c3cd40cbe tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:09.181603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ea031ca-d1f6-4e30-8b51-d31c3cd40cbe tempest-ServersWithSpecificFlavorTestJSON-1027655866 tempest-ServersWithSpecificFlavorTestJSON-1027655866-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095280 Sep 18 01:03:09.182292 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 418/842] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:03:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:09.194948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:09.209725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:09.228999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.229513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.230218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.231149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.231919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.232512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.656070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:09.675260 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7095e424-7da2-4048-b973-5936dc3112ab tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1236 microversion: 2.1 time: 0.491424 Sep 18 01:03:09.689609 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 419/843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:09 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1236 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:09.697373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:09.698239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:09.721711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.722168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.722616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.723453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.724046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.724534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.734257 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:09.748974 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] HTTP exception thrown: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Request method failure captured: Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a HTTP/1.1 Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2PRhtY0Ygu7wJtTOQIS0AhGo06m0CTWZRAu78n5xtaIu_yOGFcdUmk7A5mTQGqw1DSB79untCzzZB6TXhIu50CyaUUe3Khtu9sDmeDe_kWM5jOsm8m9cDtrpmhv59s0k5VCHK7stw8AeoMyneUyFjaCn3S_2iDQOJQ5E5Eb9dP1yk Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:03:09.751527 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bf7634e26214d1592e971399bc13360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bf7634e26214d1592e971399bc13360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fad1db1d4f7a41559b0cb1e57ba9c12d Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:09.752912 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '71a92b97-f5e4-47ec-8e50-d4539e2b908a'} Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:09.753879 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:09.755070 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:09.758568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Returning 404 to user: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:09.762363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-043dc4ec-adaf-4401-abcc-3bd8e04b2020 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 404 len: 111 microversion: 2.1 time: 0.074562 Sep 18 01:03:09.763985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 420/844] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:09 2022] DELETE /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:09.776706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-238086005", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6d48a9cd-b662-4a76-a839-5174b05a84ad"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:09.788190 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:09.806024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:09.808638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:09.812503 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e486e6ac-bc6a-45bd-99ad-f528350ef40f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1556 microversion: 2.25 time: 0.807776 Sep 18 01:03:09.813304 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 425/845] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:09 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1556 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:09.823397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:09.824370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:09.871196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.872028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.872712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.873711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.876727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.880168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.957033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:11.000351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:11.015669 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b7f72f8-94a8-4bb2-acd3-8c87c1da40ba tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1503 microversion: 2.1 time: 1.201149 Sep 18 01:03:11.016513 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 426/846] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:09 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1503 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:11.039335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1149995290", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:11.090693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:11.092069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:11.092885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:11.093370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:11.093942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:11.108453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.110399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.111061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:11.112950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.115131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.115810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:11.172153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] validate_networks() for [('ce7051d4-da13-4653-b912-b3eb0bcc70a0', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:11.183490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:11.197785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Getting quotas for user af59db2a206a4451bd1dd95c124c3723 and project 792b8e71f32e4c558f8753ee5de6cc0e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:11.228658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:11.231071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:11.327758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf4fd301-d221-4aee-b2b4-f80627636d5f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562398 Sep 18 01:03:11.329024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 421/847] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:11.333916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:11.341101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: 71a92b97-f5e4-47ec-8e50-d4539e2b908a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:11.358061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.358897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.359665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:11.360551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.361165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.361777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:11.401442 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] HTTP exception thrown: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Request method failure captured: Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a HTTP/1.1 Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2PRhtY0Ygu7wJtTOQIS0AhGo06m0CTWZRAu78n5xtaIu_yOGFcdUmk7A5mTQGqw1DSB79untCzzZB6TXhIu50CyaUUe3Khtu9sDmeDe_kWM5jOsm8m9cDtrpmhv59s0k5VCHK7stw8AeoMyneUyFjaCn3S_2iDQOJQ5E5Eb9dP1yk Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:03:11.404788 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bf7634e26214d1592e971399bc13360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bf7634e26214d1592e971399bc13360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fad1db1d4f7a41559b0cb1e57ba9c12d Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:11.406411 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '71a92b97-f5e4-47ec-8e50-d4539e2b908a'} Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:11.407148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. Sep 18 01:03:11.408338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:11.411569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Returning 404 to user: Instance 71a92b97-f5e4-47ec-8e50-d4539e2b908a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:11.412840 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aa08416f-1576-49a2-8fdd-7c650eb57de9 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a" status: 404 len: 111 microversion: 2.1 time: 0.082581 Sep 18 01:03:11.417213 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 422/848] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:11 2022] GET /compute/v2.1/servers/71a92b97-f5e4-47ec-8e50-d4539e2b908a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:11.786580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:11.787182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:11.799572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.801506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.802097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:11.803172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.803780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.806762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.371861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid b1b4f360-e61a-4fea-8b7d-05c20f3f0743 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:13.406669 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c597ca92-3af0-43fe-861e-e5be6e970a3e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 2048 microversion: 2.25 time: 1.983853 Sep 18 01:03:13.409656 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 423/849] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:11 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 2048 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:13.421021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:13.422999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 45ab2bf9-08d5-4191-9253-a7f0d52fe320] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:13.439106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.440334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.441359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.442448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.447196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.448040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.490196 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] HTTP exception thrown: Instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 could not be found. Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Request method failure captured: Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 HTTP/1.1 Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4DbZthDfYr6HqDTft2-_mier4bQvDRMfkhj56-5BSaa8i7QqmPazmbuidov44igR-HaY5YemvQo5F1hIJNdwMBjTdb-ulLaSjOBOv6USZSzGpt-leOD-hg5oBMuhhfcMjZUg3dVkS0JEkgNJlN7jWhCaQzme9IfnCzepPyinvidA4 Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 9e1212dcbcc24b82ba47a5e11c57881e Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1066576614 Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:03:13.492230 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1066576614 Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 9e1212dcbcc24b82ba47a5e11c57881e Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1066576614 Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAdminNegativeTestJSON-1066576614-project Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 88f666ed768b4bd89b59b7608b30a030 Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1066576614-project Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 could not be found. Sep 18 01:03:13.493669 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '45ab2bf9-08d5-4191-9253-a7f0d52fe320'} Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 could not be found. Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:13.494447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 could not be found. Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 could not be found. Sep 18 01:03:13.495653 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:13.496760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Returning 404 to user: Instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:13.496760 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7e1e2ad-e3da-48e0-a084-73b46c0f6a48 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320" status: 404 len: 111 microversion: 2.1 time: 0.082790 Sep 18 01:03:13.497893 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 424/850] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:13 2022] GET /compute/v2.1/servers/45ab2bf9-08d5-4191-9253-a7f0d52fe320 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:13.506824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-07e29627-0421-4e54-8ccf-c64a116ee2b5 req-5a3f2091-43db-45fa-8ecb-5675938d952e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ab2bf9-08d5-4191-9253-a7f0d52fe320", "name": "network-vif-deleted", "tag": "b5d0d741-ab03-4a78-8cd5-cae07f91175f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:13.519489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:13.520731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:13.521511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:13.522255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:13.523117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:13.541633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.542445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.543375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.546663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.547419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.548134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.550533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-07e29627-0421-4e54-8ccf-c64a116ee2b5 req-5a3f2091-43db-45fa-8ecb-5675938d952e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.551183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-07e29627-0421-4e54-8ccf-c64a116ee2b5 req-5a3f2091-43db-45fa-8ecb-5675938d952e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.551694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-07e29627-0421-4e54-8ccf-c64a116ee2b5 req-5a3f2091-43db-45fa-8ecb-5675938d952e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.580388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-07e29627-0421-4e54-8ccf-c64a116ee2b5 req-5a3f2091-43db-45fa-8ecb-5675938d952e service nova] Creating event network-vif-deleted:b5d0d741-ab03-4a78-8cd5-cae07f91175f for instance 45ab2bf9-08d5-4191-9253-a7f0d52fe320 on n-h2-master-1 Sep 18 01:03:13.593360 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-07e29627-0421-4e54-8ccf-c64a116ee2b5 req-5a3f2091-43db-45fa-8ecb-5675938d952e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092120 Sep 18 01:03:13.594522 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 425/851] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:13.611599 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for project c9ce34433498444b8058b1354aed0f78. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:13.612655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:13.614245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:13.626839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for user 62dbad162d74407a891f11c9e972ada0 and project c9ce34433498444b8058b1354aed0f78. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:13.636469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.639260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.640753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.643837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.645732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.646397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.666092 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:13.672087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:13.679707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:13.791413 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19057103-9fba-4b2a-8636-ca7244e3d623 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.757460 Sep 18 01:03:13.796090 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 427/852] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:13.807842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:13.821708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:13.857385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.857930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.858380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.859113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.884065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.888283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:14.311600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:14.324115 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7a8e1b6-6b42-4b52-87db-0d0a5996986e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1286 microversion: 2.1 time: 0.526657 Sep 18 01:03:14.325137 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 428/853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:13 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1286 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:14.333923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:14.339127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:14.370012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:14.373715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:14.374545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:14.376865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:14.381420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:14.382271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:14.418217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] HTTP exception thrown: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Request method failure captured: Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb HTTP/1.1 Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2PRhtY0Ygu7wJtTOQIS0AhGo06m0CTWZRAu78n5xtaIu_yOGFcdUmk7A5mTQGqw1DSB79untCzzZB6TXhIu50CyaUUe3Khtu9sDmeDe_kWM5jOsm8m9cDtrpmhv59s0k5VCHK7stw8AeoMyneUyFjaCn3S_2iDQOJQ5E5Eb9dP1yk Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:14.436993 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bf7634e26214d1592e971399bc13360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bf7634e26214d1592e971399bc13360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fad1db1d4f7a41559b0cb1e57ba9c12d Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: exception: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:14.438621 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb'} Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:14.439386 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:14.440556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:14.441788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Returning 404 to user: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:14.442065 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a93e540-cc0f-4ae3-a24d-f5321eb70ae5 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 404 len: 111 microversion: 2.1 time: 0.113020 Sep 18 01:03:14.444439 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 429/854] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:14 2022] DELETE /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:14.468626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:14.469254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:14.497835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:14.498339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:14.498771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:14.502145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:14.506907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:14.521673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.078379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:15.086643 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d15861d2-0d2d-435f-bb3f-8330a609f37a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1304 microversion: 2.1 time: 1.488426 Sep 18 01:03:15.089903 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 426/855] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:13 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1304 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:15.100739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:15.101352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:15.114586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.123718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.124521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.125473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.126115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.126911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.415046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:15.432709 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5629a195-7710-4f2b-be55-f2f1616b4bd7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1503 microversion: 2.1 time: 0.978386 Sep 18 01:03:15.450996 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 430/856] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:14 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1503 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:15.456557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:15.457282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:15.466819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.467570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.468211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.469103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.469842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.472716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.536537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:15.739483 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93961229-e3a1-4022-af04-08be419d7112 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "DELETE /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 204 len: 0 microversion: 2.1 time: 0.286577 Sep 18 01:03:15.740695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 431/857] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:15 2022] DELETE /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:15.748643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:15.750245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:15.769175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.770104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.770641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.771510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.772795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.775615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.897915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:15.909588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e7601ed-e34e-413a-b271-b688ff6c60f4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1277 microversion: 2.1 time: 0.167167 Sep 18 01:03:15.922353 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 432/858] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:15 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:15.942211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:15.943256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] [instance: aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:15.952177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.953153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.958194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.959111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.959701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.960255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.000460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid b1b4f360-e61a-4fea-8b7d-05c20f3f0743 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:16.002565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] HTTP exception thrown: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Request method failure captured: Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb HTTP/1.1 Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2PRhtY0Ygu7wJtTOQIS0AhGo06m0CTWZRAu78n5xtaIu_yOGFcdUmk7A5mTQGqw1DSB79untCzzZB6TXhIu50CyaUUe3Khtu9sDmeDe_kWM5jOsm8m9cDtrpmhv59s0k5VCHK7stw8AeoMyneUyFjaCn3S_2iDQOJQ5E5Eb9dP1yk Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:16.007984 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bf7634e26214d1592e971399bc13360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bf7634e26214d1592e971399bc13360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bf7634e26214d1592e971399bc13360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1bf7634e26214d1592e971399bc13360 Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959 Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fad1db1d4f7a41559b0cb1e57ba9c12d Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-253369959-project Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: exception: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:16.009407 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb'} Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:16.010164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. Sep 18 01:03:16.011331 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:16.015726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] Returning 404 to user: Instance aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:16.016833 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e83ee090-5b4d-4ed5-a49f-5098af209c01 tempest-ServersWithSpecificFlavorTestJSON-253369959 tempest-ServersWithSpecificFlavorTestJSON-253369959-project] 10.222.0.25 "GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb" status: 404 len: 111 microversion: 2.1 time: 0.093367 Sep 18 01:03:16.018006 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 433/859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:15 2022] GET /compute/v2.1/servers/aebaa2e0-05b4-4c5c-af19-c1a6f877ffcb => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:16.023354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:16.024327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:16.031175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.032020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.032682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.033694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.034408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.035396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.042455 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-87e0978a-3fb6-4caf-9d02-f6e5e0c05b8d tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 2048 microversion: 2.25 time: 0.951384 Sep 18 01:03:16.043053 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 427/860] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:15 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 2048 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:16.058581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:16.059510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:16.076279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.077030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.077468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.078204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.078656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.079206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.276682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:16.297962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0d86f4be-7a47-446b-81d9-d898bdba783e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1274 microversion: 2.1 time: 0.269937 Sep 18 01:03:16.299205 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 434/861] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:16 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:16.306183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0d68aa14-ca33-42f1-950d-03f2b0389a1e req-12a6d4a4-074d-4b1f-a5e9-17ad30a16ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d680a3c6-91ab-4755-b862-9cb85ba60fe5", "tag": "c56f633b-dd20-4dec-b564-db9918ef1a6a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:16.332328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0d68aa14-ca33-42f1-950d-03f2b0389a1e req-12a6d4a4-074d-4b1f-a5e9-17ad30a16ccc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.335438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0d68aa14-ca33-42f1-950d-03f2b0389a1e req-12a6d4a4-074d-4b1f-a5e9-17ad30a16ccc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.336146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0d68aa14-ca33-42f1-950d-03f2b0389a1e req-12a6d4a4-074d-4b1f-a5e9-17ad30a16ccc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.355419 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0d68aa14-ca33-42f1-950d-03f2b0389a1e req-12a6d4a4-074d-4b1f-a5e9-17ad30a16ccc service nova] Creating event network-changed:c56f633b-dd20-4dec-b564-db9918ef1a6a for instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 on n-h2-master-1 Sep 18 01:03:16.363981 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0d68aa14-ca33-42f1-950d-03f2b0389a1e req-12a6d4a4-074d-4b1f-a5e9-17ad30a16ccc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061136 Sep 18 01:03:16.365125 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 435/862] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:16.398483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:16.406965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.408250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.409147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.410783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.413369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.413964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.460304 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-392820d6-232f-4b7f-b4db-f2371acc28f5 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.092847 Sep 18 01:03:16.470245 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 436/863] 10.222.0.25 () {60 vars in 1217 bytes} [Sun Sep 18 01:03:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:03:16.481301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:16.487445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:16.497188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.498179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.498877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:16.499853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:16.501041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:16.501737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:17.084603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:17.094431 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-791d6da4-9c37-4639-a0a5-b53e4d32f003 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1477 microversion: 2.1 time: 1.048031 Sep 18 01:03:17.105911 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 428/864] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:16 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1477 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:17.111456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:17.112361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:17.124453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:17.124947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:17.125574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:17.127146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:17.130360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:17.131379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:17.137768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:17.148106 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-326fa062-27cc-45f9-97e7-32c3ba69d28d tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1304 microversion: 2.1 time: 0.674692 Sep 18 01:03:17.166091 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 437/865] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:16 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1304 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:17.179438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:17.194948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:17.205271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:17.206126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:17.206639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:17.207536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:17.208124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:17.208663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:17.251925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'flavor' on Instance uuid b1b4f360-e61a-4fea-8b7d-05c20f3f0743 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:17.275318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Going to try to live migrate instance to n-h2-master-1 {{(pid=122374) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:03:18.623556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:18.654030 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e5e19d0f-29e5-42fc-b082-89aae138e513 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1478 microversion: 2.1 time: 1.529491 Sep 18 01:03:18.669052 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 429/866] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:17 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1478 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:18.685660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:18.689043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:18.707522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:18.708394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:18.709425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:18.710396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:18.711014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:18.712338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.010394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:19.024094 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c32101dd-c3bd-4042-a4b3-31e6b1f77bba tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1283 microversion: 2.1 time: 0.345992 Sep 18 01:03:19.042526 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 430/867] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:18 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1283 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:19.050449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:19.051304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:19.059848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.060516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.061121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.062085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.062836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.063414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.649465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:19.663825 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67cb078f-1b39-49f6-a841-08d926b9bf70 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.619725 Sep 18 01:03:19.667188 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 431/868] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:19 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:19.676089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:19.678062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:19.691324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.692419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.694303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.696619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.698054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.698934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.761444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.763380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.764275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.765386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lazy-loading 'fault' on Instance uuid 866710a8-e463-4bd4-93f1-478b92c88029 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:19.959385 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f666ed768b4bd89b59b7608b30a030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1212dcbcc24b82ba47a5e11c57881e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:19.968905 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff7e92a4-6325-4ecd-8210-39b21e20afc7 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 200 len: 1311 microversion: 2.1 time: 0.299561 Sep 18 01:03:19.982436 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 432/869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:19 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 1311 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:19.991328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:19.991965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:19.998204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.998898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.999489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:20.000186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:20.000631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:20.001253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:20.916013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:20.925851 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9396efab-1c21-4141-8477-1b2a3bcc5cb3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 0.941777 Sep 18 01:03:20.927189 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 433/870] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:19 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1292 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:21.064646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f373df70-d23d-4359-b917-4ee3741a0cc6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Action: 'create', calling method: .version_select at 0x7f70065b01f0>, body: {"keypair": {"name": "tempest-keypair-1144870756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlrW2cGoO1Cbif7JNHo353etev+2pS+Wwy8eqCfBfEBpt6HPIor89TyN+m0RJRRxDIfJX3RSNEvLJ2wTsFLU2+mby6aoC/nUQcmcUaJFmJpgAPW27Df11uMQ21IotzObQ=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:21.108763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f373df70-d23d-4359-b917-4ee3741a0cc6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Getting quotas for project 71ee3046b1b54c14aad90abf94e90e0a. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:21.117054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f373df70-d23d-4359-b917-4ee3741a0cc6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Getting quotas for user 5db81d9aa4714dcf871b98e26584d325 and project 71ee3046b1b54c14aad90abf94e90e0a. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:21.141395 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:21.154155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f373df70-d23d-4359-b917-4ee3741a0cc6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225382 Sep 18 01:03:21.155156 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 434/871] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:03:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:21.181448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a2d6c081-f4d5-4e3e-9a4e-8f876174c84b req-131bc178-669b-4fbc-9c69-d89bb81b4515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866710a8-e463-4bd4-93f1-478b92c88029", "name": "network-vif-deleted", "tag": "4061eeef-6e2b-4ccc-a170-46f285f558b7"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:21.255731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a2d6c081-f4d5-4e3e-9a4e-8f876174c84b req-131bc178-669b-4fbc-9c69-d89bb81b4515 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.262078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a2d6c081-f4d5-4e3e-9a4e-8f876174c84b req-131bc178-669b-4fbc-9c69-d89bb81b4515 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.263586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a2d6c081-f4d5-4e3e-9a4e-8f876174c84b req-131bc178-669b-4fbc-9c69-d89bb81b4515 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.325542 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96077139-a823-4035-9dbc-e219dec3486e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743/action" status: 202 len: 0 microversion: 2.25 time: 4.153745 Sep 18 01:03:21.328027 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 438/872] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:03:17 2022] POST /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743/action => generated 0 bytes in 4161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:21.365806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9738fdd2-7a03-4969-b3a5-f6cf8c46e01a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '.version_select at 0x7f7006d343a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:21.403537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9738fdd2-7a03-4969-b3a5-f6cf8c46e01a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.419339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9738fdd2-7a03-4969-b3a5-f6cf8c46e01a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.420702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9738fdd2-7a03-4969-b3a5-f6cf8c46e01a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.434837 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a2d6c081-f4d5-4e3e-9a4e-8f876174c84b req-131bc178-669b-4fbc-9c69-d89bb81b4515 service nova] Creating event network-vif-deleted:4061eeef-6e2b-4ccc-a170-46f285f558b7 for instance 866710a8-e463-4bd4-93f1-478b92c88029 on n-h1-master-1 Sep 18 01:03:21.446966 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:21.488008 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a2d6c081-f4d5-4e3e-9a4e-8f876174c84b req-131bc178-669b-4fbc-9c69-d89bb81b4515 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329097 Sep 18 01:03:21.500326 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 435/873] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:21.548595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:21.563994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:21.590777 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9738fdd2-7a03-4969-b3a5-f6cf8c46e01a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.260538 Sep 18 01:03:21.606010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.607709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.609598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.611218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.612989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.614164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.622780 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 439/874] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:03:21 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:21.633580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:21.634739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:21.643378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.644140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.644745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.645714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.646356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.646948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.841323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:21.850593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52ad23b2-12ee-4c4e-bc88-e8c4c151f266 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1283 microversion: 2.1 time: 0.347943 Sep 18 01:03:21.851177 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 436/875] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:21 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1283 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:21.860113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:21.867222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] [instance: 866710a8-e463-4bd4-93f1-478b92c88029] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:21.882608 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:21.887318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.887815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.888259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.888962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.889423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.898282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.941386 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] HTTP exception thrown: Instance 866710a8-e463-4bd4-93f1-478b92c88029 could not be found. Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Request method failure captured: Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 HTTP/1.1 Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4DbZthDfYr6HqDTft2-_mier4bQvDRMfkhj56-5BSaa8i7QqmPazmbuidov44igR-HaY5YemvQo5F1hIJNdwMBjTdb-ulLaSjOBOv6USZSzGpt-leOD-hg5oBMuhhfcMjZUg3dVkS0JEkgNJlN7jWhCaQzme9IfnCzepPyinvidA4 Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 9e1212dcbcc24b82ba47a5e11c57881e Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1066576614 Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:03:21.947676 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e1212dcbcc24b82ba47a5e11c57881e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1066576614 Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 9e1212dcbcc24b82ba47a5e11c57881e Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1066576614 Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAdminNegativeTestJSON-1066576614-project Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 88f666ed768b4bd89b59b7608b30a030 Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1066576614-project Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 866710a8-e463-4bd4-93f1-478b92c88029 could not be found. Sep 18 01:03:21.949354 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '866710a8-e463-4bd4-93f1-478b92c88029'} Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866710a8-e463-4bd4-93f1-478b92c88029 could not be found. Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:21.950258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866710a8-e463-4bd4-93f1-478b92c88029 could not be found. Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866710a8-e463-4bd4-93f1-478b92c88029 could not be found. Sep 18 01:03:21.952766 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:21.959593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] Returning 404 to user: Instance 866710a8-e463-4bd4-93f1-478b92c88029 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:21.963041 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67c1d942-fe4d-4254-80ab-c9c203a41f04 tempest-ServersAdminNegativeTestJSON-1066576614 tempest-ServersAdminNegativeTestJSON-1066576614-project] 10.222.0.25 "GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029" status: 404 len: 111 microversion: 2.1 time: 0.105120 Sep 18 01:03:21.964405 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 437/876] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:21 2022] GET /compute/v2.1/servers/866710a8-e463-4bd4-93f1-478b92c88029 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:21.992544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:21.993341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:22.017316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.017831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.018221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.018998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.019494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.019925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.538052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:22.553470 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba9a9cd5-98ce-4bc1-8521-1c93a87d2634 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.929225 Sep 18 01:03:22.566313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 440/877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:21 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:22.578204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:22.578823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:22.599207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.600022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.600621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.601523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.602225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.602822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.835488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:22.845714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:22.847908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:22.849396 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d955fa0-bb39-44cd-bacc-7ce32d8af97f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 0.881305 Sep 18 01:03:22.851543 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 438/878] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:21 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:22.858157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:22.859065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:22.866454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.867775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.868398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.869360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.870008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.870571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.919184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e03e7018-7c5c-4c69-ab54-f568dca62cb8 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1629 microversion: 2.1 time: 0.349363 Sep 18 01:03:22.920163 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 441/879] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:22 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1629 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:22.950379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:22.951340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:22.958611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.959363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.959974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.960903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.962122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.962915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:23.656152 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:23.942172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:23.982594 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d68adb13-71c1-4b6c-a9c8-76030a8ca721 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 1.119021 Sep 18 01:03:23.984035 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 439/880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:22 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1292 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:23.999884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0a72873d-947b-4762-819f-6c4fdca7cb44 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Action: 'create', calling method: .version_select at 0x7f70065b0670>, body: {"keypair": {"name": "tempest-keypair-1441990173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgH+sIFZDenJzyxzEHKt5XtyCSPGc7P7wO0lQomZ9mVYRt4bvU9IE3CMbYRwa0/L3rT24ctJxfVvc9XuEfsEHS0itwFt/ncTZBd3ogzm8MhS+OVMbPFkJsCwJERUepavg=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:24.064455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0a72873d-947b-4762-819f-6c4fdca7cb44 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for project 27153d8891d146b88d7ba3b5076ad538. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:24.080377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0a72873d-947b-4762-819f-6c4fdca7cb44 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for user cf8f60e6d52b498c90dd1ace5418ae13 and project 27153d8891d146b88d7ba3b5076ad538. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:24.128065 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0a72873d-947b-4762-819f-6c4fdca7cb44 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142369 Sep 18 01:03:24.130887 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 440/881] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:03:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:24.137439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ba2fcff9-33ae-4ade-aed1-a4a460363882 req-21b918f0-c8a0-431b-b01e-916db995acda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b6443b-01f5-4af7-9b74-cccd0fd2936b", "tag": "e9d8f6fb-12e8-4620-a387-875ee2828384"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:24.154398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ba2fcff9-33ae-4ade-aed1-a4a460363882 req-21b918f0-c8a0-431b-b01e-916db995acda service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:24.155225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ba2fcff9-33ae-4ade-aed1-a4a460363882 req-21b918f0-c8a0-431b-b01e-916db995acda service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:24.155943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ba2fcff9-33ae-4ade-aed1-a4a460363882 req-21b918f0-c8a0-431b-b01e-916db995acda service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:24.171668 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ba2fcff9-33ae-4ade-aed1-a4a460363882 req-21b918f0-c8a0-431b-b01e-916db995acda service nova] Creating event network-changed:e9d8f6fb-12e8-4620-a387-875ee2828384 for instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b on n-h2-master-1 Sep 18 01:03:24.178872 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ba2fcff9-33ae-4ade-aed1-a4a460363882 req-21b918f0-c8a0-431b-b01e-916db995acda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046293 Sep 18 01:03:24.180907 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 441/882] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:24.188184 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:24.189418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:24.202662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:24.203440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:24.204073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:24.204972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:24.205672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:24.206270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:24.301958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:24.328511 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1cfbffe6-2d18-43c4-80bb-67331524b3df tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1325 microversion: 2.1 time: 1.391913 Sep 18 01:03:24.330102 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 442/883] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:22 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1325 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:24.339938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:24.341360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:24.357581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:24.358995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:24.360128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:24.362266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:24.363431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:24.364484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:24.804648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:24.814546 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aef8839c-dcea-4a63-829c-50207aa83579 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.632022 Sep 18 01:03:24.815365 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 442/884] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:24 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:24.821240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-861050872", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "1349a5bb-29ab-48ae-878d-8a8d6be8c958"}], "security_groups": [{"name": "tempest-securitygroup--1069454687"}], "key_name": "tempest-keypair-1144870756", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:25.171597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:25.194321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] validate_networks() for [('1349a5bb-29ab-48ae-878d-8a8d6be8c958', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:25.195076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:25.197712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:25.200884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-30b09d2b-3a79-4c95-a71c-765946394663 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 0.868824 Sep 18 01:03:25.214319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 443/885] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:24 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:25.214319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e9d6be6f-f3db-41e8-9fec-222a2e6b788c req-cfdd106f-f194-46bb-a27a-c64f3edc805f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b4f360-e61a-4fea-8b7d-05c20f3f0743", "name": "network-vif-unplugged", "status": "completed", "tag": "da3bd35c-65ba-4bd4-a22d-f10bb6509b6d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:25.240041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9d6be6f-f3db-41e8-9fec-222a2e6b788c req-cfdd106f-f194-46bb-a27a-c64f3edc805f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:25.240530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9d6be6f-f3db-41e8-9fec-222a2e6b788c req-cfdd106f-f194-46bb-a27a-c64f3edc805f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:25.240969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9d6be6f-f3db-41e8-9fec-222a2e6b788c req-cfdd106f-f194-46bb-a27a-c64f3edc805f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:25.265071 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e9d6be6f-f3db-41e8-9fec-222a2e6b788c req-cfdd106f-f194-46bb-a27a-c64f3edc805f service nova] Creating event network-vif-unplugged:da3bd35c-65ba-4bd4-a22d-f10bb6509b6d for instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 on n-h1-master-1 Sep 18 01:03:25.273178 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e9d6be6f-f3db-41e8-9fec-222a2e6b788c req-cfdd106f-f194-46bb-a27a-c64f3edc805f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063384 Sep 18 01:03:25.274459 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 444/886] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:25.282773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:25.283799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:25.291444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:25.292360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:25.293093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:25.294055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:25.294895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:25.295491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:26.013095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:26.032315 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be78ac96-e451-4a58-baa2-5f3220177c53 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 0.755356 Sep 18 01:03:26.034313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 445/887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:25 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1292 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:26.043433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:26.044546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:26.052659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:26.053463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:26.054095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:26.055024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:26.055637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:26.061945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:26.439537 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:27.018085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:27.032306 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7700751-f798-4977-ad23-a02f3b8f70d1 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1325 microversion: 2.1 time: 0.994364 Sep 18 01:03:27.053641 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 446/888] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:26 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1325 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:27.060458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:27.061401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:27.069774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.071223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.071896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.072864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.073704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.074345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.294232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:27.294905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:27.298390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:27.298915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:27.299337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:27.322884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.323606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.324237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.325160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.326142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.327149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.351701 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:27.373882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Getting quotas for project 71ee3046b1b54c14aad90abf94e90e0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:27.381010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Getting quotas for user 5db81d9aa4714dcf871b98e26584d325 and project 71ee3046b1b54c14aad90abf94e90e0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:27.411390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:27.440184 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:27.578126 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-da6a3519-c5ad-47f3-801a-11ee115a77b6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.761125 Sep 18 01:03:27.585376 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 443/889] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:27.606123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:27.609392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:27.631635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.633391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.634362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.635446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.636143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.636743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.697650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:27.712458 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-57d05b37-fa9b-4fa6-b4a2-94d16c982ba4 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.657153 Sep 18 01:03:27.713056 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 447/890] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:27 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:27.734166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a8273a1f-fe32-4ed8-9f12-34de8c0e0f06 req-fe7720cc-4a8c-4a13-a90d-3056ee664083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a681c23f-ec48-43cb-be35-f479496bda0f", "tag": "79af51af-eeba-4495-957f-0baadfa436a0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:27.761843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8273a1f-fe32-4ed8-9f12-34de8c0e0f06 req-fe7720cc-4a8c-4a13-a90d-3056ee664083 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.763938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8273a1f-fe32-4ed8-9f12-34de8c0e0f06 req-fe7720cc-4a8c-4a13-a90d-3056ee664083 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.765837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8273a1f-fe32-4ed8-9f12-34de8c0e0f06 req-fe7720cc-4a8c-4a13-a90d-3056ee664083 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.808658 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a8273a1f-fe32-4ed8-9f12-34de8c0e0f06 req-fe7720cc-4a8c-4a13-a90d-3056ee664083 service nova] Creating event network-changed:79af51af-eeba-4495-957f-0baadfa436a0 for instance a681c23f-ec48-43cb-be35-f479496bda0f on n-h1-master-1 Sep 18 01:03:27.815324 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a8273a1f-fe32-4ed8-9f12-34de8c0e0f06 req-fe7720cc-4a8c-4a13-a90d-3056ee664083 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097155 Sep 18 01:03:27.816041 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 448/891] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:27.827329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:27.828045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:27.860165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.862089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.866691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:27.868739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:27.871300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:27.873220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:28.617482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:28.638512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:28.644059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:28.649417 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b750d4f1-4e0c-4d7b-b037-15f53b96a1b3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 1.063580 Sep 18 01:03:28.666583 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 444/892] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:27 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:28.687827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:28.705657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-efa32bc9-74bc-4fdc-9d38-f81e75b3d773 req-3c03a675-74a7-4dd5-ba93-f0b6754acf7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b4f360-e61a-4fea-8b7d-05c20f3f0743", "tag": "da3bd35c-65ba-4bd4-a22d-f10bb6509b6d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:28.712931 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88acc4fc-2c52-46a3-9ede-6cd099b14bcd tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 0.890070 Sep 18 01:03:28.713650 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 449/893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:27 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1292 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:28.725401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:28.726045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:28.736854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-efa32bc9-74bc-4fdc-9d38-f81e75b3d773 req-3c03a675-74a7-4dd5-ba93-f0b6754acf7b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:28.748421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-efa32bc9-74bc-4fdc-9d38-f81e75b3d773 req-3c03a675-74a7-4dd5-ba93-f0b6754acf7b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:28.751899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-efa32bc9-74bc-4fdc-9d38-f81e75b3d773 req-3c03a675-74a7-4dd5-ba93-f0b6754acf7b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:28.760547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:28.761046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:28.761487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:28.762503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:28.762980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:28.763642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:28.783401 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-efa32bc9-74bc-4fdc-9d38-f81e75b3d773 req-3c03a675-74a7-4dd5-ba93-f0b6754acf7b service nova] Creating event network-changed:da3bd35c-65ba-4bd4-a22d-f10bb6509b6d for instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 on n-h1-master-1 Sep 18 01:03:28.790237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-efa32bc9-74bc-4fdc-9d38-f81e75b3d773 req-3c03a675-74a7-4dd5-ba93-f0b6754acf7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121798 Sep 18 01:03:28.791008 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 445/894] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:28.806855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:28.808237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:28.815992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:28.816567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:28.817270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:28.818112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:28.818631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:28.819124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:28.918860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:28.933717 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0789cdd1-1e22-4ac9-9585-2b99d239c28a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1237 microversion: 2.1 time: 0.218717 Sep 18 01:03:28.935172 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 450/895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:28 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1237 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:29.107751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-925688347", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:29.172034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:29.269474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:29.282485 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96a6547d-ddf4-4fb2-8659-48ac9d991703 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1325 microversion: 2.1 time: 0.489983 Sep 18 01:03:29.283850 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 446/896] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:28 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1325 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:29.289071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:29.290919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:29.299001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:29.299758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:29.300540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:29.301811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:29.302484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:29.303136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:29.788473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:29.797185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:29.797986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:29.798121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:29.798709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:29.799193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:29.802050 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ff527d4-2e94-4788-bafb-f4bdc5675fa0 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.516591 Sep 18 01:03:29.814496 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 447/897] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:29 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:29.814496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:29.814496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:29.816106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:29.816607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:29.816952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:29.817105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:29.818290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:29.819016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:29.820078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:29.820259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:29.820786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:29.821392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:29.821701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:29.822347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:29.871780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Getting quotas for project ccc21635096f4fadb606d7bf5ab6f197. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:29.884970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Getting quotas for user dba1a4cbf6c04c2e803f47b0536c33a4 and project ccc21635096f4fadb606d7bf5ab6f197. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:29.915064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:29.917924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:29.994189 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a49676e5-ce24-4652-9f0a-6d49c32ac399 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056165 Sep 18 01:03:29.995033 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 451/898] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:30.014749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:30.015495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:30.032666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:30.036793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:30.037495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:30.050541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:30.050899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:30.051523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:30.233000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:30.256017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:30.257731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:30.258940 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-855cc6a4-23e8-4ba9-ad2b-db3ba380698c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 0.454823 Sep 18 01:03:30.278859 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 448/899] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:29 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:30.282954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-129807357", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "cdfd9210-2a2b-4d14-ac9e-64814397e610"}], "security_groups": [{"name": "tempest-securitygroup--1024110698"}], "key_name": "tempest-keypair-1441990173", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:30.517313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:30.540979 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f240df7-eb19-467f-9e33-c6723e4a1e56 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 0.530016 Sep 18 01:03:30.543203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 452/900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:29 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1292 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:30.568423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:30.581918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] validate_networks() for [('cdfd9210-2a2b-4d14-ac9e-64814397e610', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:30.582542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:30.601202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:30.607189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:30.608608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:30.611899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:30.614470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:30.618382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:30.798235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:30.821271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15286e76-86c1-4440-98ef-510c9cfdb8e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1293 microversion: 2.1 time: 0.261150 Sep 18 01:03:30.823162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 453/901] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:30 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:30.831836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:30.832685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:30.874959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:30.884498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:30.888278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:30.891428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:30.891428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:30.891428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:31.167585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:31.215361 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70ada654-f4d8-4574-8ec6-b787839a3bc3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1217 microversion: 2.1 time: 0.375492 Sep 18 01:03:31.216699 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 454/902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:30 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1217 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:31.227501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:31.228721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:31.261444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:31.262755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:31.263585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:31.265158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:31.266225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:31.266967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:32.324210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:32.345741 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bc163081-7fe1-4c7f-8a91-e54ea85f61ab tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1325 microversion: 2.1 time: 1.125227 Sep 18 01:03:32.363621 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 455/903] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:31 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1325 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:32.368924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:32.373047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:32.375019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:32.377043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:32.379398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:32.380179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:32.380877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:32.391595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:32.394905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:32.395772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:32.406647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:32.407554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:32.408255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:32.415530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:32.416588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:32.417685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:32.419889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:32.423917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:32.425279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:32.461441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:32.468414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for user cf8f60e6d52b498c90dd1ace5418ae13 and project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:32.494043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:32.497219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:32.590200 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-236427ed-8a37-4e60-957c-c60bdef8c8fe tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.309124 Sep 18 01:03:32.592771 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 449/904] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:32.621531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-294c056d-a212-46ec-895c-10850bd95b3e req-41dc2463-1ba2-4826-9ff6-218218c3a0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d680a3c6-91ab-4755-b862-9cb85ba60fe5", "name": "network-vif-plugged", "status": "completed", "tag": "c56f633b-dd20-4dec-b564-db9918ef1a6a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:32.673604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-294c056d-a212-46ec-895c-10850bd95b3e req-41dc2463-1ba2-4826-9ff6-218218c3a0fd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:32.675080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-294c056d-a212-46ec-895c-10850bd95b3e req-41dc2463-1ba2-4826-9ff6-218218c3a0fd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:32.676635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-294c056d-a212-46ec-895c-10850bd95b3e req-41dc2463-1ba2-4826-9ff6-218218c3a0fd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:32.704561 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-294c056d-a212-46ec-895c-10850bd95b3e req-41dc2463-1ba2-4826-9ff6-218218c3a0fd service nova] Creating event network-vif-plugged:c56f633b-dd20-4dec-b564-db9918ef1a6a for instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 on n-h2-master-1 Sep 18 01:03:32.713121 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-294c056d-a212-46ec-895c-10850bd95b3e req-41dc2463-1ba2-4826-9ff6-218218c3a0fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115988 Sep 18 01:03:32.715177 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 450/905] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:32.724211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:32.726204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:32.738669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:32.739539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:32.740248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:32.741849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:32.743793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:32.745055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:33.298771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:33.316824 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-036cf4e3-d2e2-4fff-ac3a-ecdac018fc6c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.951590 Sep 18 01:03:33.331027 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 456/906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:32 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:33.355321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:33.357092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:33.372710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:33.374748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:33.375697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:33.377799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:33.379373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:33.380741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:33.707743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:33.733145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:33.746898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:33.748790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-06851ab4-b2aa-4b7d-bc46-2b1915b0a922 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 1.031532 Sep 18 01:03:33.752495 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 451/907] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:32 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:33.774875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:33.776433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:33.800433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:33.803454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:33.803454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:33.810203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:33.811949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:33.813266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:33.938397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:33.965976 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6781377b-ce6c-4019-a879-71885bde887a tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 0.618145 Sep 18 01:03:33.984236 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 457/908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:33 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1292 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:33.994557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:33.995658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:34.003327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.004311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.006845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.008852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.009908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.010684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.012421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:34.031746 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e00bef4f-154c-4d24-855a-e084b119bfe4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1299 microversion: 2.1 time: 0.275175 Sep 18 01:03:34.031967 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 452/909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:33 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:34.034912 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:34.051467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:34.052118 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:34.068061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.068674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.069164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.077964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.078597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.079273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.154481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:34.170767 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6eb9b5dd-91fb-43cb-9332-769cd8d1eeeb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1271 microversion: 2.1 time: 0.184567 Sep 18 01:03:34.172627 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 458/910] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:33 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:34.177305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:34.186798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:34.188360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:34.197704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4dc99162-5198-4e09-8a5a-8b9834923f4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1238 microversion: 2.1 time: 0.157209 Sep 18 01:03:34.198386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 453/911] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:34 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1238 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:34.199905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.201232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.202569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.211774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.213369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.214792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.366077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:34.370380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:34.393273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.394414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.397899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.400673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.405071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.405532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.734185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:34.748272 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83a38e65-a5dd-451a-918c-dc1133eb9bf9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1325 microversion: 2.1 time: 0.572923 Sep 18 01:03:34.752222 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 459/912] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:34 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1325 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:34.762649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:34.771875 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8ff3949-b927-40ef-b66c-1b60e6617608 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.413645 Sep 18 01:03:34.775708 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 454/913] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:34 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:34.798448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:34.799351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:34.810034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.810928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.811607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.812526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:34.813212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:34.814417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:34.998759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:34.999762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:35.012247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:35.013103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:35.014223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:35.015209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:35.016642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:35.017208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:35.395466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:35.407624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:35.409664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:35.411175 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70b65202-953e-4ba7-9e58-98728e7971bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 0.618269 Sep 18 01:03:35.412013 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 460/914] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:34 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:35.417805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:35.418767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:35.427161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:35.428548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:35.429457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:35.430542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:35.431513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:35.432172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:35.702095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:35.730745 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96f9671e-22b8-4ab2-9bdf-ae0f858e04c0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 0.735897 Sep 18 01:03:35.733987 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 455/915] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:34 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1292 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:35.757136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:35.759957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:35.776151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:35.778590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:35.779634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:35.782657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:35.783710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:35.784697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:36.419675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:36.436861 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60eefdb2-1b9c-4a01-b36a-f920350929d5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 1.022935 Sep 18 01:03:36.450048 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 461/916] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:35 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:36.478917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:36.480002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:36.495874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:36.497177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:36.498360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:36.500307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:36.501452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:36.502580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:36.610995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:36.633470 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d62aad3-faa3-4ec6-8551-bd325a381da3 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1313 microversion: 2.1 time: 0.897199 Sep 18 01:03:36.641663 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 456/917] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:35 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:36.679878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:36.681291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:36.694721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:36.696326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:36.697433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:36.697924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:36.699423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:36.700653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:36.702062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:36.731553 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6527a3c9-630a-4eb4-8f4a-2aad50c1f38c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1286 microversion: 2.1 time: 0.274953 Sep 18 01:03:36.748086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 462/918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:36 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1286 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:36.782102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:36.784386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:36.797882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:36.799390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:36.801577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:36.803150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:36.805219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:36.806829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.124512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:38.144466 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2788f839-f2e4-4e42-a86a-8622a5dd0847 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1325 microversion: 2.1 time: 1.488899 Sep 18 01:03:38.161968 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 457/919] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:36 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1325 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:38.174577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:38.177774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:38.182000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:38.185701 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd317f5c-5106-4cff-af59-799eebb87b61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 1.434330 Sep 18 01:03:38.186625 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 463/920] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:36 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:38.192951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:38.193611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:38.201601 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:38.204381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.204884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.205402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.206183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.206649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.207079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.216398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.216943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.217380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.222265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.222776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.223310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.746285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:38.774726 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f909435-d2af-478f-a721-37d39d4cd302 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1483 microversion: 2.1 time: 0.586314 Sep 18 01:03:38.779612 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 464/921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:38 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1483 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:38.800496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5efec5bd-ee0a-46b5-8867-358f173d917f req-a563b1c9-31b9-426c-8e12-518f56154655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a681c23f-ec48-43cb-be35-f479496bda0f", "name": "network-vif-plugged", "status": "completed", "tag": "79af51af-eeba-4495-957f-0baadfa436a0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:38.822344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5efec5bd-ee0a-46b5-8867-358f173d917f req-a563b1c9-31b9-426c-8e12-518f56154655 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.823075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5efec5bd-ee0a-46b5-8867-358f173d917f req-a563b1c9-31b9-426c-8e12-518f56154655 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.824068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5efec5bd-ee0a-46b5-8867-358f173d917f req-a563b1c9-31b9-426c-8e12-518f56154655 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.839663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5efec5bd-ee0a-46b5-8867-358f173d917f req-a563b1c9-31b9-426c-8e12-518f56154655 service nova] Creating event network-vif-plugged:79af51af-eeba-4495-957f-0baadfa436a0 for instance a681c23f-ec48-43cb-be35-f479496bda0f on n-h1-master-1 Sep 18 01:03:38.845168 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5efec5bd-ee0a-46b5-8867-358f173d917f req-a563b1c9-31b9-426c-8e12-518f56154655 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062719 Sep 18 01:03:38.846259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 465/922] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:38.854379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:38.855680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:38.865726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.866078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.867316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.868295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.869389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.870204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.908422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:38.933311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:38.935320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:38.936737 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-44a17805-0ea0-4b61-8586-3c2f7209e55f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 0.773698 Sep 18 01:03:38.939173 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 458/923] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:38 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:38.952137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:38.960349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:38.967186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.968120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.969075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:38.970580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:38.971780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:38.972507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.394956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:39.404738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e1020e8-1005-44ec-bd82-ec01f6016dae tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.556996 Sep 18 01:03:39.406155 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 466/924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:38 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:39.411224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:39.412304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:39.419450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.420479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.421142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.422127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.422836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.423567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.471695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:39.504058 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ac6ef68-4818-4d39-916d-7f568c89d9b0 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1313 microversion: 2.1 time: 0.561352 Sep 18 01:03:39.508186 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 459/925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:38 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:39.518338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-96b56aca-b8b7-44ad-8510-3d4f4fe94c3f req-5b139547-7f69-4ca8-abec-7703399dca4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee7c69b-d3a1-479c-b99d-334a7e399821", "tag": "65102f0d-0a2d-4958-a139-bcfcdd36b250"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:39.540758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-96b56aca-b8b7-44ad-8510-3d4f4fe94c3f req-5b139547-7f69-4ca8-abec-7703399dca4a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.542225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-96b56aca-b8b7-44ad-8510-3d4f4fe94c3f req-5b139547-7f69-4ca8-abec-7703399dca4a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.542668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-96b56aca-b8b7-44ad-8510-3d4f4fe94c3f req-5b139547-7f69-4ca8-abec-7703399dca4a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.556294 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-96b56aca-b8b7-44ad-8510-3d4f4fe94c3f req-5b139547-7f69-4ca8-abec-7703399dca4a service nova] Creating event network-changed:65102f0d-0a2d-4958-a139-bcfcdd36b250 for instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 on n-h1-master-1 Sep 18 01:03:39.561494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:39.562591 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-96b56aca-b8b7-44ad-8510-3d4f4fe94c3f req-5b139547-7f69-4ca8-abec-7703399dca4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052019 Sep 18 01:03:39.563576 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 460/926] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:39.573809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:39.574534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:39.582778 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6902ed84-babd-47d6-9f9d-ef4858f881fd tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1292 microversion: 2.1 time: 0.173801 Sep 18 01:03:39.585280 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 467/927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:39 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1292 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:39.586676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.587340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.588035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.589132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.589621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.590412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.599417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:39.600750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:39.616703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.619335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.620909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.622218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.623166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.624237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.747940 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7ef198d9-4c44-436e-b645-fde0432f21bb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183273 Sep 18 01:03:39.753229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 461/928] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:03:39 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:39.762482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:39.770298 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:39.786119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.786693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.787207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.788643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.789366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.790002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.844744 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:39.908349 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:40.077089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:40.087072 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc787366-1a6a-4068-b515-66e26d0160b3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1325 microversion: 2.1 time: 0.497897 Sep 18 01:03:40.087722 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 468/929] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:39 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:40.093629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-841677e1-9111-4267-941a-9a75757f1f47 req-812d0c50-ca63-4c36-849e-9f9bb474a958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78083c60-a6b6-4e5a-9be6-3bca0baaa576", "tag": "a501be6c-7161-4f35-8a40-adf934fd7f00"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:40.116006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-841677e1-9111-4267-941a-9a75757f1f47 req-812d0c50-ca63-4c36-849e-9f9bb474a958 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:40.116612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-841677e1-9111-4267-941a-9a75757f1f47 req-812d0c50-ca63-4c36-849e-9f9bb474a958 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:40.117118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-841677e1-9111-4267-941a-9a75757f1f47 req-812d0c50-ca63-4c36-849e-9f9bb474a958 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:40.133263 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-841677e1-9111-4267-941a-9a75757f1f47 req-812d0c50-ca63-4c36-849e-9f9bb474a958 service nova] Creating event network-changed:a501be6c-7161-4f35-8a40-adf934fd7f00 for instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 on n-h1-master-1 Sep 18 01:03:40.138488 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-841677e1-9111-4267-941a-9a75757f1f47 req-812d0c50-ca63-4c36-849e-9f9bb474a958 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049344 Sep 18 01:03:40.139567 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 469/930] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:40.146261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:40.151167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:40.155384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:40.155998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:40.156509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:40.157283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:40.157842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:40.158456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:40.245486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:40.254514 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-95f3f1bc-800d-4010-b94d-e55cd34f64d7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.499837 Sep 18 01:03:40.255495 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 462/931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:39 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:40.444771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:40.446822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:40.454934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:40.459791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:40.475452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:40.479519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:40.480758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:40.481206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:40.508995 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:40.548838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:40.568620 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:40.575054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:40.578401 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd77f34b-846e-43ac-93eb-2f6f410b17f8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 0.437145 Sep 18 01:03:40.581447 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 470/932] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:40 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:40.605619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:40.607787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:40.617507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:40.618839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:40.619888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:40.621564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:40.622657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:40.623652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.358380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:41.371283 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-487b74bf-c33a-4ad0-bf91-e7efaf1e2623 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.933109 Sep 18 01:03:41.383077 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 463/933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:40 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:41.396565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:41.397181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:41.406061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.406550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.407215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.408521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.410111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.411032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.666851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:41.683707 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4aae160b-88b3-4b8a-9f35-6d0d3ccf2efb tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1313 microversion: 2.1 time: 1.099959 Sep 18 01:03:41.686543 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 471/934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:40 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1313 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:41.709199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b5053b40-81d8-4099-afdc-f1c9a2345a90 req-adb6061d-6a31-4daf-8e4d-3cd754f729c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b6443b-01f5-4af7-9b74-cccd0fd2936b", "name": "network-vif-plugged", "status": "completed", "tag": "e9d8f6fb-12e8-4620-a387-875ee2828384"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:41.724150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b5053b40-81d8-4099-afdc-f1c9a2345a90 req-adb6061d-6a31-4daf-8e4d-3cd754f729c9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.725138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b5053b40-81d8-4099-afdc-f1c9a2345a90 req-adb6061d-6a31-4daf-8e4d-3cd754f729c9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.726150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b5053b40-81d8-4099-afdc-f1c9a2345a90 req-adb6061d-6a31-4daf-8e4d-3cd754f729c9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.748245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b5053b40-81d8-4099-afdc-f1c9a2345a90 req-adb6061d-6a31-4daf-8e4d-3cd754f729c9 service nova] Creating event network-vif-plugged:e9d8f6fb-12e8-4620-a387-875ee2828384 for instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b on n-h2-master-1 Sep 18 01:03:41.756561 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b5053b40-81d8-4099-afdc-f1c9a2345a90 req-adb6061d-6a31-4daf-8e4d-3cd754f729c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067009 Sep 18 01:03:41.762464 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 472/935] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:41.769931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:41.771935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:41.788371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.789164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.791231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.794913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.795819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.796461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.152262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.163490 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a0c7a62-4948-4a59-a708-54ab8b2b06ef tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.770562 Sep 18 01:03:42.183231 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 464/936] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:41 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:42.189503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:42.190351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:42.198410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.198950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.199619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.200629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.201331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.201864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.333723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.349343 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4082c503-09e2-46b5-ab82-0e7feeae4504 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1523 microversion: 2.1 time: 0.585261 Sep 18 01:03:42.350707 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 473/937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:41 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1523 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:42.362794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:42.364309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:42.377041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.378397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.379475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.381062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.383573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.384713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.443915 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:42.481385 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=36 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:42.720219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.737513 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3fa3224-f94d-41f2-9341-fd3815142f79 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1316 microversion: 2.1 time: 0.552038 Sep 18 01:03:42.739322 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 465/938] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:42 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:42.949109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.967312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.970727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.972965 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c88b2719-7ccc-49be-adf6-e6bd41c5e35b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1566 microversion: 2.25 time: 0.619972 Sep 18 01:03:42.994233 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 474/939] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:42 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1566 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:43.009118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:43.010304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:43.018550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.019482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.020219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.021290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.022221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.023043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.053818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-556358e8-d4ae-435a-833c-cbf123daaa06 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1388614082", "ram": 512, "vcpus": 1, "disk": 10, "id": 373459334, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:43.068083 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:43.087672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-556358e8-d4ae-435a-833c-cbf123daaa06 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.346390 Sep 18 01:03:43.088588 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 466/940] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:42 2022] POST /compute/v2.1/flavors => generated 413 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:43.096089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:43.096988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:43.105272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.106020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.106745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.107680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.108287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.108849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.420694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:43.438784 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-322d1fa9-54e7-4d89-b34d-2b90e908a399 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1523 microversion: 2.1 time: 0.441671 Sep 18 01:03:43.440283 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 475/941] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:42 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:43.446966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:43.448135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:43.455773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.456845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.457990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.459230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.460244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.461125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.466643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:43.485000 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2158da14-492a-420d-b3b4-5755780e7cda tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.394924 Sep 18 01:03:43.488640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 467/942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:43 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:43.679748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9cf87635-403c-44b0-998f-78b0c4f76a63 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:43.696026 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9cf87635-403c-44b0-998f-78b0c4f76a63 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] HTTP exception thrown: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9cf87635-403c-44b0-998f-78b0c4f76a63 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Request method failure captured: Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/flavors/373459334/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm5sPPC9ClRMZy1vm3Al_xHIjArcPTcXwEyncKa9CPdGNvjBuHUaR7ka40CMle8_-tu6sZrFVrycVNJtWarm1hmbvRW378oiSgdlnf44mKOh8q0RjPlt9WeB1XTN6y1NlQnWRD1mjpFU4g6ty8PgeWVDWZcOSbZyQLMB_96yVmK1j6Q Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:03:43.698883 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 769ae7743b2543e792168b05c555104f Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:43.701824 n-d-master-1 devstack@n-api.service[122373]: exception: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: action_args: {'flavor_id': '373459334', 'id': 'hw:cpu_thread_policy'} Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:43.703313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9cf87635-403c-44b0-998f-78b0c4f76a63 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Returning 404 to user: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9cf87635-403c-44b0-998f-78b0c4f76a63 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] 10.222.0.25 "GET /compute/v2.1/flavors/373459334/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.211691 Sep 18 01:03:43.706290 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 468/943] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:03:43 2022] GET /compute/v2.1/flavors/373459334/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:43.711183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:43.711863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:43.719753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.720242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.720674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.721670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.722237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.722661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.149703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:44.160829 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cbcd474c-68a8-4732-a156-61138c8176d7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.456200 Sep 18 01:03:44.166202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:44.172561 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 469/944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:43 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:44.177989 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c32f594c-47f3-482f-a239-be3cfd341229 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1313 microversion: 2.1 time: 0.735706 Sep 18 01:03:44.187568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:44.187775 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 476/945] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:43 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:44.197319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:44.197597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-34a0e98e-5d92-42bf-a9d5-9cd9f15ac3e0 req-f5b97068-74aa-4573-8269-e0ecf9eb0ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d680a3c6-91ab-4755-b862-9cb85ba60fe5", "tag": "c56f633b-dd20-4dec-b564-db9918ef1a6a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:44.204049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.205048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.205719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.206829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.207525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.208212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.211634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34a0e98e-5d92-42bf-a9d5-9cd9f15ac3e0 req-f5b97068-74aa-4573-8269-e0ecf9eb0ce0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.212210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34a0e98e-5d92-42bf-a9d5-9cd9f15ac3e0 req-f5b97068-74aa-4573-8269-e0ecf9eb0ce0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.212727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34a0e98e-5d92-42bf-a9d5-9cd9f15ac3e0 req-f5b97068-74aa-4573-8269-e0ecf9eb0ce0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.218816 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:44.234913 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-34a0e98e-5d92-42bf-a9d5-9cd9f15ac3e0 req-f5b97068-74aa-4573-8269-e0ecf9eb0ce0 service nova] Creating event network-changed:c56f633b-dd20-4dec-b564-db9918ef1a6a for instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 on n-h2-master-1 Sep 18 01:03:44.247115 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-34a0e98e-5d92-42bf-a9d5-9cd9f15ac3e0 req-f5b97068-74aa-4573-8269-e0ecf9eb0ce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056965 Sep 18 01:03:44.248231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 477/946] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:44.256193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1420416048"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:44.259941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:44.268261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.269591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.270311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.271409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.271950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.272392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.502526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:44.513125 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2fbd2c5d-2128-44ca-aae4-8431f4ab3aae tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1483 microversion: 2.1 time: 0.335348 Sep 18 01:03:44.513743 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 470/947] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:44 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1483 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:44.519397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6632c2e6-2c8d-404b-aaf0-5cd0682e49dc tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:44.525216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6632c2e6-2c8d-404b-aaf0-5cd0682e49dc tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '769ae7743b2543e792168b05c555104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5822d50412ae47b2a0130650c5f703ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6632c2e6-2c8d-404b-aaf0-5cd0682e49dc tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Request method failure captured: Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/flavors/373459334/os-extra_specs HTTP/1.1 Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 66 Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm5sPPC9ClRMZy1vm3Al_xHIjArcPTcXwEyncKa9CPdGNvjBuHUaR7ka40CMle8_-tu6sZrFVrycVNJtWarm1hmbvRW378oiSgdlnf44mKOh8q0RjPlt9WeB1XTN6y1NlQnWRD1mjpFU4g6ty8PgeWVDWZcOSbZyQLMB_96yVmK1j6Q Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:03:44.527040 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 769ae7743b2543e792168b05c555104f Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 18 01:03:44.528842 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: action_args: {'flavor_id': '373459334', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:03:44.529820 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 18 01:03:44.531287 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:44.533510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6632c2e6-2c8d-404b-aaf0-5cd0682e49dc tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:44.534549 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6632c2e6-2c8d-404b-aaf0-5cd0682e49dc tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] 10.222.0.25 "POST /compute/v2.1/flavors/373459334/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019551 Sep 18 01:03:44.535137 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 471/948] 10.222.0.25 () {60 vars in 1221 bytes} [Sun Sep 18 01:03:44 2022] POST /compute/v2.1/flavors/373459334/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:44.544161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:44.548516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:44.562368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.563242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.564011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.571180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.571693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.572295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.679947 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34a15cff-b04f-4d1f-8325-eac6e31d87d0 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f/action" status: 202 len: 0 microversion: 2.1 time: 0.428932 Sep 18 01:03:44.680958 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 478/949] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:03:44 2022] POST /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:03:44.710134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:44.712395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:44.731097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.731818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.735144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.737531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.738247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.740503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.950429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:44.962929 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3822815-1adb-4fd5-ae98-fe436c0c7b49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1466 microversion: 2.1 time: 0.426345 Sep 18 01:03:44.963842 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 472/950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:44 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1466 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:44.971033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:44.972274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:44.982400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.983550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.984737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.986503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.987923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.988813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.213326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:45.252740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:45.263607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:45.265909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5b74702-3ccd-4b21-a0e0-058992f5d834 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1556 microversion: 2.25 time: 0.563374 Sep 18 01:03:45.274870 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 479/951] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:44 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1556 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:45.313169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c0127011-030f-4dbe-99df-3cde3f7802c2 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:45.363153 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c0127011-030f-4dbe-99df-3cde3f7802c2 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/373459334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.071566 Sep 18 01:03:45.364138 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 480/952] 10.222.0.25 () {60 vars in 1221 bytes} [Sun Sep 18 01:03:45 2022] POST /compute/v2.1/flavors/373459334/os-extra_specs => generated 66 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:03:45.373167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16d82ea6-6efd-4be4-ba49-98609fc6ca44 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '.version_select at 0x7f7006497040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:45.396091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:45.406247 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e9d3a1e-c6a9-4a82-8340-98995c0195c7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.440502 Sep 18 01:03:45.407651 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 473/953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:44 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:45.418810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-899af9f9-7f01-4c39-81fc-c24419b0f517 req-5e2e4508-bcd1-4bdd-908b-116bc684d9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee7c69b-d3a1-479c-b99d-334a7e399821", "name": "network-vif-plugged", "status": "completed", "tag": "65102f0d-0a2d-4958-a139-bcfcdd36b250"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:45.438943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-899af9f9-7f01-4c39-81fc-c24419b0f517 req-5e2e4508-bcd1-4bdd-908b-116bc684d9af service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.439722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-899af9f9-7f01-4c39-81fc-c24419b0f517 req-5e2e4508-bcd1-4bdd-908b-116bc684d9af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.440313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-899af9f9-7f01-4c39-81fc-c24419b0f517 req-5e2e4508-bcd1-4bdd-908b-116bc684d9af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.452721 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-899af9f9-7f01-4c39-81fc-c24419b0f517 req-5e2e4508-bcd1-4bdd-908b-116bc684d9af service nova] Creating event network-vif-plugged:65102f0d-0a2d-4958-a139-bcfcdd36b250 for instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 on n-h1-master-1 Sep 18 01:03:45.459025 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-899af9f9-7f01-4c39-81fc-c24419b0f517 req-5e2e4508-bcd1-4bdd-908b-116bc684d9af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048235 Sep 18 01:03:45.460312 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 474/954] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:45.466491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:45.467862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:45.475100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.475597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.476093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.477356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.478151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.478601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.570667 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16d82ea6-6efd-4be4-ba49-98609fc6ca44 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972" status: 204 len: 0 microversion: 2.1 time: 0.204850 Sep 18 01:03:45.571446 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 481/955] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:45 2022] DELETE /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:45.579538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:45.580162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:45.598812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.600016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.601356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.602866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.604378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.605283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.846559 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a139553-0739-4e84-8372-ec4b68e3e611 tempest-ServersOnMultiNodesTest-447237104 tempest-ServersOnMultiNodesTest-447237104-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1617 microversion: 2.1 time: 0.384102 Sep 18 01:03:45.847821 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 475/956] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:45 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1617 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:45.853464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:45.854521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:45.863868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.864769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.865584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.874785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.875913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.876482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.901430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:45.912926 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b9f8a5fe-c4bc-4a6e-90d9-574498b3d9bf tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.340165 Sep 18 01:03:45.914268 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 482/957] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:45 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:45.923057 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06e482b1-63c7-40bc-9490-a3fe118f119c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '.version_select at 0x7f7006f66a60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:45.929867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06e482b1-63c7-40bc-9490-a3fe118f119c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:45.930742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06e482b1-63c7-40bc-9490-a3fe118f119c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:45.931542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06e482b1-63c7-40bc-9490-a3fe118f119c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.946501 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06e482b1-63c7-40bc-9490-a3fe118f119c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.030608 Sep 18 01:03:45.947421 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 483/958] 10.222.0.25 () {60 vars in 1184 bytes} [Sun Sep 18 01:03:45 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:45.955742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-384078fa-6d58-4cb5-84ca-93d929b20611 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:45.958998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-384078fa-6d58-4cb5-84ca-93d929b20611 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '769ae7743b2543e792168b05c555104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5822d50412ae47b2a0130650c5f703ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-384078fa-6d58-4cb5-84ca-93d929b20611 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Request method failure captured: Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5sPPC9ClRMZy1vm3Al_xHIjArcPTcXwEyncKa9CPdGNvjBuHUaR7ka40CMle8_-tu6sZrFVrycVNJtWarm1hmbvRW378oiSgdlnf44mKOh8q0RjPlt9WeB1XTN6y1NlQnWRD1mjpFU4g6ty8PgeWVDWZcOSbZyQLMB_96yVmK1j6Q Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:45.963047 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 769ae7743b2543e792168b05c555104f Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:45.965097 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: action_args: {'flavor_id': '373459334', 'id': 'hw:numa_nodes'} Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:03:45.966765 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:45.969206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-384078fa-6d58-4cb5-84ca-93d929b20611 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:45.971242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-384078fa-6d58-4cb5-84ca-93d929b20611 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016464 Sep 18 01:03:45.971242 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 484/959] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:03:45 2022] DELETE /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:45.974127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d70a051-06b5-400b-a3f5-1b8330e13800 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '.version_select at 0x7f70064971f0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.000293 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-2d70a051-06b5-400b-a3f5-1b8330e13800 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Image not found. Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d70a051-06b5-400b-a3f5-1b8330e13800 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972 HTTP/1.1 Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:46.003213 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: exception: Image not found. Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '76097b8a-86df-4ff4-a17a-017d641a4972'} Sep 18 01:03:46.006419 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:03:46.008650 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 76097b8a-86df-4ff4-a17a-017d641a4972 Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:03:46.010851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76097b8a-86df-4ff4-a17a-017d641a4972 could not be found. Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:03:46.013541 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.016083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d70a051-06b5-400b-a3f5-1b8330e13800 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Image not found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:46.018259 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2d70a051-06b5-400b-a3f5-1b8330e13800 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972" status: 404 len: 62 microversion: 2.1 time: 0.037258 Sep 18 01:03:46.018259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 485/960] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:03:45 2022] GET /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:03:46.018259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.018259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:46.025014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.025689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.026208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.027109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.028123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.028831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.078333 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:46.094155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:46.102581 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f52a425d-a2b7-4f54-9a6f-42c7e529280e tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1313 microversion: 2.1 time: 0.253642 Sep 18 01:03:46.103154 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 476/961] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:45 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:46.126247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.127297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:46.137437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.138369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.138993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.140248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.141301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.142138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.185187 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b00d83d3-801f-4e56-bca4-33019fc47d08 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 204 len: 0 microversion: 2.1 time: 0.176509 Sep 18 01:03:46.185807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 486/962] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:46 2022] DELETE /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:46.191046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93ae0ea5-914d-4ac5-9eb6-7ad2d3743100 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:46.219193 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93ae0ea5-914d-4ac5-9eb6-7ad2d3743100 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/373459334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032147 Sep 18 01:03:46.220355 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 487/963] 10.222.0.25 () {60 vars in 1221 bytes} [Sun Sep 18 01:03:46 2022] POST /compute/v2.1/flavors/373459334/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:03:46.225588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.226568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:46.233872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.234659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.235278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.236105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.236725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.237312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.422984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid b1b4f360-e61a-4fea-8b7d-05c20f3f0743 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:46.449279 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d54c9081-a725-421e-b4ce-3797115b5b45 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 2048 microversion: 2.25 time: 0.329840 Sep 18 01:03:46.450397 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 477/964] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:46 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 2048 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:46.459173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.461420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:46.471622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.472121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.472563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.473517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.474292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.474729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.477931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:46.491402 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cae8f516-2430-492b-8cbd-66e0868e26da tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1535 microversion: 2.1 time: 0.269683 Sep 18 01:03:46.494752 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 488/965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:46 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:46.503368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f351bcd-8acf-4b7d-9b58-1f78e032d0b9 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:46.510021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f351bcd-8acf-4b7d-9b58-1f78e032d0b9 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '769ae7743b2543e792168b05c555104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5822d50412ae47b2a0130650c5f703ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f351bcd-8acf-4b7d-9b58-1f78e032d0b9 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Request method failure captured: Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 22 Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5sPPC9ClRMZy1vm3Al_xHIjArcPTcXwEyncKa9CPdGNvjBuHUaR7ka40CMle8_-tu6sZrFVrycVNJtWarm1hmbvRW378oiSgdlnf44mKOh8q0RjPlt9WeB1XTN6y1NlQnWRD1mjpFU4g6ty8PgeWVDWZcOSbZyQLMB_96yVmK1j6Q Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:46.515238 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5822d50412ae47b2a0130650c5f703ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5822d50412ae47b2a0130650c5f703ce Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 769ae7743b2543e792168b05c555104f Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: {"hw:numa_nodes": "1"} Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:46.517143 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: action_args: {'flavor_id': '373459334', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:03:46.518288 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 18 01:03:46.521302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.524882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f351bcd-8acf-4b7d-9b58-1f78e032d0b9 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:46.524882 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f351bcd-8acf-4b7d-9b58-1f78e032d0b9 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930 tempest-FlavorsExtraSpecsNegativeTestJSON-1940278930-project] 10.222.0.25 "PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.027061 Sep 18 01:03:46.530267 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 489/966] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:03:46 2022] PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:46.535885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-17519d00-004f-47ed-80a1-5bebe6523c39 req-d129e618-4cc8-4b12-8cfd-b649cdb26eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ff9e6d-5612-447a-b317-dd1e6f1324b3", "tag": "b7e00281-7e7f-4aed-af4e-b7dd24f7147a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:46.551273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-17519d00-004f-47ed-80a1-5bebe6523c39 req-d129e618-4cc8-4b12-8cfd-b649cdb26eea service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.551749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-17519d00-004f-47ed-80a1-5bebe6523c39 req-d129e618-4cc8-4b12-8cfd-b649cdb26eea service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.552185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-17519d00-004f-47ed-80a1-5bebe6523c39 req-d129e618-4cc8-4b12-8cfd-b649cdb26eea service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.571217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-17519d00-004f-47ed-80a1-5bebe6523c39 req-d129e618-4cc8-4b12-8cfd-b649cdb26eea service nova] Creating event network-changed:b7e00281-7e7f-4aed-af4e-b7dd24f7147a for instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 on n-h2-master-1 Sep 18 01:03:46.578513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-17519d00-004f-47ed-80a1-5bebe6523c39 req-d129e618-4cc8-4b12-8cfd-b649cdb26eea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045631 Sep 18 01:03:46.580668 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 490/967] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:46.588973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.589710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:46.598908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.600030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.601695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.603191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.604235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.605393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.734406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:46.742848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9baa5778-4cef-4bfb-af6c-b0719ca06a36 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1472 microversion: 2.1 time: 0.290986 Sep 18 01:03:46.743498 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 478/968] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:46 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1472 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:46.760005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-808c27d9-496b-443b-9ae8-115d3d90a477 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.768306 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-808c27d9-496b-443b-9ae8-115d3d90a477 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] HTTP exception thrown: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-808c27d9-496b-443b-9ae8-115d3d90a477 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Request method failure captured: Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/flavors/373459334/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm5taRcerzE6Pjxr3JF5DQTm2cv9AD7anWr5RdRjiD5Kn2Th0TPp4Eny0QzRluhwDkyUtADRoQraLw-Nofk52ZTLWJhyMHDEZLLXytTRhdym7niIfY0iHC_YvWSNjcNuBYxXjGRFVrcPdwhyW-usO2PX-IYCQ1212q9RyBnz4vypQTA Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 2f93296e91764ce695f4f8c5d8eb5cad Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:03:46.769707 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 2f93296e91764ce695f4f8c5d8eb5cad Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9867794fbe92430c9048e2e8792a2392 Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:03:46.771285 n-d-master-1 devstack@n-api.service[122373]: exception: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: action_args: {'flavor_id': '373459334', 'id': 'hw:cpu_thread_policy'} Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.772078 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.773651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.773651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.773651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.773651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:46.773651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:46.773651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. Sep 18 01:03:46.773651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.775442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-808c27d9-496b-443b-9ae8-115d3d90a477 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Returning 404 to user: Flavor 373459334 has no extra specs with key hw:cpu_thread_policy. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:46.776456 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-808c27d9-496b-443b-9ae8-115d3d90a477 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/373459334/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.031112 Sep 18 01:03:46.777802 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 479/969] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:03:46 2022] DELETE /compute/v2.1/flavors/373459334/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:46.782754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1533635063", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "3946aa63-a4f2-4eee-aaa3-ec460267890e"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:46.847254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:46.856250 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76f7ad43-feb0-4251-af63-b4b1b7c2d042 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.273882 Sep 18 01:03:46.856909 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 491/970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:46 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:46.861932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da83c6e0-5d31-41e2-8cdd-80f43f1c4a46 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:46.865345 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-da83c6e0-5d31-41e2-8cdd-80f43f1c4a46 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da83c6e0-5d31-41e2-8cdd-80f43f1c4a46 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Request method failure captured: Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 27 Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5taRcerzE6Pjxr3JF5DQTm2cv9AD7anWr5RdRjiD5Kn2Th0TPp4Eny0QzRluhwDkyUtADRoQraLw-Nofk52ZTLWJhyMHDEZLLXytTRhdym7niIfY0iHC_YvWSNjcNuBYxXjGRFVrcPdwhyW-usO2PX-IYCQ1212q9RyBnz4vypQTA Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 2f93296e91764ce695f4f8c5d8eb5cad Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:03:46.867457 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 2f93296e91764ce695f4f8c5d8eb5cad Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9867794fbe92430c9048e2e8792a2392 Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: {"hw:cpu_policy": "shared"} Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:46.870079 n-d-master-1 devstack@n-api.service[122374]: exception: Request body and URI mismatch Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: action_args: {'flavor_id': '373459334', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.871558 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.874859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:46.874859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:46.874859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 18 01:03:46.874859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.874859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da83c6e0-5d31-41e2-8cdd-80f43f1c4a46 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:46.874859 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-da83c6e0-5d31-41e2-8cdd-80f43f1c4a46 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010750 Sep 18 01:03:46.874859 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 492/971] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:03:46 2022] PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes => generated 73 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:03:46.880040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec1226f4-84ab-410d-ae3b-c2cd537ff1d9 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec1226f4-84ab-410d-ae3b-c2cd537ff1d9 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Request method failure captured: Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 49 Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5taRcerzE6Pjxr3JF5DQTm2cv9AD7anWr5RdRjiD5Kn2Th0TPp4Eny0QzRluhwDkyUtADRoQraLw-Nofk52ZTLWJhyMHDEZLLXytTRhdym7niIfY0iHC_YvWSNjcNuBYxXjGRFVrcPdwhyW-usO2PX-IYCQ1212q9RyBnz4vypQTA Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 2f93296e91764ce695f4f8c5d8eb5cad Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:03:46.883950 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f93296e91764ce695f4f8c5d8eb5cad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 2f93296e91764ce695f4f8c5d8eb5cad Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9867794fbe92430c9048e2e8792a2392 Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 18 01:03:46.885259 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: action_args: {'flavor_id': '373459334', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance: Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 18 01:03:46.886097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.887498 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:46.888979 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:46.888979 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:46.888979 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:03:46.888979 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:03:46.888979 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 18 01:03:46.888979 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:46.889748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] validate_networks() for [('3946aa63-a4f2-4eee-aaa3-ec460267890e', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:46.891555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec1226f4-84ab-410d-ae3b-c2cd537ff1d9 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:46.892429 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ec1226f4-84ab-410d-ae3b-c2cd537ff1d9 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016836 Sep 18 01:03:46.892999 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 493/972] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:03:46 2022] PUT /compute/v2.1/flavors/373459334/os-extra_specs/hw:numa_nodes => generated 117 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:03:46.911845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-872cba93-4b9d-4e00-8450-e14a52ec0b62 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.942982 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-872cba93-4b9d-4e00-8450-e14a52ec0b62 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/373459334" status: 202 len: 0 microversion: 2.1 time: 0.039799 Sep 18 01:03:46.943941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 494/973] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:03:46 2022] DELETE /compute/v2.1/flavors/373459334 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:03:46.955222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.956483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:46.967547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.968400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.969181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.970459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.971279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.972039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.296278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:47.311670 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f0012dc1-5e8b-432f-9450-abd3d1e7f53f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.362560 Sep 18 01:03:47.316829 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 495/974] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:46 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:47.326394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5867f46a-689a-4f94-81f3-57efdf7191d6 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:47.351318 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5867f46a-689a-4f94-81f3-57efdf7191d6 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807 tempest-FlavorsExtraSpecsNegativeTestJSON-798097807-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032778 Sep 18 01:03:47.352550 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 496/975] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:03:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:47.358005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:47.358565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:47.366592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.367180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.367716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.368505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.369030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.369905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.697732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:47.698461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:47.699365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:47.700096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:47.700806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:47.716265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.717312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.719176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.720465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.721443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.722414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.732121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:47.748624 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7d53137-62dd-4e3e-861c-6df668dfc5fc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1463 microversion: 2.1 time: 0.394537 Sep 18 01:03:47.749634 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 497/976] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:47 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1463 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:47.757578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:47.758646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:47.761857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:47.769105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.769955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.770741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.771929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.772692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.773643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for user bb1c3f4298d34bb2a820ec5de46a76c2 and project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:47.773973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.795427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:47.799520 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:47.892867 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b92fc6f4-219a-4d11-9ad8-19b7a4178553 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.113598 Sep 18 01:03:47.895889 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 480/977] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:03:48.045989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:48.063798 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59ea24f5-a7cc-408f-bb52-92df4fbc38a5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1541 microversion: 2.1 time: 0.312337 Sep 18 01:03:48.065747 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 498/978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:47 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1541 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:48.094642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:48.097962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:48.110374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.111160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.111963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.113135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.113978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.114768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.361309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Calling method '.version_select at 0x7f70065cd430>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:48.388424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.389681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.390396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.425706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.426651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.427567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.458882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:48.473450 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c4afc8ac-89f5-4c52-9fe1-1bea81312cd2 tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/ccc21635096f4fadb606d7bf5ab6f197?start=2022-09-17T01%3A03%3A47.764897&end=2022-09-19T01%3A03%3A47.764897" status: 200 len: 698 microversion: 2.1 time: 0.578103 Sep 18 01:03:48.474412 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 481/979] 10.222.0.25 () {58 vars in 1412 bytes} [Sun Sep 18 01:03:47 2022] GET /compute/v2.1/os-simple-tenant-usage/ccc21635096f4fadb606d7bf5ab6f197?start=2022-09-17T01%3A03%3A47.764897&end=2022-09-19T01%3A03%3A47.764897 => generated 698 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:48.482880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:48.483872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:48.488256 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1dc5ed71-2101-4faa-98e3-717a02914842 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1472 microversion: 2.1 time: 0.404618 Sep 18 01:03:48.489763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 499/980] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:48 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:48.499489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.499489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.499489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.500095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.500984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bdfabe2e-add3-4486-99cd-092d85ca493a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:48.501823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.502959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bdfabe2e-add3-4486-99cd-092d85ca493a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:48.503678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.800872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bdfabe2e-add3-4486-99cd-092d85ca493a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:48.854509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bdfabe2e-add3-4486-99cd-092d85ca493a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:48.866655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bdfabe2e-add3-4486-99cd-092d85ca493a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:48.890308 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bdfabe2e-add3-4486-99cd-092d85ca493a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1262 microversion: 2.25 time: 0.398627 Sep 18 01:03:48.898270 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 500/981] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:48 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1262 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:48.928583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:48.931088 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:48.950593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.958311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.962137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.963720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.964536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.964877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:48.968749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.983538 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4a92889f-c784-42bb-9ba9-e85ab29d8230 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.507181 Sep 18 01:03:48.984414 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 482/982] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:48 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:48.991802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '.version_select at 0x7f7006567280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:49.008706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.009914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.010807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.031788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.032880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.034566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.058942 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-176387d1-6947-43f4-ae8f-abca55451e6b tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/ccc21635096f4fadb606d7bf5ab6f197?start=2022-09-17T01%3A03%3A47.764897&end=2022-09-19T01%3A03%3A47.764897" status: 200 len: 642 microversion: 2.1 time: 0.072874 Sep 18 01:03:49.071646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 483/983] 10.222.0.25 () {58 vars in 1412 bytes} [Sun Sep 18 01:03:48 2022] GET /compute/v2.1/os-simple-tenant-usage/ccc21635096f4fadb606d7bf5ab6f197?start=2022-09-17T01%3A03%3A47.764897&end=2022-09-19T01%3A03%3A47.764897 => generated 642 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:49.082362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Calling method '.version_select at 0x7f7006592c10>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:49.118653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.119779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.120751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.154138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.155596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.156692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.245362 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61dbbd12-77b1-4d5c-b69f-cbf5fda35c8c tempest-TenantUsagesTestJSON-122639272 tempest-TenantUsagesTestJSON-122639272-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-17T01%3A03%3A47.764897&end=2022-09-19T01%3A03%3A47.764897&detailed=1" status: 200 len: 13232 microversion: 2.1 time: 0.170902 Sep 18 01:03:49.262736 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 484/984] 10.222.0.25 () {58 vars in 1335 bytes} [Sun Sep 18 01:03:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-17T01%3A03%3A47.764897&end=2022-09-19T01%3A03%3A47.764897&detailed=1 => generated 13232 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:03:49.275338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:49.276314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:49.284920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.285908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.286527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.287555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.288402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.289074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.348972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:49.388530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b08cc4e-8b52-4f13-a7df-d35f696d2a74 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.482568 Sep 18 01:03:49.391827 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 501/985] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:48 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:49.413817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-76d78eb8-fbec-4dbf-99fe-d3f78820be9b req-589315e8-7bf0-49b0-a5e8-57aa078076b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78083c60-a6b6-4e5a-9be6-3bca0baaa576", "name": "network-vif-plugged", "status": "completed", "tag": "a501be6c-7161-4f35-8a40-adf934fd7f00"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:49.466612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-76d78eb8-fbec-4dbf-99fe-d3f78820be9b req-589315e8-7bf0-49b0-a5e8-57aa078076b0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.471690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-76d78eb8-fbec-4dbf-99fe-d3f78820be9b req-589315e8-7bf0-49b0-a5e8-57aa078076b0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.473928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-76d78eb8-fbec-4dbf-99fe-d3f78820be9b req-589315e8-7bf0-49b0-a5e8-57aa078076b0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.512055 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-76d78eb8-fbec-4dbf-99fe-d3f78820be9b req-589315e8-7bf0-49b0-a5e8-57aa078076b0 service nova] Creating event network-vif-plugged:a501be6c-7161-4f35-8a40-adf934fd7f00 for instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 on n-h1-master-1 Sep 18 01:03:49.524667 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-76d78eb8-fbec-4dbf-99fe-d3f78820be9b req-589315e8-7bf0-49b0-a5e8-57aa078076b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129493 Sep 18 01:03:49.526557 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 502/986] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:49.539594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:49.540914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:49.555496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.557135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.558283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.560959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.562204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.563540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.659259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:49.785162 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:49.941121 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:49.956918 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a8043096-fae9-4ad8-8583-85aed17eb8a1 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 204 len: 0 microversion: 2.1 time: 0.427023 Sep 18 01:03:49.959704 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 503/987] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:49 2022] DELETE /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:49.967193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:49.968371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:49.978399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.979425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.981593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.982682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.983394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.984375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.067347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:50.077723 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fec029ff-24c2-455b-ae91-d62e9e460104 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1523 microversion: 2.1 time: 0.813246 Sep 18 01:03:50.078894 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 485/988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:49 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1523 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:50.088962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:50.091254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:50.113515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.114251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.114884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.115862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.116425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.117589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.249502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:50.270035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:50.272511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:50.275250 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96bf6b8f-ffb5-477d-a05f-a2c1ac58aeb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1314 microversion: 2.25 time: 0.193243 Sep 18 01:03:50.276090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 486/989] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:50 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:50.285631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:50.287040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:50.295840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.296607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.297258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.299739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.300852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.301931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.308184 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:50.447891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:50.470639 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b7a5e0b4-af48-4429-bc00-8d49050005ec tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1472 microversion: 2.1 time: 0.508377 Sep 18 01:03:50.472025 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 504/990] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:49 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:50.480618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:50.481252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:50.490869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.491566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.492029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.495504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.496263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.497862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.958298 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:51.002926 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-34e12401-89ab-467f-8dd8-9304ff92630c tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1469 microversion: 2.1 time: 0.708078 Sep 18 01:03:51.004318 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 487/991] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:50 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1469 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:51.019699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:51.020261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:51.037168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.039388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.040455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.045446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.046970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.047415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.089794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:51.212035 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d2fb6436-dff9-462c-adb6-58e760d5887d tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 204 len: 0 microversion: 2.1 time: 0.199700 Sep 18 01:03:51.212776 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 488/992] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:51 2022] DELETE /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:51.224984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:51.231049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:51.240309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.241510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.242204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.243217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.244640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.246097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.265452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:51.275158 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5680171-b0ea-4572-8ab6-56088a2ae482 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.801628 Sep 18 01:03:51.290534 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 505/993] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:50 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:51.299018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-38f95317-ece8-45be-84c7-54779c69de09 req-d5a50415-7eb9-47be-b8de-d373b0161e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b6443b-01f5-4af7-9b74-cccd0fd2936b", "name": "network-vif-deleted", "tag": "e9d8f6fb-12e8-4620-a387-875ee2828384"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:51.314442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-38f95317-ece8-45be-84c7-54779c69de09 req-d5a50415-7eb9-47be-b8de-d373b0161e27 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.314956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-38f95317-ece8-45be-84c7-54779c69de09 req-d5a50415-7eb9-47be-b8de-d373b0161e27 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.315916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-38f95317-ece8-45be-84c7-54779c69de09 req-d5a50415-7eb9-47be-b8de-d373b0161e27 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.382774 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-38f95317-ece8-45be-84c7-54779c69de09 req-d5a50415-7eb9-47be-b8de-d373b0161e27 service nova] Creating event network-vif-deleted:e9d8f6fb-12e8-4620-a387-875ee2828384 for instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b on n-h2-master-1 Sep 18 01:03:51.396771 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-38f95317-ece8-45be-84c7-54779c69de09 req-d5a50415-7eb9-47be-b8de-d373b0161e27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104571 Sep 18 01:03:51.402464 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 506/994] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:51.418055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:51.419926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:51.436660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.437342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.438012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.438597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.439078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.439514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.813531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:51.849016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-662e05e1-5fda-4f77-9b3f-1fdc995173f6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.634410 Sep 18 01:03:51.863064 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 489/995] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:51 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:51.875313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:51.878536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:51.901111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.901987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.904031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.912043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.914394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.914394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.920536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:51.938562 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a6f89de4-cb94-4436-848d-da7d077a9c20 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1529 microversion: 2.1 time: 0.532347 Sep 18 01:03:51.939681 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 507/996] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:51 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1529 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:51.948336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:51.949004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:51.968212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.970977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.971963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.975278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.975947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.976811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.057115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:52.068722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.069496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.070115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.070913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lazy-loading 'fault' on Instance uuid a8b6443b-01f5-4af7-9b74-cccd0fd2936b {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:52.082306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:52.090781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:52.096209 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88cfe674-f4c1-4070-a687-663b07e50f90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1314 microversion: 2.25 time: 0.241785 Sep 18 01:03:52.097443 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 490/997] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:51 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:52.109665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d7e07914-a130-42ec-a599-3bc2e7467ca2 req-b52a4ae6-2c3c-4d78-a46c-69768353b128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a681c23f-ec48-43cb-be35-f479496bda0f", "name": "network-vif-plugged", "status": "completed", "tag": "79af51af-eeba-4495-957f-0baadfa436a0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:52.123614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d7e07914-a130-42ec-a599-3bc2e7467ca2 req-b52a4ae6-2c3c-4d78-a46c-69768353b128 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.124381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d7e07914-a130-42ec-a599-3bc2e7467ca2 req-b52a4ae6-2c3c-4d78-a46c-69768353b128 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.125084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d7e07914-a130-42ec-a599-3bc2e7467ca2 req-b52a4ae6-2c3c-4d78-a46c-69768353b128 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.149367 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d7e07914-a130-42ec-a599-3bc2e7467ca2 req-b52a4ae6-2c3c-4d78-a46c-69768353b128 service nova] Creating event network-vif-plugged:79af51af-eeba-4495-957f-0baadfa436a0 for instance a681c23f-ec48-43cb-be35-f479496bda0f on n-h1-master-1 Sep 18 01:03:52.158607 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d7e07914-a130-42ec-a599-3bc2e7467ca2 req-b52a4ae6-2c3c-4d78-a46c-69768353b128 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059082 Sep 18 01:03:52.159968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:52.160246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 491/998] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:52.167274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:52.168693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:52.172540 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c36b4d00-22ae-4721-a16d-7b407dae2162 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 200 len: 1306 microversion: 2.1 time: 0.231255 Sep 18 01:03:52.175298 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 508/999] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:51 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:52.184055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.185299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.186045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.187249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.188094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.188849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.304604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:52.306259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:52.321859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.322743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.323477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.324430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.325116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.325841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.419979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:52.430705 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eff050f7-1903-40fd-97d9-a681952e353a tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1469 microversion: 2.1 time: 0.268750 Sep 18 01:03:52.442175 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 492/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:52 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:52.559401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:52.569296 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08a5841d-fa80-4f15-8b78-f5bdfc0cc2e9 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.268929 Sep 18 01:03:52.570983 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 509/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:52 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:52.890433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:52.890973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:52.899348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.899847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.900293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.901354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.902036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.902463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.969345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:52.971538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:52.981715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.982370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.983219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.984390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.985295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.986270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.161184 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:53.172409 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b0f58b1-5892-45a6-ac2c-bd4ad94f2349 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.286942 Sep 18 01:03:53.176110 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 493/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:52 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:53.190839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:53.191923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:53.208526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.209335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.209441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.210721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.211208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.211639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.240038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:53.279078 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8505c6e5-017e-4019-b87e-da221a6c06c3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1529 microversion: 2.1 time: 0.314798 Sep 18 01:03:53.281872 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 510/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:52 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1529 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:53.288188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:53.288890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: a8b6443b-01f5-4af7-9b74-cccd0fd2936b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:53.298631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.299389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.300247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.303985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.305117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.306382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.322818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:53.332503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:53.334510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:53.336538 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d0be98c2-20d6-4e17-a663-4ccf4cad946b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1314 microversion: 2.25 time: 0.158767 Sep 18 01:03:53.338134 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 494/1004] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:53 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:53.350590 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b could not be found. Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b HTTP/1.1 Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:53.359163 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b could not be found. Sep 18 01:03:53.362655 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a8b6443b-01f5-4af7-9b74-cccd0fd2936b'} Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b could not be found. Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:53.366557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b could not be found. Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b could not be found. Sep 18 01:03:53.369750 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:53.373263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance a8b6443b-01f5-4af7-9b74-cccd0fd2936b could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:53.373263 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-24c3d7a0-fc6b-465b-816a-c4c4a6439b18 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b" status: 404 len: 111 microversion: 2.1 time: 0.077907 Sep 18 01:03:53.373263 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 511/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:53 2022] GET /compute/v2.1/servers/a8b6443b-01f5-4af7-9b74-cccd0fd2936b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:53.373777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:53.374295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:53.383699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.384528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.385237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.386954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.387497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.388818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.441507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:53.464752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:53.467173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:53.476608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.477502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.478278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.479085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.479616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.480118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.607857 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-066adc05-0cbf-45ff-a08e-d050dc55af42 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 204 len: 0 microversion: 2.1 time: 0.240785 Sep 18 01:03:53.608453 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 495/1006] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:53 2022] DELETE /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:53.614285 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:53.615235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:53.622054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.622567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.623010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.623737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.624187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.624826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.738905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:53.749232 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-383de6ea-6487-4749-ae09-6720b0cdd114 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1469 microversion: 2.1 time: 0.295297 Sep 18 01:03:53.749991 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 512/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:53 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1469 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:53.833927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:53.845824 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56d85eca-7642-48e6-8948-2562d1140357 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1367 microversion: 2.1 time: 0.235630 Sep 18 01:03:53.852161 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 496/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:53 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:53.862118 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:53.862913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:53.877302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.878759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.879509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.881773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.882328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.882765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.955306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-891041317", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:54.060351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:54.175033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:54.187075 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9fbcfd35-286b-4c4c-a5a3-98af2e838f9d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1472 microversion: 2.1 time: 0.333105 Sep 18 01:03:54.188489 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 497/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:53 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:54.209711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-feca8b1b-6454-41b9-952a-f84cc452357f req-af305f9d-2969-40a7-ab18-d726c02921ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ff9e6d-5612-447a-b317-dd1e6f1324b3", "name": "network-vif-plugged", "status": "completed", "tag": "b7e00281-7e7f-4aed-af4e-b7dd24f7147a"}, {"server_uuid": "a681c23f-ec48-43cb-be35-f479496bda0f", "name": "network-vif-unplugged", "status": "completed", "tag": "79af51af-eeba-4495-957f-0baadfa436a0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:54.221440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-feca8b1b-6454-41b9-952a-f84cc452357f req-af305f9d-2969-40a7-ab18-d726c02921ed service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.221965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-feca8b1b-6454-41b9-952a-f84cc452357f req-af305f9d-2969-40a7-ab18-d726c02921ed service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.222398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-feca8b1b-6454-41b9-952a-f84cc452357f req-af305f9d-2969-40a7-ab18-d726c02921ed service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.238486 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-feca8b1b-6454-41b9-952a-f84cc452357f req-af305f9d-2969-40a7-ab18-d726c02921ed service nova] Creating event network-vif-plugged:b7e00281-7e7f-4aed-af4e-b7dd24f7147a for instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 on n-h2-master-1 Sep 18 01:03:54.239045 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-feca8b1b-6454-41b9-952a-f84cc452357f req-af305f9d-2969-40a7-ab18-d726c02921ed service nova] Creating event network-vif-unplugged:79af51af-eeba-4495-957f-0baadfa436a0 for instance a681c23f-ec48-43cb-be35-f479496bda0f on n-h1-master-1 Sep 18 01:03:54.250549 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-feca8b1b-6454-41b9-952a-f84cc452357f req-af305f9d-2969-40a7-ab18-d726c02921ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045706 Sep 18 01:03:54.251521 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 498/1010] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:54.265680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:54.267058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:54.280506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.283057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.284053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.285521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.286337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.287008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.485029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:54.489190 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:54.490011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:54.490530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:54.491036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:54.502838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.503352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.504023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.505000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.505525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.506035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.526629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:54.536618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for user 666826ce8e51441ea7c271be4c5d8eb9 and project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:54.553041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:54.557284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:54.611303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:54.656670 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-749fef48-67ec-4484-b1e2-c355196948b8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.398037 Sep 18 01:03:54.657887 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 499/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:54 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:54.664646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:54.665514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:54.674877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.676127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.677260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.678152 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5661051d-6b56-4884-ae71-8271a2772b60 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926826 Sep 18 01:03:54.678532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.689922 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 513/1012] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:54.689922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:54.689922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:54.692718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.694609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.701895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.702575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.703018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.703732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.704185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.704889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.879076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:54.907318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:54.910573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:54.912416 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7f736903-52fb-45ee-875f-bb37ea3cb62d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1314 microversion: 2.25 time: 0.228380 Sep 18 01:03:54.914023 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 514/1013] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:54 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:54.921148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f457ab3f-f300-4226-a362-3962014afa72 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:54.922980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f457ab3f-f300-4226-a362-3962014afa72 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:55.061222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:55.062187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f457ab3f-f300-4226-a362-3962014afa72 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:55.084807 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f457ab3f-f300-4226-a362-3962014afa72 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1212 microversion: 2.1 time: 0.168862 Sep 18 01:03:55.086990 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 515/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:54 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1212 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:55.095607 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c02e500b-74d8-4205-a1e7-d2b87ffc2b08 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1529 microversion: 2.1 time: 0.433131 Sep 18 01:03:55.095827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:55.095827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:55.097385 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 500/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:54 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1529 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:55.103561 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a7082101-f5c4-4e97-bbee-46baf28efba6 req-9785f797-b03e-431d-9fa4-c23a457248fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee7c69b-d3a1-479c-b99d-334a7e399821", "name": "network-vif-deleted", "tag": "65102f0d-0a2d-4958-a139-bcfcdd36b250"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:55.130358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a7082101-f5c4-4e97-bbee-46baf28efba6 req-9785f797-b03e-431d-9fa4-c23a457248fa service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.131601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a7082101-f5c4-4e97-bbee-46baf28efba6 req-9785f797-b03e-431d-9fa4-c23a457248fa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.133117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a7082101-f5c4-4e97-bbee-46baf28efba6 req-9785f797-b03e-431d-9fa4-c23a457248fa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.134632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.135503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.136114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.137001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.137973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.138549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.153974 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a7082101-f5c4-4e97-bbee-46baf28efba6 req-9785f797-b03e-431d-9fa4-c23a457248fa service nova] Creating event network-vif-deleted:65102f0d-0a2d-4958-a139-bcfcdd36b250 for instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 on n-h1-master-1 Sep 18 01:03:55.165179 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a7082101-f5c4-4e97-bbee-46baf28efba6 req-9785f797-b03e-431d-9fa4-c23a457248fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064930 Sep 18 01:03:55.167066 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 501/1016] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:55.179988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:55.182415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:55.195260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.196425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.198238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.199972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.200773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.202044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.263377 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:55.367508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:55.386531 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4555a116-85fd-4043-8c2c-4a6db1373228 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1427 microversion: 2.1 time: 0.297935 Sep 18 01:03:55.388215 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 516/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:55 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1427 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:55.393522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:55.394403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:55.407083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.407748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.408606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.409622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.411625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.412686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.703427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:55.712469 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee986f98-cb33-47f9-af85-3036a7b62fc7 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1557 microversion: 2.1 time: 0.543195 Sep 18 01:03:55.713396 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 502/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:55 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1557 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:55.726547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:55.728273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:55.732447 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:55.740458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.742004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.742477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.743296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.743752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.744181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.745082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:55.759929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a0f7354-fe59-404c-bb61-6dc39f3549b5 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1472 microversion: 2.1 time: 0.370284 Sep 18 01:03:55.760536 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 517/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:55 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:55.767734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:55.768474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:55.778367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.778861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.779487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.780221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.782701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.783173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:56.166462 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9e5b8208-1cbc-4668-97fb-609a7a44508f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.401110 Sep 18 01:03:56.188380 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 518/1020] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:03:55 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-interface => generated 284 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:56.204096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:56.206930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:56.233436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:56.235089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:56.237636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:56.239478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:56.242588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:56.244062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:56.410890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:56.425228 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ebef6fb-1741-4f4c-a7b8-fd55cde0dca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1360 microversion: 2.1 time: 0.709826 Sep 18 01:03:56.426913 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 503/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:55 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1360 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:56.435554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:56.436889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:56.446560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:56.447445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:56.448262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:56.449181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:56.450254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:56.450963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:56.531273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:56.544850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:56.545904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:56.552896 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08a304b7-122c-484a-bbd8-86070e6d7c82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1332 microversion: 2.25 time: 0.359024 Sep 18 01:03:56.553931 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 519/1022] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:56 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1332 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:56.559246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:56.568296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:56.579318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:56.581409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:56.586384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:56.588136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:56.588866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:56.589728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:56.871021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:56.913631 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a6a1ff3-f2ba-41d1-9d32-23c9b6eac83c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1264 microversion: 2.1 time: 0.485169 Sep 18 01:03:56.945090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 504/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:56 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1264 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:56.962988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:56.969804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:56.971273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:57.007440 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-97bdd3a9-9275-4db6-9935-0374e3e88076 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1487 microversion: 2.1 time: 0.452017 Sep 18 01:03:57.010368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 520/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:56 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1487 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:57.025283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.029788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:57.030744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:57.049236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.051412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.052364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.057266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.058805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.059740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.060667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.061147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.061959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.062657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.062956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.255355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.255984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.256638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.259353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lazy-loading 'fault' on Instance uuid 5ee7c69b-d3a1-479c-b99d-334a7e399821 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:57.789317 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:57.848344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:57.852957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba1a4cbf6c04c2e803f47b0536c33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc21635096f4fadb606d7bf5ab6f197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:57.860119 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dbf88775-d190-495a-8a0f-05080709e003 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 200 len: 1301 microversion: 2.1 time: 0.845939 Sep 18 01:03:57.861956 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 521/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:57 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 1301 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:57.871904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f0b57d03-a5ad-4fe8-845a-7fddd0387e72 req-ec42fc82-64d7-4ebe-8804-367d567901e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84de09eb-4f7f-4e7a-b718-1db6db5f3dd2", "name": "network-vif-deleted", "tag": "74874a6a-d953-4266-b50c-a1ed31ba0569"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:57.896941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f0b57d03-a5ad-4fe8-845a-7fddd0387e72 req-ec42fc82-64d7-4ebe-8804-367d567901e8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.898980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bfac32de-6ce8-48ab-82e9-2c28d55078dc tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 200 len: 1303 microversion: 2.1 time: 0.916461 Sep 18 01:03:57.899761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f0b57d03-a5ad-4fe8-845a-7fddd0387e72 req-ec42fc82-64d7-4ebe-8804-367d567901e8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.900472 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 505/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:56 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 1303 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:57.901320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f0b57d03-a5ad-4fe8-845a-7fddd0387e72 req-ec42fc82-64d7-4ebe-8804-367d567901e8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.919854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-da1caede-9fb3-4c06-bd17-85eb6461edbd req-98337f09-4b8f-4a35-8458-3147c2a178b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a681c23f-ec48-43cb-be35-f479496bda0f", "name": "network-vif-deleted", "tag": "79af51af-eeba-4495-957f-0baadfa436a0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:57.925024 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f0b57d03-a5ad-4fe8-845a-7fddd0387e72 req-ec42fc82-64d7-4ebe-8804-367d567901e8 service nova] Creating event network-vif-deleted:74874a6a-d953-4266-b50c-a1ed31ba0569 for instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 on n-h1-master-1 Sep 18 01:03:57.932800 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f0b57d03-a5ad-4fe8-845a-7fddd0387e72 req-ec42fc82-64d7-4ebe-8804-367d567901e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068313 Sep 18 01:03:57.933883 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 522/1027] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:57.944030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:57.948777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:57.949458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-da1caede-9fb3-4c06-bd17-85eb6461edbd req-98337f09-4b8f-4a35-8458-3147c2a178b6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.950095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-da1caede-9fb3-4c06-bd17-85eb6461edbd req-98337f09-4b8f-4a35-8458-3147c2a178b6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.950540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-da1caede-9fb3-4c06-bd17-85eb6461edbd req-98337f09-4b8f-4a35-8458-3147c2a178b6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.959951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.961448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.962378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.963582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:57.964248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:57.964856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:57.972758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-da1caede-9fb3-4c06-bd17-85eb6461edbd req-98337f09-4b8f-4a35-8458-3147c2a178b6 service nova] Creating event network-vif-deleted:79af51af-eeba-4495-957f-0baadfa436a0 for instance a681c23f-ec48-43cb-be35-f479496bda0f on n-h1-master-1 Sep 18 01:03:57.972998 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:57.991687 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-da1caede-9fb3-4c06-bd17-85eb6461edbd req-98337f09-4b8f-4a35-8458-3147c2a178b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089066 Sep 18 01:03:57.992961 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 506/1028] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:58.003800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:58.005783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:58.017034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.017931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.018795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.020077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.020896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.022026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.387188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:58.407329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:58.410766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:58.413338 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6c3fb42d-192c-42ec-aa20-3258763c75b4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1320 microversion: 2.25 time: 0.417773 Sep 18 01:03:58.435313 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 507/1029] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:57 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:58.455939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:58.457249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:58.469157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.470185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.470894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.472133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.473162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.473999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.635952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:58.653674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee643b68-3865-4d2e-b381-6823fb1a2f52 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1543 microversion: 2.1 time: 0.717131 Sep 18 01:03:58.654656 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 523/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:57 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1543 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:58.664010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:58.665295 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:58.676346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.677740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.680709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.682247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.683396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.684321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.728051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:58.739449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.740084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.740374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.740840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lazy-loading 'fault' on Instance uuid a681c23f-ec48-43cb-be35-f479496bda0f {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:58.749799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-067ba785-9709-4dd5-8acb-272cfdc5754a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1282 microversion: 2.1 time: 0.311527 Sep 18 01:03:58.750895 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 508/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:58 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:58.775120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:58.789079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:58.807592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.821004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.822806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:58.826143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:58.830758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:58.831730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.057136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:59.083879 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a0b5b7c-4603-41d5-b2ba-45628fa861d4 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 200 len: 1315 microversion: 2.1 time: 0.426909 Sep 18 01:03:59.084743 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 524/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:58 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:59.093672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:59.095123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:59.111142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.112543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.113775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.115668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.117496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.118498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.154471 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:59.156234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 could not be found. Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 HTTP/1.1 Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:59.160154 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 could not be found. Sep 18 01:03:59.163110 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '84de09eb-4f7f-4e7a-b718-1db6db5f3dd2'} Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 could not be found. Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:59.165295 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 could not be found. Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 could not be found. Sep 18 01:03:59.167739 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.172949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance 84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:59.174859 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ced7dec2-6a1d-4fd3-82b5-7c1396ebde2f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2" status: 404 len: 111 microversion: 2.1 time: 0.087855 Sep 18 01:03:59.176180 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 525/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:59 2022] GET /compute/v2.1/servers/84de09eb-4f7f-4e7a-b718-1db6db5f3dd2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:59.188006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:59.189468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] [instance: 5ee7c69b-d3a1-479c-b99d-334a7e399821] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:59.204143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.205147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.206038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.207326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.208200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.208932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.234158 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] HTTP exception thrown: Instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 could not be found. Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Request method failure captured: Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 HTTP/1.1 Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5epi6e4dThfruo03qA69DPy6v0MADyfj1RHYc6316ihNXArOMi0f1sVh2m0yQy1iLfUpst-eJXzgXAT5Bx4oS0cAgOh4Gpn3h70b3AagkCV1HgVLSGxOfW_pjp8PdIPCI6p7JqHAJGAuJeAPKgIXftsAnEhF-s9E1X-0S4detp0VY Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ccc21635096f4fadb606d7bf5ab6f197 Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TenantUsagesTestJSON-1452320370 Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:03:59.237047 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ccc21635096f4fadb606d7bf5ab6f197"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ccc21635096f4fadb606d7bf5ab6f197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ccc21635096f4fadb606d7bf5ab6f197"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ccc21635096f4fadb606d7bf5ab6f197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TenantUsagesTestJSON-1452320370 Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ccc21635096f4fadb606d7bf5ab6f197 Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1452320370 Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TenantUsagesTestJSON-1452320370-project Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: dba1a4cbf6c04c2e803f47b0536c33a4 Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TenantUsagesTestJSON-1452320370-project Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 could not be found. Sep 18 01:03:59.240040 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5ee7c69b-d3a1-479c-b99d-334a7e399821'} Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 could not be found. Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:59.242309 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 could not be found. Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 could not be found. Sep 18 01:03:59.244952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:03:59.250725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] Returning 404 to user: Instance 5ee7c69b-d3a1-479c-b99d-334a7e399821 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:59.251887 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3eba90ba-4bdd-49ef-90e0-a951adfbc977 tempest-TenantUsagesTestJSON-1452320370 tempest-TenantUsagesTestJSON-1452320370-project] 10.222.0.25 "GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821" status: 404 len: 111 microversion: 2.1 time: 0.073578 Sep 18 01:03:59.253212 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 526/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:59 2022] GET /compute/v2.1/servers/5ee7c69b-d3a1-479c-b99d-334a7e399821 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:59.264105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:59.265366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:59.276784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.277874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.279019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.280547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.281659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.282967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.339121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:59.393108 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-37327a32-a808-4d60-bddc-14be5198d6be tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.640674 Sep 18 01:03:59.394740 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 509/1035] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:03:58 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-interface => generated 285 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:59.463885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:59.466183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:59.486608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.487511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.488719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.490448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.493469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.494221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.511087 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7ca7898a-5010-4e1a-b0c5-6afc1623db8c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 204 len: 0 microversion: 2.1 time: 0.255692 Sep 18 01:03:59.513307 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 527/1036] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:59 2022] DELETE /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:59.541422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:59.544922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:59.567249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.568090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.568834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.572533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.573338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.575514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.855307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:59.878534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:59.882480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:59.884319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3536be21-3ba5-44c2-a2c9-9fd296f34423 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1320 microversion: 2.25 time: 0.431857 Sep 18 01:03:59.908773 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 510/1037] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:59 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:59.923941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:59.924563 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:59.932625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.932959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.933680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:59.934728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:59.935365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:59.935951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:00.541425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:00.557095 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3443382-26e5-48ae-bdf9-6fdcb34e9995 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1472 microversion: 2.1 time: 1.037102 Sep 18 01:04:00.558103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 528/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:59 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1472 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:00.564611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:00.565798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:00.578082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:00.579347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:00.581316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:00.594844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:00.595968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:00.598418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:00.628599 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f HTTP/1.1 Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:00.634129 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:00.636679 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a681c23f-ec48-43cb-be35-f479496bda0f'} Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:00.637483 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:00.638864 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:00.642213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:00.643693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7189902f-c338-4811-ae0d-edbb36e9724e tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 404 len: 111 microversion: 2.1 time: 0.084099 Sep 18 01:04:00.644413 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 529/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:00 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:00.848346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-570331693", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:00.986348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] validate_networks() for [('ce7051d4-da13-4653-b912-b3eb0bcc70a0', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:04:01.016202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:01.068913 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69bdc1d8-051a-4f7d-b065-286410e4897d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 1.134443 Sep 18 01:04:01.072771 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 511/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:59 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:01.089892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:01.090786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:01.099164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:01.099659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:01.100099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:01.100848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:01.101518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:01.102146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:02.067553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:02.080898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:02.085473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:02.088755 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d9c0c9a-3f27-4116-8aa8-9ac6ce538025 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 1.013008 Sep 18 01:04:02.101962 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 512/1041] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:01 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:02.101962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:02.102608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:02.117350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:02.118404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:02.119336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:02.120665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:02.121605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:02.122751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:02.628966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:02.652964 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-44be0237-9181-4188-a625-9b8d119096b2 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 200 len: 1430 microversion: 2.1 time: 0.557868 Sep 18 01:04:02.672036 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 513/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:02 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 1430 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:02.689327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-901d86e2-645f-4e9f-b76f-e823adfb09bb req-5738f48c-780d-4a31-9cf8-3163a69a9843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76259e8b-809c-4d92-8e2e-5dd2c058a6eb", "tag": "6bd27624-3292-471e-9c69-4045a4a44529"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:02.707128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-901d86e2-645f-4e9f-b76f-e823adfb09bb req-5738f48c-780d-4a31-9cf8-3163a69a9843 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:02.708088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-901d86e2-645f-4e9f-b76f-e823adfb09bb req-5738f48c-780d-4a31-9cf8-3163a69a9843 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:02.708821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-901d86e2-645f-4e9f-b76f-e823adfb09bb req-5738f48c-780d-4a31-9cf8-3163a69a9843 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:02.725398 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-901d86e2-645f-4e9f-b76f-e823adfb09bb req-5738f48c-780d-4a31-9cf8-3163a69a9843 service nova] Creating event network-changed:6bd27624-3292-471e-9c69-4045a4a44529 for instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb on n-h2-master-1 Sep 18 01:04:02.734383 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-901d86e2-645f-4e9f-b76f-e823adfb09bb req-5738f48c-780d-4a31-9cf8-3163a69a9843 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060923 Sep 18 01:04:02.740806 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 514/1043] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:02.753395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:02.755757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:02.768326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:02.769049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:02.769858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:02.771030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:02.771815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:02.772702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.129166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:04.168082 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8067b7b7-8bae-41c3-b496-57686e4cb9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 1.421707 Sep 18 01:04:04.168667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 515/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:02 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:04.194995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:04.198981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:04.214937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.215707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.218180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.219723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.223818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.224835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.452570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:04:04.453837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:04:04.455102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:04:04.456109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:04:04.466351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:04:04.488160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.489473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.490595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.492339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.493269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.494120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.543128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for project c9ce34433498444b8058b1354aed0f78. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:04:04.553041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Getting quotas for user 62dbad162d74407a891f11c9e972ada0 and project c9ce34433498444b8058b1354aed0f78. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:04:04.578143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:04:04.582689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:04:04.679728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:04.700292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:04.703465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:04.705873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75fa66f2-7e88-484b-8fd6-9c53e0d00ab6 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.522257 Sep 18 01:04:04.707702 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 516/1045] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:04 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:04.712954 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-645f5fbd-b41e-4499-b168-3b8822aa5160 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.871497 Sep 18 01:04:04.717992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:04.719724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 3602d686-ef2d-4b39-b08f-673e0a1c5d0e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:04.726035 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 530/1046] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:04:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 3886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:04:04.734428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.735760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.737051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.738787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.740031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.741160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.751258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b251a64e-9acc-44a1-8ec5-cbc54aef2434 req-022b6f74-7af7-4e6c-a3a8-8e4ff03e255c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78083c60-a6b6-4e5a-9be6-3bca0baaa576", "tag": "a501be6c-7161-4f35-8a40-adf934fd7f00"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:04.770967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b251a64e-9acc-44a1-8ec5-cbc54aef2434 req-022b6f74-7af7-4e6c-a3a8-8e4ff03e255c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.771475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b251a64e-9acc-44a1-8ec5-cbc54aef2434 req-022b6f74-7af7-4e6c-a3a8-8e4ff03e255c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.771916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b251a64e-9acc-44a1-8ec5-cbc54aef2434 req-022b6f74-7af7-4e6c-a3a8-8e4ff03e255c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.786357 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b251a64e-9acc-44a1-8ec5-cbc54aef2434 req-022b6f74-7af7-4e6c-a3a8-8e4ff03e255c service nova] Creating event network-changed:a501be6c-7161-4f35-8a40-adf934fd7f00 for instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 on n-h1-master-1 Sep 18 01:04:04.792415 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b251a64e-9acc-44a1-8ec5-cbc54aef2434 req-022b6f74-7af7-4e6c-a3a8-8e4ff03e255c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064577 Sep 18 01:04:04.793316 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 531/1047] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:04.801229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa958e69-c1d3-4c4c-9c00-f1d0431a300a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:04.806019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa958e69-c1d3-4c4c-9c00-f1d0431a300a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:04.813092 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e could not be found. Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e HTTP/1.1 Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:04:04.814799 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e could not be found. Sep 18 01:04:04.816389 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3602d686-ef2d-4b39-b08f-673e0a1c5d0e'} Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e could not be found. Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:04.817247 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e could not be found. Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e could not be found. Sep 18 01:04:04.819130 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:04.821373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:04.821373 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2929e37-a039-4158-8ef4-03c4c2875921 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e" status: 404 len: 111 microversion: 2.1 time: 0.106725 Sep 18 01:04:04.821593 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:04.831526 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 517/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:04 2022] GET /compute/v2.1/servers/3602d686-ef2d-4b39-b08f-673e0a1c5d0e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:04.844933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-42f131e7-021a-4b32-a122-575dce3c7372 req-d68ce81d-0f67-446f-8800-a04425cd3a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3602d686-ef2d-4b39-b08f-673e0a1c5d0e", "name": "network-vif-deleted", "tag": "9c62e587-dd92-4793-b6cf-263e3a8f025f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:04.886149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-42f131e7-021a-4b32-a122-575dce3c7372 req-d68ce81d-0f67-446f-8800-a04425cd3a55 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.886629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-42f131e7-021a-4b32-a122-575dce3c7372 req-d68ce81d-0f67-446f-8800-a04425cd3a55 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.889495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-42f131e7-021a-4b32-a122-575dce3c7372 req-d68ce81d-0f67-446f-8800-a04425cd3a55 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.907409 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-42f131e7-021a-4b32-a122-575dce3c7372 req-d68ce81d-0f67-446f-8800-a04425cd3a55 service nova] Creating event network-vif-deleted:9c62e587-dd92-4793-b6cf-263e3a8f025f for instance 3602d686-ef2d-4b39-b08f-673e0a1c5d0e on n-h1-master-1 Sep 18 01:04:04.916917 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-42f131e7-021a-4b32-a122-575dce3c7372 req-d68ce81d-0f67-446f-8800-a04425cd3a55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085919 Sep 18 01:04:04.918295 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 518/1049] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:04.929609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:04.930525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:04.944735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.945536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.947061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:04.973590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:04.974307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:04.975240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.000460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa958e69-c1d3-4c4c-9c00-f1d0431a300a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:05.011043 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa958e69-c1d3-4c4c-9c00-f1d0431a300a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1224 microversion: 2.1 time: 0.216439 Sep 18 01:04:05.018739 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 532/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:04 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1224 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:05.066884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:04:05.197288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:05.198795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:05.215745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.218619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.220235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.235764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.240642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.246276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.280186 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3eec414e-ddde-490f-a3ba-45fb8d039d38 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0" status: 204 len: 0 microversion: 2.1 time: 0.360065 Sep 18 01:04:05.284914 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 519/1051] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:04 2022] DELETE /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:05.291783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:05.302519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:05.309962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.310703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.311382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.312438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.313382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.314077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.320240 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:05.353365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:04:05.649613 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47abc730-edbd-4492-90b8-c7aea7920b4e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 204 len: 0 microversion: 2.1 time: 0.357553 Sep 18 01:04:05.651142 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 520/1052] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:05 2022] DELETE /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:05.678231 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:05.680435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:05.690044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.691753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.692213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.693000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.693667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.694311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.715143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:05.725625 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65413a46-5fc0-4281-bc34-5902301d10b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.533060 Sep 18 01:04:05.739395 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 533/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:05 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:05.752336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:05.753042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:05.764131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.765150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.766513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:05.767690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:05.768393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:05.769077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:06.016474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:06.032678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:06.036663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:06.040162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-05aa55ec-49a4-4bc0-ace0-164d56d82dd5 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.292769 Sep 18 01:04:06.042314 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 534/1054] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:05 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:06.047031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:06.062443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f23514cc-cb4c-4234-a07e-657c59489eb5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:06.063128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f23514cc-cb4c-4234-a07e-657c59489eb5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:06.070424 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fa539d84-4595-44fa-9519-38dc48bb8872 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0" status: 200 len: 1474 microversion: 2.1 time: 0.412618 Sep 18 01:04:06.077925 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 521/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:05 2022] GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 => generated 1474 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:06.163252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f23514cc-cb4c-4234-a07e-657c59489eb5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:06.176670 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f23514cc-cb4c-4234-a07e-657c59489eb5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1224 microversion: 2.1 time: 0.127765 Sep 18 01:04:06.179170 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 535/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:06 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:06.757647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:06.758651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:06.775112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:06.776507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:06.778877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:06.780615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:06.781869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:06.782983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:06.839784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8f6001f2-067c-4880-a773-0427abe82dd4 req-93407bd3-932e-4220-9aca-a448a5e58acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ef5a3a-6c77-45a8-8d8a-0fa832b43783", "tag": "c513b274-e342-4ba5-9347-e8e7434250f7"}, {"name": "network-changed", "server_uuid": "f5ff9e6d-5612-447a-b317-dd1e6f1324b3", "tag": "b7e00281-7e7f-4aed-af4e-b7dd24f7147a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:06.869908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8f6001f2-067c-4880-a773-0427abe82dd4 req-93407bd3-932e-4220-9aca-a448a5e58acb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:06.871859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8f6001f2-067c-4880-a773-0427abe82dd4 req-93407bd3-932e-4220-9aca-a448a5e58acb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:06.874335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8f6001f2-067c-4880-a773-0427abe82dd4 req-93407bd3-932e-4220-9aca-a448a5e58acb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:06.901754 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8f6001f2-067c-4880-a773-0427abe82dd4 req-93407bd3-932e-4220-9aca-a448a5e58acb service nova] Creating event network-changed:c513b274-e342-4ba5-9347-e8e7434250f7 for instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 on n-h1-master-1 Sep 18 01:04:06.902952 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8f6001f2-067c-4880-a773-0427abe82dd4 req-93407bd3-932e-4220-9aca-a448a5e58acb service nova] Creating event network-changed:b7e00281-7e7f-4aed-af4e-b7dd24f7147a for instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 on n-h2-master-1 Sep 18 01:04:06.920510 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8f6001f2-067c-4880-a773-0427abe82dd4 req-93407bd3-932e-4220-9aca-a448a5e58acb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093430 Sep 18 01:04:06.922475 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 536/1057] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:07.073754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:07.074523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:07.083810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:07.084671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:07.086012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:07.086975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:07.087871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:07.088508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:07.555155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:07.572976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:07.592530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:07.594063 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-efb5dd32-aa60-4e76-aa2e-6088d7a5fa89 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.526664 Sep 18 01:04:07.594897 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 537/1058] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:07 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:07.613666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:07.617621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:07.621330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:07.634587 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4bd63d87-75c9-4fbd-b1b0-8529f59a982a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.885579 Sep 18 01:04:07.636508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:07.636508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:07.636508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:07.650878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:07.651411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 522/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:06 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:07.652067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:07.652996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:07.681405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:07.688012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:07.714628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:07.715521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:07.716293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:07.720413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:07.721377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:07.722286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:07.915913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:07.930835 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3c5f4b2a-80bd-4d1b-9af4-c6d24f3d529f tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0" status: 200 len: 1432 microversion: 2.1 time: 0.334276 Sep 18 01:04:07.935103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 538/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:07 2022] GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 => generated 1432 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:08.006103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:08.019492 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7af845a2-fc8d-44ee-bfb2-0d1c2cbe1e40 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1284 microversion: 2.1 time: 0.364657 Sep 18 01:04:08.021505 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 523/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:07 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1284 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:08.644488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:08.645362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:08.662515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0f6e1144-f860-4e66-ba4c-d06eee4a5539 req-5d9c78ee-f508-432e-aa99-258859b32535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2356100a-11ad-4f3b-8a64-96d04a0079d0", "name": "network-vif-deleted", "tag": "9e0ad0f5-7db1-4649-86a9-c4bc9368ef0f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:08.693514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:08.698211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:08.701809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:08.709066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:08.711828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:08.715053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:08.716386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f6e1144-f860-4e66-ba4c-d06eee4a5539 req-5d9c78ee-f508-432e-aa99-258859b32535 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:08.721326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f6e1144-f860-4e66-ba4c-d06eee4a5539 req-5d9c78ee-f508-432e-aa99-258859b32535 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:08.726349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f6e1144-f860-4e66-ba4c-d06eee4a5539 req-5d9c78ee-f508-432e-aa99-258859b32535 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:08.779843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0f6e1144-f860-4e66-ba4c-d06eee4a5539 req-5d9c78ee-f508-432e-aa99-258859b32535 service nova] Creating event network-vif-deleted:9e0ad0f5-7db1-4649-86a9-c4bc9368ef0f for instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 on n-h1-master-1 Sep 18 01:04:08.804700 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0f6e1144-f860-4e66-ba4c-d06eee4a5539 req-5d9c78ee-f508-432e-aa99-258859b32535 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146848 Sep 18 01:04:08.806191 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 524/1062] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:08.824295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:08.825662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:08.849996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:08.853637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:08.855950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:08.859121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:08.861745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:08.862977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:09.492978 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:09.520231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:09.526736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:09.530888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8ffb08a-f3b7-486b-a9ab-b6d3df6a7288 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.892091 Sep 18 01:04:09.532716 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 539/1063] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:08 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:09.583373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:09.587952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:09.607533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:09.609043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:09.609941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:09.611520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:09.612631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:09.613801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:09.646111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:09.685992 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6dbd3419-6e7e-4272-8f6a-ec473219acbd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.865707 Sep 18 01:04:09.686715 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 525/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:08 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:09.686884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:09.689881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:09.693027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:09.698052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lazy-loading 'fault' on Instance uuid 2356100a-11ad-4f3b-8a64-96d04a0079d0 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:09.704661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:09.707245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:09.731788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:09.738379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:09.739085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:09.740358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:09.740557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:09.745374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:10.412180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:10.437938 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26219416-f75a-4a93-aa14-4d78fdf522de tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0" status: 200 len: 1308 microversion: 2.1 time: 0.902884 Sep 18 01:04:10.453848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 540/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:09 2022] GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 => generated 1308 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:10.486167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-61a47793-72bd-41df-861e-407e8fc27fdb req-5a955e6e-d0e6-43f1-bd2b-96f1485bf496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6df15fb-1858-49de-81d5-60a7bdac3261", "name": "network-vif-unplugged", "status": "completed", "tag": "f6f6dadf-9e4d-492a-b773-c58fd6f6d91d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:10.515672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-61a47793-72bd-41df-861e-407e8fc27fdb req-5a955e6e-d0e6-43f1-bd2b-96f1485bf496 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:10.516479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-61a47793-72bd-41df-861e-407e8fc27fdb req-5a955e6e-d0e6-43f1-bd2b-96f1485bf496 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:10.530811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-61a47793-72bd-41df-861e-407e8fc27fdb req-5a955e6e-d0e6-43f1-bd2b-96f1485bf496 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:10.576710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-61a47793-72bd-41df-861e-407e8fc27fdb req-5a955e6e-d0e6-43f1-bd2b-96f1485bf496 service nova] Creating event network-vif-unplugged:f6f6dadf-9e4d-492a-b773-c58fd6f6d91d for instance d6df15fb-1858-49de-81d5-60a7bdac3261 on n-h2-master-1 Sep 18 01:04:10.588531 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-61a47793-72bd-41df-861e-407e8fc27fdb req-5a955e6e-d0e6-43f1-bd2b-96f1485bf496 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108785 Sep 18 01:04:10.589772 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 541/1066] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:04:10.596750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:10.597804 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:10.605050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:10.606321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:10.606917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:10.608061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:10.609297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:10.609897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:11.378884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:11.418061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c18fdc17-0483-4cd4-99e4-0653c0332117 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1324 microversion: 2.1 time: 1.715737 Sep 18 01:04:11.419160 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 526/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:09 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1324 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:11.424464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:11.425809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:11.446651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:11.447569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:11.448283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:11.449287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:11.450052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:11.450728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:11.857131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:11.892620 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:11.908067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:11.911770 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cef1e1e6-a513-41bb-a771-bc693385ee24 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 1.319490 Sep 18 01:04:11.913239 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 542/1068] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:10 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:11.925924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-211eb056-34dc-4b61-8473-50b47ae41ba6 req-add5f1c0-1371-4240-b88b-52e0bbe44023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c", "tag": "f54e385e-0205-4116-a210-0c5e9d05a388"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:11.964554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-211eb056-34dc-4b61-8473-50b47ae41ba6 req-add5f1c0-1371-4240-b88b-52e0bbe44023 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:11.965211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-211eb056-34dc-4b61-8473-50b47ae41ba6 req-add5f1c0-1371-4240-b88b-52e0bbe44023 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:11.965697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-211eb056-34dc-4b61-8473-50b47ae41ba6 req-add5f1c0-1371-4240-b88b-52e0bbe44023 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.000801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-211eb056-34dc-4b61-8473-50b47ae41ba6 req-add5f1c0-1371-4240-b88b-52e0bbe44023 service nova] Creating event network-changed:f54e385e-0205-4116-a210-0c5e9d05a388 for instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c on n-h1-master-1 Sep 18 01:04:12.014696 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-211eb056-34dc-4b61-8473-50b47ae41ba6 req-add5f1c0-1371-4240-b88b-52e0bbe44023 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099545 Sep 18 01:04:12.015350 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 543/1069] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:12.035652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:12.036870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 2356100a-11ad-4f3b-8a64-96d04a0079d0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:12.056745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.057474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.058771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.060082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.061028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.063040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.104170 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 could not be found. Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 HTTP/1.1 Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:12.120080 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 could not be found. Sep 18 01:04:12.122806 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2356100a-11ad-4f3b-8a64-96d04a0079d0'} Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 could not be found. Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:12.124375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 could not be found. Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 could not be found. Sep 18 01:04:12.126175 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:12.131366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance 2356100a-11ad-4f3b-8a64-96d04a0079d0 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:12.134716 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a094d2f1-b8b2-4f52-a875-ad9595017e7e tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0" status: 404 len: 111 microversion: 2.1 time: 0.114511 Sep 18 01:04:12.139110 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 544/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:12 2022] GET /compute/v2.1/servers/2356100a-11ad-4f3b-8a64-96d04a0079d0 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:12.155052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-29e089e2-8346-4c57-8ca0-8a168e84bb61 req-fe44adad-bad7-4fb0-961b-aff69bd93c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6df15fb-1858-49de-81d5-60a7bdac3261", "name": "network-vif-deleted", "tag": "f6f6dadf-9e4d-492a-b773-c58fd6f6d91d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:12.175613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-29e089e2-8346-4c57-8ca0-8a168e84bb61 req-fe44adad-bad7-4fb0-961b-aff69bd93c14 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.180668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-29e089e2-8346-4c57-8ca0-8a168e84bb61 req-fe44adad-bad7-4fb0-961b-aff69bd93c14 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.181942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-29e089e2-8346-4c57-8ca0-8a168e84bb61 req-fe44adad-bad7-4fb0-961b-aff69bd93c14 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.220036 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-29e089e2-8346-4c57-8ca0-8a168e84bb61 req-fe44adad-bad7-4fb0-961b-aff69bd93c14 service nova] Creating event network-vif-deleted:f6f6dadf-9e4d-492a-b773-c58fd6f6d91d for instance d6df15fb-1858-49de-81d5-60a7bdac3261 on n-h2-master-1 Sep 18 01:04:12.242769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-29e089e2-8346-4c57-8ca0-8a168e84bb61 req-fe44adad-bad7-4fb0-961b-aff69bd93c14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100237 Sep 18 01:04:12.249016 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 545/1071] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:12.270175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:12.271837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:12.289162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.292070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.295366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.299049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.301863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.305803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.324112 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:12.510774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.516055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.518095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.521447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lazy-loading 'fault' on Instance uuid d6df15fb-1858-49de-81d5-60a7bdac3261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:12.527286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:12.544038 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e4d9465-fb36-439a-a4cc-b0c5ba598a3f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 1.123386 Sep 18 01:04:12.554972 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 527/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:11 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:12.571007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:12.572505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:12.608945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.609476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.609948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.610829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.611369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.611811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.817032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:12.840743 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-39005de9-6eca-42c6-b546-f70dd1e56ab7 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 200 len: 1308 microversion: 2.1 time: 0.584553 Sep 18 01:04:12.843476 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 546/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:12 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:12.946200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:12.948436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:12.958189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.959244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.960337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:12.961761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:12.962540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:12.963404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:13.414721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:13.431850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7382124b-a62e-4d76-9ee1-4a6b8a15acd5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1324 microversion: 2.1 time: 0.874956 Sep 18 01:04:13.435542 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 528/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:12 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1324 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:13.501462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:13.547424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:13.551328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:13.553423 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-990796bc-7560-4222-b67e-0e40ea7e6b8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.613148 Sep 18 01:04:13.554999 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 547/1075] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:12 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:13.590626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:13.591258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:13.609721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:13.610221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:13.610659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:13.611494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:13.611958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:13.612435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:13.889319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:13.890213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: d6df15fb-1858-49de-81d5-60a7bdac3261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:13.906370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:13.915866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:13.916606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:13.917525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:13.918268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:13.918886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:13.960904 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance d6df15fb-1858-49de-81d5-60a7bdac3261 could not be found. Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 HTTP/1.1 Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:13.965028 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: exception: Instance d6df15fb-1858-49de-81d5-60a7bdac3261 could not be found. Sep 18 01:04:13.966938 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'd6df15fb-1858-49de-81d5-60a7bdac3261'} Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6df15fb-1858-49de-81d5-60a7bdac3261 could not be found. Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:13.968050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6df15fb-1858-49de-81d5-60a7bdac3261 could not be found. Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6df15fb-1858-49de-81d5-60a7bdac3261 could not be found. Sep 18 01:04:13.969584 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:13.972275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance d6df15fb-1858-49de-81d5-60a7bdac3261 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:13.973492 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e14f9e40-5c20-41a9-b12b-8359ac188bbc tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261" status: 404 len: 111 microversion: 2.1 time: 0.099580 Sep 18 01:04:13.975188 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 548/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:13 2022] GET /compute/v2.1/servers/d6df15fb-1858-49de-81d5-60a7bdac3261 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:14.003009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f83406e-3026-4f87-9d32-43d8bad6770d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:14.050508 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f83406e-3026-4f87-9d32-43d8bad6770d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/0ba66605-aa03-4eb2-a33f-9843a900efb9" status: 204 len: 0 microversion: 2.1 time: 0.070192 Sep 18 01:04:14.052860 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 549/1077] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:04:13 2022] DELETE /compute/v2.1/os-server-groups/0ba66605-aa03-4eb2-a33f-9843a900efb9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:14.065059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:14.066814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:14.072474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:14.079431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.087382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.088333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.089205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.089852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.090498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.097082 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-85c71bc9-4363-46dd-9afa-737d18a6fb9c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.524969 Sep 18 01:04:14.103608 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 529/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:13 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:14.125059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:04:14.248707 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-997ba4d6-fdcf-4bf4-9117-6dd34f882a28 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 204 len: 0 microversion: 2.1 time: 0.189794 Sep 18 01:04:14.252962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 550/1079] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:14 2022] DELETE /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:04:14.270950 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:14.275040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:14.295072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.296073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.300927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.302148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.314426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.315279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.370173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:04:14.467657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:14.471474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:14.491683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.496112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.496905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.499255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.501124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.502906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.528936 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:14.583576 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d689b0e3-9fae-477a-812e-316a0e259c49 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 204 len: 0 microversion: 2.1 time: 0.325733 Sep 18 01:04:14.584177 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 530/1080] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:14 2022] DELETE /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:14.595572 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:14.597249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:14.605000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.606097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.606737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.607778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.608452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.608883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.881288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:14.896947 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d107a1f-5df4-4fc6-8d36-b114e40f9439 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1324 microversion: 2.1 time: 0.441849 Sep 18 01:04:14.898036 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 551/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:14 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:14.903850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:14.905111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:14.917432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.918108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.919444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.919444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.920017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.920790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.948216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:14.958307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:14.960169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:14.961624 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8dc3c719-0f67-436d-ab93-e19239035268 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.371914 Sep 18 01:04:14.962388 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 531/1082] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:14 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:14.967586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2c445490-bd59-4332-9e08-fb7d957fbb1c req-87fae83b-3079-4f48-8a97-a564b6d6843d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76259e8b-809c-4d92-8e2e-5dd2c058a6eb", "name": "network-vif-plugged", "status": "completed", "tag": "6bd27624-3292-471e-9c69-4045a4a44529"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:14.978099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2c445490-bd59-4332-9e08-fb7d957fbb1c req-87fae83b-3079-4f48-8a97-a564b6d6843d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:14.978847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2c445490-bd59-4332-9e08-fb7d957fbb1c req-87fae83b-3079-4f48-8a97-a564b6d6843d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:14.979484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2c445490-bd59-4332-9e08-fb7d957fbb1c req-87fae83b-3079-4f48-8a97-a564b6d6843d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:14.992845 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2c445490-bd59-4332-9e08-fb7d957fbb1c req-87fae83b-3079-4f48-8a97-a564b6d6843d service nova] Creating event network-vif-plugged:6bd27624-3292-471e-9c69-4045a4a44529 for instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb on n-h2-master-1 Sep 18 01:04:15.005158 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2c445490-bd59-4332-9e08-fb7d957fbb1c req-87fae83b-3079-4f48-8a97-a564b6d6843d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040653 Sep 18 01:04:15.009299 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 532/1083] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:15.132129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:15.132935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:15.142279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:15.143434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:15.143658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:15.144368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:15.144837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:15.145433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:15.190479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:15.207252 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-403a0a33-6127-4a50-a48e-9ed753362133 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1475 microversion: 2.1 time: 0.308157 Sep 18 01:04:15.221155 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 552/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:14 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1475 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:15.484710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:15.503836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-870494e9-f27c-4eb3-87ca-b53453445f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.377813 Sep 18 01:04:15.511863 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 533/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:15 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:15.936665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:15.938692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:15.957369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:15.957369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:15.957874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:15.959698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:15.967634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:15.968312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:16.014155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:16.015831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:16.047464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:16.048593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:16.049413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:16.050681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:16.051515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:16.052337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:16.171962 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=20 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:16.348527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:16.372141 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65bf69da-1acf-44db-92e4-d87908aa1887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1324 microversion: 2.1 time: 0.441873 Sep 18 01:04:16.399636 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 553/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:15 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:16.415345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:16.416354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:16.429402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:16.430321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:16.430486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:16.430941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:16.431676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:16.432225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:16.433219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:16.437221 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:16.449020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:16.452305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:16.454897 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-af6b8f39-efee-436d-9e3c-b03895146566 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.452515 Sep 18 01:04:16.457172 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 534/1087] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:15 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:16.560986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:16.562048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:16.578619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:16.581031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:16.581812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:16.582786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:16.583449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:16.586043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:16.719896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:16.734217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93b998e3-fcbb-4847-9f82-48b4cea44e69 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1475 microversion: 2.1 time: 0.330035 Sep 18 01:04:16.749354 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 554/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:16 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1475 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:16.812925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:16.824731 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4a81fbd-012f-4558-b053-74936fcc1937 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.270490 Sep 18 01:04:16.825979 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 535/1089] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:16 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:17.030691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4d382948-594f-4411-a87f-57fc8068338c req-29d46d8b-8ee4-4572-94e8-3e0cc0c2b0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ef5a3a-6c77-45a8-8d8a-0fa832b43783", "name": "network-vif-plugged", "status": "completed", "tag": "c513b274-e342-4ba5-9347-e8e7434250f7"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:17.058710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4d382948-594f-4411-a87f-57fc8068338c req-29d46d8b-8ee4-4572-94e8-3e0cc0c2b0d7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:17.060759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4d382948-594f-4411-a87f-57fc8068338c req-29d46d8b-8ee4-4572-94e8-3e0cc0c2b0d7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:17.061426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4d382948-594f-4411-a87f-57fc8068338c req-29d46d8b-8ee4-4572-94e8-3e0cc0c2b0d7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:17.078679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4d382948-594f-4411-a87f-57fc8068338c req-29d46d8b-8ee4-4572-94e8-3e0cc0c2b0d7 service nova] Creating event network-vif-plugged:c513b274-e342-4ba5-9347-e8e7434250f7 for instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 on n-h1-master-1 Sep 18 01:04:17.090184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4d382948-594f-4411-a87f-57fc8068338c req-29d46d8b-8ee4-4572-94e8-3e0cc0c2b0d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068060 Sep 18 01:04:17.091600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 555/1090] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:17.417152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:17.417830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:17.432117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:17.432609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:17.433045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:17.433801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:17.434253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:17.434673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:17.497112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:17.498963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:17.512462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:17.512969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:17.513735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:17.514356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:17.514809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:17.516013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:17.735291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:17.747087 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a29c476c-34a4-4709-96ce-b8795c1803c9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1324 microversion: 2.1 time: 0.337898 Sep 18 01:04:17.750190 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 536/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:17 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:17.779206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:17.781274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:17.798230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:17.801704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:17.818209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:17.820433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:17.833735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:17.839776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:17.910635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:17.957175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:17.965070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:17.971693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-44322b99-fc00-4307-9f8e-f0767f64799e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1362 microversion: 2.25 time: 0.487191 Sep 18 01:04:17.992993 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 556/1092] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:17 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:17.999037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:18.000123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:18.014758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:18.015759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:18.016628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:18.017771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:18.018408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:18.018998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:18.236646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:18.255980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-062a7b23-c6d4-46da-a823-d353a5893270 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1475 microversion: 2.1 time: 0.485822 Sep 18 01:04:18.258459 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 537/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:17 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1475 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:18.353415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:18.366003 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3b4a398-aae3-40f4-81ae-e06bc619e563 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.371099 Sep 18 01:04:18.368355 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 557/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:17 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:18.509307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1852355192", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b3f04822-05c6-4706-9c26-72bee19a7c93"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:18.613731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] validate_networks() for [('b3f04822-05c6-4706-9c26-72bee19a7c93', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:04:18.791671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:18.792674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:18.805846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:18.806766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:18.807293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:18.808218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:18.808760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:18.809466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.075934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:19.088283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-100d65c6-2f01-4ccc-8934-0ec60efa704a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1324 microversion: 2.1 time: 0.302267 Sep 18 01:04:19.089328 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 558/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:18 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:19.095913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:19.096535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:19.104002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.104386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.105125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.106152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.106959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.107549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.520174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:04:19.520996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:04:19.521149 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:04:19.521439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:04:19.522398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:04:19.546938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.548732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.549603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.551008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.551584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.552251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.576919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Getting quotas for project fce0cec677134476aa0da53e6813c602. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:04:19.583482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Getting quotas for user c3817ebe53a344c3ba3b6b56c726cc57 and project fce0cec677134476aa0da53e6813c602. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:04:19.601158 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:19.604421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:04:19.607935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:04:19.644444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:19.664052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:19.666586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:19.669509 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1c295cb-2a0a-4bb7-b09c-06de3ae71da0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1558 microversion: 2.25 time: 0.577445 Sep 18 01:04:19.671494 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 559/1096] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:19 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1558 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:19.681097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c2372cea-f928-43d1-a5eb-d45e56649958 req-116c3275-5c11-438d-99cc-3e46270608c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c", "name": "network-vif-plugged", "status": "completed", "tag": "f54e385e-0205-4116-a210-0c5e9d05a388"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:19.684125 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03f5d3bf-4a07-4920-8f79-67aa2340f5eb tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368261 Sep 18 01:04:19.695261 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 538/1097] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:04:19.707092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c2372cea-f928-43d1-a5eb-d45e56649958 req-116c3275-5c11-438d-99cc-3e46270608c6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.707636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c2372cea-f928-43d1-a5eb-d45e56649958 req-116c3275-5c11-438d-99cc-3e46270608c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.708087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c2372cea-f928-43d1-a5eb-d45e56649958 req-116c3275-5c11-438d-99cc-3e46270608c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.711678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:19.713367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:19.722119 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c2372cea-f928-43d1-a5eb-d45e56649958 req-116c3275-5c11-438d-99cc-3e46270608c6 service nova] Creating event network-vif-plugged:f54e385e-0205-4116-a210-0c5e9d05a388 for instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c on n-h1-master-1 Sep 18 01:04:19.729982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.730740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.731480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.732534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.733286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.733994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.743041 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c2372cea-f928-43d1-a5eb-d45e56649958 req-116c3275-5c11-438d-99cc-3e46270608c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069615 Sep 18 01:04:19.743994 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 560/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:19.749224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:19.754586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:19.762883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.763394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.763738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.764431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.764883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.765405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:20.221154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:20.247741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5af9490-aa62-4f0a-b450-c1a17f90cf7d tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1475 microversion: 2.1 time: 0.550073 Sep 18 01:04:20.249787 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 539/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:19 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1475 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:20.292044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5fd2178c-461c-4a16-8597-0f880decf020 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:20.293310 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5fd2178c-461c-4a16-8597-0f880decf020 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:20.314712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:20.344580 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c39309a-2d7b-4377-a83c-41bf87effd0d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1312 microversion: 2.1 time: 0.598925 Sep 18 01:04:20.356695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 561/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:19 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1312 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:20.374938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:20.386802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:20.408148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:20.410685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:20.415152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:20.422654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:20.423751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:20.424644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:20.526833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5fd2178c-461c-4a16-8597-0f880decf020 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:20.549045 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5fd2178c-461c-4a16-8597-0f880decf020 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1224 microversion: 2.1 time: 0.293547 Sep 18 01:04:20.550899 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 540/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:20 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1224 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:20.559754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:20.561174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:20.574342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:20.575475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:20.576515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:20.578107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:20.579481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:20.580478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:20.973612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:21.026941 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-564b960b-5d78-4321-9e49-b95d96e976b6 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 2051 microversion: 2.25 time: 0.666042 Sep 18 01:04:21.029163 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 562/1102] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:20 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 2051 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:21.031070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:21.047404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-2a8c23d6-2128-4447-98e0-d71fc194f95a req-e617c6e2-77db-4350-9bc1-720861e59d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb91f594-076a-4e8a-8fc7-64374e6a940c", "name": "network-vif-deleted", "tag": "9fbacf54-4217-4dc3-9491-f2614a46bca3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:21.053477 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5f6f8b9-b510-4539-b630-0e00c4481397 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1324 microversion: 2.1 time: 0.500742 Sep 18 01:04:21.064388 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 541/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:20 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:21.064388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:21.064388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:21.085929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.089988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.091200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.092747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2a8c23d6-2128-4447-98e0-d71fc194f95a req-e617c6e2-77db-4350-9bc1-720861e59d00 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.093793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.094601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.094791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2a8c23d6-2128-4447-98e0-d71fc194f95a req-e617c6e2-77db-4350-9bc1-720861e59d00 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.095216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.096278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2a8c23d6-2128-4447-98e0-d71fc194f95a req-e617c6e2-77db-4350-9bc1-720861e59d00 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.117417 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-2a8c23d6-2128-4447-98e0-d71fc194f95a req-e617c6e2-77db-4350-9bc1-720861e59d00 service nova] Creating event network-vif-deleted:9fbacf54-4217-4dc3-9491-f2614a46bca3 for instance eb91f594-076a-4e8a-8fc7-64374e6a940c on n-h2-master-1 Sep 18 01:04:21.126800 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-2a8c23d6-2128-4447-98e0-d71fc194f95a req-e617c6e2-77db-4350-9bc1-720861e59d00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094969 Sep 18 01:04:21.128168 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 563/1104] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:21.285396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:21.288043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:21.320739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.324979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.326147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.329462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.337472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.338760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.352049 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:21.447050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:21.480475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.481181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.481602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.482364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lazy-loading 'fault' on Instance uuid fc220ad8-f059-4a53-86a5-ee792b74597f {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:21.512802 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aeeac548-719e-46e3-926e-875aa5ec0f11 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 2051 microversion: 2.25 time: 0.455094 Sep 18 01:04:21.516590 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 542/1105] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:21 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 2051 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:21.525380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:21.531946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:21.543868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.544819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.545423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.546401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.547042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.547626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.573344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:21.589943 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f63eff08-d77b-409c-b2f4-63c2b2f0f67c tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1309 microversion: 2.1 time: 0.313802 Sep 18 01:04:21.591980 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 564/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:21 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:21.599609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:21.612208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.612847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.613471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.624041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.624872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.625536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.694359 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c221bb4-5cdb-4c35-9ccc-3b8d0d39a685 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.095318 Sep 18 01:04:21.705852 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 565/1107] 10.222.0.25 () {60 vars in 1217 bytes} [Sun Sep 18 01:04:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:04:21.712524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:21.713978 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:21.721173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.721906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.722350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.723060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.723505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.724113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.805329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:21.819295 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d30e6c8d-74d0-4a54-b63f-948d5084fd4e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1461 microversion: 2.1 time: 0.300321 Sep 18 01:04:21.833246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 543/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:21 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1461 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:21.844489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:21.844712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:21.845292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:21.856429 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e15e858-7614-4292-9f5a-f24aa0925767 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1276 microversion: 2.1 time: 0.147897 Sep 18 01:04:21.857307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.857988 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 566/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:21 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:21.867948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.892078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:21.893090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:21.894981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:21.895615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.038436 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7bf27bcb-fcec-448d-90d9-9c4c08621b9b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783/action" status: 202 len: 0 microversion: 2.25 time: 0.200641 Sep 18 01:04:22.050810 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 544/1110] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:04:21 2022] POST /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:22.071742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:22.072861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:22.080970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.082027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.082700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.083904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.085081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.085784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.122738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:22.125823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:22.142320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.143160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.143967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.145352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.146905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.148689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.430733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:22.469591 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4844025f-c05a-47c3-8179-5b1142010a84 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 2056 microversion: 2.25 time: 0.406957 Sep 18 01:04:22.471143 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 545/1111] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:22 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 2056 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:22.478731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:22.479754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:22.500513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.502088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.504066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.506837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.508237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.509479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.228201 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e97ed8d-e9b0-420f-ae54-2f63fdb83939 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1612 microversion: 2.1 time: 1.368288 Sep 18 01:04:23.232636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:23.233662 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 567/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:21 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1612 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:23.243701 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b388b00-8f63-4ae0-b9a1-57522e49c55f tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1522 microversion: 2.1 time: 0.769934 Sep 18 01:04:23.245128 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 546/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:22 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:23.250815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:23.251054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:23.251912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:23.252167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:23.260553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.261295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.261915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.262760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.263345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.263901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.272084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.272500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.273045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.273974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.283637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.284203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.363506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:23.368271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.369972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.371077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.372101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lazy-loading 'fault' on Instance uuid fc220ad8-f059-4a53-86a5-ee792b74597f {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:23.378963 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b258e5a0-0adc-495c-b867-cee198f768b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1282 microversion: 2.1 time: 0.132377 Sep 18 01:04:23.393614 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 547/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:23 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1282 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:23.393614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-09d9ebee-d8b3-4ff6-b414-c8a1a53895a7 req-71bd5ac9-7964-4a95-aee5-d378cab138bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc220ad8-f059-4a53-86a5-ee792b74597f", "name": "network-vif-deleted", "tag": "3df39045-3c0b-4322-8a83-12731bd21bc2"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:23.396835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-09d9ebee-d8b3-4ff6-b414-c8a1a53895a7 req-71bd5ac9-7964-4a95-aee5-d378cab138bb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.397314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-09d9ebee-d8b3-4ff6-b414-c8a1a53895a7 req-71bd5ac9-7964-4a95-aee5-d378cab138bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.406398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-09d9ebee-d8b3-4ff6-b414-c8a1a53895a7 req-71bd5ac9-7964-4a95-aee5-d378cab138bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.412093 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-09d9ebee-d8b3-4ff6-b414-c8a1a53895a7 req-71bd5ac9-7964-4a95-aee5-d378cab138bb service nova] Creating event network-vif-deleted:3df39045-3c0b-4322-8a83-12731bd21bc2 for instance fc220ad8-f059-4a53-86a5-ee792b74597f on n-h2-master-1 Sep 18 01:04:23.431813 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-09d9ebee-d8b3-4ff6-b414-c8a1a53895a7 req-71bd5ac9-7964-4a95-aee5-d378cab138bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050210 Sep 18 01:04:23.432846 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 548/1115] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:23.440346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:23.441197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:23.449545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.450566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.451289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.452391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.453149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.454277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.469385 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:23.480879 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5eaef35b-62b9-4137-af50-d664d7e17618 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 200 len: 1309 microversion: 2.1 time: 0.244751 Sep 18 01:04:23.481813 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 568/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:23 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:23.488567 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:23.494959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:23.511809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.512578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.513308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.514313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.520087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.521104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.610347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:04:23.747525 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:23.784647 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-beefc865-82c2-45eb-9d72-39ba4c9c35d8 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 204 len: 0 microversion: 2.1 time: 0.300441 Sep 18 01:04:23.788298 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 569/1117] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:23 2022] DELETE /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:23.800018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:23.800839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:23.808362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.809265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.809864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.810437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.810917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.811346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.826570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7440ddf0e81c427e891af0ff670ce460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445992bf3ef04a8e989aff66eba42917', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:23.827595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] flavor_id is None. Assuming migration. {{(pid=122373) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 18 01:04:23.828602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122373) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:04:24.058495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:24.081406 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ea58a8cc-4cae-4df6-a111-76e67875d0f8 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 2036 microversion: 2.25 time: 0.289137 Sep 18 01:04:24.082879 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 570/1118] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:23 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 2036 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:24.089872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:24.096918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:24.125605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.126541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.127355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.128705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.129736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.130559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.221439 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72ae56c4-ddc7-4ef0-a1c9-67bfec321d0d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb/action" status: 202 len: 0 microversion: 2.1 time: 0.786473 Sep 18 01:04:24.222689 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 549/1119] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:04:23 2022] POST /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:04:24.228608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:24.231557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:24.243295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.244030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.244200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.244923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.245392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.245846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.274709 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:24.283919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'flavor' on Instance uuid 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:24.315312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Going to try to live migrate instance to n-h2-master-1 {{(pid=122373) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:04:24.437963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:24.453287 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46494993-e277-4f78-9153-73f72a6bc136 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1528 microversion: 2.1 time: 0.368892 Sep 18 01:04:24.454174 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 571/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:24 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1528 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:24.478607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:24.480900 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:24.494152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.495650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.496911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.498335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.498889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.499703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.727301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:24.743905 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d9a44678-0be0-4ec2-b6c8-dcd2bf9cc3e0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1470 microversion: 2.1 time: 0.287852 Sep 18 01:04:24.745374 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 572/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:24 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:24.754186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:24.755503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:24.763980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.764776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.765238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.765955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.766652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.767290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.023465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:25.042694 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61aa6435-f0d3-4fa2-9da7-538ec3f31658 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.293373 Sep 18 01:04:25.048436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 573/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:24 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:25.068035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:25.069416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: fc220ad8-f059-4a53-86a5-ee792b74597f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:25.077789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.078287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.078787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.079613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.080215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.080704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.118061 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance fc220ad8-f059-4a53-86a5-ee792b74597f could not be found. Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f HTTP/1.1 Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:25.123440 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: exception: Instance fc220ad8-f059-4a53-86a5-ee792b74597f could not be found. Sep 18 01:04:25.126776 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'fc220ad8-f059-4a53-86a5-ee792b74597f'} Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc220ad8-f059-4a53-86a5-ee792b74597f could not be found. Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:25.128651 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc220ad8-f059-4a53-86a5-ee792b74597f could not be found. Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc220ad8-f059-4a53-86a5-ee792b74597f could not be found. Sep 18 01:04:25.133510 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.137305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance fc220ad8-f059-4a53-86a5-ee792b74597f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:25.137305 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88b89f9c-2e88-45a3-acfc-79af296e4676 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f" status: 404 len: 111 microversion: 2.1 time: 0.080669 Sep 18 01:04:25.137305 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 574/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:25 2022] GET /compute/v2.1/servers/fc220ad8-f059-4a53-86a5-ee792b74597f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:25.144573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:25.145245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: eb91f594-076a-4e8a-8fc7-64374e6a940c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:25.157782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.158511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.158952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.160941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.161567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.162015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.187358 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance eb91f594-076a-4e8a-8fc7-64374e6a940c could not be found. Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c HTTP/1.1 Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:25.189503 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: exception: Instance eb91f594-076a-4e8a-8fc7-64374e6a940c could not be found. Sep 18 01:04:25.191040 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'eb91f594-076a-4e8a-8fc7-64374e6a940c'} Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb91f594-076a-4e8a-8fc7-64374e6a940c could not be found. Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:25.191810 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb91f594-076a-4e8a-8fc7-64374e6a940c could not be found. Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb91f594-076a-4e8a-8fc7-64374e6a940c could not be found. Sep 18 01:04:25.196259 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:25.199980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance eb91f594-076a-4e8a-8fc7-64374e6a940c could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:25.199980 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8bd8f240-3b4a-4db6-b527-92ecbff3ad61 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c" status: 404 len: 111 microversion: 2.1 time: 0.054322 Sep 18 01:04:25.203243 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 575/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:25 2022] GET /compute/v2.1/servers/eb91f594-076a-4e8a-8fc7-64374e6a940c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:25.217259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-882822df-b275-4ef6-a775-1d3027cff8ca tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:25.354982 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-882822df-b275-4ef6-a775-1d3027cff8ca tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/084bc720-50cf-480b-8f0d-59acb60d5aa9" status: 204 len: 0 microversion: 2.1 time: 0.150823 Sep 18 01:04:25.356477 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 576/1125] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:04:25 2022] DELETE /compute/v2.1/os-server-groups/084bc720-50cf-480b-8f0d-59acb60d5aa9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:25.369354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:25.374671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:25.396630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.400522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.403497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.419212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.422575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.425664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.531036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:04:25.867324 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3edafa65-2950-4b3f-864a-ec62c580e2dd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 204 len: 0 microversion: 2.1 time: 0.505015 Sep 18 01:04:25.872899 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 577/1126] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:25 2022] DELETE /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:04:25.887629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:25.889501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:25.911810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.913144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.916056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.918842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.919844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.921240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:26.372602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:26.387516 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-759083cb-d5da-4324-849c-95e7d33587fd tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1528 microversion: 2.1 time: 0.511651 Sep 18 01:04:26.401588 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 578/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:25 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1528 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:26.401588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:26.401588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:26.404788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:26.405710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:26.406415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:26.407305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:26.407931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:26.408551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:26.428699 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:26.835586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:26.846083 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0e00faf7-6dcf-4164-b60f-f3db8d5a9f0f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1470 microversion: 2.1 time: 0.456148 Sep 18 01:04:26.847037 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 579/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:26 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:26.853431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:26.854552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:26.895077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:26.896994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:26.897787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:26.901230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:26.902207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:26.905003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.116582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:27.136015 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a293b38f-fe53-45ec-958b-da0822baa076 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1472 microversion: 2.1 time: 0.285703 Sep 18 01:04:27.156659 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 580/1129] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:26 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:27.162622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:27.164029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:27.174843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.175426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.175919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.176871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.177383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.177934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.412047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:27.420772 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07475f5e-e205-4f37-9902-5f679583c64c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.262722 Sep 18 01:04:27.421354 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 581/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:27 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:27.426657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-361a1ccd-4935-4abf-b6a6-3b299f471e23 req-d3ce52b1-0099-4b60-b0c3-3b64b1794327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c", "name": "network-vif-deleted", "tag": "f54e385e-0205-4116-a210-0c5e9d05a388"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:27.437515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-361a1ccd-4935-4abf-b6a6-3b299f471e23 req-d3ce52b1-0099-4b60-b0c3-3b64b1794327 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.438078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-361a1ccd-4935-4abf-b6a6-3b299f471e23 req-d3ce52b1-0099-4b60-b0c3-3b64b1794327 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.438695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-361a1ccd-4935-4abf-b6a6-3b299f471e23 req-d3ce52b1-0099-4b60-b0c3-3b64b1794327 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.452429 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-361a1ccd-4935-4abf-b6a6-3b299f471e23 req-d3ce52b1-0099-4b60-b0c3-3b64b1794327 service nova] Creating event network-vif-deleted:f54e385e-0205-4116-a210-0c5e9d05a388 for instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c on n-h1-master-1 Sep 18 01:04:27.457964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-361a1ccd-4935-4abf-b6a6-3b299f471e23 req-d3ce52b1-0099-4b60-b0c3-3b64b1794327 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Sep 18 01:04:27.458839 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 582/1131] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:27.465519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-030b712a-55bc-4a9a-b1f5-2700cbf70108 req-2ffa1535-bd63-4683-926f-4510a9b02576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b76040-84b4-4c7e-a381-5cb762d7c75c", "tag": "94467f9b-0d92-4d5c-9827-c574a8f20650"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:27.478296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-030b712a-55bc-4a9a-b1f5-2700cbf70108 req-2ffa1535-bd63-4683-926f-4510a9b02576 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.479024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-030b712a-55bc-4a9a-b1f5-2700cbf70108 req-2ffa1535-bd63-4683-926f-4510a9b02576 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.479555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-030b712a-55bc-4a9a-b1f5-2700cbf70108 req-2ffa1535-bd63-4683-926f-4510a9b02576 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.493909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-030b712a-55bc-4a9a-b1f5-2700cbf70108 req-2ffa1535-bd63-4683-926f-4510a9b02576 service nova] Creating event network-changed:94467f9b-0d92-4d5c-9827-c574a8f20650 for instance 00b76040-84b4-4c7e-a381-5cb762d7c75c on n-h1-master-1 Sep 18 01:04:27.501136 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-030b712a-55bc-4a9a-b1f5-2700cbf70108 req-2ffa1535-bd63-4683-926f-4510a9b02576 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040006 Sep 18 01:04:27.502668 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 583/1132] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:27.513803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:27.515100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:27.526034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.526897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.527941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.529222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.530094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.530870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.583905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.584733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.585354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.586424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lazy-loading 'fault' on Instance uuid 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:27.596993 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30ddcf03-89d5-426e-999d-acdb313d50fb tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783/action" status: 202 len: 0 microversion: 2.25 time: 3.372873 Sep 18 01:04:27.598052 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 550/1133] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:04:24 2022] POST /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783/action => generated 0 bytes in 3375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:27.610852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:27.611568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:27.621406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.621912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.622337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.623262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.623943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.624370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.657347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:27.667554 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b5fb812f-cc93-4cba-92b6-cef148d611d3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1314 microversion: 2.1 time: 0.162789 Sep 18 01:04:27.668367 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 584/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:27 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:27.878156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:27.882999 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:27.884735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:27.899665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:27.903826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.904696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.905452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.906733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:27.907552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:27.908325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:27.913580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:27.916501 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d84a45f4-ce83-46a6-a0a2-1d7c0ea0714b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.310600 Sep 18 01:04:27.920245 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 551/1135] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:27 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:28.165813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:28.166626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:28.178297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.178928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.179604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.180888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.181497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.182160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.188337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:28.201853 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f12660a0-31fb-4c1a-9799-3a35a0768665 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1470 microversion: 2.1 time: 0.322843 Sep 18 01:04:28.202682 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 585/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:27 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:28.462686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:28.463991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:28.476155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.476827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.477468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.478693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.479302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.479920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.591200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:28.601609 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64162903-565d-4a3a-a408-0c6d86c8d1da tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1472 microversion: 2.1 time: 0.441184 Sep 18 01:04:28.603122 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 552/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:28 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1472 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:28.708259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:28.710142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:28.721481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.722723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.723462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.724654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.725586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.726361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.780106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.780846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.781514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.782236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lazy-loading 'fault' on Instance uuid 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:28.882000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62dbad162d74407a891f11c9e972ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ce34433498444b8058b1354aed0f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:28.897530 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cdb2c897-b129-4282-830e-a55f4f58068a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 200 len: 1314 microversion: 2.1 time: 0.194911 Sep 18 01:04:28.898593 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 553/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:28 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:28.918414 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:28.928486 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48ac0640-1631-4853-bcdb-85831ddd86cc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.472579 Sep 18 01:04:28.929368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 586/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:28 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:28.958788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:28.960164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:28.971756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.972849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.973815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.975276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.976255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.977209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.230255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:29.230900 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:29.249909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.250645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.251490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.252706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.253587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.254401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.270115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:29.290392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:29.298431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:29.302222 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c583eaa0-8aed-48f5-9bdd-0c518992e6eb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.348829 Sep 18 01:04:29.305459 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 554/1140] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:28 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:29.637593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:29.656515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:29.665061 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36adf10a-a281-471c-a0d8-81ef9b3235e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1470 microversion: 2.1 time: 0.433943 Sep 18 01:04:29.667463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:29.670021 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 587/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:29 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:29.684547 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:29.688075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.688895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.689722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.690927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.691705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.692653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.696972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bec56f65-b3da-447c-b4ad-6f8993e3c64b req-4b25a690-980c-4796-9fd2-dd2da056e578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d48a9cd-b662-4a76-a839-5174b05a84ad", "name": "network-vif-deleted", "tag": "70d92a14-d071-4798-8f7e-6d813868a5bc"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:29.719542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bec56f65-b3da-447c-b4ad-6f8993e3c64b req-4b25a690-980c-4796-9fd2-dd2da056e578 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.720619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bec56f65-b3da-447c-b4ad-6f8993e3c64b req-4b25a690-980c-4796-9fd2-dd2da056e578 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.721642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bec56f65-b3da-447c-b4ad-6f8993e3c64b req-4b25a690-980c-4796-9fd2-dd2da056e578 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.744627 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bec56f65-b3da-447c-b4ad-6f8993e3c64b req-4b25a690-980c-4796-9fd2-dd2da056e578 service nova] Creating event network-vif-deleted:70d92a14-d071-4798-8f7e-6d813868a5bc for instance 6d48a9cd-b662-4a76-a839-5174b05a84ad on n-h2-master-1 Sep 18 01:04:29.756094 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bec56f65-b3da-447c-b4ad-6f8993e3c64b req-4b25a690-980c-4796-9fd2-dd2da056e578 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065583 Sep 18 01:04:29.756984 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 588/1142] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:29.819652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:29.838413 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52b2618a-69cd-4352-a83e-0b0986e96cc1 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1430 microversion: 2.1 time: 0.194056 Sep 18 01:04:29.839029 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 555/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:29 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1430 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:29.929918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:29.938027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:29.950155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.951133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.951884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.953089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.953956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.955348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.962322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:29.962966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:29.970499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.971140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.971581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.972322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.972957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.973383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.990891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c could not be found. Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c HTTP/1.1 Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:29.996451 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c could not be found. Sep 18 01:04:29.999879 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c'} Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c could not be found. Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:30.001227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c could not be found. Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c could not be found. Sep 18 01:04:30.003052 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.007696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Instance 56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:30.009142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-94a266ee-ef9c-49fc-87f0-e0fd86027f38 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c" status: 404 len: 111 microversion: 2.1 time: 0.090026 Sep 18 01:04:30.010895 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 589/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:29 2022] GET /compute/v2.1/servers/56d5f9c5-3eac-4a60-9f14-07f0e0e2d57c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:30.031916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32a8ae0a-2549-43d9-9626-2bd680b550c5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '.version_select at 0x7f70063dec10>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.087050 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-32a8ae0a-2549-43d9-9626-2bd680b550c5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Image not found. Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32a8ae0a-2549-43d9-9626-2bd680b550c5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972 HTTP/1.1 Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:30.090741 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: exception: Image not found. Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '76097b8a-86df-4ff4-a17a-017d641a4972'} Sep 18 01:04:30.092307 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 76097b8a-86df-4ff4-a17a-017d641a4972 to delete Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.093281 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76097b8a-86df-4ff4-a17a-017d641a4972 could not be found. Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:30.095010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32a8ae0a-2549-43d9-9626-2bd680b550c5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Image not found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:30.098458 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-32a8ae0a-2549-43d9-9626-2bd680b550c5 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972" status: 404 len: 62 microversion: 2.1 time: 0.068536 Sep 18 01:04:30.101970 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 590/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:30 2022] DELETE /compute/v2.1/images/76097b8a-86df-4ff4-a17a-017d641a4972 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:04:30.108885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.109823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:30.122343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.123257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.124034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.125251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.126271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.127576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.163223 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f HTTP/1.1 Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:30.167093 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.170064 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a681c23f-ec48-43cb-be35-f479496bda0f'} Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:30.171863 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.175525 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.181572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:30.183694 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b298fad-6530-4311-84cd-22e783e9a8b9 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 404 len: 111 microversion: 2.1 time: 0.081824 Sep 18 01:04:30.185460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 591/1146] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:30 2022] DELETE /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:30.197172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-29c72978-8698-41fa-9323-3d7968ff2295 req-8cfb62bb-5e2f-4a93-a7f9-af239f1cac0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ef5a3a-6c77-45a8-8d8a-0fa832b43783", "name": "network-vif-unplugged", "status": "completed", "tag": "c513b274-e342-4ba5-9347-e8e7434250f7"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:30.227143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-29c72978-8698-41fa-9323-3d7968ff2295 req-8cfb62bb-5e2f-4a93-a7f9-af239f1cac0a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.228374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-29c72978-8698-41fa-9323-3d7968ff2295 req-8cfb62bb-5e2f-4a93-a7f9-af239f1cac0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.229205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-29c72978-8698-41fa-9323-3d7968ff2295 req-8cfb62bb-5e2f-4a93-a7f9-af239f1cac0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.262795 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-29c72978-8698-41fa-9323-3d7968ff2295 req-8cfb62bb-5e2f-4a93-a7f9-af239f1cac0a service nova] Creating event network-vif-unplugged:c513b274-e342-4ba5-9347-e8e7434250f7 for instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 on n-h1-master-1 Sep 18 01:04:30.272565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-29c72978-8698-41fa-9323-3d7968ff2295 req-8cfb62bb-5e2f-4a93-a7f9-af239f1cac0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082649 Sep 18 01:04:30.273465 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 592/1147] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:30.275213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:30.279876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.280750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: a681c23f-ec48-43cb-be35-f479496bda0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:30.289756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.290306 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82f3c276-d48a-4aba-889e-ec27635cd02c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.336230 Sep 18 01:04:30.291073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.291745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.292657 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 556/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:29 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:30.293052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.293896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.294362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.313718 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f HTTP/1.1 Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:30.315799 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.318986 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a681c23f-ec48-43cb-be35-f479496bda0f'} Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:30.320763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. Sep 18 01:04:30.323455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:30.328607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Instance a681c23f-ec48-43cb-be35-f479496bda0f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:30.328607 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1213641-e7aa-40e9-b5b8-213e245ad887 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f" status: 404 len: 111 microversion: 2.1 time: 0.042636 Sep 18 01:04:30.328607 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 593/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:30 2022] GET /compute/v2.1/servers/a681c23f-ec48-43cb-be35-f479496bda0f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:30.333581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de90c635-2ad8-44a7-b619-e95fc75ef5f3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '.version_select at 0x7f700655baf0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.341694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.341694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:30.348088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.348584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.349024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.350493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.350970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.351394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.382995 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de90c635-2ad8-44a7-b619-e95fc75ef5f3 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185449018" status: 202 len: 0 microversion: 2.1 time: 0.059274 Sep 18 01:04:30.386058 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 557/1150] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185449018 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:04:30.698451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.700210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:30.724314 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:30.729522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:30.733159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.736448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.737772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.741045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.744808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.745883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.759452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:30.762523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:30.764643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bded5b83-e72a-4900-be99-cea463dcc76b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.428252 Sep 18 01:04:30.786790 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 594/1151] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:30 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:30.888332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.893193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:30.918877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.919956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.920654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.922503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.923838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.924835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.031652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:31.032630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:31.033581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.035743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lazy-loading 'fault' on Instance uuid 6d48a9cd-b662-4a76-a839-5174b05a84ad {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:31.097344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:31.109320 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e0aa815-6d24-4e26-b866-97d734ac197e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.414734 Sep 18 01:04:31.110383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 558/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:30 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:31.128641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af59db2a206a4451bd1dd95c124c3723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792b8e71f32e4c558f8753ee5de6cc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:31.138453 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8ba6b60c-cc31-4e00-ae98-5ae95d66dccd tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 200 len: 1307 microversion: 2.1 time: 0.267506 Sep 18 01:04:31.139388 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 595/1153] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:30 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:31.323773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:31.325042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:31.358827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:31.359802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:31.360659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.362145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:31.363093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:31.364030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.721933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:31.732555 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-965a53de-f429-4e4b-87f0-a03a0757d265 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.420200 Sep 18 01:04:31.733594 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 559/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:31 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:31.805802 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:31.810189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:31.810927 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:31.824099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:31.830022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:31.830648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.831513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:31.832268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:31.832991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.972950 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03059805-54f2-412b-8851-a1cb6c821efc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '.version_select at 0x7f70064f00d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:32.004376 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-03059805-54f2-412b-8851-a1cb6c821efc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Image not found. Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03059805-54f2-412b-8851-a1cb6c821efc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/4e28afa2-d47f-45e1-af35-bc33813480f8 HTTP/1.1 Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:04:32.007299 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4e28afa2-d47f-45e1-af35-bc33813480f8'} Sep 18 01:04:32.010584 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4e28afa2-d47f-45e1-af35-bc33813480f8 to delete Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.012294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e28afa2-d47f-45e1-af35-bc33813480f8 could not be found. Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:32.014745 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03059805-54f2-412b-8851-a1cb6c821efc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:32.017768 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03059805-54f2-412b-8851-a1cb6c821efc tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/images/4e28afa2-d47f-45e1-af35-bc33813480f8" status: 404 len: 62 microversion: 2.1 time: 0.040959 Sep 18 01:04:32.019632 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 560/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:31 2022] DELETE /compute/v2.1/images/4e28afa2-d47f-45e1-af35-bc33813480f8 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:04:32.028514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:32.029337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:32.039511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.040130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.040657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.041667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.042208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.042777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.058225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc HTTP/1.1 Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:04:32.060009 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: exception: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.062130 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'cf7e561f-2415-4705-9c53-b67f9c67cafc'} Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:32.063081 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.064874 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.066628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:32.066628 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6c10c836-68d0-45ac-9f01-77cb25d7c29a tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 404 len: 111 microversion: 2.1 time: 0.043275 Sep 18 01:04:32.066628 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 561/1156] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:32 2022] DELETE /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:32.076012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:32.076789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] [instance: cf7e561f-2415-4705-9c53-b67f9c67cafc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:32.091334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.092740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.095193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.096968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.097840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.098730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.121994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:32.133249 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] HTTP exception thrown: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Request method failure captured: Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc HTTP/1.1 Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4KSDn4d0DUAH0iQ7aW8bYIYHYL3cfOdbQeSWERNvTWdklm5xNVBSLiolJARo1FRmXT1Uo5Armhh-eIjZAIqPvDUUeXtTWocDan363FdbgNN-0tl27Vu_Y3dCYTsC-myCb0ajdE9dIuHClb4Zuvenglxft8I8uRbRIFOj5E_HU8O88 Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:04:32.136862 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9ce34433498444b8058b1354aed0f78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9ce34433498444b8058b1354aed0f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c9ce34433498444b8058b1354aed0f78 Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-26633554 Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 62dbad162d74407a891f11c9e972ada0 Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-26633554-project Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: exception: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.139887 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'cf7e561f-2415-4705-9c53-b67f9c67cafc'} Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:32.141669 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. Sep 18 01:04:32.143803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.145327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] Returning 404 to user: Instance cf7e561f-2415-4705-9c53-b67f9c67cafc could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:32.145327 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cd08a664-a157-4c8d-b106-b6b6b11199d2 tempest-ImagesOneServerNegativeTestJSON-26633554 tempest-ImagesOneServerNegativeTestJSON-26633554-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc" status: 404 len: 111 microversion: 2.1 time: 0.067895 Sep 18 01:04:32.146399 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 562/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:32 2022] GET /compute/v2.1/servers/cf7e561f-2415-4705-9c53-b67f9c67cafc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:04:32.150607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:32.152998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:32.154699 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-12cbf1bf-6556-4c15-9f5b-1830f59a3a6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.349993 Sep 18 01:04:32.158782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:32.160709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:32.161941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 596/1158] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:31 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:32.169435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.170580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.171503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.172761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.173450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.174151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.186957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:32.190135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] [instance: 6d48a9cd-b662-4a76-a839-5174b05a84ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:32.202845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.203945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.205238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.206682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.207734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.208516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.241239 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] HTTP exception thrown: Instance 6d48a9cd-b662-4a76-a839-5174b05a84ad could not be found. Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Request method failure captured: Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad HTTP/1.1 Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm2u3jXDU9eIM5mfNQxBzl-8fgj8h0oOQ9XEgPStXBhSWBEPt7sT2RynTJe92rGxCXw4_DMUWkdKRW5e4dJ5N3TXn185wXDil44BdsQPCjjw5FyCazUo11fGXxFRqliyZxk_7AXJ0NCCUh3pWNm-Y4LcfePLOYm7YIc2evlM1Bbr-T0 Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:32.244703 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/792b8e71f32e4c558f8753ee5de6cc0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 792b8e71f32e4c558f8753ee5de6cc0e Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-271731933 Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af59db2a206a4451bd1dd95c124c3723 Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersOnMultiNodesTest-271731933-project Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 6d48a9cd-b662-4a76-a839-5174b05a84ad could not be found. Sep 18 01:04:32.247448 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6d48a9cd-b662-4a76-a839-5174b05a84ad'} Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d48a9cd-b662-4a76-a839-5174b05a84ad could not be found. Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:32.248906 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d48a9cd-b662-4a76-a839-5174b05a84ad could not be found. Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d48a9cd-b662-4a76-a839-5174b05a84ad could not be found. Sep 18 01:04:32.251321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:32.255056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] Returning 404 to user: Instance 6d48a9cd-b662-4a76-a839-5174b05a84ad could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:32.255056 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4431b59f-fe85-473d-a579-52f5a7a2bd51 tempest-ServersOnMultiNodesTest-271731933 tempest-ServersOnMultiNodesTest-271731933-project] 10.222.0.25 "GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad" status: 404 len: 111 microversion: 2.1 time: 0.069521 Sep 18 01:04:32.255056 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 597/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:32 2022] GET /compute/v2.1/servers/6d48a9cd-b662-4a76-a839-5174b05a84ad => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:32.344630 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b8b617a7-65f9-4453-b454-222ffc1d34df req-d641471f-ec03-4498-952c-1c5898bb7838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ef5a3a-6c77-45a8-8d8a-0fa832b43783", "tag": "c513b274-e342-4ba5-9347-e8e7434250f7"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:32.358400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b8b617a7-65f9-4453-b454-222ffc1d34df req-d641471f-ec03-4498-952c-1c5898bb7838 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.361314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b8b617a7-65f9-4453-b454-222ffc1d34df req-d641471f-ec03-4498-952c-1c5898bb7838 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.362259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b8b617a7-65f9-4453-b454-222ffc1d34df req-d641471f-ec03-4498-952c-1c5898bb7838 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.416749 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b8b617a7-65f9-4453-b454-222ffc1d34df req-d641471f-ec03-4498-952c-1c5898bb7838 service nova] Creating event network-changed:c513b274-e342-4ba5-9347-e8e7434250f7 for instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 on n-h1-master-1 Sep 18 01:04:32.433256 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b8b617a7-65f9-4453-b454-222ffc1d34df req-d641471f-ec03-4498-952c-1c5898bb7838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094431 Sep 18 01:04:32.435749 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 598/1160] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:04:32.612985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:32.635438 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ff5be9c-504d-429f-bd3f-f7d9eb0c91e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.484656 Sep 18 01:04:32.661690 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 563/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:32 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:32.773442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:32.774698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:32.796696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.797536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.798547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.799682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.800716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.801403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:33.122964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:33.138972 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a785b826-f9fb-4fc1-a98b-b02ca9822b04 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.373699 Sep 18 01:04:33.140867 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 599/1162] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:32 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:33.186467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:33.187758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:33.200754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.201779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.202660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:33.204085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.205608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.206711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:33.462766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6dd7f92-274d-4794-afef-89c0093992a1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:33.465723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:33.472828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.473681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.474297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:33.475812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.476460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.477050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:33.856025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:33.890406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:33.894166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:33.896345 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67ce3457-c1a3-493f-a81d-67baa0537355 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.718657 Sep 18 01:04:33.907048 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 564/1163] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:33 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:33.914573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:33.915745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:33.927565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.929992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.931064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:33.932568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.933169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.933758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:34.073671 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c957ffb2-dec1-4a5e-9869-f34f5c5cf6ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "POST /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614294 Sep 18 01:04:34.077540 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 600/1164] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:04:33 2022] POST /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 194 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:04:34.091720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d54741e0-b0ec-4e13-ab2e-440abe7c9e54 req-36644e9b-5194-4a67-89fe-a87256d56092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b76040-84b4-4c7e-a381-5cb762d7c75c", "name": "network-vif-plugged", "status": "completed", "tag": "94467f9b-0d92-4d5c-9827-c574a8f20650"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:34.120021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d54741e0-b0ec-4e13-ab2e-440abe7c9e54 req-36644e9b-5194-4a67-89fe-a87256d56092 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:34.121144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d54741e0-b0ec-4e13-ab2e-440abe7c9e54 req-36644e9b-5194-4a67-89fe-a87256d56092 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:34.122993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d54741e0-b0ec-4e13-ab2e-440abe7c9e54 req-36644e9b-5194-4a67-89fe-a87256d56092 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:34.134384 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:34.158231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d54741e0-b0ec-4e13-ab2e-440abe7c9e54 req-36644e9b-5194-4a67-89fe-a87256d56092 service nova] Creating event network-vif-plugged:94467f9b-0d92-4d5c-9827-c574a8f20650 for instance 00b76040-84b4-4c7e-a381-5cb762d7c75c on n-h1-master-1 Sep 18 01:04:34.169484 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d54741e0-b0ec-4e13-ab2e-440abe7c9e54 req-36644e9b-5194-4a67-89fe-a87256d56092 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088525 Sep 18 01:04:34.170871 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 601/1165] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:34.188649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:34.190624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:34.202965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:34.204095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:34.205270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:34.206863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:34.207842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:34.208786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:34.243759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:34.261843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4a58f75-6a4b-4bb9-a1a4-3f2f45298540 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.360647 Sep 18 01:04:34.263555 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 565/1166] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:33 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:34.639910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:34.654929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-523dd882-d607-41d3-92b1-13678b7a34bc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.474425 Sep 18 01:04:34.667118 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 602/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:34 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:34.945143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:34.949659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:34.989616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:34.995949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.000288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.001993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.005790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.008650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.295866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:35.297457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:35.312730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.313672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.314828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.325799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.332392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.333245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.519017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:35.536416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:35.538468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:35.539985 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e61130fa-e13b-4b87-8bdf-df46da3bfef3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.603664 Sep 18 01:04:35.540821 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 566/1168] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:34 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:35.722428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:35.743089 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5da57b93-3386-4640-830b-c7b33ed4647b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.456406 Sep 18 01:04:35.745271 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 603/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:35 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:35.760356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:35.761140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:35.775152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.775917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.776949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.779026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.780086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.781087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:36.090656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:36.099018 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dcd88583-ae32-4ee1-8baa-ee06346972a2 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1324 microversion: 2.1 time: 0.343862 Sep 18 01:04:36.100746 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 567/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:35 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:36.573180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:36.575747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:36.605285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:36.612199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:36.613696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:36.614967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:36.626763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:36.628101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:36.780089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:36.781304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:36.798786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:36.800254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:36.802240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:36.804391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:36.807216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:36.807925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:36.839143 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:36.932151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:36.945680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:36.954316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:36.955743 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68362f8c-4d4c-495e-89d9-b737e8ad37e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.390814 Sep 18 01:04:36.963016 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 604/1171] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:36 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:37.040216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:37.051530 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ac9a86c-958a-40b5-bcae-ec05ba84f9e3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.275551 Sep 18 01:04:37.068073 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 568/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:36 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:37.137251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:37.138158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:37.155457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.156031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.156479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.157206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.157700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.158124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.438156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:37.452788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c28b293b-6faf-4a41-976f-b0619fa37346 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1520 microversion: 2.1 time: 0.319046 Sep 18 01:04:37.471195 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 605/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:37 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:37.499268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b0d1177d-a5af-43b5-80c7-f41ed61b86dd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'create', calling method: .version_select at 0x7f7006551dc0>, body: {"pool": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:37.906480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Action: 'update', calling method: .version_select at 0x7f7006345ee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:37.913775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.914956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.919091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.936984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.939236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.941887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.961925 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] HTTP exception thrown: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Request method failure captured: Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515 HTTP/1.1 Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 56 Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm6leRFRKCz-DMCtdWxVYWGXsOEcnSyKgMoyYZhGVUHiV6_rhXreerO2dphHf0nDZGcolxPUcrTupAsYrRRSU3gsPv858202_xqV_NNOsA5qy-bC04gyCPwLyS_6bmBv0P1B4U8xsAStrHcB-vplaEaYqhxuh69uqWdwAS9c4WKWH8I Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.53 Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3952825c42c04b2ea912be02fde4ee48 Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:04:37.975714 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3952825c42c04b2ea912be02fde4ee48 Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: da8ce734ca6f47c8911aa555f0eb3fa8 Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:04:37.979002 n-d-master-1 devstack@n-api.service[122374]: exception: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0bd543d8-0af6-4a8a-b0ff-f37c26e90515', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:37.980760 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:37.983742 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:37.986388 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:37.986388 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:37.986388 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:37.986388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Returning 404 to user: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:37.986388 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa1fc617-7b52-4241-8da4-93da33202283 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515" status: 404 len: 110 microversion: 2.53 time: 0.375176 Sep 18 01:04:37.991104 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 606/1174] 10.222.0.25 () {62 vars in 1309 bytes} [Sun Sep 18 01:04:37 2022] PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515 => generated 110 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:04:38.009084 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Action: 'update', calling method: .version_select at 0x7f70063de790>, body: {"status": "disabled"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:38.016620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:38.017119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:38.017583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:38.038666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:38.040851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:38.045805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:38.061644 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] HTTP exception thrown: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Request method failure captured: Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515 HTTP/1.1 Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 22 Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm6leRFRKCz-DMCtdWxVYWGXsOEcnSyKgMoyYZhGVUHiV6_rhXreerO2dphHf0nDZGcolxPUcrTupAsYrRRSU3gsPv858202_xqV_NNOsA5qy-bC04gyCPwLyS_6bmBv0P1B4U8xsAStrHcB-vplaEaYqhxuh69uqWdwAS9c4WKWH8I Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.53 Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3952825c42c04b2ea912be02fde4ee48 Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:04:38.067126 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3952825c42c04b2ea912be02fde4ee48 Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: da8ce734ca6f47c8911aa555f0eb3fa8 Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: {"status": "disabled"} Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: exception: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:38.070967 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0bd543d8-0af6-4a8a-b0ff-f37c26e90515', 'body': {'status': 'disabled'}} Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:38.072840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:38.075283 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:38.077488 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:38.077488 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:38.082629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Returning 404 to user: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:38.086820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb473f21-3d58-4e6e-9b54-879cedb6cc6a tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515" status: 404 len: 110 microversion: 2.53 time: 0.091501 Sep 18 01:04:38.091357 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 607/1175] 10.222.0.25 () {62 vars in 1309 bytes} [Sun Sep 18 01:04:37 2022] PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515 => generated 110 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:04:38.106397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:38.107881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:38.121534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:38.124579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:38.126038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:38.127649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:38.128931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:38.130014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:38.618859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:38.648132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:38.650833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:38.652333 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c98b0dc0-cf01-4b12-ada5-b89a6c58d4c7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.557528 Sep 18 01:04:38.654133 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 608/1176] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:38 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:38.676102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:38.678125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:38.689880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:38.690766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:38.691450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:38.693209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:38.694879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:38.695657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.085963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:39.098950 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9e3475db-4b93-46c0-a6d4-eb138f6f9e20 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.442006 Sep 18 01:04:39.099921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 609/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:38 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:39.119343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Action: 'update', calling method: .version_select at 0x7f7006351700>, body: {"status": "enabled"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:39.127922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.128479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.129031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.142174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.144685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.145903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.160124 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] HTTP exception thrown: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Request method failure captured: Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515 HTTP/1.1 Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 21 Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm6leRFRKCz-DMCtdWxVYWGXsOEcnSyKgMoyYZhGVUHiV6_rhXreerO2dphHf0nDZGcolxPUcrTupAsYrRRSU3gsPv858202_xqV_NNOsA5qy-bC04gyCPwLyS_6bmBv0P1B4U8xsAStrHcB-vplaEaYqhxuh69uqWdwAS9c4WKWH8I Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.53 Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3952825c42c04b2ea912be02fde4ee48 Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:04:39.162117 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3952825c42c04b2ea912be02fde4ee48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3952825c42c04b2ea912be02fde4ee48 Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749 Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: da8ce734ca6f47c8911aa555f0eb3fa8 Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: {"status": "enabled"} Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: exception: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:39.164694 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0bd543d8-0af6-4a8a-b0ff-f37c26e90515', 'body': {'status': 'enabled'}} Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:39.168385 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:39.171718 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:39.176350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. Sep 18 01:04:39.176350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:39.176350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Returning 404 to user: Service 0bd543d8-0af6-4a8a-b0ff-f37c26e90515 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:39.176350 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f6810ed-f3ae-4a4b-a6bf-26072ea6e274 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515" status: 404 len: 110 microversion: 2.53 time: 0.063534 Sep 18 01:04:39.176350 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 610/1178] 10.222.0.25 () {62 vars in 1309 bytes} [Sun Sep 18 01:04:39 2022] PUT /compute/v2.1/os-services/0bd543d8-0af6-4a8a-b0ff-f37c26e90515 => generated 110 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:04:39.184329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:39.190829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.191722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.192498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.194492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.195332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.196043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.244813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-570203bd-cb68-41fb-b1c8-1e21878d6237 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.065423 Sep 18 01:04:39.255054 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 611/1179] 10.222.0.25 () {60 vars in 1178 bytes} [Sun Sep 18 01:04:39 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:39.260728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:39.266110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.266624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.267074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.267889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.268456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.268892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.290581 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:39.306755 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8773ae50-a8ad-4150-a8a1-ad2c4e7706ec tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049783 Sep 18 01:04:39.324935 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 612/1180] 10.222.0.25 () {60 vars in 1211 bytes} [Sun Sep 18 01:04:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:39.332842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:39.338732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.341165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.341909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.342942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.343666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.344273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.446837 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b4f02e8-3657-4bce-a9cc-be747b5a7d50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.113592 Sep 18 01:04:39.455979 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 613/1181] 10.222.0.25 () {60 vars in 1178 bytes} [Sun Sep 18 01:04:39 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:39.471794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:39.488693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.489448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.494367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.497102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.500472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.501005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.572643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-29777855-a6df-4808-a698-a8dc23936b50 tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.112612 Sep 18 01:04:39.590472 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 614/1182] 10.222.0.25 () {60 vars in 1235 bytes} [Sun Sep 18 01:04:39 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:39.602472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:39.609061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.610660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.611428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.612469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.613514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.614630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.674032 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7f8c5f6d-d602-4a19-bec5-a3ae6d7f986e tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.077882 Sep 18 01:04:39.689615 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 615/1183] 10.222.0.25 () {60 vars in 1178 bytes} [Sun Sep 18 01:04:39 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:39.701490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:39.702613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:39.720022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.720761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.722199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.726174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.727149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.731401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:40.249758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b0d1177d-a5af-43b5-80c7-f41ed61b86dd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.759105 Sep 18 01:04:40.253178 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 569/1184] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:04:37 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:40.272880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:40.281886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:40.283379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:40.285676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:40.287534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:40.288697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:40.289733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:40.363702 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6ec0a4c5-6f2e-4edb-aa40-8ee43098f22b tempest-ServicesAdminNegativeV253TestJSON-1750464749 tempest-ServicesAdminNegativeV253TestJSON-1750464749-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.108336 Sep 18 01:04:40.368571 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 570/1185] 10.222.0.25 () {60 vars in 1239 bytes} [Sun Sep 18 01:04:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:40.385198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:40.386515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:40.392282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:40.409415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:40.413954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:40.417451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:40.417773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:40.419091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:40.419300 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0384ac0c-0d26-4700-aa8f-786a57352ea8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1568 microversion: 2.25 time: 0.731621 Sep 18 01:04:40.420225 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 616/1186] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:39 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1568 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:40.422459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:40.426053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:40.429944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:40.775251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a287ecf-55b3-4421-afe1-9941f290b059 tempest-ServicesAdminNegativeV253TestJSON-1202154613 tempest-ServicesAdminNegativeV253TestJSON-1202154613-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:40.783394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a287ecf-55b3-4421-afe1-9941f290b059 tempest-ServicesAdminNegativeV253TestJSON-1202154613 tempest-ServicesAdminNegativeV253TestJSON-1202154613-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '527bd3a8707849238f89432b5a157cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150eb1d9c9474e18a18a79d41df98ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a287ecf-55b3-4421-afe1-9941f290b059 tempest-ServicesAdminNegativeV253TestJSON-1202154613 tempest-ServicesAdminNegativeV253TestJSON-1202154613-project] Request method failure captured: Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm6ka1asGKh7-Hmo65zGbvvqB4Q7n7hJ3sVGv1Ke-Q8yQJMfM_FST8nBNVP076YX6tnXwvC5Sd5DFYpM0Ry4SIGaE-vAe1yBgvaYEpWV3WlRIg7HTyxLnn98Mlxdt5mVDcauNvMlyL1Vhwg-na8a7AUbtCrAcZcfYBgpC9YblZKPBUM Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.53 Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 150eb1d9c9474e18a18a79d41df98ff3 Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1202154613 Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:04:40.785623 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/150eb1d9c9474e18a18a79d41df98ff3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/150eb1d9c9474e18a18a79d41df98ff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_150eb1d9c9474e18a18a79d41df98ff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/150eb1d9c9474e18a18a79d41df98ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1202154613 Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 150eb1d9c9474e18a18a79d41df98ff3 Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1202154613 Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1202154613-project Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 527bd3a8707849238f89432b5a157cec Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1202154613-project Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 18 01:04:40.788269 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:04:40.789292 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 18 01:04:40.790677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:40.795852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a287ecf-55b3-4421-afe1-9941f290b059 tempest-ServicesAdminNegativeV253TestJSON-1202154613 tempest-ServicesAdminNegativeV253TestJSON-1202154613-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:40.798725 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a287ecf-55b3-4421-afe1-9941f290b059 tempest-ServicesAdminNegativeV253TestJSON-1202154613 tempest-ServicesAdminNegativeV253TestJSON-1202154613-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.377256 Sep 18 01:04:40.810256 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 617/1187] 10.222.0.25 () {60 vars in 1178 bytes} [Sun Sep 18 01:04:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 388 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:04:40.822509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-335516526", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b3f04822-05c6-4706-9c26-72bee19a7c93"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:40.914276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:40.946812 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-480c33ee-7020-456c-8a3a-1542380a51ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.575967 Sep 18 01:04:40.950513 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 571/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:40 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:40.964478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] validate_networks() for [('b3f04822-05c6-4706-9c26-72bee19a7c93', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:04:41.482552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:41.487486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:41.504000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:41.505749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:41.506933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:41.509159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:41.510415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:41.511705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:41.847596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:41.866846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:41.872675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:41.877178 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-962378a1-45c4-4221-8e86-8e920e5280ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1543 microversion: 2.25 time: 0.406744 Sep 18 01:04:41.879201 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 572/1189] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:41 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1543 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:41.892534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:41.909442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:41.914023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Searching by: {'deleted': False, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:04:41.927110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:41.929350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:41.930601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:41.932788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:41.935822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:41.937007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.077218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:04:42.195876 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b76b859-8bbc-4f7c-8bfb-83d1cdc0b3eb tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.313198 Sep 18 01:04:42.208395 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 573/1190] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:04:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:42.208395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f6d41de6-7a35-48ae-9922-b143d32edd8b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '.version_select at 0x7f70065b6ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:42.212019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6d41de6-7a35-48ae-9922-b143d32edd8b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.213235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6d41de6-7a35-48ae-9922-b143d32edd8b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.213438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6d41de6-7a35-48ae-9922-b143d32edd8b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.233785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f6d41de6-7a35-48ae-9922-b143d32edd8b tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2364 microversion: 2.25 time: 0.034801 Sep 18 01:04:42.235831 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 574/1191] 10.222.0.25 () {60 vars in 1184 bytes} [Sun Sep 18 01:04:42 2022] GET /compute/v2.1/os-migrations => generated 2364 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:42.246591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:42.249812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:42.275031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.277366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.279321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.283861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.285570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.287879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.464666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:04:42.465799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:04:42.466470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:04:42.467040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:04:42.467627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:04:42.489883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.492898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.500317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.502370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.532657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.533153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.590367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:42.604023 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-71d1f850-e1b3-4260-a349-eb732d380c12 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.366671 Sep 18 01:04:42.612046 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 575/1192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:42 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:42.621366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:42.651771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Getting quotas for project fce0cec677134476aa0da53e6813c602. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:04:42.654237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:42.655069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Searching by: {'deleted': False, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:04:42.664056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Getting quotas for user c3817ebe53a344c3ba3b6b56c726cc57 and project fce0cec677134476aa0da53e6813c602. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:04:42.671510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.671993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.672574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.673383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.673859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.674383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.703262 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:04:42.707511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:04:42.871350 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-57240250-d973-4245-a4bf-ff5e52551e44 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.058099 Sep 18 01:04:42.872675 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 618/1193] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:04:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:04:42.907505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:42.910874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:04:42.911427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:42.944144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.947904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.948673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.951271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.952446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.953734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:43.139809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:43.161147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:43.167237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:43.167878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:43.540668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:43.574243 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c898237-e849-4047-bfaf-ac6484a164a9 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 2036 microversion: 2.25 time: 0.699136 Sep 18 01:04:43.576712 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 619/1194] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:42 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 2036 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:43.600469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-929ff71c-f873-466f-9e13-39d377a0e867 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:43.602168 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-929ff71c-f873-466f-9e13-39d377a0e867 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:43.629723 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9698d167-b353-4231-b05a-d4dfcf3a2138 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.016317 Sep 18 01:04:43.631620 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 576/1195] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:04:42 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:43.636812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b58293cc-26eb-4d79-97bd-218453836683 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Action: 'create', calling method: .version_select at 0x7f70065dc550>, body: {"keypair": {"name": "tempest-keypair-152895215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAiqPrQSY8GpZBYfCw6HHHFANfjd6zGBOgwR9qWXNNsGBxgzaAp/XSTHGoRMxO7zQdEpsUY/2MQoDGv/SjrhsJQWP/YdaLkmpuo8l36TMkU4xHsY69Dn2BYPQnbXzZQMw=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:43.717005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b58293cc-26eb-4d79-97bd-218453836683 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:04:43.745651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b58293cc-26eb-4d79-97bd-218453836683 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for user bb1c3f4298d34bb2a820ec5de46a76c2 and project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:04:43.810043 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:43.823019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-929ff71c-f873-466f-9e13-39d377a0e867 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:43.829598 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b58293cc-26eb-4d79-97bd-218453836683 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.196225 Sep 18 01:04:43.837897 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 577/1196] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:04:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:04:43.845169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:43.857452 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-929ff71c-f873-466f-9e13-39d377a0e867 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1223 microversion: 2.1 time: 0.277097 Sep 18 01:04:43.859067 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 620/1197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:43 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1223 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:43.876030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:43.887244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b77d864a-6081-4bef-8abe-278fab1dce96 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:43.910534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:43.914084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:43.917782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:43.920602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:43.921123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:43.921820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:43.930052 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b77d864a-6081-4bef-8abe-278fab1dce96 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.068558 Sep 18 01:04:43.935509 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 621/1198] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:04:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:44.196709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:44.205474 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-946046c5-7713-4c65-8a74-91aac382705c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.365832 Sep 18 01:04:44.221757 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 578/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:43 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:44.430748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:44.433215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:44.460254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:44.463013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:44.463699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:44.464459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:44.467974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:44.470234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:44.580392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:04:44.768586 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ffd301fa-6920-4807-a88c-53e57848d0f6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 204 len: 0 microversion: 2.1 time: 0.342801 Sep 18 01:04:44.770515 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 622/1200] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:04:44 2022] DELETE /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:04:44.784438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:44.789185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:44.816522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:44.817291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:44.817936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:44.819535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:44.820095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:44.820631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:44.885163 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:44.891330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:44.914322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:44.917133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:44.918013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:44.919573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:44.921820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:44.922754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.053809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:45.075851 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2e29065-fc9a-4321-a38c-3a410fbb2bbd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1275 microversion: 2.1 time: 0.197286 Sep 18 01:04:45.089593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 623/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:44 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1275 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:45.190336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:45.203829 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b2def46-2601-4882-9f2c-874f96c30790 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1608 microversion: 2.1 time: 0.427171 Sep 18 01:04:45.221306 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 579/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:44 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1608 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:45.247263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:45.249012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:45.263724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:45.265322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:45.266131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.268053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:45.268838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:45.269935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.493229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:45.504165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2556b1d8-ed92-4c87-898e-f468dd61dfca tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.275041 Sep 18 01:04:45.527584 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 624/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:45 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:46.115811 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:46.116839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:46.124984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:46.126193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:46.127210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:46.128118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:46.129231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:46.130402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:46.237895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:46.238990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:46.259845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:46.261898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:46.264144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:46.272905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:46.273056 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:46.275112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:46.276125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:46.290600 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-426b0522-4335-4a64-aa6c-05a949aac8ad tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1281 microversion: 2.1 time: 0.179803 Sep 18 01:04:46.292027 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 580/1204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:46 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1281 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:46.302141 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:46.542321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:46.543893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:46.561215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:46.563073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:46.564499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:46.566142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:46.566343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:46.567669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:46.568503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:46.591280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca09df88-69b4-45cb-942c-dc249ab5537e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1608 microversion: 2.1 time: 0.359627 Sep 18 01:04:46.591876 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 625/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:46 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1608 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:46.941148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:46.990376 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46e9bdd4-0efb-45f1-b1db-bb6ea8de6fe1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.455019 Sep 18 01:04:46.992274 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 581/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:46 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:47.322948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:47.324123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:47.353595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:47.355068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:47.355621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:47.372557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:47.374590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:47.375265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:47.621303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:47.623795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:47.635991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:47.636973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:47.637871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:47.638994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:47.639696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:47.640342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:47.948383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:47.975285 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d5f18d91-8f39-4e52-b44a-bb9a5209c553 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1608 microversion: 2.1 time: 0.358702 Sep 18 01:04:47.980089 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 582/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:47 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1608 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:48.024713 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:48.025925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:48.040893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:48.045067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:48.048114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:48.050334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:48.051811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:48.055013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:48.156113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:48.168146 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-830476b2-2757-4e6c-a772-7ad2f1a7ea6d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 0.854791 Sep 18 01:04:48.168763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 626/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:47 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:48.190672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-548541468", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "3946aa63-a4f2-4eee-aaa3-ec460267890e"}], "security_groups": [{"name": "tempest-securitygroup--1286513249"}], "key_name": "tempest-keypair-152895215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:48.775480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] validate_networks() for [('3946aa63-a4f2-4eee-aaa3-ec460267890e', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:04:48.790549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:48.801061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-317585ba-d6a1-4a0f-b4bc-c6e8e11ffbdf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.790293 Sep 18 01:04:48.802088 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 583/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:48 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:49.005181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:49.006918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:49.034681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:49.040548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:49.041830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:49.043338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:49.046680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:49.047446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:49.780386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:49.791339 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9cbc226d-047c-47d7-84bb-fb336141a40e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1608 microversion: 2.1 time: 0.793616 Sep 18 01:04:49.816634 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 584/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:48 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1608 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:49.849697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:49.850429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:49.861040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:49.861685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:49.862194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:49.862989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:49.863514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:49.864008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.495204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:50.503785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1a19061-c2e6-467c-88ff-7a740d9647e6 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 0.662552 Sep 18 01:04:50.509339 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 585/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:49 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:50.517288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-226b6d75-e19c-4f16-b632-b1cee59c5cdf req-8a272d6f-d006-4405-9bfd-d4b2db101d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029b967c-e30b-4828-af5d-b78e5f14ec02", "tag": "5b719cda-b0c5-435c-be67-77c91366eed4"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:50.539078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-226b6d75-e19c-4f16-b632-b1cee59c5cdf req-8a272d6f-d006-4405-9bfd-d4b2db101d17 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:50.544597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-226b6d75-e19c-4f16-b632-b1cee59c5cdf req-8a272d6f-d006-4405-9bfd-d4b2db101d17 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:50.545262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-226b6d75-e19c-4f16-b632-b1cee59c5cdf req-8a272d6f-d006-4405-9bfd-d4b2db101d17 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.570657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-226b6d75-e19c-4f16-b632-b1cee59c5cdf req-8a272d6f-d006-4405-9bfd-d4b2db101d17 service nova] Creating event network-changed:5b719cda-b0c5-435c-be67-77c91366eed4 for instance 029b967c-e30b-4828-af5d-b78e5f14ec02 on n-h1-master-1 Sep 18 01:04:50.580448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-226b6d75-e19c-4f16-b632-b1cee59c5cdf req-8a272d6f-d006-4405-9bfd-d4b2db101d17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069604 Sep 18 01:04:50.581377 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 586/1212] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:50.585302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:04:50.586506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:04:50.586974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:04:50.587638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:04:50.588271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:04:50.591764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:50.602228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:50.609001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:50.609486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:50.609955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.610679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:50.611120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:50.618300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.630074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:50.633211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:50.634434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.638260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:50.639403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:50.642600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.722805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:04:50.732145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for user bb1c3f4298d34bb2a820ec5de46a76c2 and project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:04:50.773027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:04:50.776566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:04:50.885522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91bf2518-1c8f-41a0-b525-35f2882f2c19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.704842 Sep 18 01:04:50.891210 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 627/1213] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:04:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:04:50.916518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:50.918002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:50.968916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:50.972042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:50.973791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.980250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:50.982572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:50.985467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:50.997203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:51.005066 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:51.014225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7d7a1cad-590a-49e9-8a42-3197120aa758 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.422536 Sep 18 01:04:51.015186 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 587/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:50 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:51.026346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36ebdbb2-2b28-45e1-abef-a66c0ab3039f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:51.027335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-36ebdbb2-2b28-45e1-abef-a66c0ab3039f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:51.254799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36ebdbb2-2b28-45e1-abef-a66c0ab3039f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:51.267507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36ebdbb2-2b28-45e1-abef-a66c0ab3039f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:51.269051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36ebdbb2-2b28-45e1-abef-a66c0ab3039f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:51.272923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36ebdbb2-2b28-45e1-abef-a66c0ab3039f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1284 microversion: 2.25 time: 0.256455 Sep 18 01:04:51.274120 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 588/1215] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:51 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:51.316133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:51.353841 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80b7803d-e0a2-4ab8-a9d9-21b1c945f5da tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1251 microversion: 2.1 time: 0.457923 Sep 18 01:04:51.362791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 628/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:50 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1251 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:51.547363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:51.548335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:51.561060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:51.561697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:51.562015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:51.562719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:51.563166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:51.563582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:52.111100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "564813a3-6756-4831-96d3-ebef27878a34"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:52.116027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:52.157084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:52.158205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:52.160836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:52.163974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:52.165498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:52.167465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:52.415250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:52.423817 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96a4349d-490d-4281-ac5f-4e4ef9bcbabd tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 0.880143 Sep 18 01:04:52.436743 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 589/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:51 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:52.444496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:52.447348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:52.479403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:52.479902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:52.480341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:52.481034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:52.489221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:52.490361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:52.521904 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] HTTP exception thrown: Volume 564813a3-6756-4831-96d3-ebef27878a34 could not be found. Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Request method failure captured: Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments/b6dd7f92-274d-4794-afef-89c0093992a1 HTTP/1.1 Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 74 Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5WVesWpbruEa7kZO23njClbzAdQ7FT_XtEHlnEp376-fnXSRlEEhZeM7VlJd4fPOfFUjFw7Y6ExuTEJRmLbn6KwcUs0enMfT5TJJbJbX6xNtrvEK_nU7KoIBcJkvLG3ImUGHQpKovaScKD-136C9MEQ9j4Mz7kF-HNmX8RYfiAXm4 Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 611ad025fb3143d89bd446b2f3a0f5ef Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesAdminNegativeTest-2000864663 Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:04:52.525921 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesAdminNegativeTest-2000864663 Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 611ad025fb3143d89bd446b2f3a0f5ef Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2000864663 Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesAdminNegativeTest-2000864663-project-admin Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 3da7dffd0ed0439ab15f3076e9b2cf6d Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesAdminNegativeTest-2000864663-project-admin Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: {"volumeAttachment": {"volumeId": "564813a3-6756-4831-96d3-ebef27878a34"}} Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:04:52.527564 n-d-master-1 devstack@n-api.service[122374]: exception: Volume 564813a3-6756-4831-96d3-ebef27878a34 could not be found. Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '78083c60-a6b6-4e5a-9be6-3bca0baaa576', 'id': 'b6dd7f92-274d-4794-afef-89c0093992a1', 'body': {'volumeAttachment': {'volumeId': '564813a3-6756-4831-96d3-ebef27878a34'}}} Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:04:52.528802 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 564813a3-6756-4831-96d3-ebef27878a34 could not be found. (HTTP 404) (Request-ID: req-60af4205-e1d1-49cd-9c36-b53265489e7e) Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:04:52.530156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 564813a3-6756-4831-96d3-ebef27878a34 could not be found. Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:04:52.531563 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 564813a3-6756-4831-96d3-ebef27878a34 could not be found. Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 564813a3-6756-4831-96d3-ebef27878a34 could not be found. Sep 18 01:04:52.532955 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:04:52.534403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Returning 400 to user: Volume 564813a3-6756-4831-96d3-ebef27878a34 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:04:52.534403 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-73733d4d-caa2-46e8-8ab1-384910e689e0 tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments/b6dd7f92-274d-4794-afef-89c0093992a1" status: 400 len: 107 microversion: 2.1 time: 0.880763 Sep 18 01:04:52.538125 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 629/1218] 10.222.0.25 () {60 vars in 1433 bytes} [Sun Sep 18 01:04:51 2022] PUT /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments/b6dd7f92-274d-4794-afef-89c0093992a1 => generated 107 bytes in 892 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:04:52.554059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:52.556402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:52.581693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:52.582168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:52.583267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:52.584244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:52.584876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:52.585476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:52.781672 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:53.254921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:53.274792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:53.278559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:53.292069 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-17bb4125-b808-4f18-bdf9-d327e34196a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1288 microversion: 2.25 time: 0.752715 Sep 18 01:04:53.293213 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 630/1219] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:52 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1288 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:53.314349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:53.315740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:53.342783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:53.343627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:53.344255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:53.345167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:53.345856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:53.346463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:53.617049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:53.629725 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b97a5748-6c90-401d-a9a6-0ed7284e36b3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1251 microversion: 2.1 time: 0.330977 Sep 18 01:04:53.631398 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 631/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:53 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1251 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:53.648097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bbe68d36-4b72-49c7-92ab-d01373c79db0 req-29fccdb2-710f-4552-be83-bfb399d9ee3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d680a3c6-91ab-4755-b862-9cb85ba60fe5", "name": "network-vif-deleted", "tag": "c56f633b-dd20-4dec-b564-db9918ef1a6a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:53.660888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bbe68d36-4b72-49c7-92ab-d01373c79db0 req-29fccdb2-710f-4552-be83-bfb399d9ee3b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:53.662198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bbe68d36-4b72-49c7-92ab-d01373c79db0 req-29fccdb2-710f-4552-be83-bfb399d9ee3b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:53.662811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bbe68d36-4b72-49c7-92ab-d01373c79db0 req-29fccdb2-710f-4552-be83-bfb399d9ee3b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:53.683432 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bbe68d36-4b72-49c7-92ab-d01373c79db0 req-29fccdb2-710f-4552-be83-bfb399d9ee3b service nova] Creating event network-vif-deleted:c56f633b-dd20-4dec-b564-db9918ef1a6a for instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 on n-h2-master-1 Sep 18 01:04:53.713386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:53.722013 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bbe68d36-4b72-49c7-92ab-d01373c79db0 req-29fccdb2-710f-4552-be83-bfb399d9ee3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086599 Sep 18 01:04:53.723673 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 632/1221] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:53.728682 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a643ff4d-ffde-413a-87c0-878c8aeccef4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 1.290752 Sep 18 01:04:53.730507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 590/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:52 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:53.735786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:53.737089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:53.750085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:53.751573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:53.752583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:53.754052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:53.755121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:53.756628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:53.773491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:53.775079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:53.805928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:53.812404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:53.813057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:53.814247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:53.814849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:53.815346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.080567 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lazy-loading 'services' on Instance uuid 78083c60-a6b6-4e5a-9be6-3bca0baaa576 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:04:54.247732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5789a252-e692-466a-93a2-565050c5ffd6 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments/b6dd7f92-274d-4794-afef-89c0093992a1" status: 202 len: 0 microversion: 2.1 time: 0.521843 Sep 18 01:04:54.248583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 633/1223] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:04:53 2022] DELETE /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments/b6dd7f92-274d-4794-afef-89c0093992a1 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:04:54.258926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:54.262231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:54.273896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.274656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.275416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.276179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.276652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.277191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.329244 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3bd2ab4d-04b9-48eb-bc54-ccf0414052e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075670 Sep 18 01:04:54.336331 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 634/1224] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:04:54 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:04:54.343083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:54.343931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:54.352478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.353447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.354061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.354913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.355480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.356013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.426629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:54.440618 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8af59eca-0a4d-40d3-94a2-5da5eb035e3d tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 0.688058 Sep 18 01:04:54.441310 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 591/1225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:53 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:54.483921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:54.510259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:54.514318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:54.516668 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf0f554f-9abf-4bb2-a313-78126ad3a5ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1280 microversion: 2.25 time: 0.179723 Sep 18 01:04:54.517708 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 635/1226] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:54 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:54.658903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:54.662448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:54.684748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.685812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.687104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.690105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.693323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.694467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.761106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:54.765215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:54.800147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.800950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.801789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.803814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:54.805024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:54.806791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:54.991092 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:55.008857 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7f96542-57ac-4145-8059-157510ae3b02 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1251 microversion: 2.1 time: 0.356869 Sep 18 01:04:55.009977 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 592/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:54 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1251 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:55.359829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:55.370486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:55.378864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:55.394015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:55.395012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:55.395480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:55.398470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:55.398643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21ea0f28-aa18-4207-8bba-ce5ff4f59fa8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.642679 Sep 18 01:04:55.400759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:55.404184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:55.423063 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 636/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:54 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:55.466955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:55.467802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:55.485213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:55.485804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:55.494804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:55.495644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:55.502277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:55.503196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:55.530300 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d636aebd-caec-47af-91ad-9d4ff29a48ac tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188270 Sep 18 01:04:55.542651 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 593/1229] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:04:55 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:55.566826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:55.568349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:55.593978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:55.597321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:55.599697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:55.604902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:55.606884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:55.607721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:55.943778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:55.968537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:55.979401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:55.981799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf89986d-5a06-4cb1-bddf-a00a53d9a9ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1336 microversion: 2.25 time: 0.423239 Sep 18 01:04:55.983824 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 594/1230] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:55 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1336 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:56.039593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:56.040606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:56.058315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:56.058817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:56.059448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:56.060408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:56.061321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:56.062297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:56.189607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:56.202915 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e88fe1d3-cbac-4229-bfcc-f000d44d0139 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 0.741843 Sep 18 01:04:56.204138 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 637/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:55 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:56.259302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:56.279246 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a3b65ef-9389-4d1d-a17c-71342a1610ee tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1251 microversion: 2.1 time: 0.243944 Sep 18 01:04:56.298905 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 595/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:56 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1251 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:56.456456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:56.457216 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:56.496940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:56.497450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:56.499393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:56.502536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:56.506946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:56.507617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:56.551375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:56.554658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:56.607024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:56.607659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:56.608336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:56.636206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:56.638749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:56.642870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:56.733593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-add803ec-6dc8-4ea1-aa60-cc7fdf96591a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188332 Sep 18 01:04:56.741575 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 596/1233] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:04:56 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:57.025414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:57.029197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:57.068315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:57.081272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:57.082676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:57.085371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:57.090748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:57.091885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:57.895849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:57.930100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:57.935002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:57.941698 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9edbf65a-db66-4b07-ab7f-4d590ccbac26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1342 microversion: 2.25 time: 0.929658 Sep 18 01:04:57.946819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 597/1234] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:57 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1342 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:04:57.977202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:57.978597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:57.995519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:57.996139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:57.997216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:57.998756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:58.002405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:58.003247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:58.046626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:58.063730 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60fd4e6f-1d77-49e8-a62f-f1a6775fc783 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 1.621726 Sep 18 01:04:58.067481 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 638/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:56 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:58.078375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:58.079996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:58.104681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:58.116845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:58.121999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:58.127613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:58.128695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:58.132668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:58.351958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:58.369519 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6cb38eef-8224-4956-a749-092387de2fd0 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1251 microversion: 2.1 time: 0.299886 Sep 18 01:04:58.370421 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 639/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:58 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1251 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:58.375374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:58.384401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:58.397063 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:58.404867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:58.405853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:58.406460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:58.407391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:58.408005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:58.408599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:58.487841 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e340b32c-d15c-4e70-9dc7-3c0d5ce0b531 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116170 Sep 18 01:04:58.488802 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 640/1237] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:04:58 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:58.752609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:58.778836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-045b30ab-6194-4ebd-b45a-0a083fd15511 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 0.828694 Sep 18 01:04:58.783233 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 598/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:57 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:58.977851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:58.978635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:58.994581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:58.998353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:58.999158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:59.000158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:59.004320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:59.005224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:59.123418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:59.124336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:59.168023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:59.168855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:59.169680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:59.172623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:59.192452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:59.204056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:59.332413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:59.358175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:59.359791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:59.373435 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46c8a24b-d556-4b20-8460-aaad9d8236ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1342 microversion: 2.25 time: 0.399769 Sep 18 01:04:59.374688 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 641/1239] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:04:58 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1342 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:04:59.420465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:59.427607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:59.455520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:59.456469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:59.460754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:59.461831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:59.465272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:59.465992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:59.982833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:00.033838 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac2845e3-198e-41fe-86ec-3f9b17ba0eb6 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1251 microversion: 2.1 time: 0.618548 Sep 18 01:05:00.040765 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 642/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:59 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1251 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:00.047656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:00.050408 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:00.060708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:00.061470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:00.062298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:00.063668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:00.064329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:00.064927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:00.069776 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:00.118667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:00.139553 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c8965c6-6f21-4006-ae3a-3fac9026e178 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 1.019863 Sep 18 01:05:00.144705 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 599/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:59 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:00.174889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:00.190147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:00.225251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d56c8395-c7be-48e5-8598-62e8c328b9f4 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174790 Sep 18 01:05:00.237984 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 643/1242] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:05:00 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:00.256160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:00.276920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:00.277495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:00.287774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:00.289252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:00.289902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:00.293045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:00.293624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:00.320694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:00.321183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:00.321620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:00.322424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:00.338266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:00.339346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:00.682273 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=20 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:00.752689 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=14 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:01.260054 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:01.467535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:01.478502 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-166391dd-b249-42cf-bce9-f79e38ad8f36 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 1.238891 Sep 18 01:05:01.479104 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 644/1243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:00 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:01.490182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1d77b522-349a-4ad3-b86b-c47c52058dd8 req-5d4a5bbf-aec1-4c8f-9992-486676fa7759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029b967c-e30b-4828-af5d-b78e5f14ec02", "name": "network-vif-plugged", "status": "completed", "tag": "5b719cda-b0c5-435c-be67-77c91366eed4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:01.491743 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e60afc30-673c-4bf7-9a5b-9f064828bd62 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1812 microversion: 2.1 time: 1.345167 Sep 18 01:05:01.509121 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 600/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:00 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1812 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:01.524181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d77b522-349a-4ad3-b86b-c47c52058dd8 req-5d4a5bbf-aec1-4c8f-9992-486676fa7759 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.524667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d77b522-349a-4ad3-b86b-c47c52058dd8 req-5d4a5bbf-aec1-4c8f-9992-486676fa7759 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.525305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d77b522-349a-4ad3-b86b-c47c52058dd8 req-5d4a5bbf-aec1-4c8f-9992-486676fa7759 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:01.529312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:01.529922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:01.547861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.548682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.549262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:01.550179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.550788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.551919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:01.573275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1d77b522-349a-4ad3-b86b-c47c52058dd8 req-5d4a5bbf-aec1-4c8f-9992-486676fa7759 service nova] Creating event network-vif-plugged:5b719cda-b0c5-435c-be67-77c91366eed4 for instance 029b967c-e30b-4828-af5d-b78e5f14ec02 on n-h1-master-1 Sep 18 01:05:01.585673 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1d77b522-349a-4ad3-b86b-c47c52058dd8 req-5d4a5bbf-aec1-4c8f-9992-486676fa7759 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105260 Sep 18 01:05:01.586304 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 645/1245] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:01.606028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:01.606752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:01.623306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.624190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.624833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:01.627199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.629073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.629840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:01.753640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.753640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.753640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:01.753640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lazy-loading 'fault' on Instance uuid d680a3c6-91ab-4755-b862-9cb85ba60fe5 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:05:01.855687 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad79b8d173143c7aeaf4804e3949ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb58c52b4e6a451a880af6c63eb3ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:01.878693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-070c771d-d064-4947-b731-0bb3a6a3a51e tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 200 len: 1256 microversion: 2.1 time: 0.281034 Sep 18 01:05:01.885114 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 646/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:01 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 1256 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:01.891343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:01.891957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:01.916139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.917681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.918595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:01.923014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:01.923964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:01.925842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:02.030082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:02.042991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:02.048872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:02.058016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5bcc3083-6c4f-4de9-93d9-d8b6acf13ff8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1410 microversion: 2.25 time: 0.547040 Sep 18 01:05:02.061342 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 601/1247] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:05:01 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1410 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:05:02.080799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:02.084436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:02.106611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:02.107464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:02.109261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:02.112603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:02.114781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:02.116807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:02.199723 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-986ed7bb-77d5-4018-94e3-03ca0b1cee61 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132990 Sep 18 01:05:02.203875 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 602/1248] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:05:02 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:02.217113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:02.231502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:02.232116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:02.232560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:02.236408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:02.236986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:02.237934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:02.248463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:02.264423 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26159d96-0e15-4ae4-8588-c795d6aff220 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1475 microversion: 2.1 time: 0.374738 Sep 18 01:05:02.265453 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 647/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:01 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1475 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:02.299172 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9a89c12-61da-4b20-b208-aa3f6ec0d139 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093825 Sep 18 01:05:02.299788 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 603/1250] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:05:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:02.412291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4251bb34-6749-4cf4-82fe-a2e1483c5e80 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70061c4310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-260478187", "description": "tempest-description-1242240096"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:02.465421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e7125770-4347-4c8c-99db-369c611c4d0b tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Action: 'create', calling method: .version_select at 0x7f7006254c10>, body: {"pool": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:02.991593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4251bb34-6749-4cf4-82fe-a2e1483c5e80 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.722597 Sep 18 01:05:02.992942 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 648/1251] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:05:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:03.007342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:03.008077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:03.047463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:03.047730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:03.048068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:03.064610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:03.070671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:03.071301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:03.913390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:03.930004 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d5c2b77-4566-4853-af79-93bcc56e4a34 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1323 microversion: 2.1 time: 0.935390 Sep 18 01:05:03.931389 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 649/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:02 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1323 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:03.936351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:03.950649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] [instance: d680a3c6-91ab-4755-b862-9cb85ba60fe5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:03.968453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:03.971870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:03.972668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:03.974960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:03.980224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:03.981053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:04.023154 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] HTTP exception thrown: Instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 could not be found. Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Request method failure captured: Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 HTTP/1.1 Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4XjZjiDjenRAZAfF9Zr7dE3uNMnkJoOAL-xj6yOVKzz4aCLYEm8xnwF6JNgwF9I-yQGbbkNTSrrw9KViKCQczGgx-NsQkRegzhVTDGZNIX3jrBDQMBSSGOe0kDSg5jQMKfNSKph3XIlAvY_SR3WBxoUew__UZaP2gOC2Ne4MAemfE Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: cb58c52b4e6a451a880af6c63eb3ff4c Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestBootFromVolume-129588285 Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:04.025739 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cb58c52b4e6a451a880af6c63eb3ff4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cb58c52b4e6a451a880af6c63eb3ff4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cb58c52b4e6a451a880af6c63eb3ff4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cb58c52b4e6a451a880af6c63eb3ff4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestBootFromVolume-129588285 Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: cb58c52b4e6a451a880af6c63eb3ff4c Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestBootFromVolume-129588285 Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestBootFromVolume-129588285-project Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: dad79b8d173143c7aeaf4804e3949ca5 Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestBootFromVolume-129588285-project Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: exception: Instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 could not be found. Sep 18 01:05:04.027240 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'd680a3c6-91ab-4755-b862-9cb85ba60fe5'} Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 could not be found. Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:04.028456 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 could not be found. Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 could not be found. Sep 18 01:05:04.029846 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:04.037827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Returning 404 to user: Instance d680a3c6-91ab-4755-b862-9cb85ba60fe5 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:04.039072 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-51176d83-b252-4a36-af41-beaef53efef3 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5" status: 404 len: 111 microversion: 2.1 time: 0.106498 Sep 18 01:05:04.044086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 650/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:03 2022] GET /compute/v2.1/servers/d680a3c6-91ab-4755-b862-9cb85ba60fe5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:04.059806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-604a4f6e-35cc-4d13-a6b1-43710d1cc954 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70062c3ee0>, body: {"security_group_rule": {"parent_group_id": "d0256542-dea4-4b7c-8717-3fa1c4eaa7e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:05.651138 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-604a4f6e-35cc-4d13-a6b1-43710d1cc954 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.605524 Sep 18 01:05:05.652279 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 651/1254] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:05:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:05.662059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:05.662748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:05.699775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:05.701437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:05.702540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:05.707648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:05.708485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:05.708962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.063290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:06.080413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:06.086307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:06.087866 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-03b85634-f2ca-4dfc-94a1-b64404093974 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1410 microversion: 2.25 time: 0.433319 Sep 18 01:05:06.090421 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 652/1255] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:05:05 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1410 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:05:06.103028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:06.109459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:06.135397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.136348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.137266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.140490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.141802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.147051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.213909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b96f179-62a1-4895-a5da-6f155febd760 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120849 Sep 18 01:05:06.214498 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 653/1256] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:05:06 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:06.234231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:06.235140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:06.246957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.251097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.252087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.253131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.255154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.260799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.658445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:06.671978 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bedb2830-72b2-4dba-b6c9-30b2efcaf87d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1474 microversion: 2.1 time: 0.449024 Sep 18 01:05:06.672877 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 654/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:06 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1474 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:06.715850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-aabdc656-56b5-4f12-a376-c15567625391 req-63ac1894-c0c8-4aab-8b19-eb6f46d32f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6817d787-8c57-4c31-9d3d-787ff28ce6b6", "tag": "58e0419d-f921-4818-8610-d972ee40fa0c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:06.736822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aabdc656-56b5-4f12-a376-c15567625391 req-63ac1894-c0c8-4aab-8b19-eb6f46d32f6d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.737746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aabdc656-56b5-4f12-a376-c15567625391 req-63ac1894-c0c8-4aab-8b19-eb6f46d32f6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.738825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aabdc656-56b5-4f12-a376-c15567625391 req-63ac1894-c0c8-4aab-8b19-eb6f46d32f6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.761506 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-aabdc656-56b5-4f12-a376-c15567625391 req-63ac1894-c0c8-4aab-8b19-eb6f46d32f6d service nova] Creating event network-changed:58e0419d-f921-4818-8610-d972ee40fa0c for instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 on n-h1-master-1 Sep 18 01:05:06.769718 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-aabdc656-56b5-4f12-a376-c15567625391 req-63ac1894-c0c8-4aab-8b19-eb6f46d32f6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093829 Sep 18 01:05:06.775392 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 655/1258] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:06.783322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-75bd2210-0841-4c95-b69e-95177e125855 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] Calling method '.version_select at 0x7f7006351280>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:06.808085 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-75bd2210-0841-4c95-b69e-95177e125855 tempest-ServersTestBootFromVolume-129588285 tempest-ServersTestBootFromVolume-129588285-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048361840" status: 202 len: 0 microversion: 2.1 time: 0.030306 Sep 18 01:05:06.809081 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 656/1259] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:05:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048361840 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:06.825790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c4f272bd-c557-4ebc-a416-f92bce2677f7 req-6850223a-b26a-48e7-bb91-cd8c2b72b05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76259e8b-809c-4d92-8e2e-5dd2c058a6eb", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd27624-3292-471e-9c69-4045a4a44529"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:06.849718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c4f272bd-c557-4ebc-a416-f92bce2677f7 req-6850223a-b26a-48e7-bb91-cd8c2b72b05c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.856541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c4f272bd-c557-4ebc-a416-f92bce2677f7 req-6850223a-b26a-48e7-bb91-cd8c2b72b05c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.857345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c4f272bd-c557-4ebc-a416-f92bce2677f7 req-6850223a-b26a-48e7-bb91-cd8c2b72b05c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.887587 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c4f272bd-c557-4ebc-a416-f92bce2677f7 req-6850223a-b26a-48e7-bb91-cd8c2b72b05c service nova] Creating event network-vif-unplugged:6bd27624-3292-471e-9c69-4045a4a44529 for instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb on n-h1-master-1 Sep 18 01:05:06.911320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-c4f272bd-c557-4ebc-a416-f92bce2677f7 req-6850223a-b26a-48e7-bb91-cd8c2b72b05c service nova] Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:05:06.944725 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c4f272bd-c557-4ebc-a416-f92bce2677f7 req-6850223a-b26a-48e7-bb91-cd8c2b72b05c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133655 Sep 18 01:05:06.948481 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 657/1260] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:06.954197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:06.954917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:06.975387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.976213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.976836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:06.986949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:06.987718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:06.988355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:07.422485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:07.435088 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f859b31-4757-48ba-be89-56449c70fd7c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 200 len: 1519 microversion: 2.1 time: 0.485218 Sep 18 01:05:07.435664 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 658/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:06 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 1519 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:07.452442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "745a08c2-f9b0-49c7-bd13-9ca54ec8e263", "device": "/dev/xvdb"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:07.456021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:07.466673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:07.467152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:07.471305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:07.472076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:07.472557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:07.472993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:07.478303 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e7125770-4347-4c8c-99db-369c611c4d0b tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.168907 Sep 18 01:05:07.479503 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 604/1262] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:05:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:07.491561 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b12b678-890b-4e05-9c58-85d4fc837525 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70065dc790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1832496725", "description": "tempest-description-1146999832"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:07.991154 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b12b678-890b-4e05-9c58-85d4fc837525 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.510281 Sep 18 01:05:07.992580 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 605/1263] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:05:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:07.997534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:07.998320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:08.012941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:08.013371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:08.014039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:08.016119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:08.016464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:08.016890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:08.079089 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f656d54d-7308-492e-9c7f-b261d648be5e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "POST /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640826 Sep 18 01:05:08.084096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 659/1264] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:05:07 2022] POST /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:08.121962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:08.124800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:08.146550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:08.152048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:08.156492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:08.159144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:08.160744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:08.163541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:08.229240 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f9f2b85f-0374-4f0e-b641-f5c62d8b38e5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142617 Sep 18 01:05:08.236803 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 660/1265] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:05:08 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:08.242611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'action', calling method: .version_select at 0x7f7008b2e9d0>, body: {"addFloatingIp": {"address": "172.35.3.2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:08.245364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:08.276921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:08.278271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:08.278955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:08.279929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:08.280627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:08.281253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:08.315257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:08.325505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:08.327265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:08.328665 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d4f2867-9655-427d-bfcc-6ade60ee0803 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1410 microversion: 2.25 time: 0.335070 Sep 18 01:05:08.329917 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 606/1266] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:05:07 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1410 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:05:08.335317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c4943ccd-97d6-44fa-bd20-0432d9ff71de tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Action: 'create', calling method: .version_select at 0x7f70063b24c0>, body: {"pool": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:08.431139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:05:08.431900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquired lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:05:10.904341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:05:11.439887 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c4943ccd-97d6-44fa-bd20-0432d9ff71de tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.108579 Sep 18 01:05:11.447411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 607/1267] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:05:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:11.447411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:11.447411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:11.460841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:11.464499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:11.465155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:11.471773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:11.472502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:11.473123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:11.697257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:11.705668 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5994ebc5-21a5-429c-a342-dbf3c38f7a3a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1469 microversion: 2.1 time: 0.263758 Sep 18 01:05:11.717972 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 608/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:11 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:11.717972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-86a93980-aa13-4bcd-9f3c-d1f88f9740e4 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70062a10d0>, body: {"security_group_rule": {"parent_group_id": "d499803e-ff3c-4b5e-baa6-8db32d6880e5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:12.257433 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:12.442999 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-86a93980-aa13-4bcd-9f3c-d1f88f9740e4 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.729748 Sep 18 01:05:12.443951 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 609/1269] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:05:11 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:12.448610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b5b17e8d-c167-4648-851a-f213a20fa2b4 req-8f9aa01d-2b47-4f51-8574-3e675fb69743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817d787-8c57-4c31-9d3d-787ff28ce6b6", "name": "network-vif-plugged", "status": "completed", "tag": "58e0419d-f921-4818-8610-d972ee40fa0c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:12.473618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b5b17e8d-c167-4648-851a-f213a20fa2b4 req-8f9aa01d-2b47-4f51-8574-3e675fb69743 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:12.474098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b5b17e8d-c167-4648-851a-f213a20fa2b4 req-8f9aa01d-2b47-4f51-8574-3e675fb69743 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:12.474713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b5b17e8d-c167-4648-851a-f213a20fa2b4 req-8f9aa01d-2b47-4f51-8574-3e675fb69743 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:12.497914 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:12.500509 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b5b17e8d-c167-4648-851a-f213a20fa2b4 req-8f9aa01d-2b47-4f51-8574-3e675fb69743 service nova] Creating event network-vif-plugged:58e0419d-f921-4818-8610-d972ee40fa0c for instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 on n-h1-master-1 Sep 18 01:05:12.513225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b5b17e8d-c167-4648-851a-f213a20fa2b4 req-8f9aa01d-2b47-4f51-8574-3e675fb69743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068008 Sep 18 01:05:12.518035 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 610/1270] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:12.725329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-87079c24-8b6a-4d2a-9581-650018656692 req-bddaa4c6-267d-4ba4-9e6d-932325058fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76259e8b-809c-4d92-8e2e-5dd2c058a6eb", "tag": "6bd27624-3292-471e-9c69-4045a4a44529"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:12.750239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-87079c24-8b6a-4d2a-9581-650018656692 req-bddaa4c6-267d-4ba4-9e6d-932325058fd4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:12.750725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-87079c24-8b6a-4d2a-9581-650018656692 req-bddaa4c6-267d-4ba4-9e6d-932325058fd4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:12.751159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-87079c24-8b6a-4d2a-9581-650018656692 req-bddaa4c6-267d-4ba4-9e6d-932325058fd4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:12.809080 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-87079c24-8b6a-4d2a-9581-650018656692 req-bddaa4c6-267d-4ba4-9e6d-932325058fd4 service nova] Creating event network-changed:6bd27624-3292-471e-9c69-4045a4a44529 for instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb on n-h1-master-1 Sep 18 01:05:12.837174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-87079c24-8b6a-4d2a-9581-650018656692 req-bddaa4c6-267d-4ba4-9e6d-932325058fd4 service nova] Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:05:12.867141 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-87079c24-8b6a-4d2a-9581-650018656692 req-bddaa4c6-267d-4ba4-9e6d-932325058fd4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347361 Sep 18 01:05:12.868574 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 611/1271] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:12.875392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:12.878105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:12.888282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:12.889044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:12.889727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:12.890630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:12.891260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:12.893845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:12.968276 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7cc1cedc-4ea9-4e16-9ce0-d7a53030d473 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096862 Sep 18 01:05:12.969229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 612/1272] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:05:12 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:05:12.993408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:12.994073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:13.019640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:13.020176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:13.020880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:13.021643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:13.022111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:13.022549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:13.465977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Updating instance_info_cache with network_info: [{"id": "94467f9b-0d92-4d5c-9827-c574a8f20650", "address": "fa:16:3e:25:76:a5", "network": {"id": "b3f04822-05c6-4706-9c26-72bee19a7c93", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1298336588-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce0cec677134476aa0da53e6813c602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94467f9b-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:05:13.600809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:13.623229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:13.631936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:13.633570 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2157a61-9dde-48d0-8e54-354b8d252eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1410 microversion: 2.25 time: 0.663076 Sep 18 01:05:13.634307 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 613/1273] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:05:12 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1410 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:05:13.639145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b1b9a2f-42bf-4611-b5aa-b948a3e3b910 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Action: 'create', calling method: .version_select at 0x7f70063fc310>, body: {"pool": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:13.959197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Releasing lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:05:13.960597 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f85bfb03-eaeb-4c34-8ab7-9c5d68f72bef tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action" status: 202 len: 0 microversion: 2.1 time: 5.722122 Sep 18 01:05:13.964921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 661/1274] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:08 2022] POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action => generated 0 bytes in 5727 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:05:13.977894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:13.978453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:13.990481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:13.991023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:13.991466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:13.992197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:13.992657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:13.998322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:14.053630 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:14.164959 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abe5038c-c16c-4d1d-8c28-4d66a02ea79b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb/action" status: 204 len: 0 microversion: 2.1 time: 0.198657 Sep 18 01:05:14.166280 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 662/1275] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:13 2022] POST /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb/action => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:05:14.192948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53bf9001-c193-45c6-a121-bc01f8f5d356 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f700618edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-143294114", "description": "tempest-description-1259142458"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:15.090954 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53bf9001-c193-45c6-a121-bc01f8f5d356 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.919371 Sep 18 01:05:15.091818 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 663/1276] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:05:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:15.096592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1160316613", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "1349a5bb-29ab-48ae-878d-8a8d6be8c958"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:15.245695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] validate_networks() for [('1349a5bb-29ab-48ae-878d-8a8d6be8c958', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:05:16.058180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:05:16.058610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:05:16.059068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:05:16.059483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:05:16.059909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:05:16.089677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.090181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.090626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:16.091370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.092216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.092329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:16.121618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Getting quotas for project 71ee3046b1b54c14aad90abf94e90e0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:16.129612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Getting quotas for user 5db81d9aa4714dcf871b98e26584d325 and project 71ee3046b1b54c14aad90abf94e90e0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:16.149394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:05:16.153247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:05:16.221980 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-40e20336-bc1b-488b-986b-de0b3d5fd83d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.128994 Sep 18 01:05:16.223383 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 664/1277] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:05:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:05:16.229794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:16.233295 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:16.242058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.242944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.243629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:16.244716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.245390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.246231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:16.324143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "refresh_cache-029b967c-e30b-4828-af5d-b78e5f14ec02" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:05:16.331351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquired lock "refresh_cache-029b967c-e30b-4828-af5d-b78e5f14ec02" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:05:16.871165 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b1b9a2f-42bf-4611-b5aa-b948a3e3b910 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.235387 Sep 18 01:05:16.872437 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 614/1278] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:05:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:16.877275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:16.878415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:16.885991 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=69 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:16.915712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.916205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.916663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:16.917621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.918080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.918525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:17.267741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:17.283987 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1eede758-f506-4b55-b432-e3a60d442da6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1469 microversion: 2.1 time: 0.410488 Sep 18 01:05:17.285181 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 615/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:16 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:17.291129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-17d349da-38e6-4654-a957-a183672cba2b req-72ca8ee7-6625-43ba-9cb0-216f55bfb480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76259e8b-809c-4d92-8e2e-5dd2c058a6eb", "name": "network-vif-plugged", "status": "completed", "tag": "6bd27624-3292-471e-9c69-4045a4a44529"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:17.302819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-17d349da-38e6-4654-a957-a183672cba2b req-72ca8ee7-6625-43ba-9cb0-216f55bfb480 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:17.303555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-17d349da-38e6-4654-a957-a183672cba2b req-72ca8ee7-6625-43ba-9cb0-216f55bfb480 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:17.304134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-17d349da-38e6-4654-a957-a183672cba2b req-72ca8ee7-6625-43ba-9cb0-216f55bfb480 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:17.321710 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-17d349da-38e6-4654-a957-a183672cba2b req-72ca8ee7-6625-43ba-9cb0-216f55bfb480 service nova] Creating event network-vif-plugged:6bd27624-3292-471e-9c69-4045a4a44529 for instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb on n-h1-master-1 Sep 18 01:05:17.328260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-17d349da-38e6-4654-a957-a183672cba2b req-72ca8ee7-6625-43ba-9cb0-216f55bfb480 service nova] Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:05:17.341881 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-17d349da-38e6-4654-a957-a183672cba2b req-72ca8ee7-6625-43ba-9cb0-216f55bfb480 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055125 Sep 18 01:05:17.342741 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 616/1280] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:17.349473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:17.350370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:17.358386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:17.358888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:17.359330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:17.360090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:17.361029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:17.361800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:17.799975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:17.812951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:17.815013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:17.816848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a8f2abba-96a2-43dc-bc5b-1332f2f9a55d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1606 microversion: 2.25 time: 0.472775 Sep 18 01:05:17.840228 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 617/1281] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:05:17 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1606 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:05:17.845490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e403541a-2565-4840-911f-0ccaa2c0b9a2 req-060d41d6-3586-4901-a012-6db7e6e4c490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b76040-84b4-4c7e-a381-5cb762d7c75c", "tag": "94467f9b-0d92-4d5c-9827-c574a8f20650"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:17.856020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e403541a-2565-4840-911f-0ccaa2c0b9a2 req-060d41d6-3586-4901-a012-6db7e6e4c490 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:17.856785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e403541a-2565-4840-911f-0ccaa2c0b9a2 req-060d41d6-3586-4901-a012-6db7e6e4c490 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:17.857375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e403541a-2565-4840-911f-0ccaa2c0b9a2 req-060d41d6-3586-4901-a012-6db7e6e4c490 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:17.870528 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e403541a-2565-4840-911f-0ccaa2c0b9a2 req-060d41d6-3586-4901-a012-6db7e6e4c490 service nova] Creating event network-changed:94467f9b-0d92-4d5c-9827-c574a8f20650 for instance 00b76040-84b4-4c7e-a381-5cb762d7c75c on n-h1-master-1 Sep 18 01:05:17.877833 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e403541a-2565-4840-911f-0ccaa2c0b9a2 req-060d41d6-3586-4901-a012-6db7e6e4c490 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035237 Sep 18 01:05:17.879408 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 618/1282] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:17.885025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2459306e-7fcd-49d8-8dae-be8288f4c8aa tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70063be310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-971386391", "description": "tempest-description-2031246316"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:18.402037 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2459306e-7fcd-49d8-8dae-be8288f4c8aa tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.519667 Sep 18 01:05:18.406199 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 619/1283] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:05:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:18.415101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:18.418201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:18.429681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:18.431490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:18.432292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:18.433182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:18.434558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:18.436017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:18.563679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:18.576185 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a2cb5c1e-62d0-442a-933d-5df1f77fd967 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1270 microversion: 2.1 time: 0.168922 Sep 18 01:05:18.598582 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 620/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:18 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:18.606845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb774f7e-cbff-42a1-aa02-68d2bdcde3fd tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Action: 'create', calling method: .version_select at 0x7f7006254ca0>, body: {"pool": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:20.771888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.neutron [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] re-assign floating IP 172.35.3.2 from instance 00b76040-84b4-4c7e-a381-5cb762d7c75c Sep 18 01:05:20.847458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:05:21.303490 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb774f7e-cbff-42a1-aa02-68d2bdcde3fd tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.703570 Sep 18 01:05:21.305001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 621/1285] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:05:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:21.311865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:21.312726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:21.328500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:21.329290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:21.329961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:21.330905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:21.331531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:21.332129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:21.528741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f48d6d40-fdf8-4daf-964a-9a966ec76fb0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.222303 Sep 18 01:05:21.530218 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 622/1286] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 18 01:05:21 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:05:21.540143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:21.541237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:21.555225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:21.560971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:21.561890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:21.562969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:21.564806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:21.565441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:22.114940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:22.126342 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6790562c-ab78-42b2-8d3a-23acdf60faf8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1461 microversion: 2.1 time: 0.594426 Sep 18 01:05:22.141583 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 623/1287] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:21 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1461 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:22.144031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3ca0a1c-8d69-4d13-82cc-744c1e54762a tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70063b23a0>, body: {"security_group_rule": {"parent_group_id": "25b46f96-9340-43ee-a57a-a5d1901c8ddd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4792999c-3f03-4f7a-9117-06b30fb70bc5"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:22.312776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Updating instance_info_cache with network_info: [{"id": "94467f9b-0d92-4d5c-9827-c574a8f20650", "address": "fa:16:3e:25:76:a5", "network": {"id": "b3f04822-05c6-4706-9c26-72bee19a7c93", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1298336588-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce0cec677134476aa0da53e6813c602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94467f9b-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:05:22.325748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:05:23.101150 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d3ca0a1c-8d69-4d13-82cc-744c1e54762a tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.962521 Sep 18 01:05:23.109331 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 624/1288] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:05:22 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:23.125424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:23.126335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:23.146634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:23.151467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:23.154267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:23.156524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:23.158048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:23.159337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:23.845633 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:23.862559 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3e691210-cf7a-4c56-9b15-2ffe51751f87 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1318 microversion: 2.1 time: 0.747157 Sep 18 01:05:23.863043 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 625/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:23 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:23.879474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-84ad924e-562d-4618-861a-1b8d854f383a req-ca1322a2-5448-481c-89ba-fee384d9ba6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b76040-84b4-4c7e-a381-5cb762d7c75c", "tag": "94467f9b-0d92-4d5c-9827-c574a8f20650"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:23.887947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Updating instance_info_cache with network_info: [{"id": "5b719cda-b0c5-435c-be67-77c91366eed4", "address": "fa:16:3e:f9:9a:4a", "network": {"id": "b3f04822-05c6-4706-9c26-72bee19a7c93", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1298336588-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce0cec677134476aa0da53e6813c602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b719cda-b0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:05:23.902279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-84ad924e-562d-4618-861a-1b8d854f383a req-ca1322a2-5448-481c-89ba-fee384d9ba6a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:23.903571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-84ad924e-562d-4618-861a-1b8d854f383a req-ca1322a2-5448-481c-89ba-fee384d9ba6a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:23.904493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-84ad924e-562d-4618-861a-1b8d854f383a req-ca1322a2-5448-481c-89ba-fee384d9ba6a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:23.907552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Releasing lock "refresh_cache-029b967c-e30b-4828-af5d-b78e5f14ec02" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:05:23.909267 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9e1aa5ad-f21e-49f9-a7c9-de52a2c26a2b tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02/action" status: 202 len: 0 microversion: 2.1 time: 7.683855 Sep 18 01:05:23.913978 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 665/1290] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:16 2022] POST /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02/action => generated 0 bytes in 7689 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:05:23.922197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d22c23c0-3e95-48ef-b6f8-b469942ade02 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Calling method '.version_select at 0x7f70062f7040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:23.924662 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-84ad924e-562d-4618-861a-1b8d854f383a req-ca1322a2-5448-481c-89ba-fee384d9ba6a service nova] Creating event network-changed:94467f9b-0d92-4d5c-9827-c574a8f20650 for instance 00b76040-84b4-4c7e-a381-5cb762d7c75c on n-h1-master-1 Sep 18 01:05:23.939904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-84ad924e-562d-4618-861a-1b8d854f383a req-ca1322a2-5448-481c-89ba-fee384d9ba6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068379 Sep 18 01:05:23.940879 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 626/1291] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:23.956863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ec5a6b4b-c20e-43c8-b542-a4e69d3dc4ed req-a35d3559-4a39-48ec-bf5a-2190c1046a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb7f179-1199-4031-a669-3648be03b240", "tag": "5d2916d1-a58e-4f2b-9414-6a0386200401"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:23.970768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ec5a6b4b-c20e-43c8-b542-a4e69d3dc4ed req-a35d3559-4a39-48ec-bf5a-2190c1046a22 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:23.971243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ec5a6b4b-c20e-43c8-b542-a4e69d3dc4ed req-a35d3559-4a39-48ec-bf5a-2190c1046a22 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:23.971671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ec5a6b4b-c20e-43c8-b542-a4e69d3dc4ed req-a35d3559-4a39-48ec-bf5a-2190c1046a22 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:23.988326 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ec5a6b4b-c20e-43c8-b542-a4e69d3dc4ed req-a35d3559-4a39-48ec-bf5a-2190c1046a22 service nova] Creating event network-changed:5d2916d1-a58e-4f2b-9414-6a0386200401 for instance 4bb7f179-1199-4031-a669-3648be03b240 on n-h2-master-1 Sep 18 01:05:24.001454 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ec5a6b4b-c20e-43c8-b542-a4e69d3dc4ed req-a35d3559-4a39-48ec-bf5a-2190c1046a22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057354 Sep 18 01:05:24.002451 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 627/1292] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:24.009158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:24.010357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:24.019145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:24.019893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:24.021776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:24.022667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:24.023283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:24.023888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:24.407715 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-505dbb7c-a49b-438e-8868-828e1d092530 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1612 microversion: 2.1 time: 0.403680 Sep 18 01:05:24.408351 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 628/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:24 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1612 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:24.428893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7bdabf68-a206-4615-82ff-938e910c612e tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f7006254550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1012615186", "description": "tempest-description-1362148441"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:24.499984 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d22c23c0-3e95-48ef-b6f8-b469942ade02 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/d9c42139-d01b-405f-adff-629e14f0f737" status: 200 len: 142 microversion: 2.1 time: 0.584576 Sep 18 01:05:24.500749 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 666/1294] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:05:23 2022] GET /compute/v2.1/os-floating-ips/d9c42139-d01b-405f-adff-629e14f0f737 => generated 142 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:24.507058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:24.508436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:24.515901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:24.516662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:24.517284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:24.518196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:24.518959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:24.519550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:24.947187 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d8e59c5-3eb7-4221-8e7e-e9c880cbff04 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1858 microversion: 2.1 time: 0.443859 Sep 18 01:05:24.948605 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 667/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:24 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1858 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:24.972228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'action', calling method: .version_select at 0x7f7008b2e820>, body: {"removeFloatingIp": {"address": "172.35.3.2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:24.992375 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7bdabf68-a206-4615-82ff-938e910c612e tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.582989 Sep 18 01:05:25.001424 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 629/1296] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:05:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:25.001424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00b72d78-2ea1-4e42-90c9-9313edd4ff2d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '.version_select at 0x7f70063fc280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:25.001424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00b72d78-2ea1-4e42-90c9-9313edd4ff2d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:25.005886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00b72d78-2ea1-4e42-90c9-9313edd4ff2d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:25.006302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00b72d78-2ea1-4e42-90c9-9313edd4ff2d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:25.016212 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00b72d78-2ea1-4e42-90c9-9313edd4ff2d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.021740 Sep 18 01:05:25.034054 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 630/1297] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:05:24 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:25.041277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77e3c4ab-514d-4a79-9794-c05dbb2c098e tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Calling method '.version_select at 0x7f70062a1f70>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:25.444837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:25.454040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:25.454790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:25.455487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:25.467591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:25.468967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:25.469645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:26.079064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] HTTP exception thrown: Floating IP 172.35.3.2 is not associated with instance 00b76040-84b4-4c7e-a381-5cb762d7c75c. Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Request method failure captured: Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action HTTP/1.1 Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 47 Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm6SgYPWyPpn5vgN04-cVLRYSgkR6hAnoCApHvqynlsSpeRRxte_q4YjHM5CiYRAK6M19zExSeniqOl5l-HZYQmPAMdsrtLzg--J_h_jmOhiGmzQR5QzD6GkbZ44oopqaNsxaQVeqPjJFkGmYTC8hOYgYhN6TGzarNWR8mn2obgW1zk Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:26.080917 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fce0cec677134476aa0da53e6813c602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fce0cec677134476aa0da53e6813c602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: c3817ebe53a344c3ba3b6b56c726cc57 Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: {"removeFloatingIp": {"address": "172.35.3.2"}} Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:05:26.082487 n-d-master-1 devstack@n-api.service[122374]: exception: Floating IP 172.35.3.2 is not associated with instance 00b76040-84b4-4c7e-a381-5cb762d7c75c. Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '00b76040-84b4-4c7e-a381-5cb762d7c75c', 'body': {'removeFloatingIp': {'address': '172.35.3.2'}}} Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.3.2 is not associated with instance 00b76040-84b4-4c7e-a381-5cb762d7c75c. Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:26.083880 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.3.2 is not associated with instance 00b76040-84b4-4c7e-a381-5cb762d7c75c. Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Returning 409 to user: Floating IP 172.35.3.2 is not associated with instance 00b76040-84b4-4c7e-a381-5cb762d7c75c. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-86d9603b-11af-4a32-93be-cfd2a077ef02 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action" status: 409 len: 144 microversion: 2.1 time: 1.119559 Sep 18 01:05:26.086215 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 668/1298] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:24 2022] POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action => generated 144 bytes in 1122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:05:26.096480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:26.097341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:26.107003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:26.107534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:26.108167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:26.108905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:26.109406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:26.109930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:26.110507 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:26.148294 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:26.345344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:26.358030 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d581234-e842-4548-b334-79d0288d4661 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1318 microversion: 2.1 time: 0.271993 Sep 18 01:05:26.364637 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 669/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:26 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:26.370079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:26.373132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:26.380284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:26.380773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:26.381201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:26.382095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:26.382729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:26.383150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:26.415283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lazy-loading 'flavor' on Instance uuid f5ff9e6d-5612-447a-b317-dd1e6f1324b3 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:05:26.435863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Going to try to live migrate instance to n-h1-master-1 {{(pid=122374) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:05:26.653110 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77e3c4ab-514d-4a79-9794-c05dbb2c098e tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/d9c42139-d01b-405f-adff-629e14f0f737" status: 202 len: 0 microversion: 2.1 time: 1.617476 Sep 18 01:05:26.653973 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 631/1300] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:05:25 2022] DELETE /compute/v2.1/os-floating-ips/d9c42139-d01b-405f-adff-629e14f0f737 => generated 0 bytes in 1619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:26.659638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b67c3a24-bf1b-4ffc-815a-f203d9c8f178 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70063b20d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1718493518", "description": "tempest-description-1740367262"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:26.888388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b67c3a24-bf1b-4ffc-815a-f203d9c8f178 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.230901 Sep 18 01:05:26.889246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 632/1301] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:05:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:26.895986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-526571474", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:26.990161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:05:27.240630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:05:27.241228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:05:27.241884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:05:27.242756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:05:27.244277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:05:27.255785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:27.256434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:27.257116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:27.258495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:27.258629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:27.259092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:27.283012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:27.288619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for user 666826ce8e51441ea7c271be4c5d8eb9 and project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:27.305545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:05:27.308074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:05:27.370734 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-303302bb-52f1-46b0-a17f-3f9dbd18a068 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.479210 Sep 18 01:05:27.371871 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 633/1302] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:05:27.385418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-234fd21f-38e2-4f98-b4c9-5b1b7c552504 req-e98ffe2f-112a-47bb-8f9a-8fedb08e1eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029b967c-e30b-4828-af5d-b78e5f14ec02", "tag": "5b719cda-b0c5-435c-be67-77c91366eed4"}, {"name": "network-changed", "server_uuid": "6817d787-8c57-4c31-9d3d-787ff28ce6b6", "tag": "58e0419d-f921-4818-8610-d972ee40fa0c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:27.404753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-234fd21f-38e2-4f98-b4c9-5b1b7c552504 req-e98ffe2f-112a-47bb-8f9a-8fedb08e1eed service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:27.405480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-234fd21f-38e2-4f98-b4c9-5b1b7c552504 req-e98ffe2f-112a-47bb-8f9a-8fedb08e1eed service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:27.406105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-234fd21f-38e2-4f98-b4c9-5b1b7c552504 req-e98ffe2f-112a-47bb-8f9a-8fedb08e1eed service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:27.443054 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-234fd21f-38e2-4f98-b4c9-5b1b7c552504 req-e98ffe2f-112a-47bb-8f9a-8fedb08e1eed service nova] Creating event network-changed:5b719cda-b0c5-435c-be67-77c91366eed4 for instance 029b967c-e30b-4828-af5d-b78e5f14ec02 on n-h1-master-1 Sep 18 01:05:27.443566 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-234fd21f-38e2-4f98-b4c9-5b1b7c552504 req-e98ffe2f-112a-47bb-8f9a-8fedb08e1eed service nova] Creating event network-changed:58e0419d-f921-4818-8610-d972ee40fa0c for instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 on n-h1-master-1 Sep 18 01:05:27.458863 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-234fd21f-38e2-4f98-b4c9-5b1b7c552504 req-e98ffe2f-112a-47bb-8f9a-8fedb08e1eed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083276 Sep 18 01:05:27.461871 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 634/1303] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:27.728290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1218737673", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b66b4645-3540-45b7-82ac-f51c6140e547"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:27.823575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] validate_networks() for [('b66b4645-3540-45b7-82ac-f51c6140e547', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:05:28.100300 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d0ae5447-1d27-4204-90fb-ac9cbc57600a tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/action" status: 202 len: 0 microversion: 2.1 time: 1.734135 Sep 18 01:05:28.115795 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 670/1304] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:26 2022] POST /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/action => generated 0 bytes in 1750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:28.121298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:28.491769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:28.494077 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:28.500731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:28.502363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:28.503099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:28.507832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:28.508383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:28.508886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:29.100350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "refresh_cache-029b967c-e30b-4828-af5d-b78e5f14ec02" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:05:29.100942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquired lock "refresh_cache-029b967c-e30b-4828-af5d-b78e5f14ec02" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:05:29.547542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:05:29.548383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:05:29.548609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:05:29.549272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:05:29.549931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:05:29.571075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:29.571675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:29.572342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:29.573366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:29.574080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:29.574715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:29.622029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:29.638936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for user 253b3027efb74403a9bfaa4d2cbfd31e and project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:29.663710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:05:29.673961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:05:29.738924 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8700131-fd3c-41b6-84b8-469ebfc58c50 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.274091 Sep 18 01:05:29.746080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 635/1305] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:05:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:05:29.747927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-356fc5cc-1443-40ce-aa75-a9018460b4a0 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Calling method '.version_select at 0x7f7006536d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:30.172078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-356fc5cc-1443-40ce-aa75-a9018460b4a0 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.431361 Sep 18 01:05:30.187165 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 636/1306] 10.222.0.25 () {58 vars in 1164 bytes} [Sun Sep 18 01:05:29 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:05:30.221582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-85e1305d-a65b-4323-9ed9-37771d0a8562 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70062019d0>, body: {"security_group_rule": {"parent_group_id": "c192466c-fef7-4f3b-be29-995d70bf6926", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "27be3eca-ac89-42a2-889c-f2ddebe12a35"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:31.859836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-85e1305d-a65b-4323-9ed9-37771d0a8562 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.670967 Sep 18 01:05:31.861535 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 637/1307] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:05:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:31.884223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:31.885049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:31.903702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:31.905654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:31.906273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:31.909141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:31.909858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:31.910540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:31.921068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:05:32.400361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:32.413451 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bc755c8a-ce88-4324-bf3c-a79fa6bef3d6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1312 microversion: 2.1 time: 0.550740 Sep 18 01:05:32.418583 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 638/1308] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:31 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:32.424576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:32.426165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:32.445823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:32.446547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:32.447198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:32.448059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:32.449509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:32.450417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:32.805102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:32.825315 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b09d4162-0e02-4b67-a007-27b45df8cb5b tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1318 microversion: 2.1 time: 0.405448 Sep 18 01:05:32.853949 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 639/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:32 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:32.859191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:32.860073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:32.866836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:32.884534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:32.885983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:32.886940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:32.887568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:32.898339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:33.219676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Updating instance_info_cache with network_info: [{"id": "5b719cda-b0c5-435c-be67-77c91366eed4", "address": "fa:16:3e:f9:9a:4a", "network": {"id": "b3f04822-05c6-4706-9c26-72bee19a7c93", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1298336588-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce0cec677134476aa0da53e6813c602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b719cda-b0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:05:33.234849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Releasing lock "refresh_cache-029b967c-e30b-4828-af5d-b78e5f14ec02" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:05:33.236121 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-25bdb639-5778-41ea-ad62-a5f6a96f7a77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02/action" status: 202 len: 0 microversion: 2.1 time: 5.119229 Sep 18 01:05:33.238129 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 671/1310] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:28 2022] POST /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02/action => generated 0 bytes in 5122 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:05:33.275380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:33.288411 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12aedaaa-f840-41a2-8f5f-4a99ae744698 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.432961 Sep 18 01:05:33.292487 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 640/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:32 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:33.300892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:33.302100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:33.312275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:33.312973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:33.313697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:33.314790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:33.316100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:33.316782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:33.375751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-48d59d91-edb8-4ba0-b716-8923f57e899c req-e3327d99-122c-4f75-b316-a71666c720c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7f179-1199-4031-a669-3648be03b240", "name": "network-vif-plugged", "status": "completed", "tag": "5d2916d1-a58e-4f2b-9414-6a0386200401"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:33.391940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-48d59d91-edb8-4ba0-b716-8923f57e899c req-e3327d99-122c-4f75-b316-a71666c720c7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:33.393241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-48d59d91-edb8-4ba0-b716-8923f57e899c req-e3327d99-122c-4f75-b316-a71666c720c7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:33.394358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-48d59d91-edb8-4ba0-b716-8923f57e899c req-e3327d99-122c-4f75-b316-a71666c720c7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:33.411728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-48d59d91-edb8-4ba0-b716-8923f57e899c req-e3327d99-122c-4f75-b316-a71666c720c7 service nova] Creating event network-vif-plugged:5d2916d1-a58e-4f2b-9414-6a0386200401 for instance 4bb7f179-1199-4031-a669-3648be03b240 on n-h2-master-1 Sep 18 01:05:33.418251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-48d59d91-edb8-4ba0-b716-8923f57e899c req-e3327d99-122c-4f75-b316-a71666c720c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177928 Sep 18 01:05:33.419524 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 672/1312] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:33.426749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f4f0459-f7a8-4824-ae48-ee3b82da3d11 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Calling method '.version_select at 0x7f7006b0db80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:33.552153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:33.569742 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-85518ec0-c359-4e11-8091-29fcb930cb64 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1273 microversion: 2.1 time: 0.275548 Sep 18 01:05:33.571483 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 641/1313] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:33 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:33.579062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4550038-17f8-48de-b896-ebdb582745b8 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f70062545e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:33.852882 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f4f0459-f7a8-4824-ae48-ee3b82da3d11 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.431500 Sep 18 01:05:33.854249 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 673/1314] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:05:33 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:33.864540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f6593abf-75dc-44fe-a736-cac2456f2723 req-053c0ca7-ed64-49c8-bb0c-05be554921cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029b967c-e30b-4828-af5d-b78e5f14ec02", "tag": "5b719cda-b0c5-435c-be67-77c91366eed4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:33.884185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f6593abf-75dc-44fe-a736-cac2456f2723 req-053c0ca7-ed64-49c8-bb0c-05be554921cd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:33.885150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f6593abf-75dc-44fe-a736-cac2456f2723 req-053c0ca7-ed64-49c8-bb0c-05be554921cd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:33.885781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f6593abf-75dc-44fe-a736-cac2456f2723 req-053c0ca7-ed64-49c8-bb0c-05be554921cd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:33.904569 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f6593abf-75dc-44fe-a736-cac2456f2723 req-053c0ca7-ed64-49c8-bb0c-05be554921cd service nova] Creating event network-changed:5b719cda-b0c5-435c-be67-77c91366eed4 for instance 029b967c-e30b-4828-af5d-b78e5f14ec02 on n-h1-master-1 Sep 18 01:05:33.914099 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f6593abf-75dc-44fe-a736-cac2456f2723 req-053c0ca7-ed64-49c8-bb0c-05be554921cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057859 Sep 18 01:05:33.915620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 674/1315] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:33.921426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c0306176-c8ec-4d30-add3-d71764516f48 req-01b5c5d9-0abd-4276-8fd0-094b54c8bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3406f44-aa77-483c-9c1b-6a51773b5023", "tag": "905d0978-cc22-487f-be72-d9e5d75cf1f8"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:33.932808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c0306176-c8ec-4d30-add3-d71764516f48 req-01b5c5d9-0abd-4276-8fd0-094b54c8bb5d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:33.933899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c0306176-c8ec-4d30-add3-d71764516f48 req-01b5c5d9-0abd-4276-8fd0-094b54c8bb5d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:33.934524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c0306176-c8ec-4d30-add3-d71764516f48 req-01b5c5d9-0abd-4276-8fd0-094b54c8bb5d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:33.952517 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c0306176-c8ec-4d30-add3-d71764516f48 req-01b5c5d9-0abd-4276-8fd0-094b54c8bb5d service nova] Creating event network-changed:905d0978-cc22-487f-be72-d9e5d75cf1f8 for instance d3406f44-aa77-483c-9c1b-6a51773b5023 on n-h2-master-1 Sep 18 01:05:33.961816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c0306176-c8ec-4d30-add3-d71764516f48 req-01b5c5d9-0abd-4276-8fd0-094b54c8bb5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044136 Sep 18 01:05:33.963563 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 675/1316] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:33.971826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:33.972773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:33.981491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:33.982314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:33.982979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:33.984152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:33.985211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:33.985935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:34.047505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:05:34.136131 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b4550038-17f8-48de-b896-ebdb582745b8 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/27be3eca-ac89-42a2-889c-f2ddebe12a35" status: 202 len: 0 microversion: 2.1 time: 0.562825 Sep 18 01:05:34.136717 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 642/1317] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:33 2022] DELETE /compute/v2.1/os-security-groups/27be3eca-ac89-42a2-889c-f2ddebe12a35 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:34.142451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:34.143406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:34.159089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:34.159653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:34.162498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:34.163314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:34.165446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:34.169815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:34.220749 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d356c87f-e9e6-45fb-8fc2-acdc3c0a9dc5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 204 len: 0 microversion: 2.1 time: 0.255026 Sep 18 01:05:34.222532 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 676/1318] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:05:33 2022] DELETE /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:05:34.235198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:34.236318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:34.239451 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:34.244861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:34.245832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:34.246505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:34.247482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:34.248176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:34.248760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:34.283180 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:34.686523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:34.703071 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb9ab0f2-c615-405e-8255-1d149b27aa04 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1312 microversion: 2.1 time: 0.564564 Sep 18 01:05:34.703273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:34.704519 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 643/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:34 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1312 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:34.710539 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-caa84375-816a-4f08-9bad-3b1293bf480d tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Calling method '.version_select at 0x7f70064075e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:34.724153 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db504fe9-4e10-404a-b780-5f2b870f283d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1318 microversion: 2.1 time: 0.499919 Sep 18 01:05:34.725745 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 677/1320] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:34 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:34.730857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cbe7841e-6074-47af-ac45-9f0f2df66e07 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f70062f7310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:35.252306 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cbe7841e-6074-47af-ac45-9f0f2df66e07 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/c192466c-fef7-4f3b-be29-995d70bf6926" status: 200 len: 248 microversion: 2.1 time: 0.525106 Sep 18 01:05:35.254122 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 678/1321] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:05:34 2022] GET /compute/v2.1/os-security-groups/c192466c-fef7-4f3b-be29-995d70bf6926 => generated 248 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:35.264028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:35.271055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:35.289255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:35.289926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:35.290530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:35.291253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:35.292300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:35.292729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:35.324398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:05:35.324797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquired lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:05:37.194835 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-caa84375-816a-4f08-9bad-3b1293bf480d tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/a97c3184-ecd5-4ba0-847f-849ef667577d" status: 202 len: 0 microversion: 2.1 time: 2.489085 Sep 18 01:05:37.195547 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 644/1322] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:05:34 2022] DELETE /compute/v2.1/os-floating-ips/a97c3184-ecd5-4ba0-847f-849ef667577d => generated 0 bytes in 2490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:37.201161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:37.201161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:37.208914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:37.209405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:37.209871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:37.210582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:37.211044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:37.211467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:37.920221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:37.933848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5cc1d3c7-d9e2-48a1-aa51-2cc47a59f7c6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.737057 Sep 18 01:05:37.938919 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 645/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:37 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:37.943856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:37.944463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:37.971019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:37.971648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:37.972097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:37.973412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:37.973957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:37.974396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:38.227446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:38.235811 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4c7bfb2-6b26-402e-b446-a3b8554c72a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1315 microversion: 2.1 time: 0.295754 Sep 18 01:05:38.242066 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 646/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:37 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:38.242066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-adc044ed-6d77-4cf3-9adb-d044d8e5a120 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70063b2670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1311717936", "description": "tempest-description-1708660206"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:38.296086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:05:38.561525 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-adc044ed-6d77-4cf3-9adb-d044d8e5a120 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.323812 Sep 18 01:05:38.562229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 647/1325] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:05:38 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:38.567498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:38.568367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:38.574687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:38.575498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:38.576169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:38.577127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:38.577901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:38.578553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:38.822836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:38.830937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4743bc3c-45ce-4fd4-809b-48a29fef2114 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1312 microversion: 2.1 time: 0.267334 Sep 18 01:05:38.832058 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 648/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:38 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:38.839047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:38.840490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:38.848390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:38.849385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:38.849969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:38.850967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:38.851617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:38.852046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:39.098869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:39.109082 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b98a187b-6074-4137-99ca-94e5b7461335 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1508 microversion: 2.1 time: 0.274970 Sep 18 01:05:39.110807 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 649/1327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:38 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:39.118388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-313e75fe-71b1-4d05-931a-7726c7f12c88 req-6270c121-06e6-44f3-b020-201b8da31718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca", "tag": "79446ee2-e15c-4ba2-a21d-d44c227e6253"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:39.129819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-313e75fe-71b1-4d05-931a-7726c7f12c88 req-6270c121-06e6-44f3-b020-201b8da31718 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:39.131363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-313e75fe-71b1-4d05-931a-7726c7f12c88 req-6270c121-06e6-44f3-b020-201b8da31718 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:39.131693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-313e75fe-71b1-4d05-931a-7726c7f12c88 req-6270c121-06e6-44f3-b020-201b8da31718 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:39.146297 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-313e75fe-71b1-4d05-931a-7726c7f12c88 req-6270c121-06e6-44f3-b020-201b8da31718 service nova] Creating event network-changed:79446ee2-e15c-4ba2-a21d-d44c227e6253 for instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca on n-h1-master-1 Sep 18 01:05:39.152295 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-313e75fe-71b1-4d05-931a-7726c7f12c88 req-6270c121-06e6-44f3-b020-201b8da31718 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039985 Sep 18 01:05:39.153185 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 650/1328] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:39.166002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Updating instance_info_cache with network_info: [{"id": "94467f9b-0d92-4d5c-9827-c574a8f20650", "address": "fa:16:3e:25:76:a5", "network": {"id": "b3f04822-05c6-4706-9c26-72bee19a7c93", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1298336588-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce0cec677134476aa0da53e6813c602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94467f9b-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:05:39.170309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54f4f39e-f0ef-4fc7-9c48-d85a79465937 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Calling method '.version_select at 0x7f70061e3b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:39.188078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Releasing lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:05:39.189016 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3d88740-a75d-40cb-a209-35de70ec6dbc tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action" status: 202 len: 0 microversion: 2.1 time: 3.933043 Sep 18 01:05:39.190414 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 679/1329] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:35 2022] POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action => generated 0 bytes in 3935 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:05:39.197792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02cf8aa8-ba20-476a-81ab-efa6657a5a92 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70063d2b80>, body: {"security_group_rule": {"parent_group_id": "4bea1d52-178b-423a-95a4-2863ff4964d6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:39.594358 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:39.647456 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:39.760689 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02cf8aa8-ba20-476a-81ab-efa6657a5a92 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.568179 Sep 18 01:05:39.762894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 680/1330] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:05:39 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:39.775195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:39.776099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:39.784452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:39.786225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:39.786749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:39.787788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:39.788286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:39.788740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:40.186990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:40.196708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b2a1d1a-e14e-477c-bbba-0c3b2b8b46e7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.432575 Sep 18 01:05:40.197295 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 681/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:39 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:40.202656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-daaa059b-f26e-4f5d-9035-9b6d6a96f6be req-7f814268-d4c2-44e4-b5ad-2e246316d362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3406f44-aa77-483c-9c1b-6a51773b5023", "name": "network-vif-plugged", "status": "completed", "tag": "905d0978-cc22-487f-be72-d9e5d75cf1f8"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:40.213236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-daaa059b-f26e-4f5d-9035-9b6d6a96f6be req-7f814268-d4c2-44e4-b5ad-2e246316d362 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:40.213754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-daaa059b-f26e-4f5d-9035-9b6d6a96f6be req-7f814268-d4c2-44e4-b5ad-2e246316d362 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:40.214191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-daaa059b-f26e-4f5d-9035-9b6d6a96f6be req-7f814268-d4c2-44e4-b5ad-2e246316d362 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:40.227354 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-daaa059b-f26e-4f5d-9035-9b6d6a96f6be req-7f814268-d4c2-44e4-b5ad-2e246316d362 service nova] Creating event network-vif-plugged:905d0978-cc22-487f-be72-d9e5d75cf1f8 for instance d3406f44-aa77-483c-9c1b-6a51773b5023 on n-h2-master-1 Sep 18 01:05:40.232535 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-daaa059b-f26e-4f5d-9035-9b6d6a96f6be req-7f814268-d4c2-44e4-b5ad-2e246316d362 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Sep 18 01:05:40.233364 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 682/1332] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:40.240513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fffb098-306d-42cc-843f-f6980a297b22 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '.version_select at 0x7f70063d5820>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:40.995499 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fffb098-306d-42cc-843f-f6980a297b22 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/e487e66e-d0ca-4cd9-99d5-322b53d31b52" status: 200 len: 182 microversion: 2.1 time: 0.760667 Sep 18 01:05:40.996084 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 683/1333] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:05:40 2022] GET /compute/v2.1/os-floating-ips/e487e66e-d0ca-4cd9-99d5-322b53d31b52 => generated 182 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:41.009353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:41.010188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:41.023778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:41.034153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:41.034649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:41.035991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:41.036455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:41.036884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:41.162000 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54f4f39e-f0ef-4fc7-9c48-d85a79465937 tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/9a69989e-fa7c-47f1-8f43-f85f90e25299" status: 202 len: 0 microversion: 2.1 time: 2.001691 Sep 18 01:05:41.162791 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 651/1334] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:05:39 2022] DELETE /compute/v2.1/os-floating-ips/9a69989e-fa7c-47f1-8f43-f85f90e25299 => generated 0 bytes in 2006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:41.173639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-adc3b4ab-0f04-4857-842a-a08f1a4a4e6d tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Action: 'create', calling method: .version_select at 0x7f70062169d0>, body: {"security_group_rule": {"parent_group_id": "4bea1d52-178b-423a-95a4-2863ff4964d6", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:41.278347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:41.287745 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a3cf661-115f-4862-b558-c502d51f2774 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1315 microversion: 2.1 time: 0.282622 Sep 18 01:05:41.288446 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 684/1335] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:41 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:41.294823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:41.294823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:41.304903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:41.305703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:41.306418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:41.307146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:41.307606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:41.308029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:41.453739 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-adc3b4ab-0f04-4857-842a-a08f1a4a4e6d tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.286478 Sep 18 01:05:41.454417 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 652/1336] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:05:41 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:41.459997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Action: 'action', calling method: .version_select at 0x7f700819bb80>, body: {"removeFloatingIp": {"address": "172.35.3.2"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:41.547637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:41.555896 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6984b0fa-f06e-4674-be01-250d2e817b08 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1312 microversion: 2.1 time: 0.266279 Sep 18 01:05:41.556475 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 685/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:41 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1312 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:41.561001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21843b36-50df-4722-9b04-4cab43a079cb tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] Calling method '.version_select at 0x7f70063deaf0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:41.665180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:41.673152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:41.675658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:41.676891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:41.677903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:41.678559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:41.678987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:42.152688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:05:42.153782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquired lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:05:43.001443 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21843b36-50df-4722-9b04-4cab43a079cb tempest-FloatingIPDetailsTestJSON-1136270636 tempest-FloatingIPDetailsTestJSON-1136270636-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/0157e167-4351-45a9-bf7a-63d5635e5be3" status: 202 len: 0 microversion: 2.1 time: 1.443894 Sep 18 01:05:43.002401 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 686/1338] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:05:41 2022] DELETE /compute/v2.1/os-floating-ips/0157e167-4351-45a9-bf7a-63d5635e5be3 => generated 0 bytes in 1445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:43.007834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ff5af040-5597-4304-aa77-b4e5093b9747 req-733de308-b720-47f4-b6ab-b8b8ff75edad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029b967c-e30b-4828-af5d-b78e5f14ec02", "name": "network-vif-deleted", "tag": "5b719cda-b0c5-435c-be67-77c91366eed4"}, {"name": "network-changed", "server_uuid": "00b76040-84b4-4c7e-a381-5cb762d7c75c", "tag": "94467f9b-0d92-4d5c-9827-c574a8f20650"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:43.019035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ff5af040-5597-4304-aa77-b4e5093b9747 req-733de308-b720-47f4-b6ab-b8b8ff75edad service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:43.020482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ff5af040-5597-4304-aa77-b4e5093b9747 req-733de308-b720-47f4-b6ab-b8b8ff75edad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:43.021199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ff5af040-5597-4304-aa77-b4e5093b9747 req-733de308-b720-47f4-b6ab-b8b8ff75edad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:43.033863 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ff5af040-5597-4304-aa77-b4e5093b9747 req-733de308-b720-47f4-b6ab-b8b8ff75edad service nova] Creating event network-vif-deleted:5b719cda-b0c5-435c-be67-77c91366eed4 for instance 029b967c-e30b-4828-af5d-b78e5f14ec02 on n-h1-master-1 Sep 18 01:05:43.034368 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ff5af040-5597-4304-aa77-b4e5093b9747 req-733de308-b720-47f4-b6ab-b8b8ff75edad service nova] Creating event network-changed:94467f9b-0d92-4d5c-9827-c574a8f20650 for instance 00b76040-84b4-4c7e-a381-5cb762d7c75c on n-h1-master-1 Sep 18 01:05:43.041849 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ff5af040-5597-4304-aa77-b4e5093b9747 req-733de308-b720-47f4-b6ab-b8b8ff75edad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038141 Sep 18 01:05:43.042761 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 687/1339] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:43.048236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:43.048663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:43.054947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:43.055434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:43.055865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:43.056562 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:43.057010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:43.057430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:43.828619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:43.838740 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e4d8452e-f739-4943-91e0-3c36e5139081 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.794760 Sep 18 01:05:43.839664 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 688/1340] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:43 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:43.845377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a20f799-849f-4275-8b39-c804dc4c7209 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f7006cacee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:44.057667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Building network info cache for instance {{(pid=122373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:05:44.130430 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a20f799-849f-4275-8b39-c804dc4c7209 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/4bea1d52-178b-423a-95a4-2863ff4964d6" status: 200 len: 665 microversion: 2.1 time: 0.289344 Sep 18 01:05:44.131401 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 689/1341] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:05:43 2022] GET /compute/v2.1/os-security-groups/4bea1d52-178b-423a-95a4-2863ff4964d6 => generated 665 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:44.137723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9b719835-2ede-42a9-a51e-df22d314771c"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:44.140253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:44.156281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:44.157428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:44.158674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:44.159627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:44.161152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:44.162278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:44.234746 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] HTTP exception thrown: Volume c50b0690-2577-4738-9884-004330b45708 could not be found. Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Request method failure captured: Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240/os-volume_attachments/c50b0690-2577-4738-9884-004330b45708 HTTP/1.1 Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 74 Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5WVesWpbruEa7kZO23njClbzAdQ7FT_XtEHlnEp376-fnXSRlEEhZeM7VlJd4fPOfFUjFw7Y6ExuTEJRmLbn6KwcUs0enMfT5TJJbJbX6xNtrvEK_nU7KoIBcJkvLG3ImUGHQpKovaScKD-136C9MEQ9j4Mz7kF-HNmX8RYfiAXm4 Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 611ad025fb3143d89bd446b2f3a0f5ef Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesAdminNegativeTest-2000864663 Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:05:44.237778 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/611ad025fb3143d89bd446b2f3a0f5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesAdminNegativeTest-2000864663 Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 611ad025fb3143d89bd446b2f3a0f5ef Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2000864663 Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesAdminNegativeTest-2000864663-project-admin Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 3da7dffd0ed0439ab15f3076e9b2cf6d Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesAdminNegativeTest-2000864663-project-admin Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: {"volumeAttachment": {"volumeId": "9b719835-2ede-42a9-a51e-df22d314771c"}} Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:05:44.240351 n-d-master-1 devstack@n-api.service[122374]: exception: Volume c50b0690-2577-4738-9884-004330b45708 could not be found. Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '4bb7f179-1199-4031-a669-3648be03b240', 'id': 'c50b0690-2577-4738-9884-004330b45708', 'body': {'volumeAttachment': {'volumeId': '9b719835-2ede-42a9-a51e-df22d314771c'}}} Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:05:44.244269 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c50b0690-2577-4738-9884-004330b45708 could not be found. (HTTP 404) (Request-ID: req-5177f706-4ca9-4ffb-b35f-85c84fa4547a) Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:05:44.248203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c50b0690-2577-4738-9884-004330b45708 could not be found. Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:44.251199 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c50b0690-2577-4738-9884-004330b45708 could not be found. Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c50b0690-2577-4738-9884-004330b45708 could not be found. Sep 18 01:05:44.254532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:44.257848 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] Returning 404 to user: Volume c50b0690-2577-4738-9884-004330b45708 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:44.257848 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c3d621d-4413-40f3-a1a3-41860575bddb tempest-VolumesAdminNegativeTest-2000864663 tempest-VolumesAdminNegativeTest-2000864663-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240/os-volume_attachments/c50b0690-2577-4738-9884-004330b45708" status: 404 len: 109 microversion: 2.1 time: 0.106693 Sep 18 01:05:44.257848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 690/1342] 10.222.0.25 () {60 vars in 1433 bytes} [Sun Sep 18 01:05:44 2022] PUT /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240/os-volume_attachments/c50b0690-2577-4738-9884-004330b45708 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:44.262239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:44.262861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:44.279431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:44.279938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:44.282455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:44.283486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:44.285816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:44.286287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:44.988206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:45.001756 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d667d828-62b5-4143-b8f2-eccb99ac3b45 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1315 microversion: 2.1 time: 0.744204 Sep 18 01:05:45.002727 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 691/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:44 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:45.016749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-586e3275-d861-49ed-b162-3a443c70559a req-9818372e-9d41-4684-9bb0-5434ed8f31e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca", "name": "network-vif-plugged", "status": "completed", "tag": "79446ee2-e15c-4ba2-a21d-d44c227e6253"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:45.042661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-586e3275-d861-49ed-b162-3a443c70559a req-9818372e-9d41-4684-9bb0-5434ed8f31e1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:45.044726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-586e3275-d861-49ed-b162-3a443c70559a req-9818372e-9d41-4684-9bb0-5434ed8f31e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:45.049999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-586e3275-d861-49ed-b162-3a443c70559a req-9818372e-9d41-4684-9bb0-5434ed8f31e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:45.076772 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-586e3275-d861-49ed-b162-3a443c70559a req-9818372e-9d41-4684-9bb0-5434ed8f31e1 service nova] Creating event network-vif-plugged:79446ee2-e15c-4ba2-a21d-d44c227e6253 for instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca on n-h1-master-1 Sep 18 01:05:45.090264 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-586e3275-d861-49ed-b162-3a443c70559a req-9818372e-9d41-4684-9bb0-5434ed8f31e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084217 Sep 18 01:05:45.092717 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 692/1344] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:45.109574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:45.113909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:45.131633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:45.133527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:45.136651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:45.139976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:45.140679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:45.141304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:45.664020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:45.677202 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5de6e836-415f-4fae-ad25-cd549d0491ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1462 microversion: 2.1 time: 0.580724 Sep 18 01:05:45.678450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 693/1345] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:45 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1462 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:45.684811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b247936c-851c-4d08-b35e-0cd3a6dea601 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f70062ec4c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:45.892269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Updating instance_info_cache with network_info: [{"id": "94467f9b-0d92-4d5c-9827-c574a8f20650", "address": "fa:16:3e:25:76:a5", "network": {"id": "b3f04822-05c6-4706-9c26-72bee19a7c93", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1298336588-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce0cec677134476aa0da53e6813c602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94467f9b-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:05:45.905099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Releasing lock "refresh_cache-00b76040-84b4-4c7e-a381-5cb762d7c75c" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:05:45.905988 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6494b527-6364-4dab-805f-e537a8134055 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action" status: 202 len: 0 microversion: 2.1 time: 4.450569 Sep 18 01:05:45.910746 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 653/1346] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:41 2022] POST /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c/action => generated 0 bytes in 4456 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:05:45.925848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:45.926959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:45.936991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:45.937836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:45.942657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:45.943628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:45.944250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:45.944824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.233428 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b247936c-851c-4d08-b35e-0cd3a6dea601 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/fa071130-9796-4e0b-8871-096a35254b74" status: 202 len: 0 microversion: 2.1 time: 0.553366 Sep 18 01:05:46.234193 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 694/1347] 10.222.0.25 () {58 vars in 1287 bytes} [Sun Sep 18 01:05:45 2022] DELETE /compute/v2.1/os-security-group-rules/fa071130-9796-4e0b-8871-096a35254b74 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:46.239564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-20cd7910-31b4-4f67-b04c-aa55173225f5 req-791841f9-0584-4add-aaed-786a2f2b71f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ff9e6d-5612-447a-b317-dd1e6f1324b3", "name": "network-vif-unplugged", "status": "completed", "tag": "b7e00281-7e7f-4aed-af4e-b7dd24f7147a"}, {"name": "network-changed", "server_uuid": "00b76040-84b4-4c7e-a381-5cb762d7c75c", "tag": "94467f9b-0d92-4d5c-9827-c574a8f20650"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:46.272856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-20cd7910-31b4-4f67-b04c-aa55173225f5 req-791841f9-0584-4add-aaed-786a2f2b71f6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.274031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-20cd7910-31b4-4f67-b04c-aa55173225f5 req-791841f9-0584-4add-aaed-786a2f2b71f6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.274777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-20cd7910-31b4-4f67-b04c-aa55173225f5 req-791841f9-0584-4add-aaed-786a2f2b71f6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.326564 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-20cd7910-31b4-4f67-b04c-aa55173225f5 req-791841f9-0584-4add-aaed-786a2f2b71f6 service nova] Creating event network-vif-unplugged:b7e00281-7e7f-4aed-af4e-b7dd24f7147a for instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 on n-h2-master-1 Sep 18 01:05:46.327249 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-20cd7910-31b4-4f67-b04c-aa55173225f5 req-791841f9-0584-4add-aaed-786a2f2b71f6 service nova] Creating event network-changed:94467f9b-0d92-4d5c-9827-c574a8f20650 for instance 00b76040-84b4-4c7e-a381-5cb762d7c75c on n-h1-master-1 Sep 18 01:05:46.341105 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-20cd7910-31b4-4f67-b04c-aa55173225f5 req-791841f9-0584-4add-aaed-786a2f2b71f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.105539 Sep 18 01:05:46.344111 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 695/1348] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:46.351504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:46.355972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:46.360581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:46.362230 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1dbe9836-f9ad-4411-a602-ad9cb8493104 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.450131 Sep 18 01:05:46.362813 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 654/1349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:45 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:46.375915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:46.377837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.378490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.379624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.379819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:46.380655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.382696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.383246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.393656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.394839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.395439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.396312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.396920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.397496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.416573 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] HTTP exception thrown: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Request method failure captured: Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 HTTP/1.1 Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm6SgYPWyPpn5vgN04-cVLRYSgkR6hAnoCApHvqynlsSpeRRxte_q4YjHM5CiYRAK6M19zExSeniqOl5l-HZYQmPAMdsrtLzg--J_h_jmOhiGmzQR5QzD6GkbZ44oopqaNsxaQVeqPjJFkGmYTC8hOYgYhN6TGzarNWR8mn2obgW1zk Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:05:46.419608 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fce0cec677134476aa0da53e6813c602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fce0cec677134476aa0da53e6813c602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c3817ebe53a344c3ba3b6b56c726cc57 Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:46.421772 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '029b967c-e30b-4828-af5d-b78e5f14ec02'} Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:46.422791 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:46.424222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:46.428271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Returning 404 to user: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:46.429405 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5cf21c4-bf89-4484-8541-08371c50a0a0 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 404 len: 111 microversion: 2.1 time: 0.063897 Sep 18 01:05:46.430569 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 655/1350] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:05:46 2022] DELETE /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:46.436353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:46.437201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:46.444150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.444924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.445517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.446496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.447118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.447718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.635623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:46.644799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:05:46.661501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:05:46.664271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:05:46.665017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:05:46.668241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:05:46.668954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:05:46.823840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:46.841734 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f484ffd0-b617-407d-8a8a-ee7ed3750052 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1315 microversion: 2.1 time: 0.408778 Sep 18 01:05:46.857805 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 656/1351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:46 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:46.885183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9dc825c-015e-47aa-a626-396a3c4a8ee1 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f7006237b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:46.955368 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14a96052-86be-4cfe-9f99-3c9727b66058 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023/action" status: 202 len: 0 microversion: 2.1 time: 0.609422 Sep 18 01:05:46.956597 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 696/1352] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:46 2022] POST /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:46.964537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:46.975259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 029b967c-e30b-4828-af5d-b78e5f14ec02] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:46.993842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.994331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.994783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:46.995517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:46.995982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:46.996420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:47.044820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] HTTP exception thrown: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Request method failure captured: Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 HTTP/1.1 Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm6SgYPWyPpn5vgN04-cVLRYSgkR6hAnoCApHvqynlsSpeRRxte_q4YjHM5CiYRAK6M19zExSeniqOl5l-HZYQmPAMdsrtLzg--J_h_jmOhiGmzQR5QzD6GkbZ44oopqaNsxaQVeqPjJFkGmYTC8hOYgYhN6TGzarNWR8mn2obgW1zk Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:47.050953 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fce0cec677134476aa0da53e6813c602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fce0cec677134476aa0da53e6813c602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: c3817ebe53a344c3ba3b6b56c726cc57 Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:47.052732 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '029b967c-e30b-4828-af5d-b78e5f14ec02'} Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:47.053729 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. Sep 18 01:05:47.055574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:47.073244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Returning 404 to user: Instance 029b967c-e30b-4828-af5d-b78e5f14ec02 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:47.080204 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46981048-267d-4c9d-85b3-d33fec550915 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02" status: 404 len: 111 microversion: 2.1 time: 0.119527 Sep 18 01:05:47.081720 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 697/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:46 2022] GET /compute/v2.1/servers/029b967c-e30b-4828-af5d-b78e5f14ec02 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:47.098446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:47.102113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:47.117902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:47.121183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:47.122195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:47.123135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:47.123777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:47.125020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:47.522027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9dc825c-015e-47aa-a626-396a3c4a8ee1 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4bea1d52-178b-423a-95a4-2863ff4964d6" status: 202 len: 0 microversion: 2.1 time: 0.662577 Sep 18 01:05:47.522764 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 657/1354] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:46 2022] DELETE /compute/v2.1/os-security-groups/4bea1d52-178b-423a-95a4-2863ff4964d6 => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:47.527568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-84a24be4-d647-49b8-ba40-6562e8391e4c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '.version_select at 0x7f7006551e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:47.615294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:47.635147 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31ad0ab1-7381-4496-a8e8-0ebd8d197e28 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1471 microversion: 2.1 time: 0.550805 Sep 18 01:05:47.670206 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 698/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:47 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1471 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:47.720963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:47.721829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:47.737934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:47.744995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:47.746079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:47.748369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:47.752631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:47.753247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:48.186586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:48.202765 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1148379f-132e-4b6c-b28a-5b334a341f30 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.529678 Sep 18 01:05:48.207870 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 699/1356] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:47 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:48.225297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b21c3de1-db06-439f-80ff-98ec1fc885a9 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f70061c4700>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:48.293153 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-b21c3de1-db06-439f-80ff-98ec1fc885a9 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:05:48.294003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-b21c3de1-db06-439f-80ff-98ec1fc885a9 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Neutron security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:05:48.294810 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b21c3de1-db06-439f-80ff-98ec1fc885a9 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] HTTP exception thrown: Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist Sep 18 01:05:48.294810 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-9ead8732-ee43-4e27-9dbe-6db3de9962b8'] Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b21c3de1-db06-439f-80ff-98ec1fc885a9 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Request method failure captured: Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-security-groups/27be3eca-ac89-42a2-889c-f2ddebe12a35 HTTP/1.1 Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm69P7bTIq3fYuFEHpEjrUwLZsguCWirtFrprXwKgaKeRQ4KnqjsdUTQ_HWXXou4xiIKP-P4S5BooETXqZpWS-r7L9ulfF3QYduKwExijiC0vztFVSEWHC5Dxsek4n1P5BEc3KSB2yo-ZXJ32bMh2QNtwspO9ymWIlM_gEumUgF2C20 Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 78851b560ef34f098bed2e395fe7682e Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-889838846 Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:48.303949 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78851b560ef34f098bed2e395fe7682e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78851b560ef34f098bed2e395fe7682e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78851b560ef34f098bed2e395fe7682e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78851b560ef34f098bed2e395fe7682e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupRulesTestJSON-889838846 Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 78851b560ef34f098bed2e395fe7682e Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-889838846 Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupRulesTestJSON-889838846-project Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 8342f3ad908c456b95da4f9ca4e314bd Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupRulesTestJSON-889838846-project Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: exception: Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-9ead8732-ee43-4e27-9dbe-6db3de9962b8'] Sep 18 01:05:48.305605 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '27be3eca-ac89-42a2-889c-f2ddebe12a35'} Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:05:48.307092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ead8732-ee43-4e27-9dbe-6db3de9962b8'] Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:05:48.308933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ead8732-ee43-4e27-9dbe-6db3de9962b8'] Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ead8732-ee43-4e27-9dbe-6db3de9962b8'] Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:48.310741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ead8732-ee43-4e27-9dbe-6db3de9962b8'] Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b21c3de1-db06-439f-80ff-98ec1fc885a9 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Returning 404 to user: Security group 27be3eca-ac89-42a2-889c-f2ddebe12a35 does not exist Sep 18 01:05:48.312341 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-9ead8732-ee43-4e27-9dbe-6db3de9962b8'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:48.317593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b21c3de1-db06-439f-80ff-98ec1fc885a9 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/27be3eca-ac89-42a2-889c-f2ddebe12a35" status: 404 len: 194 microversion: 2.1 time: 0.102097 Sep 18 01:05:48.317593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 700/1357] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:48 2022] DELETE /compute/v2.1/os-security-groups/27be3eca-ac89-42a2-889c-f2ddebe12a35 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:48.322965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:48.338008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:48.345625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:48.351315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:48.352267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:48.356721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:48.357462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:48.358144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:48.776671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:48.785995 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7872809c-fa20-4d3a-866f-e383a5d6f6c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1502 microversion: 2.1 time: 0.470355 Sep 18 01:05:48.786878 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 701/1358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:48 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1502 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:48.794624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-749f4f7d-7b2d-4188-8130-22efad4e169e tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f70073fcd30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:49.267178 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-84a24be4-d647-49b8-ba40-6562e8391e4c tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e487e66e-d0ca-4cd9-99d5-322b53d31b52" status: 202 len: 0 microversion: 2.1 time: 1.743094 Sep 18 01:05:49.268004 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 658/1359] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:05:47 2022] DELETE /compute/v2.1/os-floating-ips/e487e66e-d0ca-4cd9-99d5-322b53d31b52 => generated 0 bytes in 1745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:49.278328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5ce5575c-48eb-449b-bf08-d4a815dbae7c req-f6a02058-cbf4-4d22-854d-07122f7c8b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ff9e6d-5612-447a-b317-dd1e6f1324b3", "tag": "b7e00281-7e7f-4aed-af4e-b7dd24f7147a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:49.298488 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:49.309139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ce5575c-48eb-449b-bf08-d4a815dbae7c req-f6a02058-cbf4-4d22-854d-07122f7c8b40 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.310504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ce5575c-48eb-449b-bf08-d4a815dbae7c req-f6a02058-cbf4-4d22-854d-07122f7c8b40 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.311585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ce5575c-48eb-449b-bf08-d4a815dbae7c req-f6a02058-cbf4-4d22-854d-07122f7c8b40 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.324309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-749f4f7d-7b2d-4188-8130-22efad4e169e tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c192466c-fef7-4f3b-be29-995d70bf6926" status: 202 len: 0 microversion: 2.1 time: 0.536021 Sep 18 01:05:49.326221 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 702/1360] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:48 2022] DELETE /compute/v2.1/os-security-groups/c192466c-fef7-4f3b-be29-995d70bf6926 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:49.326918 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5ce5575c-48eb-449b-bf08-d4a815dbae7c req-f6a02058-cbf4-4d22-854d-07122f7c8b40 service nova] Creating event network-changed:b7e00281-7e7f-4aed-af4e-b7dd24f7147a for instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 on n-h2-master-1 Sep 18 01:05:49.334076 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5ce5575c-48eb-449b-bf08-d4a815dbae7c req-f6a02058-cbf4-4d22-854d-07122f7c8b40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064258 Sep 18 01:05:49.335511 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 659/1361] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:49.340666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:49.341968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:49.343230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:49.344337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:49.357425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.358873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.359776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.360955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.362371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.363089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.373455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.374367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.375266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.376538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.377902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.378632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.399138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:05:49.449491 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:49.585070 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6acf8010-8b96-4c2a-8b72-1f466b752877 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 204 len: 0 microversion: 2.1 time: 0.246163 Sep 18 01:05:49.587063 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 660/1362] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:05:49 2022] DELETE /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:05:49.597174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:49.597877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:49.607552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.608168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.608820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.610459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.611124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.612112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.660011 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:05:49.716243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:49.728240 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9984f84e-bd18-4ba4-80db-0f7d34ddd6e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1471 microversion: 2.1 time: 0.400708 Sep 18 01:05:49.744462 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 703/1363] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:49 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1471 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:49.760300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:49.761797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:49.776984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.779521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.780745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.782329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.783708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.784777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.923206 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77c79f06-9e69-4015-82ba-c0bea408362f tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 204 len: 0 microversion: 2.1 time: 0.330298 Sep 18 01:05:49.929865 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 661/1364] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:05:49 2022] DELETE /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:05:49.941827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:49.942964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:49.962511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.963427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.964194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:49.966034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:49.966205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:49.966729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:50.067586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:05:50.144030 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:50.207115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:50.222254 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53033dac-dac7-4730-a2d2-80e7f8d95089 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.476498 Sep 18 01:05:50.223359 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 704/1365] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:49 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:50.230867 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d92c2b76-9349-49eb-a225-4d536f069536 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 204 len: 0 microversion: 2.1 time: 0.298566 Sep 18 01:05:50.231366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e251210b-3cea-4fc0-ab9b-3bdb3b15b982 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f70061c40d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:50.232925 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 662/1366] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:05:49 2022] DELETE /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:05:50.243224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:50.244691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:50.260156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:50.262260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:50.262260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:50.263178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:50.264042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:50.265008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:50.515577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:50.531443 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1559cf07-242b-41c8-93f2-780da229e48b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1508 microversion: 2.1 time: 0.294251 Sep 18 01:05:50.532111 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 663/1367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:50 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:50.537707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:50.538347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:50.555780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:50.556385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:50.557144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:50.558402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:50.559221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:50.560299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:50.669083 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e251210b-3cea-4fc0-ab9b-3bdb3b15b982 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4792999c-3f03-4f7a-9117-06b30fb70bc5" status: 202 len: 0 microversion: 2.1 time: 0.443612 Sep 18 01:05:50.670328 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 705/1368] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:50 2022] DELETE /compute/v2.1/os-security-groups/4792999c-3f03-4f7a-9117-06b30fb70bc5 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:50.676582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:50.677220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:50.684552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:50.685047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:50.685485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:50.686242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:50.686718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:50.687113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:50.845033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:50.859968 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bf3a7ec-642b-473a-b692-123ab787f31d tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1514 microversion: 2.1 time: 0.326355 Sep 18 01:05:50.861162 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 664/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:50 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:50.868500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8372107b-c7a0-44f3-8933-87f68f95c5b2 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f7006592280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:51.228063 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:51.240071 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e31d36f2-8116-40be-9052-6a66397252ce tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1526 microversion: 2.1 time: 0.567980 Sep 18 01:05:51.241213 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 706/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:50 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1526 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:51.249557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:51.250697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:51.260763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:51.261383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:51.261959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:51.262802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:51.263369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:51.264092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:51.451056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:51.459962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76852f39-3272-44b7-96eb-e28af01b410e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1471 microversion: 2.1 time: 0.217272 Sep 18 01:05:51.460554 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 707/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:51 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:51.466824 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8372107b-c7a0-44f3-8933-87f68f95c5b2 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/25b46f96-9340-43ee-a57a-a5d1901c8ddd" status: 202 len: 0 microversion: 2.1 time: 0.603745 Sep 18 01:05:51.468084 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 665/1372] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:50 2022] DELETE /compute/v2.1/os-security-groups/25b46f96-9340-43ee-a57a-a5d1901c8ddd => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:51.478528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:51.480610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:51.495588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:51.496429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:51.497459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:51.498899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:51.500033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:51.501087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:51.625850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f5e1091-890e-49f5-898b-ae0d154b013b tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f7006dd1dc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/jzTGjQa3OCY45BpxnfzsgKVrgH3fR7mLIjnlxK8Yk0Jaavug+sUsWrPrpfY+ZihDU1eD9KTlhp5CE0lA1InQDNuB//+g3NRbA9D8GeOk55tMN+Ln4uN7YFr8o87xWbg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f5e1091-890e-49f5-898b-ae0d154b013b tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 257 Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:51.640482 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:05:51.643661 n-d-master-1 devstack@n-api.service[122374]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/jzTGjQa3OCY45BpxnfzsgKVrgH3fR7mLIjnlxK8Yk0Jaavug+sUsWrPrpfY+ZihDU1eD9KTlhp5CE0lA1InQDNuB//+g3NRbA9D8GeOk55tMN+Ln4uN7YFr8o87xWbg=="}} Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/jzTGjQa3OCY45BpxnfzsgKVrgH3fR7mLIjnlxK8Yk0Jaavug+sUsWrPrpfY+ZihDU1eD9KTlhp5CE0lA1InQDNuB//+g3NRbA9D8GeOk55tMN+Ln4uN7YFr8o87xWbg=='}}} Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:51.644677 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:51.646503 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:05:51.649458 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:05:51.651313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 18 01:05:51.651313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:51.651313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f5e1091-890e-49f5-898b-ae0d154b013b tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:51.651313 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9f5e1091-890e-49f5-898b-ae0d154b013b tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.180420 Sep 18 01:05:51.651313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 708/1373] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:05:51 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:05:51.663237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc1c9a0f-88d2-4b94-b17d-4e1defa0705b tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f7006d34550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:51.676869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:51.688762 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3b5233d-4d56-4729-97a8-761a48bba5f7 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.219226 Sep 18 01:05:51.689461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 666/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:51 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:51.694583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:51.695286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:51.702555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:51.702555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:51.702780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:51.703748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:51.704686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:51.705175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:51.927174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:51.936651 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3499c1d-5d39-483f-a249-12b1328a2544 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1508 microversion: 2.1 time: 0.245625 Sep 18 01:05:51.937618 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 667/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:51 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:51.945174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-659bbba2-65e0-4e6c-b587-32ee4e0cf41c tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f70062163a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-330423407", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:51.966264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-659bbba2-65e0-4e6c-b587-32ee4e0cf41c tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:51.970900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-659bbba2-65e0-4e6c-b587-32ee4e0cf41c tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for user af16efdd1b1d497b93aef7c168c6778d and project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:51.986958 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-659bbba2-65e0-4e6c-b587-32ee4e0cf41c tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:51.994680 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc1c9a0f-88d2-4b94-b17d-4e1defa0705b tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d499803e-ff3c-4b5e-baa6-8db32d6880e5" status: 202 len: 0 microversion: 2.1 time: 0.351131 Sep 18 01:05:51.995266 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 709/1376] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:51 2022] DELETE /compute/v2.1/os-security-groups/d499803e-ff3c-4b5e-baa6-8db32d6880e5 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:51.999979 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:52.000598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-659bbba2-65e0-4e6c-b587-32ee4e0cf41c tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 2166 Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-330423407", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:05:52.005751 n-d-master-1 devstack@n-api.service[122373]: exception: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-330423407', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:52.008402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.012107 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-659bbba2-65e0-4e6c-b587-32ee4e0cf41c tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:52.021829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.022254 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-659bbba2-65e0-4e6c-b587-32ee4e0cf41c tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.070879 Sep 18 01:05:52.022362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.022362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.022362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.022362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.022726 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 668/1377] 10.222.0.25 () {60 vars in 1160 bytes} [Sun Sep 18 01:05:51 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:05:52.022819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.022910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-84a622c2-281d-473d-8c2f-128c8128ec01 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] Calling method '.version_select at 0x7f700615e3a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:52.272453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:52.280988 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ac4d2d6-d83d-4625-956e-a560ac4669d2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1514 microversion: 2.1 time: 0.284598 Sep 18 01:05:52.281767 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 710/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:51 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:52.286735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0eec063-a467-43ac-a7ce-eb7d7a55f064 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f7006444d30>, body: {"keypair": {"name": "tempest-keypair-1576862873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHiSuKC0X2EY3zjiuJlTHOK4K2dTjsPQeQjDEZAmGciY8aRzU/4bdQDlfpKPOfut7tQ3bAaLbqVPND1siJAW1xVHhufdxTnOhYO3K7MXnLQo+xeYiewxUlePmNfRR0CXg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:52.304691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a0eec063-a467-43ac-a7ce-eb7d7a55f064 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:52.309209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a0eec063-a467-43ac-a7ce-eb7d7a55f064 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for user af16efdd1b1d497b93aef7c168c6778d and project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:52.336688 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0eec063-a467-43ac-a7ce-eb7d7a55f064 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053849 Sep 18 01:05:52.337309 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 711/1379] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:05:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:52.350471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:52.351093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:52.354970 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-84a622c2-281d-473d-8c2f-128c8128ec01 tempest-SecurityGroupRulesTestJSON-889838846 tempest-SecurityGroupRulesTestJSON-889838846-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d0256542-dea4-4b7c-8717-3fa1c4eaa7e3" status: 202 len: 0 microversion: 2.1 time: 0.341065 Sep 18 01:05:52.355790 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 669/1380] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:05:52 2022] DELETE /compute/v2.1/os-security-groups/d0256542-dea4-4b7c-8717-3fa1c4eaa7e3 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:52.363905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.364780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.365288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.366114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.366754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.367359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.370475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f79a0f4a-92ec-49bd-9e8a-5db86f6e07ec tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f70063fc820>, body: {"keypair": {"name": "tempest-keypair-1576862873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXgcDLlDy7AnIoUUmH6uxHrD9SWuLXAdXgBRh1qdoSD4ckC/ahxLOnfVeTIKfED9ppykS8eQ9lpnyUWceAQiFB6EfjSU4htA84Ql+r7C6xDVuONoGGiOZVlrt+wEPH/Tw=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:52.403517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f79a0f4a-92ec-49bd-9e8a-5db86f6e07ec tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:52.408296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f79a0f4a-92ec-49bd-9e8a-5db86f6e07ec tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for user af16efdd1b1d497b93aef7c168c6778d and project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:52.435590 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f79a0f4a-92ec-49bd-9e8a-5db86f6e07ec tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] HTTP exception thrown: Key pair 'tempest-keypair-1576862873' already exists. Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f79a0f4a-92ec-49bd-9e8a-5db86f6e07ec tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 273 Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: {"keypair": {"name": "tempest-keypair-1576862873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXgcDLlDy7AnIoUUmH6uxHrD9SWuLXAdXgBRh1qdoSD4ckC/ahxLOnfVeTIKfED9ppykS8eQ9lpnyUWceAQiFB6EfjSU4htA84Ql+r7C6xDVuONoGGiOZVlrt+wEPH/Tw=="}} Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: exception: Key pair 'tempest-keypair-1576862873' already exists. Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1576862873', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXgcDLlDy7AnIoUUmH6uxHrD9SWuLXAdXgBRh1qdoSD4ckC/ahxLOnfVeTIKfED9ppykS8eQ9lpnyUWceAQiFB6EfjSU4htA84Ql+r7C6xDVuONoGGiOZVlrt+wEPH/Tw=='}}} Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result.read() Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'af16efdd1b1d497b93aef7c168c6778d-tempest-keypair-1576862873' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 18 01:05:52.439031 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi session.flush() Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result.read() Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 18 01:05:52.445767 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'af16efdd1b1d497b93aef7c168c6778d-tempest-keypair-1576862873' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 18, 1, 5, 52, 428280), 'updated_at': None, 'name': 'tempest-keypair-1576862873', 'user_id': 'af16efdd1b1d497b93aef7c168c6778d', 'fingerprint': 'cb:ce:63:68:f7:c2:57:fb:89:b6:ec:dc:24:ea:8f:f9', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXgcDLlDy7AnIoUUmH6uxHrD9SWuLXAdXgBRh1qdoSD4ckC/ahxLOnfVeTIKfED9ppykS8eQ9lpnyUWceAQiFB6EfjSU4htA84Ql+r7C6xDVuONoGGiOZVlrt+wEPH/Tw==', 'type': 'ssh'}] Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi keypair.create() Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._create() Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1576862873' already exists. Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 18 01:05:52.455297 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1576862873' already exists. Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1576862873' already exists. Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f79a0f4a-92ec-49bd-9e8a-5db86f6e07ec tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 409 to user: Key pair 'tempest-keypair-1576862873' already exists. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f79a0f4a-92ec-49bd-9e8a-5db86f6e07ec tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.083421 Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 670/1381] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:05:52 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:05:52.460673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fbfc17cc-a63d-438b-9ede-ef190ffa9ae4 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Calling method '.version_select at 0x7f70065dcd30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:52.486792 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fbfc17cc-a63d-438b-9ede-ef190ffa9ae4 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576862873" status: 202 len: 0 microversion: 2.1 time: 0.038506 Sep 18 01:05:52.488702 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 671/1382] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576862873 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:52.500779 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:52.501667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:52.509647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.510468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.511071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.511917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.512512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.513163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.749424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:52.758599 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a41e3e1-9289-42ce-aeda-55c8408a5d77 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1526 microversion: 2.1 time: 0.411866 Sep 18 01:05:52.770551 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 712/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:52 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1526 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:52.781398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-669e887f-a445-4bc9-b286-34354a316c47 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f7006a00790>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP18f7ekgcLM4BswBsfed2yvYNXRZ5ydJpB4aUUCgusjrO02JmF64/lp7I23pNre3Nz4/WtzKxVn3ZzXouK+db8M+gTr80D3QVL6vUvLBiFK4q51OklJdMCmUbVf0XSdsg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-669e887f-a445-4bc9-b286-34354a316c47 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 247 Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP18f7ekgcLM4BswBsfed2yvYNXRZ5ydJpB4aUUCgusjrO02JmF64/lp7I23pNre3Nz4/WtzKxVn3ZzXouK+db8M+gTr80D3QVL6vUvLBiFK4q51OklJdMCmUbVf0XSdsg=="}} Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP18f7ekgcLM4BswBsfed2yvYNXRZ5ydJpB4aUUCgusjrO02JmF64/lp7I23pNre3Nz4/WtzKxVn3ZzXouK+db8M+gTr80D3QVL6vUvLBiFK4q51OklJdMCmUbVf0XSdsg=='}}} Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '' Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:05:52.785902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:05:52.791007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.792140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:52.793818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-669e887f-a445-4bc9-b286-34354a316c47 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:52.794922 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-669e887f-a445-4bc9-b286-34354a316c47 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023057 Sep 18 01:05:52.795675 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 713/1384] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:05:52 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:05:52.799812 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a5804e1-6ec5-4414-913d-8b43b70d7652 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1471 microversion: 2.1 time: 0.306070 Sep 18 01:05:52.802605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 672/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:52 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:52.806449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:52.807243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:52.808747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7bcdfd4-6afc-42ad-acdd-9a5bde4fee06 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f700615eee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1179225887", "public_key": " "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:52.815163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.815879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.816507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.817388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:52.818056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:52.818665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:52.859498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f7bcdfd4-6afc-42ad-acdd-9a5bde4fee06 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:52.866782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f7bcdfd4-6afc-42ad-acdd-9a5bde4fee06 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for user af16efdd1b1d497b93aef7c168c6778d and project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:52.893233 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f7bcdfd4-6afc-42ad-acdd-9a5bde4fee06 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7bcdfd4-6afc-42ad-acdd-9a5bde4fee06 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 95 Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1179225887", "public_key": " "}} Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: exception: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1179225887', 'public_key': ' '}}} Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.895408 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.900328 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.903334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7bcdfd4-6afc-42ad-acdd-9a5bde4fee06 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:52.904327 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7bcdfd4-6afc-42ad-acdd-9a5bde4fee06 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.100822 Sep 18 01:05:52.905405 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 673/1386] 10.222.0.25 () {60 vars in 1158 bytes} [Sun Sep 18 01:05:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:05:52.918377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8dc8b98-4b68-4e13-ac92-66ea88e4582e tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f7006136940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoF7+e87f/KFEFQqCC8QiKgd50y8hCRvJVQQ97bULXHpfgxhG5hgpYsZzT5WE9kKyd0paGYnROXcEcOlKvjTpM46l5YbeEwqsTZfJzUfroGPyAb3ENE+51io6/3Wg3m0A=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8dc8b98-4b68-4e13-ac92-66ea88e4582e tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 507 Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoF7+e87f/KFEFQqCC8QiKgd50y8hCRvJVQQ97bULXHpfgxhG5hgpYsZzT5WE9kKyd0paGYnROXcEcOlKvjTpM46l5YbeEwqsTZfJzUfroGPyAb3ENE+51io6/3Wg3m0A=="}} Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoF7+e87f/KFEFQqCC8QiKgd50y8hCRvJVQQ97bULXHpfgxhG5hgpYsZzT5WE9kKyd0paGYnROXcEcOlKvjTpM46l5YbeEwqsTZfJzUfroGPyAb3ENE+51io6/3Wg3m0A=='}}} Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 18 01:05:52.923796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 18 01:05:52.928133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.931359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8dc8b98-4b68-4e13-ac92-66ea88e4582e tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:52.932388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8dc8b98-4b68-4e13-ac92-66ea88e4582e tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018273 Sep 18 01:05:52.932957 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 674/1387] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:05:52 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:05:52.942123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b2d2739e-bc93-487b-897f-df097a07a608 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Action: 'create', calling method: .version_select at 0x7f7006189790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1812075705", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:52.959873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b2d2739e-bc93-487b-897f-df097a07a608 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:52.966773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b2d2739e-bc93-487b-897f-df097a07a608 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Getting quotas for user af16efdd1b1d497b93aef7c168c6778d and project c00e4fd21fd24826b3d6f6f12f59b9ab. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:52.982636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b2d2739e-bc93-487b-897f-df097a07a608 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b2d2739e-bc93-487b-897f-df097a07a608 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 118 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1812075705", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: exception: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1812075705', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 18 01:05:52.984521 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b2d2739e-bc93-487b-897f-df097a07a608 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b2d2739e-bc93-487b-897f-df097a07a608 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047601 Sep 18 01:05:52.993878 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 675/1388] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:05:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 18 01:05:52.996137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:52.996137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:53.002625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.003334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.003974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.004846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.005454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.006059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.150785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:53.159684 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11541cb8-edba-4e39-b479-5352ef749542 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.357821 Sep 18 01:05:53.160620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 714/1389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:52 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:53.178322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6c2af33-fd40-4d57-8fc2-fe21f2e648d6 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Calling method '.version_select at 0x7f7006d69940>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:53.193223 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d6c2af33-fd40-4d57-8fc2-fe21f2e648d6 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-317900270 not found for user af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6c2af33-fd40-4d57-8fc2-fe21f2e648d6 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Request method failure captured: Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-317900270 HTTP/1.1 Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7vbs-pIppbyinYkhN1fWzu_AQ6SnE49wlQuO2AZFsR5S0XmCrPhqXtKQjyPE52HzIq0zeYqEP5bJIp_pinMY6BQbK_4CCJDwTXN6urbXNsXsl5L8sB1w5iEKk1NKqBZD7EJjDAnQxRV3QkvZ_slBWQyWBJ39v7aggF3QHnPKB4ixY Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c00e4fd21fd24826b3d6f6f12f59b9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c00e4fd21fd24826b3d6f6f12f59b9ab Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-361500539 Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-KeyPairsNegativeTestJSON-361500539-project Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: exception: Keypair tempest-keypair-non-existent-317900270 not found for user af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'tempest-keypair-non-existent-317900270'} Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-317900270 not found for user af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:53.196068 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-317900270 not found for user af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-317900270 not found for user af16efdd1b1d497b93aef7c168c6778d Sep 18 01:05:53.200796 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:53.204697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6c2af33-fd40-4d57-8fc2-fe21f2e648d6 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] Returning 404 to user: Keypair tempest-keypair-non-existent-317900270 not found for user af16efdd1b1d497b93aef7c168c6778d {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:53.205791 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6c2af33-fd40-4d57-8fc2-fe21f2e648d6 tempest-KeyPairsNegativeTestJSON-361500539 tempest-KeyPairsNegativeTestJSON-361500539-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-317900270" status: 404 len: 144 microversion: 2.1 time: 0.044031 Sep 18 01:05:53.206518 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 715/1390] 10.222.0.25 () {58 vars in 1257 bytes} [Sun Sep 18 01:05:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-317900270 => generated 144 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:53.306868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:53.308270 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:53.329341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.329859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.330345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.330997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.331456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.331919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.400771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:53.414539 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90b6d658-f09d-4a0a-8472-c7e0b9d31540 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1508 microversion: 2.1 time: 0.426465 Sep 18 01:05:53.415418 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 676/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:52 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:53.442580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-247fddba-abfa-4bc2-8bb6-c87731042832 req-f696ba09-368d-43f1-bea4-5c3b5e97ea9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7f179-1199-4031-a669-3648be03b240", "name": "network-vif-deleted", "tag": "5d2916d1-a58e-4f2b-9414-6a0386200401"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:53.459010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-247fddba-abfa-4bc2-8bb6-c87731042832 req-f696ba09-368d-43f1-bea4-5c3b5e97ea9f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.459776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-247fddba-abfa-4bc2-8bb6-c87731042832 req-f696ba09-368d-43f1-bea4-5c3b5e97ea9f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.460372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-247fddba-abfa-4bc2-8bb6-c87731042832 req-f696ba09-368d-43f1-bea4-5c3b5e97ea9f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.487556 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-247fddba-abfa-4bc2-8bb6-c87731042832 req-f696ba09-368d-43f1-bea4-5c3b5e97ea9f service nova] Creating event network-vif-deleted:5d2916d1-a58e-4f2b-9414-6a0386200401 for instance 4bb7f179-1199-4031-a669-3648be03b240 on n-h2-master-1 Sep 18 01:05:53.495549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:53.515009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad8445d8-e6ce-4e18-b6ad-2f6b507da5ab tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 200 len: 1472 microversion: 2.1 time: 0.211213 Sep 18 01:05:53.516042 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 716/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:53 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:53.517616 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-247fddba-abfa-4bc2-8bb6-c87731042832 req-f696ba09-368d-43f1-bea4-5c3b5e97ea9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079137 Sep 18 01:05:53.518702 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 677/1393] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:53.786675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:53.787519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:53.818710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.820645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.821585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.823021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.824124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.839264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.845266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:53.850422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:53.882366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.883083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.885038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:53.887169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:53.887860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:53.888469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:54.319748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:54.327929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-98313604-93cf-4f0c-940f-98c1d942c0b3 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1526 microversion: 2.1 time: 0.546913 Sep 18 01:05:54.345289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:54.346231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 717/1394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:53 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1526 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:54.351994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:54.352842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:54.359623 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-368473dc-3366-4e4f-bbb8-f88438adac98 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1471 microversion: 2.1 time: 0.531440 Sep 18 01:05:54.361887 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 678/1395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:53 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1471 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:54.366310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:54.367482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:54.368177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:54.369081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:54.369748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:54.370334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:54.467476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:54.473400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:54.514779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:54.516167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:54.520089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:54.525604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:54.526395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:54.527668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:54.729962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:54.756387 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2a742d3-79dc-4a6d-964a-56ebf74980ae tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.408434 Sep 18 01:05:54.757808 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 718/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:54 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:54.770290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:54.771695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 4bb7f179-1199-4031-a669-3648be03b240] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:54.824883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:54.830482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:54.834273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:54.839690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:54.843287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:54.847164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:54.913313 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] HTTP exception thrown: Instance 4bb7f179-1199-4031-a669-3648be03b240 could not be found. Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Request method failure captured: Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 HTTP/1.1 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm5J3H58uhPhXO5FZ9jSPx0K3ZT6segO6btpSwqlq2kcXu11kJmtapHlEbcpfILt7tYRBa6ki8rFjl0wsnytAeVRJSAq0_6MEqERc7rqUBReo8PaoKPD7mZdckf12V6Vz-a0FI697D6y8e9jDc0D5zm_VEAHBkPuFLbQTMjPRUp9Z6o Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 71ee3046b1b54c14aad90abf94e90e0a Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesAdminNegativeTest-1971655729 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesAdminNegativeTest-1971655729 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 71ee3046b1b54c14aad90abf94e90e0a Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1971655729 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesAdminNegativeTest-1971655729-project Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 5db81d9aa4714dcf871b98e26584d325 Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesAdminNegativeTest-1971655729-project Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4bb7f179-1199-4031-a669-3648be03b240 could not be found. Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4bb7f179-1199-4031-a669-3648be03b240'} Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb7f179-1199-4031-a669-3648be03b240 could not be found. Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb7f179-1199-4031-a669-3648be03b240 could not be found. Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:54.916262 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb7f179-1199-4031-a669-3648be03b240 could not be found. Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Returning 404 to user: Instance 4bb7f179-1199-4031-a669-3648be03b240 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:54.923923 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-746fa39f-ffda-407d-ba80-906a738b6dfb tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240" status: 404 len: 111 microversion: 2.1 time: 0.158848 Sep 18 01:05:54.926405 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 719/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:54 2022] GET /compute/v2.1/servers/4bb7f179-1199-4031-a669-3648be03b240 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:55.219029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:55.240370 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a90fc92d-1f2c-4f49-8d39-5eff4a2228e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1508 microversion: 2.1 time: 0.798593 Sep 18 01:05:55.241735 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 679/1398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:54 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1508 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:55.359989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:55.361776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:55.376246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:55.376933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:55.379102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:55.380403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:55.388648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:55.390430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:55.397392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:55.403891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:55.416565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:55.417082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:55.419727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:55.423432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:55.426572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:55.427232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:55.543953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3817ebe53a344c3ba3b6b56c726cc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0cec677134476aa0da53e6813c602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:55.569539 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b58154d7-cc90-4fa8-9637-8366b96210b5 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 200 len: 1484 microversion: 2.1 time: 0.213346 Sep 18 01:05:55.570409 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 720/1399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:55 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 1484 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:55.582920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e60884e6-6aa2-41f9-acc1-8ffddcf7ea33 req-0124fd67-c78b-400c-92f4-fa7ebac88a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b76040-84b4-4c7e-a381-5cb762d7c75c", "name": "network-vif-deleted", "tag": "94467f9b-0d92-4d5c-9827-c574a8f20650"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:55.614997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e60884e6-6aa2-41f9-acc1-8ffddcf7ea33 req-0124fd67-c78b-400c-92f4-fa7ebac88a13 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:55.615559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e60884e6-6aa2-41f9-acc1-8ffddcf7ea33 req-0124fd67-c78b-400c-92f4-fa7ebac88a13 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:55.616280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e60884e6-6aa2-41f9-acc1-8ffddcf7ea33 req-0124fd67-c78b-400c-92f4-fa7ebac88a13 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:55.661735 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e60884e6-6aa2-41f9-acc1-8ffddcf7ea33 req-0124fd67-c78b-400c-92f4-fa7ebac88a13 service nova] Creating event network-vif-deleted:94467f9b-0d92-4d5c-9827-c574a8f20650 for instance 00b76040-84b4-4c7e-a381-5cb762d7c75c on n-h1-master-1 Sep 18 01:05:55.680320 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e60884e6-6aa2-41f9-acc1-8ffddcf7ea33 req-0124fd67-c78b-400c-92f4-fa7ebac88a13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105920 Sep 18 01:05:55.681605 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 721/1400] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:55.783411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:55.784467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:55.831380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:55.838759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:55.840628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:55.844028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:55.846382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:55.846923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:55.874279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:55.887644 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e0edb43-249c-4916-bb61-de04eda15111 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1471 microversion: 2.1 time: 0.505611 Sep 18 01:05:55.889033 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 680/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:55 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1471 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:56.127587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:56.143235 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad16a23a-00ec-4629-9964-1c9fd50eab80 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.364972 Sep 18 01:05:56.144636 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 722/1402] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:55 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:56.269434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:56.270094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:56.282545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.283657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.285902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.286857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.287853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.288753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.397471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:56.419201 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8559c5b0-4b27-441d-82e0-8d81be385675 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1466 microversion: 2.1 time: 0.153510 Sep 18 01:05:56.422159 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 681/1403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:56 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:56.594862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:56.595993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] [instance: 00b76040-84b4-4c7e-a381-5cb762d7c75c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:56.611507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.612281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.613582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.616988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.618145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.619397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.654481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] HTTP exception thrown: Instance 00b76040-84b4-4c7e-a381-5cb762d7c75c could not be found. Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Request method failure captured: Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c HTTP/1.1 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm6SgYPWyPpn5vgN04-cVLRYSgkR6hAnoCApHvqynlsSpeRRxte_q4YjHM5CiYRAK6M19zExSeniqOl5l-HZYQmPAMdsrtLzg--J_h_jmOhiGmzQR5QzD6GkbZ44oopqaNsxaQVeqPjJFkGmYTC8hOYgYhN6TGzarNWR8mn2obgW1zk Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fce0cec677134476aa0da53e6813c602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fce0cec677134476aa0da53e6813c602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fce0cec677134476aa0da53e6813c602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fce0cec677134476aa0da53e6813c602 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2093738361 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c3817ebe53a344c3ba3b6b56c726cc57 Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2093738361-project Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 00b76040-84b4-4c7e-a381-5cb762d7c75c could not be found. Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '00b76040-84b4-4c7e-a381-5cb762d7c75c'} Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b76040-84b4-4c7e-a381-5cb762d7c75c could not be found. Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b76040-84b4-4c7e-a381-5cb762d7c75c could not be found. Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:56.657677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b76040-84b4-4c7e-a381-5cb762d7c75c could not be found. Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] Returning 404 to user: Instance 00b76040-84b4-4c7e-a381-5cb762d7c75c could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89b63d7f-170d-478f-a3ab-3d63a64eae19 tempest-FloatingIPsAssociationTestJSON-2093738361 tempest-FloatingIPsAssociationTestJSON-2093738361-project] 10.222.0.25 "GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c" status: 404 len: 111 microversion: 2.1 time: 0.071070 Sep 18 01:05:56.666357 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 682/1404] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:56 2022] GET /compute/v2.1/servers/00b76040-84b4-4c7e-a381-5cb762d7c75c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:56.747739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6d8bd7d1-facb-4c94-be67-09e98c8a3b26 req-ab22c68d-ba7e-4ab0-8b98-d0372fb7e22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca", "name": "network-vif-deleted", "tag": "79446ee2-e15c-4ba2-a21d-d44c227e6253"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:56.770485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6d8bd7d1-facb-4c94-be67-09e98c8a3b26 req-ab22c68d-ba7e-4ab0-8b98-d0372fb7e22c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.772474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6d8bd7d1-facb-4c94-be67-09e98c8a3b26 req-ab22c68d-ba7e-4ab0-8b98-d0372fb7e22c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.773673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6d8bd7d1-facb-4c94-be67-09e98c8a3b26 req-ab22c68d-ba7e-4ab0-8b98-d0372fb7e22c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.796728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6d8bd7d1-facb-4c94-be67-09e98c8a3b26 req-ab22c68d-ba7e-4ab0-8b98-d0372fb7e22c service nova] Creating event network-vif-deleted:79446ee2-e15c-4ba2-a21d-d44c227e6253 for instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca on n-h1-master-1 Sep 18 01:05:56.808320 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6d8bd7d1-facb-4c94-be67-09e98c8a3b26 req-ab22c68d-ba7e-4ab0-8b98-d0372fb7e22c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.531161 Sep 18 01:05:56.809396 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 723/1405] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:56.915780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:56.916591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:56.930108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.931638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.942478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.943541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.944178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.946447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.184668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:57.185959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:57.193364 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:57.215716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:57.219693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:57.221383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.227346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:57.228010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:57.228613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.344570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:57.359867 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb49d4cd-ceb9-4d94-9814-2966ffd71feb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.448152 Sep 18 01:05:57.360437 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 683/1406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:56 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:57.444697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:57.447529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:57.471939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:57.477913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:57.480634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.483911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:57.484639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:57.485516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.617229 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:57.620093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:57.624121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:57.624991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.625705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lazy-loading 'fault' on Instance uuid 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:05:57.770299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:57.782633 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bad0121c-1fa4-43f3-99f3-f5ba86f5ec3c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 200 len: 1305 microversion: 2.1 time: 0.341023 Sep 18 01:05:57.786488 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 684/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:57 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 1305 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:57.933468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:57.946530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-846c22b8-bffd-446c-bc54-ed25a8e1e449 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.770793 Sep 18 01:05:57.967078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 724/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:57 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:58.055981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Calling method '.version_select at 0x7f70063b2a60>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:58.072377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:58.072963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:58.073677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:58.074698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:58.075379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:58.076055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:58.100282 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-605e2a86-d848-43b4-883e-b0fb63404cb6 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.312384 Sep 18 01:05:58.110548 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 685/1409] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Sep 18 01:05:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:58.163954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1620063205", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:58.267640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:58.270950 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:58.278753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:05:58.286979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:58.290633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:58.292428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:58.293300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:58.293923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:58.294430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:58.938749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 6817d787-8c57-4c31-9d3d-787ff28ce6b6 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:05:58.994684 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-116529dd-fbda-4234-ba4b-464cfb597fea tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 2343 microversion: 2.25 time: 0.733349 Sep 18 01:05:58.995461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 686/1410] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:05:58 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 2343 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:05:59.000396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:59.001159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:59.015342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.016234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.016800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.018358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.024387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.024958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.199829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Getting quotas for project 542796c9bbf9408195d940edfe36c18a. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:05:59.205751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Getting quotas for user 312e4577ba154049a6b73eff044a5fe2 and project 542796c9bbf9408195d940edfe36c18a. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:05:59.223862 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Request method failure captured: Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 1752 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm71peZz4FuSOw3V_pgNpDq73LYJq4CcADkGfSBU7i8n0jlLmCjba0dkFMHWkaKi-2HxRAoq7bgh0W2DymvHuW3-0kQW7tJySmIBXKJRlnjdeb9fVoOakRyNYVBOCTD5-4zDQf6Y7FGdI4AZYutVbfMCWu0SK8hFlgvPIdt9V_LnqYk Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 542796c9bbf9408195d940edfe36c18a Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-685306108 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/542796c9bbf9408195d940edfe36c18a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/542796c9bbf9408195d940edfe36c18a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_542796c9bbf9408195d940edfe36c18a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/542796c9bbf9408195d940edfe36c18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-685306108 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 542796c9bbf9408195d940edfe36c18a Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-685306108 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-685306108-project Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 312e4577ba154049a6b73eff044a5fe2 Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-685306108-project Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1620063205", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:05:59.226632 n-d-master-1 devstack@n-api.service[122374]: exception: Maximum number of metadata items exceeds 128 Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1620063205', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:59.229390 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 18 01:05:59.232893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.237618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:59.239245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d54289a1-c6e4-43f3-8943-0a4d3283d664 tempest-AbsoluteLimitsNegativeTestJSON-685306108 tempest-AbsoluteLimitsNegativeTestJSON-685306108-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.080410 Sep 18 01:05:59.240913 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 725/1411] 10.222.0.25 () {60 vars in 1148 bytes} [Sun Sep 18 01:05:58 2022] POST /compute/v2.1/servers => generated 87 bytes in 1083 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:05:59.246291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:59.247996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:59.258308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.259096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.259692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.260580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.261226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.261902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.279174 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca HTTP/1.1 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca'} Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:59.280983 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.286094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.286094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:59.286094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:59.286094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:59.286094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:59.286094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:05:59.286094 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.288639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:59.289737 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e90f14d8-d64b-452b-9235-87d8cb776743 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 404 len: 111 microversion: 2.1 time: 0.047559 Sep 18 01:05:59.290807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 726/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:59 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:05:59.297699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:59.299107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:59.307203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.309122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.309823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.310709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.311327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.311912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.697332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:59.726017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5b1e2d5-25ce-4feb-bec2-c803edaa420b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.720002 Sep 18 01:05:59.727112 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 687/1413] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:58 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:59.732191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:59.736402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.737009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.737763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.738622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.739265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.739793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.750265 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:59.773157 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e733ac66-0f5b-427d-b25f-cae08bad1e76 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044845 Sep 18 01:05:59.774499 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 688/1414] 10.222.0.25 () {60 vars in 1217 bytes} [Sun Sep 18 01:05:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:05:59.790588 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-622066254", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b66b4645-3540-45b7-82ac-f51c6140e547"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:59.808434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:59.818314 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-458d5b4e-ce0c-411e-92bf-88a8a2f9563e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1717 microversion: 2.1 time: 0.525397 Sep 18 01:05:59.827214 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 727/1415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:59 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1717 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:59.934240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] validate_networks() for [('b66b4645-3540-45b7-82ac-f51c6140e547', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:06:00.598241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:00.598790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:00.614172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.614675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.615120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:00.615903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.616743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.617235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:00.674651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:06:00.772176 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:00.890037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21062dd5-7a35-41ac-a419-62d885ad10e1 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 204 len: 0 microversion: 2.1 time: 0.296071 Sep 18 01:06:00.894014 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 728/1416] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:06:00 2022] DELETE /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:06:00.899956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:00.900795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:00.915016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.926457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.927204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:00.928131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.928757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.929361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:01.654394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:01.670187 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba820408-7322-46b4-a146-683b7301f4c4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.772978 Sep 18 01:06:01.685783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 729/1417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:00 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:01.696698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:01.698395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:01.714411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:01.716511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:01.717519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:01.719770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:01.720451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:01.721058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:01.831170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:01.832509 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:01.833025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:01.833541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:01.834039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:01.855062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:01.858082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:01.859939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:01.862228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:01.865894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:01.866681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:01.922204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:01.932769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for user 253b3027efb74403a9bfaa4d2cbfd31e and project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:01.975479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:06:01.983263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:06:02.101063 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03a1938b-8810-49a7-8f3d-7b8ef178799f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.322021 Sep 18 01:06:02.109935 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 689/1418] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:06:02.120169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:02.122270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:02.131952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:02.132719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:02.133466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:02.134386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:02.135055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:02.135627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:02.325941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:02.358835 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-22e3e6da-60f2-4ec0-ac1e-f72b154b0a78 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1707 microversion: 2.1 time: 0.671362 Sep 18 01:06:02.360657 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 730/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:01 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1707 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:02.368302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9009b6d3-13c1-4d34-a03d-135da96a8a28 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:02.369207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9009b6d3-13c1-4d34-a03d-135da96a8a28 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:02.532946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:02.543339 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6128551-c149-4d8c-9852-88c43f973030 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1681 microversion: 2.1 time: 0.431661 Sep 18 01:06:02.543748 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 690/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:02 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1681 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:02.567441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-24d48d63-b7ab-4118-aa99-3a493ae7b17d tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '.version_select at 0x7f70061368b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:02.581680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d48d63-b7ab-4118-aa99-3a493ae7b17d tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:02.582242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d48d63-b7ab-4118-aa99-3a493ae7b17d tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:02.582695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d48d63-b7ab-4118-aa99-3a493ae7b17d tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:02.605544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9009b6d3-13c1-4d34-a03d-135da96a8a28 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:02.617390 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9009b6d3-13c1-4d34-a03d-135da96a8a28 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1214 microversion: 2.1 time: 0.251772 Sep 18 01:06:02.622493 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 731/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:02 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:02.626321 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-24d48d63-b7ab-4118-aa99-3a493ae7b17d tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2720 microversion: 2.1 time: 0.060314 Sep 18 01:06:02.627277 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 691/1422] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:06:02 2022] GET /compute/v2.1/os-migrations => generated 2720 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:02.650097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:02.651097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:02.661314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:02.663706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:02.665905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:02.669807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:02.674583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:02.676493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:02.710453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:02.711397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:02.733583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:02.734924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:02.736547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:02.752976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:02.756294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:02.758322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:03.180334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:03.191683 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-283a5ac5-a743-4e1c-916e-c3379839effb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.487917 Sep 18 01:06:03.192467 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 692/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:02 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:03.198336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "930140c5-2d9e-452c-8cce-fb5d9ce2fc45", "device": "/dev/xvdb"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:03.201953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:03.213912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:03.215082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:03.215580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:03.216977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:03.217959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:03.218834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:03.336912 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f721906e-a7b4-4a1f-87e1-e3420e6b0786 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1858 microversion: 2.1 time: 0.694033 Sep 18 01:06:03.339536 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 732/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:02 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1858 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:03.964501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:03.966499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:03.967298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:03.969232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:03.971399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:03.972831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:03.974806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.015794 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b0e2154a-377e-47bd-b1df-00dc8d4ed7e3 tempest-AZV2TestJSON-952017564 tempest-AZV2TestJSON-952017564-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.674651 Sep 18 01:06:04.024649 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 733/1425] 10.222.0.25 () {58 vars in 1164 bytes} [Sun Sep 18 01:06:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:06:04.036059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:04.037656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:04.061306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.062741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.063792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.065387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.068272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.072893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.261287 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-683818a9-dc91-466c-87c2-b2a9747c7ba3 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "POST /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.067058 Sep 18 01:06:04.264554 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 693/1426] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Sep 18 01:06:03 2022] POST /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 194 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:06:04.289185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:04.292191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:04.323570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.325500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.325992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.326711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.327176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.332628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.598893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:04.607332 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8bd0e56a-0ae4-4a64-a336-844c15065d36 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1613 microversion: 2.1 time: 0.340832 Sep 18 01:06:04.630218 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 694/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:04 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1613 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:04.630218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:04.630218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:04.642560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.643357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.644508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.645251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.645883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.646380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.694793 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bca16978-dd59-42b7-930f-cc47c83fb6d1 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1858 microversion: 2.1 time: 0.662376 Sep 18 01:06:04.709837 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 734/1428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:04 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1858 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:04.709837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:04.713366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:04.757095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.757620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.758063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.758774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.767802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.770387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.928669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:04.944902 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5fb8b251-8916-4bad-b792-9a19e0a9e826 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1274 microversion: 2.1 time: 0.328532 Sep 18 01:06:04.977079 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 695/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:04 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1274 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:05.000613 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:05.001126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:05.017847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.018351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.018818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:05.019548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.020000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.020621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:05.331565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lazy-loading 'services' on Instance uuid f5ff9e6d-5612-447a-b317-dd1e6f1324b3 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:06:05.425871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:05.437121 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-30e57f73-3757-4c29-b952-52694b4aca34 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.739453 Sep 18 01:06:05.438062 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 735/1430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:04 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:05.587951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6e52636f-66d9-4140-a5fb-0870247c9751 req-c7eef56e-eaad-4a6f-ba96-508e88f2c6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78083c60-a6b6-4e5a-9be6-3bca0baaa576", "name": "network-vif-deleted", "tag": "a501be6c-7161-4f35-8a40-adf934fd7f00"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:05.615462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e52636f-66d9-4140-a5fb-0870247c9751 req-c7eef56e-eaad-4a6f-ba96-508e88f2c6b8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.615944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e52636f-66d9-4140-a5fb-0870247c9751 req-c7eef56e-eaad-4a6f-ba96-508e88f2c6b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.616379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e52636f-66d9-4140-a5fb-0870247c9751 req-c7eef56e-eaad-4a6f-ba96-508e88f2c6b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:05.643563 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6e52636f-66d9-4140-a5fb-0870247c9751 req-c7eef56e-eaad-4a6f-ba96-508e88f2c6b8 service nova] Creating event network-vif-deleted:a501be6c-7161-4f35-8a40-adf934fd7f00 for instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 on n-h1-master-1 Sep 18 01:06:05.655818 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6e52636f-66d9-4140-a5fb-0870247c9751 req-c7eef56e-eaad-4a6f-ba96-508e88f2c6b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072759 Sep 18 01:06:05.664396 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 736/1431] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:05.676344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:05.689657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:05.691219 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-735572f7-2868-4696-a524-d51141e5f0eb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments/745a08c2-f9b0-49c7-bd13-9ca54ec8e263" status: 202 len: 0 microversion: 2.1 time: 0.712165 Sep 18 01:06:05.691985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 696/1432] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:06:04 2022] DELETE /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments/745a08c2-f9b0-49c7-bd13-9ca54ec8e263 => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:06:05.701733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:05.702336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.703059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.703676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:05.705928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.714053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.716781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:05.717732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:05.739256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.740180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.740841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:05.741872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.742554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.743219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:05.794849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0010156c-6dc0-43e1-b4a3-1b6e4a2d2166 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097052 Sep 18 01:06:05.797933 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 697/1433] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:05 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:05.871357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:05.886234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-917f6871-eac2-44b1-b500-2a27a104e0b2 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1326 microversion: 2.1 time: 0.219553 Sep 18 01:06:05.901581 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 737/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:05 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1326 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:05.968405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:05.969520 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:05.988037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:05.988470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:05.989111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.002275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.002804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.006006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.461676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:06.462291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:06.479032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.479819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.482124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.483140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.487910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.488375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.678313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:06.690146 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-770c7957-a65b-42a1-a965-242201ac7978 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1272 microversion: 2.1 time: 0.725649 Sep 18 01:06:06.694563 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 698/1435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:05 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1272 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:06.810676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:06.814447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:06.824160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.828980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.830260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.831915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.838685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.839835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.853432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:06.864585 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8188664b-1783-42e1-b9d5-790ba21a851d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.408090 Sep 18 01:06:06.866136 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 738/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:06 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:06.918165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:06.919097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:06.926387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.927403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.928379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.929358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.930265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.930942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.973685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:06.974608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:06.975465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:06.976172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lazy-loading 'fault' on Instance uuid 78083c60-a6b6-4e5a-9be6-3bca0baaa576 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:06:06.990254 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45939355-fa94-4ac2-8a7b-c22c677ce950 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183903 Sep 18 01:06:06.993399 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 699/1437] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:06 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:07.049177 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db81d9aa4714dcf871b98e26584d325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ee3046b1b54c14aad90abf94e90e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:07.080294 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0745e1f2-870e-41aa-bb8e-22dcdb1cba4a tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 200 len: 1331 microversion: 2.1 time: 0.169430 Sep 18 01:06:07.094096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 739/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:06 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 1331 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:07.724687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:07.728263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:07.767369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:07.767893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:07.768344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:07.769114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:07.769596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:07.770033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:07.904608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:07.905881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:07.925615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:07.927554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:07.928352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:07.931516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:07.938755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:07.940414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:07.983513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:08.002376 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1571dfa-69b1-409e-bc91-ccb264df8a95 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1272 microversion: 2.1 time: 0.285737 Sep 18 01:06:08.006091 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 700/1439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:07 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:08.020269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:08.026597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:08.044533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:08.045402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:08.047184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:08.049009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:08.049814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:08.050472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:08.108311 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98a23e79-3219-42e9-b590-52375994caf3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100114 Sep 18 01:06:08.109174 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 701/1440] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:08 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:08.115121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:08.116415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] [instance: 78083c60-a6b6-4e5a-9be6-3bca0baaa576] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:08.125143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:08.126051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:08.126733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:08.127791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:08.128507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:08.129127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:08.150641 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] HTTP exception thrown: Instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 could not be found. Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Request method failure captured: Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 HTTP/1.1 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm5J3H58uhPhXO5FZ9jSPx0K3ZT6segO6btpSwqlq2kcXu11kJmtapHlEbcpfILt7tYRBa6ki8rFjl0wsnytAeVRJSAq0_6MEqERc7rqUBReo8PaoKPD7mZdckf12V6Vz-a0FI697D6y8e9jDc0D5zm_VEAHBkPuFLbQTMjPRUp9Z6o Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 71ee3046b1b54c14aad90abf94e90e0a Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesAdminNegativeTest-1971655729 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71ee3046b1b54c14aad90abf94e90e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesAdminNegativeTest-1971655729 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 71ee3046b1b54c14aad90abf94e90e0a Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1971655729 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesAdminNegativeTest-1971655729-project Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 5db81d9aa4714dcf871b98e26584d325 Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesAdminNegativeTest-1971655729-project Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 could not be found. Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '78083c60-a6b6-4e5a-9be6-3bca0baaa576'} Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 could not be found. Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 could not be found. Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:06:08.154507 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:08.160282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:08.160282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:06:08.160282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:06:08.160282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:06:08.160282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:06:08.160282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 could not be found. Sep 18 01:06:08.160282 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:08.162915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Returning 404 to user: Instance 78083c60-a6b6-4e5a-9be6-3bca0baaa576 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:06:08.164524 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9064ac34-d133-4de5-b438-3c728314ecf5 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576" status: 404 len: 111 microversion: 2.1 time: 0.053885 Sep 18 01:06:08.165718 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 702/1441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:08 2022] GET /compute/v2.1/servers/78083c60-a6b6-4e5a-9be6-3bca0baaa576 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:06:08.175205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-233cda5f-9fed-430f-9be6-71dc03443d21 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] Calling method '.version_select at 0x7f70063be0d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:08.211912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-233cda5f-9fed-430f-9be6-71dc03443d21 tempest-VolumesAdminNegativeTest-1971655729 tempest-VolumesAdminNegativeTest-1971655729-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144870756" status: 202 len: 0 microversion: 2.1 time: 0.041719 Sep 18 01:06:08.213920 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 703/1442] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144870756 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:06:08.365245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:08.393494 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d7cd085-abfc-4121-a9bf-40be418ddfd9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.490429 Sep 18 01:06:08.412840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 740/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:07 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:09.030141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:09.031548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:09.047690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:09.048976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:09.050750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:09.052816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:09.054539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:09.055358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:09.125464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:09.139296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:09.168215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:09.168746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:09.171171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:09.172176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:09.178372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:09.179727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:09.277424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-793c7476-c418-454a-a76e-fc2d6cbf4018 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157358 Sep 18 01:06:09.283274 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 741/1444] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:09 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:09.425749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:09.426643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:09.438427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:09.438920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:09.439369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:09.440086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:09.440625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:09.441592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:09.827882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:09.836530 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b0ce5596-56e0-4b98-86cb-56bdde32bc91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.812245 Sep 18 01:06:09.843264 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 704/1445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:09 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:10.104947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:10.114460 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8553b3b9-6528-4dd7-b80b-cde9d626897c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.695380 Sep 18 01:06:10.116168 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 742/1446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:09 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:10.295659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:10.298663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:10.320655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:10.321142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:10.321601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:10.322323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:10.322784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:10.323208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:10.407248 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a00bbd04-265e-4261-9819-eefb980126e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116017 Sep 18 01:06:10.407850 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 705/1447] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:10 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:10.858914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:10.860197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:10.868955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:10.869935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:10.870605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:10.872001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:10.872970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:10.873727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:11.147132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:11.148228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:11.167455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:11.168486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:11.170948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:11.174024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:11.177203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:11.178119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:11.236056 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:11.274235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:11.287427 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19360fc5-44fe-477e-9c00-f3ba7c91fc7b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.431519 Sep 18 01:06:11.289425 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 743/1448] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:10 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:11.299912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-fd9f650d-90bb-45f5-959e-62fb7975552c req-2b3eba8e-9e9c-45c2-8904-3c503e47407a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c74bd5f-0704-461c-8500-d822d23e6a8e", "tag": "db78602f-9af9-4361-af1d-c9ed25921482"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:11.326209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fd9f650d-90bb-45f5-959e-62fb7975552c req-2b3eba8e-9e9c-45c2-8904-3c503e47407a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:11.328105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fd9f650d-90bb-45f5-959e-62fb7975552c req-2b3eba8e-9e9c-45c2-8904-3c503e47407a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:11.334326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fd9f650d-90bb-45f5-959e-62fb7975552c req-2b3eba8e-9e9c-45c2-8904-3c503e47407a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:11.367343 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-fd9f650d-90bb-45f5-959e-62fb7975552c req-2b3eba8e-9e9c-45c2-8904-3c503e47407a service nova] Creating event network-changed:db78602f-9af9-4361-af1d-c9ed25921482 for instance 7c74bd5f-0704-461c-8500-d822d23e6a8e on n-h1-master-1 Sep 18 01:06:11.389232 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-fd9f650d-90bb-45f5-959e-62fb7975552c req-2b3eba8e-9e9c-45c2-8904-3c503e47407a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089390 Sep 18 01:06:11.390667 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 744/1449] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:11.421326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:11.424278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:11.439819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:11.443533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:11.444236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:11.445465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:11.448597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:11.449155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:11.528519 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4fd30b9f-2f6b-45a7-9c14-0402ef323488 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109160 Sep 18 01:06:11.529783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 745/1450] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:11 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:11.797034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:11.807285 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-004e137f-76cb-4434-bd92-5988e7a2ea4a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.668970 Sep 18 01:06:11.815247 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 706/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:11 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:12.315834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:12.316457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:12.344800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:12.357869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:12.359325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:12.377175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:12.381190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:12.384138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:12.541094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:12.543318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:12.546581 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:12.547245 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=24 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:12.561185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:12.568341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:12.570028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:12.573116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:12.574740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:12.577820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:12.613425 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:12.657068 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd21a8f8-9f45-4685-a38c-70c93f52bb64 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119860 Sep 18 01:06:12.664756 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 707/1452] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:12 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:12.835709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:12.837014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:12.851008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:12.851810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:12.852518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:12.853521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:12.854225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:12.855240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:12.943223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:12.951426 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-824cb4ac-16f1-4808-ba96-ff940bfec196 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.640014 Sep 18 01:06:12.957003 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 746/1453] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:12 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:13.671844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:13.674763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:13.687984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:13.688474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:13.688909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:13.694064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:13.694558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:13.695023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:13.743915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:13.752613 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:13.772444 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d30cc039-f804-452f-8800-89c9034bf317 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.938695 Sep 18 01:06:13.774624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 708/1454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:12 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:13.794380 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2d6fbc7a-7035-417e-9a30-4e16f5822a13 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126693 Sep 18 01:06:13.795474 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 747/1455] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:13 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:13.982899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:13.983625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:13.993395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:13.993969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:13.994416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:13.995141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:13.995601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:14.005389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:14.799518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:14.800678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:14.809451 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:14.816292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:14.816988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:14.823473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:14.824309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:14.824782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:14.825210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:15.251234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:15.263786 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9a93a046-e8b0-4ed9-801f-2886a2cbefa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 1.285351 Sep 18 01:06:15.264365 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 709/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:13 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:15.293991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:15.296854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:15.314841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:15.325181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:15.326732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:15.327722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:15.328333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:15.328865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:15.442239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:15.450794 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6259760f-7c3e-4770-a2b3-4641a1eb1eaa tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181802 Sep 18 01:06:15.452700 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 710/1457] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:15 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:15.462806 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e44e48e9-11dc-447d-9085-9af3b1f4e9d0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.667445 Sep 18 01:06:15.463882 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 748/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:14 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:16.291557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:16.292867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:16.302835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:16.306267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:16.307226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:16.309159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:16.310401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:16.323858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:16.465059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:16.468340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:16.487604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:16.488490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:16.489208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:16.490563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:16.493763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:16.494451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:16.588525 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28c5a462-3ffc-4a99-9826-73e80ba2dfb4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127713 Sep 18 01:06:16.589833 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 749/1459] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:16 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:16.601805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:16.604965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:16.622781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:16.624595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:16.626673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:16.631804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:16.637489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:16.642242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:17.212168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:17.223221 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-48981956-3182-459d-9506-e98b303ad5c2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.935466 Sep 18 01:06:17.230143 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 711/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:16 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:17.423243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:17.438828 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aaecbd38-9502-42f1-828a-85803a2f6f10 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.846250 Sep 18 01:06:17.439644 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 750/1461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:16 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:17.601582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:17.604044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:17.619720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:17.620221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:17.620659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:17.621777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:17.622251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:17.622683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:17.709126 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-74868228-1c88-48c3-b7e9-3870e3de9633 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111478 Sep 18 01:06:17.710407 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 712/1462] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:17 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:18.245921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:18.247313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:18.258160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:18.259000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:18.259737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:18.260696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:18.261602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:18.262723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:18.469658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:18.470315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:18.479498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:18.479995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:18.480437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:18.486873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:18.493581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:18.494363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:18.790720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:18.807534 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6cf230ca-b37b-43a1-8161-6ee29adc6e96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.565773 Sep 18 01:06:18.810874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 751/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:18 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:18.835933 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:18.857527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:18.872117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:18.876648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:18.878262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:18.879190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:18.880322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:18.880902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:18.952030 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a19df7c-3f1d-466b-afac-316458ddf45e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139743 Sep 18 01:06:18.953375 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 752/1464] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:18 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:19.238952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:19.250799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36ef62b4-345b-4477-b5cb-e41c641d97e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1476 microversion: 2.1 time: 0.790675 Sep 18 01:06:19.260095 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 713/1465] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:18 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1476 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:19.294461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4a5be56-a124-4d38-bb62-46b5d1557088 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Action: 'create', calling method: .version_select at 0x7f7006444c10>, body: {"keypair": {"name": "tempest-keypair-337735045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBUhEewdZl+Px2zOSFxTMtRW9IWxO1hK3ElibDZDxe6onVQF0bnLtHx8bUzTrDeV9SWSKDuJyCZkXpj+iTOad2Svn/BDvQ88uo6ADXyCjtmIorRMwjqE3yG3n9qeD/4Cw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:19.327529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-b4a5be56-a124-4d38-bb62-46b5d1557088 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Getting quotas for project a7b3a5a9208e40b49db56f6692a7c22f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:19.338305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-b4a5be56-a124-4d38-bb62-46b5d1557088 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Getting quotas for user 804bfb9582ff401189047339238b7b71 and project a7b3a5a9208e40b49db56f6692a7c22f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:19.375096 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4a5be56-a124-4d38-bb62-46b5d1557088 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.420294 Sep 18 01:06:19.384804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 753/1466] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:06:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:19.836935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:19.837868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:19.848093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:19.848589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:19.849030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:19.849777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:19.850237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:19.850664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:19.965132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:19.967810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:19.983910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:19.984763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:19.985393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:19.987871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:19.990115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:19.993306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:20.079357 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb6d1845-05a9-4655-9010-edf28fc44525 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115820 Sep 18 01:06:20.082120 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 754/1467] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:06:19 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:06:20.286849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:20.287748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:20.296658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:20.297891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:20.298537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:20.299467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:20.300685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:20.301295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:20.455413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:20.480848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a2beb353-2736-4e88-89b8-5c33b1e61578 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.642532 Sep 18 01:06:20.496327 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 714/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:19 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:20.588707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:20.604641 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bc648ead-d428-49cd-9f7c-5344c02c31f4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1475 microversion: 2.1 time: 0.322568 Sep 18 01:06:20.609088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 755/1469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:20 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:21.523706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:21.524452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:21.552758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:21.577061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:21.578850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:21.586782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:21.593991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:21.595966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:21.646472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:21.647845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:21.674229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:21.675652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:21.678058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:21.678827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:21.679290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:21.679753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:22.364784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:22.381072 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-003c32e6-3827-49b0-974f-605fb074c563 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.862623 Sep 18 01:06:22.382697 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 715/1470] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:21 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:22.388820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:22.397042 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-29c8dfff-e778-4ce9-baad-7bfcda7fe9b4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1475 microversion: 2.1 time: 0.764529 Sep 18 01:06:22.400201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 756/1471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:21 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1475 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:22.596132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-37d46adf-0e76-47df-a719-571d782b5613 req-ff90f2b4-4b93-4afb-8f72-e4c1481309ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3406f44-aa77-483c-9c1b-6a51773b5023", "name": "network-vif-unplugged", "status": "completed", "tag": "905d0978-cc22-487f-be72-d9e5d75cf1f8"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:22.628586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-37d46adf-0e76-47df-a719-571d782b5613 req-ff90f2b4-4b93-4afb-8f72-e4c1481309ce service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:22.631604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-37d46adf-0e76-47df-a719-571d782b5613 req-ff90f2b4-4b93-4afb-8f72-e4c1481309ce service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:22.635086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-37d46adf-0e76-47df-a719-571d782b5613 req-ff90f2b4-4b93-4afb-8f72-e4c1481309ce service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:22.689404 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-37d46adf-0e76-47df-a719-571d782b5613 req-ff90f2b4-4b93-4afb-8f72-e4c1481309ce service nova] Creating event network-vif-unplugged:905d0978-cc22-487f-be72-d9e5d75cf1f8 for instance d3406f44-aa77-483c-9c1b-6a51773b5023 on n-h1-master-1 Sep 18 01:06:22.702648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-37d46adf-0e76-47df-a719-571d782b5613 req-ff90f2b4-4b93-4afb-8f72-e4c1481309ce service nova] Instance d3406f44-aa77-483c-9c1b-6a51773b5023 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:06:22.727924 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-37d46adf-0e76-47df-a719-571d782b5613 req-ff90f2b4-4b93-4afb-8f72-e4c1481309ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136969 Sep 18 01:06:22.731646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 716/1472] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:23.421335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:23.422227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:23.431958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:23.433069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:23.451793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:23.457068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:23.457615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:23.458043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:23.459360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:23.459845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:23.460595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:23.461063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:23.461491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:23.466737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:23.467687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:23.470642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:24.141291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:24.165412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:24.195577 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ecaa84b-87a5-475a-a95f-24b1cff2c52a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1475 microversion: 2.1 time: 0.766123 Sep 18 01:06:24.196240 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-268e65d6-724d-49bb-8934-79cf48b5391a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.777921 Sep 18 01:06:24.199744 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 717/1473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:23 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1475 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:24.201137 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 757/1474] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:23 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:24.310360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ebad3776-9d63-4264-924d-e0707ce1ef7c tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Action: 'create', calling method: .version_select at 0x7f7006551e50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:24.372751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ebad3776-9d63-4264-924d-e0707ce1ef7c tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Getting quotas for project 7d7952ce74ce499a9e1a556b342e1a4f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:24.383707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ebad3776-9d63-4264-924d-e0707ce1ef7c tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Getting quotas for user ee1305cc89964316b3d7873605d472ba and project 7d7952ce74ce499a9e1a556b342e1a4f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:24.442207 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:24.485521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ebad3776-9d63-4264-924d-e0707ce1ef7c tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Getting quotas for project 7d7952ce74ce499a9e1a556b342e1a4f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:24.498967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ebad3776-9d63-4264-924d-e0707ce1ef7c tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Getting quotas for user ee1305cc89964316b3d7873605d472ba and project 7d7952ce74ce499a9e1a556b342e1a4f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:24.523632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ebad3776-9d63-4264-924d-e0707ce1ef7c tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.322725 Sep 18 01:06:24.524261 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 718/1475] 10.222.0.25 () {62 vars in 1214 bytes} [Sun Sep 18 01:06:24 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:06:24.539306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74720523-d829-41f4-9817-ce5def8c7732 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:24.590195 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74720523-d829-41f4-9817-ce5def8c7732 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.057125 Sep 18 01:06:24.604318 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 758/1476] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 18 01:06:24 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:06:24.608579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3cabc803-e369-4614-baff-05aec3549fb1 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:24.621609 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3cabc803-e369-4614-baff-05aec3549fb1 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/0f5f8d41-db4d-4c28-b230-7735db1ac17d" status: 200 len: 235 microversion: 2.64 time: 0.016929 Sep 18 01:06:24.628886 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 719/1477] 10.222.0.25 () {60 vars in 1304 bytes} [Sun Sep 18 01:06:24 2022] GET /compute/v2.1/os-server-groups/0f5f8d41-db4d-4c28-b230-7735db1ac17d => generated 235 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:06:24.639028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ea880e8-61c2-4fde-a824-6383004f2edb tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:24.643286 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:24.720295 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ea880e8-61c2-4fde-a824-6383004f2edb tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/0f5f8d41-db4d-4c28-b230-7735db1ac17d" status: 204 len: 0 microversion: 2.64 time: 0.086522 Sep 18 01:06:24.727500 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 759/1478] 10.222.0.25 () {60 vars in 1307 bytes} [Sun Sep 18 01:06:24 2022] DELETE /compute/v2.1/os-server-groups/0f5f8d41-db4d-4c28-b230-7735db1ac17d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:06:24.732434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48ad5695-d3de-4e00-9783-277fa6d77d43 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:24.741536 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-48ad5695-d3de-4e00-9783-277fa6d77d43 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] HTTP exception thrown: Instance group 0f5f8d41-db4d-4c28-b230-7735db1ac17d could not be found. Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48ad5695-d3de-4e00-9783-277fa6d77d43 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Request method failure captured: Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-server-groups/0f5f8d41-db4d-4c28-b230-7735db1ac17d HTTP/1.1 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm8P_uQC8L-ViiQCNvd1dBl29JWV97frO_L0QY7SdjuZTuZrxoEFvWQ25drZItrBjtHf_MGy3UW-Vu59aij-HIBiQfnX7jwL7jT0V1HoqwVKG4_klJqdtb7iY-nI3UzDVw7D9fQCrkqjOhaxemyQmUTuuw_F4-Nq7juMiR-R0bpvOFw Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.64 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 7d7952ce74ce499a9e1a556b342e1a4f Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerGroup264TestJSON-141402001 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d7952ce74ce499a9e1a556b342e1a4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d7952ce74ce499a9e1a556b342e1a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d7952ce74ce499a9e1a556b342e1a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d7952ce74ce499a9e1a556b342e1a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerGroup264TestJSON-141402001 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 7d7952ce74ce499a9e1a556b342e1a4f Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerGroup264TestJSON-141402001 Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerGroup264TestJSON-141402001-project Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: ee1305cc89964316b3d7873605d472ba Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerGroup264TestJSON-141402001-project Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: exception: Instance group 0f5f8d41-db4d-4c28-b230-7735db1ac17d could not be found. Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '0f5f8d41-db4d-4c28-b230-7735db1ac17d'} Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0f5f8d41-db4d-4c28-b230-7735db1ac17d could not be found. Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0f5f8d41-db4d-4c28-b230-7735db1ac17d could not be found. Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:24.746677 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0f5f8d41-db4d-4c28-b230-7735db1ac17d could not be found. Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48ad5695-d3de-4e00-9783-277fa6d77d43 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] Returning 404 to user: Instance group 0f5f8d41-db4d-4c28-b230-7735db1ac17d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-48ad5695-d3de-4e00-9783-277fa6d77d43 tempest-ServerGroup264TestJSON-141402001 tempest-ServerGroup264TestJSON-141402001-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/0f5f8d41-db4d-4c28-b230-7735db1ac17d" status: 404 len: 117 microversion: 2.64 time: 0.019711 Sep 18 01:06:24.757599 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 720/1479] 10.222.0.25 () {60 vars in 1307 bytes} [Sun Sep 18 01:06:24 2022] DELETE /compute/v2.1/os-server-groups/0f5f8d41-db4d-4c28-b230-7735db1ac17d => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:06:24.848405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bf5eb8f9-47ef-4b6b-a5b2-032fb060e219 req-be731910-4e40-4581-a144-608638552cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3406f44-aa77-483c-9c1b-6a51773b5023", "tag": "905d0978-cc22-487f-be72-d9e5d75cf1f8"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:24.874353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bf5eb8f9-47ef-4b6b-a5b2-032fb060e219 req-be731910-4e40-4581-a144-608638552cd0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:24.877615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bf5eb8f9-47ef-4b6b-a5b2-032fb060e219 req-be731910-4e40-4581-a144-608638552cd0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:24.878527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bf5eb8f9-47ef-4b6b-a5b2-032fb060e219 req-be731910-4e40-4581-a144-608638552cd0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:24.917242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bf5eb8f9-47ef-4b6b-a5b2-032fb060e219 req-be731910-4e40-4581-a144-608638552cd0 service nova] Creating event network-changed:905d0978-cc22-487f-be72-d9e5d75cf1f8 for instance d3406f44-aa77-483c-9c1b-6a51773b5023 on n-h1-master-1 Sep 18 01:06:24.935154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-bf5eb8f9-47ef-4b6b-a5b2-032fb060e219 req-be731910-4e40-4581-a144-608638552cd0 service nova] Instance d3406f44-aa77-483c-9c1b-6a51773b5023 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:06:24.965719 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bf5eb8f9-47ef-4b6b-a5b2-032fb060e219 req-be731910-4e40-4581-a144-608638552cd0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123044 Sep 18 01:06:24.966587 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 760/1480] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:25.242393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:25.243536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:25.247416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:25.248814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:25.305018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:25.307691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:25.308896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:25.309340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:25.310095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:25.310810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:25.312175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:25.313095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:25.314020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:25.315014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:25.315907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:25.316946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:26.446238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:26.449962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:26.465867 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2b00075-4097-4f5c-9ff1-9c364628de26 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1475 microversion: 2.1 time: 1.233251 Sep 18 01:06:26.466646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-93fe17b7-c230-495d-b3f6-0f82f56afc96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 1.237397 Sep 18 01:06:26.467260 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 721/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:25 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:26.469944 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 761/1482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:25 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1475 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:26.493886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8d0e4f07-5938-423b-8202-b24864ef6d80 req-40b0854d-6378-4245-a7e2-a96206bd62d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c74bd5f-0704-461c-8500-d822d23e6a8e", "name": "network-vif-plugged", "status": "completed", "tag": "db78602f-9af9-4361-af1d-c9ed25921482"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:26.521423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8d0e4f07-5938-423b-8202-b24864ef6d80 req-40b0854d-6378-4245-a7e2-a96206bd62d3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:26.522136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8d0e4f07-5938-423b-8202-b24864ef6d80 req-40b0854d-6378-4245-a7e2-a96206bd62d3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:26.522754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8d0e4f07-5938-423b-8202-b24864ef6d80 req-40b0854d-6378-4245-a7e2-a96206bd62d3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:26.553227 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8d0e4f07-5938-423b-8202-b24864ef6d80 req-40b0854d-6378-4245-a7e2-a96206bd62d3 service nova] Creating event network-vif-plugged:db78602f-9af9-4361-af1d-c9ed25921482 for instance 7c74bd5f-0704-461c-8500-d822d23e6a8e on n-h1-master-1 Sep 18 01:06:26.564898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8d0e4f07-5938-423b-8202-b24864ef6d80 req-40b0854d-6378-4245-a7e2-a96206bd62d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081030 Sep 18 01:06:26.570786 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 722/1483] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:27.494529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:27.495239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:27.495503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:27.496238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:27.516217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:27.516735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:27.517189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:27.517960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:27.519871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:27.520327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:27.523469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:27.524457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:27.531131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:27.532401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:27.533243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:27.534121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:27.943890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:27.963831 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dabda9eb-8e33-4e79-9fd6-93904c58280d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1314 microversion: 2.1 time: 0.477341 Sep 18 01:06:27.967196 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 762/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:27 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:27.996085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:28.019459 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-738f608c-bcdd-439c-8e62-313cca604b70 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1475 microversion: 2.1 time: 0.529908 Sep 18 01:06:28.020803 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 723/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:27 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1475 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:28.989129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:28.989872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:29.002987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:29.003491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:29.003937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:29.004660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:29.005121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:29.005613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:29.047693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:29.048431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:29.067172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:29.070899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:29.072195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:29.073887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:29.075057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:29.077267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:29.374138 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:30.374989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:30.403632 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a1b73565-d623-4fde-a271-a24ada6d491a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1501 microversion: 2.1 time: 1.418454 Sep 18 01:06:30.404263 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 763/1486] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:28 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1501 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:30.418374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:30.421918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:30.467820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:30.503574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:30.506865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:30.507747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:30.514968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:30.515468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:30.535621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:30.547580 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc4c29b8-2e3e-4a20-9fd9-de5bf67fb4f1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1473 microversion: 2.1 time: 1.508157 Sep 18 01:06:30.553267 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 724/1487] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:29 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1473 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:30.564060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-116310131", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "74760081-40ab-4fb6-b8e7-26bd7400df41"}], "security_groups": [{"name": "tempest-securitygroup--899919186"}], "key_name": "tempest-keypair-337735045", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:30.889865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] validate_networks() for [('74760081-40ab-4fb6-b8e7-26bd7400df41', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:06:31.173373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 6817d787-8c57-4c31-9d3d-787ff28ce6b6 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:06:31.217056 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6252fcf2-fa13-4ecb-a208-823d41284a02 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 2421 microversion: 2.25 time: 0.811203 Sep 18 01:06:31.222721 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 764/1488] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:30 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 2421 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:31.251387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:31.260769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:31.298554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:31.299068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:31.299511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:31.300234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:31.300756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:31.301100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:31.391781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'flavor' on Instance uuid 6817d787-8c57-4c31-9d3d-787ff28ce6b6 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:06:31.419001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Going to try to live migrate instance to n-h2-master-1 {{(pid=122374) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:06:31.495849 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:32.301931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Getting quotas for project a7b3a5a9208e40b49db56f6692a7c22f. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:32.312526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Getting quotas for user 804bfb9582ff401189047339238b7b71 and project a7b3a5a9208e40b49db56f6692a7c22f. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:32.337160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:32.338089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:32.339216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:32.339941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:32.340654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:32.367649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:32.368128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:32.370883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:32.371849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:32.372488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:32.374125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:32.421306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Getting quotas for project a7b3a5a9208e40b49db56f6692a7c22f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:32.432671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Getting quotas for user 804bfb9582ff401189047339238b7b71 and project a7b3a5a9208e40b49db56f6692a7c22f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:32.459324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:06:32.463746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:06:32.581248 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52a4e5b4-6b07-4596-b701-1ffd4e0a782e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.025832 Sep 18 01:06:32.583517 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 725/1489] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:06:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:06:32.595046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:32.597885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:32.609603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:32.615601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:32.616260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:32.618277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:32.620485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:32.621120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:33.662542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:33.671673 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0a221c44-9062-484f-8d95-607fabdffc50 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1470 microversion: 2.1 time: 1.086074 Sep 18 01:06:33.672266 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 726/1490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:32 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1470 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:33.699495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f3c9184-d4c8-43ff-9e38-e6e8641910b3 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:33.700695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2f3c9184-d4c8-43ff-9e38-e6e8641910b3 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:33.930412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2f3c9184-d4c8-43ff-9e38-e6e8641910b3 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:33.943556 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f3c9184-d4c8-43ff-9e38-e6e8641910b3 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1276 microversion: 2.1 time: 0.264506 Sep 18 01:06:33.946314 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 727/1491] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:33 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:33.979378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7e56132-8556-49ff-a2a0-4d0a4aff9886"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:33.995096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:34.013727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.014229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.014679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:34.015390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.015849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.016276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:34.207990 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:34.558880 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bdc30216-ebc9-4752-87a8-ec2774d4d19c tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/action" status: 202 len: 0 microversion: 2.25 time: 3.312510 Sep 18 01:06:34.560178 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 765/1492] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:06:31 2022] POST /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/action => generated 0 bytes in 3315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:06:34.566785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:34.570865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:34.616324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.620859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.623524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:34.627873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.629681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.631243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:34.660162 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3e7c6175-6c74-436e-8b7d-9ee4694ebdd6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678299 Sep 18 01:06:34.660841 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 728/1493] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:06:33 2022] POST /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:34.702928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:34.712660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:34.756693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.756693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.763055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:34.764324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.769957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.770560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:34.810880 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7397b9a1-378d-4eda-9089-4dfdce4fbf18 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023/action" status: 204 len: 0 microversion: 2.1 time: 0.243850 Sep 18 01:06:34.827555 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 766/1494] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:06:34 2022] POST /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023/action => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:06:34.882148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:34.882148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:34.934253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.934891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.935348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:34.938231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:34.938715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:34.939846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:35.756757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:35.774041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:35.787874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:35.790322 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed7fbd60-ff6e-4e93-8bbc-b80f0b60147b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 1.125854 Sep 18 01:06:35.792165 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 729/1495] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:34 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:35.797882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:35.806672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:35.826940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:35.841656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:35.846978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:35.851656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:35.854435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:35.855032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:35.876307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:35.891305 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-72715e1f-031d-48f1-86a7-97d8206e60e2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1470 microversion: 2.1 time: 1.058729 Sep 18 01:06:35.892287 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 767/1496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:34 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1470 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:36.235007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:36.251943 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6bc0853b-d406-4625-8bda-a8d448c19cad tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1334 microversion: 2.1 time: 0.458615 Sep 18 01:06:36.256444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 730/1497] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:35 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1334 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:36.529819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-431646502", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "f76c0a81-41f2-4839-941e-afd3fdd1ae18"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:36.655906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] validate_networks() for [('f76c0a81-41f2-4839-941e-afd3fdd1ae18', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:06:36.827541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:36.828361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:36.861192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:36.862752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:36.863729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:36.885987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:36.887122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:36.888678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:37.508414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:37.517803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:37.524398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:37.536286 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3432868-6f15-41c7-853d-3a7427c58d6c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.716532 Sep 18 01:06:37.560494 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 731/1498] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:36 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:06:37.569160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:37.570138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:37.577261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:37.578042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:37.579849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:37.581338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:37.582015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:37.582611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:38.403551 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:38.404986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:38.405749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:38.406676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:38.407492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:38.427858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:38.430373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:38.431485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:38.435312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:38.436317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:38.438864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:38.490765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Getting quotas for project 6b48892f4faf4b9193663a17a6d6c4a9. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:38.502833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Getting quotas for user 0fa4005cb3944bd6b85bbc64021fa705 and project 6b48892f4faf4b9193663a17a6d6c4a9. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:38.542805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:06:38.545139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:06:38.676390 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2c712876-8323-4e91-b638-44d1a2bd0e17 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.780774 Sep 18 01:06:38.677742 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 768/1499] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:06:38.688461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-99825057-1b42-4531-84c4-292f1959a9de req-fa926c9a-312d-4a01-b5a6-631d1458137a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3406f44-aa77-483c-9c1b-6a51773b5023", "name": "network-vif-plugged", "status": "completed", "tag": "905d0978-cc22-487f-be72-d9e5d75cf1f8"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:38.710238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-99825057-1b42-4531-84c4-292f1959a9de req-fa926c9a-312d-4a01-b5a6-631d1458137a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:38.712946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-99825057-1b42-4531-84c4-292f1959a9de req-fa926c9a-312d-4a01-b5a6-631d1458137a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:38.722029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-99825057-1b42-4531-84c4-292f1959a9de req-fa926c9a-312d-4a01-b5a6-631d1458137a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:38.780287 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-99825057-1b42-4531-84c4-292f1959a9de req-fa926c9a-312d-4a01-b5a6-631d1458137a service nova] Creating event network-vif-plugged:905d0978-cc22-487f-be72-d9e5d75cf1f8 for instance d3406f44-aa77-483c-9c1b-6a51773b5023 on n-h1-master-1 Sep 18 01:06:38.792449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-99825057-1b42-4531-84c4-292f1959a9de req-fa926c9a-312d-4a01-b5a6-631d1458137a service nova] Instance d3406f44-aa77-483c-9c1b-6a51773b5023 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:06:38.813617 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-99825057-1b42-4531-84c4-292f1959a9de req-fa926c9a-312d-4a01-b5a6-631d1458137a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133110 Sep 18 01:06:38.814645 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 769/1500] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:38.822762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:38.824801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:38.849073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:38.849862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:38.850646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:38.851203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:38.851721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:38.852489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:39.016850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:39.059829 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-27d84065-1d1b-4150-b265-d1be2b0095e5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1470 microversion: 2.1 time: 1.493650 Sep 18 01:06:39.064357 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 732/1501] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:37 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1470 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:39.089448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:39.090354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:39.100034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:39.100530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:39.100971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:39.101723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:39.102181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:39.102606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:39.197584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:39.209134 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a51027e8-e5fb-4444-b41b-84a98dc30969 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1334 microversion: 2.1 time: 0.392550 Sep 18 01:06:39.222523 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 770/1502] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:38 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1334 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:39.241440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6871b19-3eba-4385-b06e-4a0cfa03d444 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:39.243450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6871b19-3eba-4385-b06e-4a0cfa03d444 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:39.543464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6871b19-3eba-4385-b06e-4a0cfa03d444 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:39.552237 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6871b19-3eba-4385-b06e-4a0cfa03d444 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1231 microversion: 2.1 time: 0.328449 Sep 18 01:06:39.571464 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 771/1503] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:39 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1231 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:39.849695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:39.886639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:39.892183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:39.898806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-691c5818-78a0-488c-b099-20983a69b075 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.832248 Sep 18 01:06:39.901390 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 733/1504] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:39 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:40.101015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:40.102411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:40.132871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:40.136435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:40.139140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:40.145286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:40.147430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:40.148768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:40.236427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:40.238146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:40.262380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:40.263804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:40.264965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:40.270223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:40.271007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:40.271707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:40.786286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:40.799742 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-791700d6-a16d-4a09-9e7d-2c1e6e4edeee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1470 microversion: 2.1 time: 0.708231 Sep 18 01:06:40.820821 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 772/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:40 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1470 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:40.838801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:40.845295 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:40.853315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:40.859526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:40.861140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:40.862268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:40.865996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:40.866933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:40.968448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:40.990253 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f6774dc-b1ab-4b0d-8ad7-1fa91d312277 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.749521 Sep 18 01:06:40.996160 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 734/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:40 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:41.008608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:41.009997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:41.028922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:41.029693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:41.032515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:41.035518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:41.036447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:41.037004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:41.141960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:41.161977 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-67d98765-c22d-4205-b29e-e8ed5ddfbd13 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1283 microversion: 2.1 time: 0.339245 Sep 18 01:06:41.167656 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 773/1507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:40 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1283 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:41.476807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:41.493425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:41.495564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:41.497165 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45bc514d-6811-4f55-ac2b-3cccd0225c1f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.499475 Sep 18 01:06:41.498439 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 735/1508] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:40 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:41.827150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:41.827798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:41.849587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:41.850137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:41.850578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:41.851294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:41.851753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:41.852170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.019744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:42.020360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:42.040730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.041233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.041996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.042702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.043162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.043579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.397855 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:42.638635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:42.652582 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d929824-33c5-4d64-88a9-fbf906c303bd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1462 microversion: 2.1 time: 0.829632 Sep 18 01:06:42.669672 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 774/1509] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:41 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1462 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:42.669672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:42.669672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:42.691519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.692244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.693686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.696919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.697408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.697880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.908050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:42.921068 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5bd2ffe2-8e23-481b-9923-da96a4f81a28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1289 microversion: 2.1 time: 0.264928 Sep 18 01:06:42.922957 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 775/1510] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:42 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1289 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:42.927710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:42.944536 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de4b48cd-bce5-4ede-9ce7-858de5231dbb tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.927645 Sep 18 01:06:42.946551 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 736/1511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:42 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:42.951858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:42.953506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:42.960799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:42.964741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:42.975798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.976293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.976735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.977458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.977939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.978358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.987252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.988409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.989492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:42.990657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:42.991422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:42.992551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:43.543777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:43.557868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:43.564516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:43.566456 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7adf530b-1d5a-4272-a805-e10a2c08d891 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.632852 Sep 18 01:06:43.567713 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 776/1512] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:42 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:43.579458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:43.581263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e5616521-e9f4-46d1-86ce-a8688fd0c359 req-401bb10c-b095-46b1-bc29-e40c39ade475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e521a43a-d173-4504-ab89-b570bee4ef51", "tag": "d21a6986-3af5-4e71-a913-31d36ca03e81"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:43.591704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90d2aa87-8e4f-4d64-8e91-c5cc6624c463 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1462 microversion: 2.1 time: 0.641109 Sep 18 01:06:43.597926 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 737/1513] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:42 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1462 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:43.603607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5616521-e9f4-46d1-86ce-a8688fd0c359 req-401bb10c-b095-46b1-bc29-e40c39ade475 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:43.604400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5616521-e9f4-46d1-86ce-a8688fd0c359 req-401bb10c-b095-46b1-bc29-e40c39ade475 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:43.610702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5616521-e9f4-46d1-86ce-a8688fd0c359 req-401bb10c-b095-46b1-bc29-e40c39ade475 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:43.619984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d29fa2ba-7682-48bd-bba2-d80f8adcd775 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'create', calling method: .version_select at 0x7f700652cee0>, body: {"keypair": {"name": "tempest-keypair-1145241410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdQLJSXHit1dMfhBBEOiDAdAIpCq7VYql/cSknYDxFq1AKR2aMSk9tZberUmvdLuNVcU9I3gbcScYwmtRKjdVQQWVeTjMsktGNeKnAkX7QA2Ax+rTtdJwKTXYjbWrw/9Q=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:43.632093 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e5616521-e9f4-46d1-86ce-a8688fd0c359 req-401bb10c-b095-46b1-bc29-e40c39ade475 service nova] Creating event network-changed:d21a6986-3af5-4e71-a913-31d36ca03e81 for instance e521a43a-d173-4504-ab89-b570bee4ef51 on n-h1-master-1 Sep 18 01:06:43.640319 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e5616521-e9f4-46d1-86ce-a8688fd0c359 req-401bb10c-b095-46b1-bc29-e40c39ade475 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069535 Sep 18 01:06:43.644270 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 777/1514] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:43.654065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d29fa2ba-7682-48bd-bba2-d80f8adcd775 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:43.668857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d29fa2ba-7682-48bd-bba2-d80f8adcd775 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for user 666826ce8e51441ea7c271be4c5d8eb9 and project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:43.712727 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d29fa2ba-7682-48bd-bba2-d80f8adcd775 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096831 Sep 18 01:06:43.716439 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 738/1515] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:06:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:43.953329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:43.955028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:43.973572 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:43.975028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:43.983144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:43.985159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:43.991000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:43.991388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:43.992396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:43.993050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:43.993793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:43.995147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:44.000122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:44.003448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:44.004315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:44.004931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:44.288278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:44.303480 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a5cf73c-ff64-4b16-8730-f1d225404a0d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1289 microversion: 2.1 time: 0.355886 Sep 18 01:06:44.304102 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 778/1516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:43 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1289 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:44.514962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:44.536247 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e439e316-5fe8-4d71-ab22-0e408e3a1a77 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.568029 Sep 18 01:06:44.539802 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 739/1517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:43 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:44.603001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:44.604407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:44.620038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:44.620853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:44.623789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:44.624856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:44.627358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:44.628128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:45.094576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:45.113214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:45.114803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:45.115992 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e34447e2-56e6-4513-bbfa-b8fc0dd74808 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.522369 Sep 18 01:06:45.116559 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 779/1518] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:44 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:45.332184 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:45.333664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:45.352520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:45.362203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:45.362975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:45.364116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:45.364769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:45.365389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:45.564648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:45.567399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:45.588797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:45.589299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:45.589767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:45.596727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:45.597289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:45.602220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:46.153351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:46.178080 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf2c3147-7954-4e2e-9fdd-30b00dbb3980 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 0.851172 Sep 18 01:06:46.184291 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 740/1519] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:45 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:46.195823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:46.196823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:46.216500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:46.217006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:46.217463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:46.218213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:46.218731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:46.219112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:46.258751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:46.270926 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-787842d9-4222-479b-8bc8-0661b898a7c5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.710490 Sep 18 01:06:46.296179 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 780/1520] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:45 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:46.499176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:46.508864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:46.510373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:46.511583 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c408b7aa-cfdd-43e0-97c8-1f1599b11b7e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.325823 Sep 18 01:06:46.525748 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 741/1521] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:46 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:46.916377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-bb172212-3209-4aa7-8f58-e9b23b2d754d req-16e7ccc4-6746-44c5-923b-00761f10d2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b111d2-6cb9-40c2-b63e-319247c07f3e", "tag": "bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:46.937223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bb172212-3209-4aa7-8f58-e9b23b2d754d req-16e7ccc4-6746-44c5-923b-00761f10d2c2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:46.937944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bb172212-3209-4aa7-8f58-e9b23b2d754d req-16e7ccc4-6746-44c5-923b-00761f10d2c2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:46.938391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bb172212-3209-4aa7-8f58-e9b23b2d754d req-16e7ccc4-6746-44c5-923b-00761f10d2c2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:46.976781 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-bb172212-3209-4aa7-8f58-e9b23b2d754d req-16e7ccc4-6746-44c5-923b-00761f10d2c2 service nova] Creating event network-changed:bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 for instance e2b111d2-6cb9-40c2-b63e-319247c07f3e on n-h2-master-1 Sep 18 01:06:47.007462 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-bb172212-3209-4aa7-8f58-e9b23b2d754d req-16e7ccc4-6746-44c5-923b-00761f10d2c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094748 Sep 18 01:06:47.008710 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 742/1522] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:47.085969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-15689486", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": "none"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:47.203524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:47.204044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:47.207104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:47.207700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:47.208174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:47.212771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:47.215324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:47.227527 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:47.231592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:47.232168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:47.234801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:47.239191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:47.239746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:47.242366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:47.243395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:47.244056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:47.246948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:47.247902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:47.255587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:47.256049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:47.302020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Getting quotas for project 00e7bb6cb7ff4520950600ef2e371488. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:47.313016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Getting quotas for user 206cf85ae8a844aebbdd08ba8e5c0207 and project 00e7bb6cb7ff4520950600ef2e371488. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:47.334697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:06:47.337779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:06:47.455816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8e5fd986-f04a-4811-9bf3-25029d5a0285 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.702623 Sep 18 01:06:47.462786 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 781/1523] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:06:47.467299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:47.467934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:47.479618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:47.479618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:47.479817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:47.480482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:47.481461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:47.482079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:48.038525 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.044738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.051622 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b965ca14-41ff-495e-b952-e25e6f6e60ef tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.593535 Sep 18 01:06:48.070096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 782/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:47 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:48.071180 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0478c13f-6508-4957-996e-ff2f97ea85ca tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 0.863166 Sep 18 01:06:48.071790 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 743/1525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:47 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:48.076600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:48.077219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:48.091917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1088290b-9a99-4635-a1ed-ef86dbf10ac5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:48.092833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1088290b-9a99-4635-a1ed-ef86dbf10ac5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:48.103414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:48.118580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:48.122164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:48.123007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:48.123559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:48.124065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:48.298051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1088290b-9a99-4635-a1ed-ef86dbf10ac5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.316739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1088290b-9a99-4635-a1ed-ef86dbf10ac5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.319422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1088290b-9a99-4635-a1ed-ef86dbf10ac5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.328212 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1088290b-9a99-4635-a1ed-ef86dbf10ac5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1276 microversion: 2.57 time: 0.256760 Sep 18 01:06:48.329169 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 783/1526] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:48 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:48.634652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.647548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.652534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:48.656520 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3962f65b-2466-4155-a990-9e813fc66df0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.583719 Sep 18 01:06:48.682418 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 744/1527] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:48 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:49.075825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:49.076707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:49.094146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:49.095409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:49.103320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.106184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.106960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.107658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.108447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.109591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.110291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.111305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.112131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.112813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.113585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.117330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.401030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:49.408164 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:49.422251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7f158306-b95b-43f7-ad63-ec0922f1e5b9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 0.320756 Sep 18 01:06:49.423366 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 745/1528] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:49 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:49.443569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:49.444573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:49.457170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:49.466517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.467411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.474088 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-09ade2f6-890f-42a4-86d2-1d8dbe16d180 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.402397 Sep 18 01:06:49.474411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.475570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.491444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.492171 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 784/1529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:49 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:49.492979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.651254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:49.661445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:49.669840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:49.671640 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3050fa1a-6aab-4c72-8eb7-8e2bdafc276b tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1328 microversion: 2.57 time: 0.246449 Sep 18 01:06:49.675350 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 746/1530] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:49 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1328 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:49.700266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:49.702000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:49.710350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.711246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.711960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.713031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:49.713843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:49.714708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:49.720593 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:50.030320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-464f5ece-abab-483b-9998-9fe64dc5ca23 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '.version_select at 0x7f700655b1f0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:50.039065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-464f5ece-abab-483b-9998-9fe64dc5ca23 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:50.041396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-464f5ece-abab-483b-9998-9fe64dc5ca23 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:50.042155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-464f5ece-abab-483b-9998-9fe64dc5ca23 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:50.062619 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-464f5ece-abab-483b-9998-9fe64dc5ca23 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3106 microversion: 2.1 time: 0.040628 Sep 18 01:06:50.081211 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 747/1531] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:06:50 2022] GET /compute/v2.1/os-migrations => generated 3106 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:50.090130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-27500828-e366-4f30-87fb-aebf3b146cf2 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:50.104022 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-27500828-e366-4f30-87fb-aebf3b146cf2 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021065 Sep 18 01:06:50.114827 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 748/1532] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:06:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:50.134517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c570376-1adc-4794-b5ef-f4176dcbf83e tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1813796279", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:50.180056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c570376-1adc-4794-b5ef-f4176dcbf83e tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.055918 Sep 18 01:06:50.181117 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 749/1533] 10.222.0.25 () {60 vars in 1146 bytes} [Sun Sep 18 01:06:50 2022] POST /compute/v2.1/flavors => generated 499 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:50.194045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-16afc6e5-6b01-4758-856a-83f4e8934d22 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:50.205793 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-16afc6e5-6b01-4758-856a-83f4e8934d22 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016795 Sep 18 01:06:50.211581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 750/1534] 10.222.0.25 () {58 vars in 1182 bytes} [Sun Sep 18 01:06:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:06:50.242238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:50.252357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:50.254810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:50.256268 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c7d5713-8f94-405a-ac33-eaef5c97cb51 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.569438 Sep 18 01:06:50.274095 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 785/1535] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:49 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:50.448198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:50.452985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:50.459248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1293308114", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "899f774b-26ad-46c7-941b-a6beccc58a5b"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:50.467857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:50.468647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:50.469095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:50.470082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:50.470538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:50.470994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:50.603358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:06:51.567564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:51.579088 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2708bba0-5de7-46f9-9042-546b0ca810bd tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 1.136006 Sep 18 01:06:51.581866 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 751/1536] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:50 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:51.597728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:51.599098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:51.622828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:51.625898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:51.627690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:51.628742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:51.629390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:51.630031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:51.937975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:51.938571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:51.939154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:51.940161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:51.940717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:51.970715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:51.974654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:51.976688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:51.979787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:51.980821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:51.983184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:52.012095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.022175 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc018ca0-2da7-4449-ab9b-7d6a84caae9e tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.438320 Sep 18 01:06:52.037633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:52.037633 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:52.037633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for user 666826ce8e51441ea7c271be4c5d8eb9 and project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:52.038967 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 752/1537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:51 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:52.051022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:52.052080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:52.060155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:52.060902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:52.061593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:52.063100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:52.063802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:52.065007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:52.082259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:06:52.093835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:06:52.171888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b930292-f7b4-4005-a622-4c12b0e85242 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714979 Sep 18 01:06:52.172898 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 786/1538] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:06:52.185695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:52.192890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:52.205740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:52.213446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:52.214424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:52.215355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:52.215979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:52.216572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:52.247048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.272201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.293435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.300559 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-23e58e15-de1a-4cbf-ae44-80ea2b6c56e8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1334 microversion: 2.57 time: 0.258273 Sep 18 01:06:52.303905 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 753/1539] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:52 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1334 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:52.320724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57a9c7ab-c114-4d2f-bfa6-1b6c3bdd8ee1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:52.321343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57a9c7ab-c114-4d2f-bfa6-1b6c3bdd8ee1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:52.546227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57a9c7ab-c114-4d2f-bfa6-1b6c3bdd8ee1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.563857 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57a9c7ab-c114-4d2f-bfa6-1b6c3bdd8ee1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1279 microversion: 2.1 time: 0.252520 Sep 18 01:06:52.566051 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 754/1540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:52 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:52.607787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:52.608485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:52.624221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:52.624753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:52.625187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:52.630743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:52.631828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:52.632811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:52.863786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.878914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.885930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:52.900665 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb2ceaf6-2946-4160-98aa-b2d0981ea208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.715127 Sep 18 01:06:52.905434 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 787/1541] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:52 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:52.996466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:53.013432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80506692-3e6c-4fb6-a11a-fb3c47330aa3 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 0.410472 Sep 18 01:06:53.017386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 755/1542] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:52 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:53.056709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:53.057591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:53.071410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.072758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.073596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.084280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.086780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.088611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.338484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:53.339203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:53.364177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.367342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.370070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.371142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.371763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.383077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.684942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:53.698545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:53.700006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:53.717027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2e52ca9-c3f1-44c8-b6e7-2eeeaa3d2808 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1334 microversion: 2.57 time: 0.382168 Sep 18 01:06:53.717744 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 756/1543] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:53 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1334 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:53.746052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:53.746962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:53.747298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:53.753895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.754839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.755461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.757029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.757702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.758288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.760161 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ebf1f9a4-7a53-49a0-a16c-e203d91f2b8f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.708129 Sep 18 01:06:53.760760 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 788/1544] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:53 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:53.782082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-23e42a39-490d-409c-ac58-9299718a1089 req-ea957275-b07f-4f70-bd37-2ec9a33a1b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e521a43a-d173-4504-ab89-b570bee4ef51", "name": "network-vif-plugged", "status": "completed", "tag": "d21a6986-3af5-4e71-a913-31d36ca03e81"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:53.799425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-23e42a39-490d-409c-ac58-9299718a1089 req-ea957275-b07f-4f70-bd37-2ec9a33a1b14 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.803533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-23e42a39-490d-409c-ac58-9299718a1089 req-ea957275-b07f-4f70-bd37-2ec9a33a1b14 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.805156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-23e42a39-490d-409c-ac58-9299718a1089 req-ea957275-b07f-4f70-bd37-2ec9a33a1b14 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.843024 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-23e42a39-490d-409c-ac58-9299718a1089 req-ea957275-b07f-4f70-bd37-2ec9a33a1b14 service nova] Creating event network-vif-plugged:d21a6986-3af5-4e71-a913-31d36ca03e81 for instance e521a43a-d173-4504-ab89-b570bee4ef51 on n-h1-master-1 Sep 18 01:06:53.854410 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-23e42a39-490d-409c-ac58-9299718a1089 req-ea957275-b07f-4f70-bd37-2ec9a33a1b14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079473 Sep 18 01:06:53.856445 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 789/1545] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:06:53.863810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:53.874604 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3161a441-a6cf-461c-9af3-f581d39ff272 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1275 microversion: 2.1 time: 0.132958 Sep 18 01:06:53.879712 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 757/1546] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:53 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:53.936279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:53.936989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:53.950111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.950611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.951050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:53.951761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:53.971626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:53.974634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:54.040148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:54.041073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:54.050188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:54.053504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:54.058346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:54.059358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:54.060003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:54.060738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:54.383884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:54.395811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:54.397650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:54.399005 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe703c29-60f5-4235-869f-79208b53a6dd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.468738 Sep 18 01:06:54.400042 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 790/1547] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:53 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:54.445722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:54.459183 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea8b5069-8187-456b-a74e-bb3bd8fe2df1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 0.422696 Sep 18 01:06:54.474446 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 758/1548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:54 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:06:54.478771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1472624342", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8549b193-9309-4447-b854-895b85b228c7"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:54.558868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] validate_networks() for [('8549b193-9309-4447-b854-895b85b228c7', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:06:54.760305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:54.761756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:54.771331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:54.772103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:54.772930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:54.773870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:54.774508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:54.775102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:54.913640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:54.927547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:54.930120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:54.931879 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33bc6e90-2591-4654-9864-e85d0083f404 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1355 microversion: 2.57 time: 0.175305 Sep 18 01:06:54.933208 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 759/1549] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:54 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1355 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:54.941861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:54.943247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:54.954550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:54.956449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:54.957144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:54.958218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:54.958905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:54.959779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.193014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:55.205599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0db4216-4d53-4773-b5a3-d0bc053f42cd tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1401 microversion: 2.1 time: 0.268029 Sep 18 01:06:55.206341 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 760/1550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:54 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1401 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:55.224848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:55.226897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:55.235232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.239151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.239676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.240590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.246175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.246690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.422984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:55.436850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c4070ab-6064-453c-b0b4-0d1a05fb0531 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1275 microversion: 2.1 time: 0.228028 Sep 18 01:06:55.438153 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 761/1551] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:55 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:55.457480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:55.461665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:55.472066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.473194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.473910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.474921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.475611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.479714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.544583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:55.545299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:55.545487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:55.545837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:55.546250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:55.556678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.557377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.558161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.559208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.559952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.560629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.594887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:55.595426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:55.595815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:55.596362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:55.597171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:55.601117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:55.605723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for user a7b979a402b74d679ec79f0b39255155 and project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:55.618020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:06:55.620495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:06:55.676578 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96570a91-3bd8-40d0-ad97-e146279ad5f1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275353 Sep 18 01:06:55.682122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:55.684252 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 791/1552] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:06:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:06:55.689178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:55.690333 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:55.690890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.691550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.692152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.693291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.695020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.696169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.696664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.697176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.697635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.698341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.698798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.699222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.731783 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-821f8a4c-27bc-485f-b213-ebc7d983298d tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "POST /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b/action" status: 202 len: 1136 microversion: 2.57 time: 0.292102 Sep 18 01:06:55.733693 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 762/1553] 10.222.0.25 () {62 vars in 1320 bytes} [Sun Sep 18 01:06:55 2022] POST /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b/action => generated 1136 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 18 01:06:55.739128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:55.739914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:55.746862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.747707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.748327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:55.750806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:55.751516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:55.752672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.062389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.070089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.073050 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-31546c59-fbb9-4647-aaee-f2c9d34b56cb tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 0.338028 Sep 18 01:06:56.073921 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 763/1554] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:55 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:56.080485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.080845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75feedfe-d8a1-4a61-9e9c-9885f6e168f2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:56.081668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75feedfe-d8a1-4a61-9e9c-9885f6e168f2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:56.082302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.083481 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4b7929a-eb2e-417e-a1ee-088344e6457d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.398161 Sep 18 01:06:56.084036 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 792/1555] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:55 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:56.089080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:56.089865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:56.096385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.097189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.098139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.099162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.099836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.100522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.145371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-75feedfe-d8a1-4a61-9e9c-9885f6e168f2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.147754 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=27 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:56.157975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75feedfe-d8a1-4a61-9e9c-9885f6e168f2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1208 microversion: 2.1 time: 0.080326 Sep 18 01:06:56.159103 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 764/1556] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:56 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1208 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:56.165529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e458beff-8177-4f15-96b5-b6703c885a09 req-d23d9219-3bec-4b83-8c40-2d2bdf841159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b111d2-6cb9-40c2-b63e-319247c07f3e", "name": "network-vif-plugged", "status": "completed", "tag": "bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:56.178063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e458beff-8177-4f15-96b5-b6703c885a09 req-d23d9219-3bec-4b83-8c40-2d2bdf841159 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.178540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e458beff-8177-4f15-96b5-b6703c885a09 req-d23d9219-3bec-4b83-8c40-2d2bdf841159 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.179131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e458beff-8177-4f15-96b5-b6703c885a09 req-d23d9219-3bec-4b83-8c40-2d2bdf841159 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.194867 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e458beff-8177-4f15-96b5-b6703c885a09 req-d23d9219-3bec-4b83-8c40-2d2bdf841159 service nova] Creating event network-vif-plugged:bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 for instance e2b111d2-6cb9-40c2-b63e-319247c07f3e on n-h2-master-1 Sep 18 01:06:56.200965 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e458beff-8177-4f15-96b5-b6703c885a09 req-d23d9219-3bec-4b83-8c40-2d2bdf841159 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039835 Sep 18 01:06:56.202492 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 765/1557] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:56.210613 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-634208069", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "cdfd9210-2a2b-4d14-ac9e-64814397e610"}], "block_device_mapping_v2": [{"uuid": "cab90b67-3cfe-4bb8-931d-320e9007b9f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:56.230888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.241702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.243127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.244352 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16a099d9-10de-40f1-8f4e-c901f866877e tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.159389 Sep 18 01:06:56.244924 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 793/1558] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:56 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:56.249717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:56.250348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:56.258509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.259262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.259891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.260801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.262447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.263192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.355943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] validate_networks() for [('cdfd9210-2a2b-4d14-ac9e-64814397e610', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:06:56.590203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.598841 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fb190f3-af50-47ec-96cb-ce16a973ac89 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1587 microversion: 2.1 time: 0.352895 Sep 18 01:06:56.599419 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 794/1559] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:56 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1587 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:56.614155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:56.614802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:56.628340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.628340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.628340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.628340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.628340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.628340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.707294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:56.722106 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6734d3ce-49f2-4917-84e6-fe218dba0aac tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1331 microversion: 2.1 time: 0.120316 Sep 18 01:06:56.722713 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 795/1560] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:56 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:56.727960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:56.728454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:56.740666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.742210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.743241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.744292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:56.745366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:56.746549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:56.944171 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61e9fa4d-5fac-4668-94c0-9e632c3d2477 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220146 Sep 18 01:06:56.944778 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 796/1561] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:06:56 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:57.102227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:57.102859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:57.110945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.116025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.118595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.121166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.122237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.124433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.139481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:06:57.140010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:06:57.140364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:06:57.140769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:06:57.141173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:06:57.160934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.161701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.162670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.163625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.164280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.164872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.193595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:06:57.197640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Getting quotas for user cf8f60e6d52b498c90dd1ace5418ae13 and project 27153d8891d146b88d7ba3b5076ad538. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:06:57.292723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.302532 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-986745af-5c3e-4ee1-bc39-c657933d7e39 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1331 microversion: 2.1 time: 0.205890 Sep 18 01:06:57.306839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:06:57.309099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cab90b67-3cfe-4bb8-931d-320e9007b9f5',volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:06:57.310075 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 797/1562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:57 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1331 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:57.323361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:57.324072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:57.338204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.338776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.339278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.340055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.340595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.341088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.562767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.576385 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.580260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.582110 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b36db336-337d-4a91-bccc-a26bd8fe0a0f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.270399 Sep 18 01:06:57.583269 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 798/1563] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:57 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:57.589874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:57.591047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:57.599002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.599265 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3c4230b-1410-416f-8750-273d3cae0f4a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393995 Sep 18 01:06:57.600030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.600672 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 766/1564] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:06:57.601112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.602108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.602816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.603464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.615394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:57.621335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:57.661275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.662208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.662983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.664279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.671238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.675995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.725259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.739658 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f120b1f9-8911-4722-b5e3-13fc308c4653 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1204 microversion: 2.1 time: 0.153764 Sep 18 01:06:57.747495 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:06:57.748151 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 799/1565] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:57 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1204 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:57.785518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ed7f7f2-9112-4850-b7e3-817f08f288d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:57.787237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ed7f7f2-9112-4850-b7e3-817f08f288d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:57.836089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.851159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.852869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:57.854597 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d1cb19b-6c08-497f-a190-f6ba981d84b5 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.252452 Sep 18 01:06:57.874133 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 767/1566] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:57 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:57.897898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:57.898942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:57.925132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.926441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.927406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.928900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:57.930050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:57.931049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:57.984500 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2ed7f7f2-9112-4850-b7e3-817f08f288d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:58.009998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ed7f7f2-9112-4850-b7e3-817f08f288d3 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1052 microversion: 2.1 time: 0.245908 Sep 18 01:06:58.013124 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 800/1567] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:57 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1052 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:58.101079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:58.111857 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc354b67-06f2-49b4-88b3-39a14971c450 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1349 microversion: 2.1 time: 0.235855 Sep 18 01:06:58.120208 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 768/1568] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:57 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1349 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:58.259541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:58.260346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:58.270032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.270531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.270961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.271863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.272487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.273194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.327814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:06:58.334739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:58.336045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:58.342710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.343416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.344028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.344964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.346348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.346960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.566260 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-235010dc-660a-41bc-a496-e1c67e79005e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 204 len: 0 microversion: 2.1 time: 0.309937 Sep 18 01:06:58.568400 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 801/1569] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:06:58 2022] DELETE /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:06:58.579696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:58.580580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:58.588583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.590059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.590890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.593293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.594480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.595084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.675576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:58.690956 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d4ee9a2-6621-4a0c-94f9-741349fde497 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1534 microversion: 2.1 time: 0.363856 Sep 18 01:06:58.695304 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 769/1570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:58 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1534 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:58.708279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:58.710009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:58.723507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.725984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.726679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.727644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:58.730564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:58.732321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:58.875083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:58.891127 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42d16ce1-52db-493b-a138-f4696c868c63 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1553 microversion: 2.1 time: 0.316592 Sep 18 01:06:58.892009 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 802/1571] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:58 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:58.897306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-740f7773-ef21-4f09-81b4-b7c3c70e1523 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'create', calling method: .version_select at 0x7f70068110d0>, body: {"pool": "240606ee-92d0-43ce-a525-7d5ea98509b1"} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:59.143440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.152511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.155244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.157530 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-848c141d-7ec2-4e3a-ba13-a3d858a90037 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.459556 Sep 18 01:06:59.158819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 770/1572] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:58 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:59.163897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:59.165375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:59.172834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.174525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.175908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.177045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.177841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.178413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.299338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.317979 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00da0f87-afc7-4b1e-94fb-b916015e7d46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1260 microversion: 2.1 time: 0.157749 Sep 18 01:06:59.318580 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 771/1573] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:59 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:59.338717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:59.340636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:59.350658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.351388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.352020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.353104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.354604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.355542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.498598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.511731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.515955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.518371 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-49257e25-695d-4f14-95b1-eb85476762fc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.198343 Sep 18 01:06:59.519468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 772/1574] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:06:59 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:06:59.524672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:59.525447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:59.534754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.536090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.536711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.537636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.538259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.538878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.683691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.701953 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de0b9945-2efb-4820-b153-7cfdafac44d2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1150 microversion: 2.1 time: 0.180665 Sep 18 01:06:59.703361 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 773/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:59 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1150 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:59.724334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:59.725717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:59.735553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.736653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.737286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.738833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.739680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.740574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.849608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:59.884493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1270ebf-504a-40c4-8e72-65ccba5bc060 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1337 microversion: 2.1 time: 0.179054 Sep 18 01:06:59.888767 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 774/1576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:59 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1337 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:59.898131 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:59.899035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:59.906772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.908716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.909511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:59.910544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:59.911002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:59.911449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:00.224380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:00.252250 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a61de6ca-0391-48fe-a89e-3cb38a62f4c4 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1587 microversion: 2.1 time: 0.358505 Sep 18 01:07:00.253383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 775/1577] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:59 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1587 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:00.263674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d4d94f6f-5796-41ac-a7c0-e39f35369ff6 req-8ee462d0-45e9-4932-885c-f50107522466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e521a43a-d173-4504-ab89-b570bee4ef51", "tag": "d21a6986-3af5-4e71-a913-31d36ca03e81"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:00.282880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d4d94f6f-5796-41ac-a7c0-e39f35369ff6 req-8ee462d0-45e9-4932-885c-f50107522466 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:00.283386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d4d94f6f-5796-41ac-a7c0-e39f35369ff6 req-8ee462d0-45e9-4932-885c-f50107522466 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:00.283824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d4d94f6f-5796-41ac-a7c0-e39f35369ff6 req-8ee462d0-45e9-4932-885c-f50107522466 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:00.309403 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d4d94f6f-5796-41ac-a7c0-e39f35369ff6 req-8ee462d0-45e9-4932-885c-f50107522466 service nova] Creating event network-changed:d21a6986-3af5-4e71-a913-31d36ca03e81 for instance e521a43a-d173-4504-ab89-b570bee4ef51 on n-h1-master-1 Sep 18 01:07:00.326777 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d4d94f6f-5796-41ac-a7c0-e39f35369ff6 req-8ee462d0-45e9-4932-885c-f50107522466 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071334 Sep 18 01:07:00.327993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 776/1578] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:00.334204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:00.335664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:00.343307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:00.344579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:00.345198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:00.346797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:00.347615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:00.348226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:01.013619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:01.027054 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f5d2b755-6e31-482e-8cd4-2753fa297249 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1553 microversion: 2.1 time: 0.697473 Sep 18 01:07:01.033887 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 777/1579] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:00 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1553 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:01.041662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:01.049917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:01.071162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:01.071661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:01.073803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:01.077700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:01.078270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:01.080528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:02.581136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:02.591494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:02.595896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:02.598338 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1db34b7f-69e3-4d3c-a4d7-d7784fe15fbe tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 1.563369 Sep 18 01:07:02.618094 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 778/1580] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:01 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:02.629980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:02.631379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:02.639089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:02.639969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:02.640657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:02.641614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:02.642343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:02.642996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:02.883491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:02.902863 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96e4b44a-a49c-4fbb-aff1-83c736653f8d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1266 microversion: 2.1 time: 0.282399 Sep 18 01:07:02.904671 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 779/1581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:02 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:02.914707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:02.915613 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:02.930487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:02.931256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:02.932874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:02.935745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:02.936630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:02.937076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.083989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:03.120027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:03.123405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:03.130652 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77cee875-1970-4550-b8ba-a62e4ab00882 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.220829 Sep 18 01:07:03.131616 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 780/1582] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:02 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:03.149526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:03.158236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:03.188633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.190944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.191707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.194261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.195149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.196344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.241516 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-740f7773-ef21-4f09-81b4-b7c3c70e1523 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.347702 Sep 18 01:07:03.252349 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 803/1583] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:06:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:03.257668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:03.258602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:03.266775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.268186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.268872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.270071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.270765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.271418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.295877 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:03.322711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:03.337217 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b201fad8-b565-43dd-b583-a5d5dd5a0c19 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1168 microversion: 2.1 time: 0.202964 Sep 18 01:07:03.338431 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 781/1584] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:03 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1168 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:03.355538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:03.356447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:03.359868 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:03.368707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.369589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.370246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.371135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.375259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.375895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.622982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:03.697282 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7c34061-3be3-4ebc-8871-53d434943fa9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1511 microversion: 2.1 time: 0.350728 Sep 18 01:07:03.702111 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 782/1585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:03 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:03.735881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'action', calling method: .version_select at 0x7f700819b790>, body: {"addFloatingIp": {"address": "172.35.3.181"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:03.745105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:03.753691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.755044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.755713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.756882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:03.757541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:03.758276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:03.797904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:07:03.798923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquired lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:07:04.030082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:04.045861 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af4fb5e2-3dcf-406c-9327-7c2bece61e0a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1379 microversion: 2.1 time: 0.790277 Sep 18 01:07:04.048998 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 804/1586] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:03 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1379 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:04.055800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-10b9224d-c9ff-4b77-ace2-521c7fc0953e req-874afa97-6dfe-4311-a6ed-d608296d327b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817d787-8c57-4c31-9d3d-787ff28ce6b6", "name": "network-vif-unplugged", "status": "completed", "tag": "58e0419d-f921-4818-8610-d972ee40fa0c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:04.088942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-10b9224d-c9ff-4b77-ace2-521c7fc0953e req-874afa97-6dfe-4311-a6ed-d608296d327b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:04.090339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-10b9224d-c9ff-4b77-ace2-521c7fc0953e req-874afa97-6dfe-4311-a6ed-d608296d327b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:04.092204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-10b9224d-c9ff-4b77-ace2-521c7fc0953e req-874afa97-6dfe-4311-a6ed-d608296d327b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:04.137813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-10b9224d-c9ff-4b77-ace2-521c7fc0953e req-874afa97-6dfe-4311-a6ed-d608296d327b service nova] Creating event network-vif-unplugged:58e0419d-f921-4818-8610-d972ee40fa0c for instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 on n-h1-master-1 Sep 18 01:07:04.156971 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-10b9224d-c9ff-4b77-ace2-521c7fc0953e req-874afa97-6dfe-4311-a6ed-d608296d327b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105496 Sep 18 01:07:04.159963 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 805/1587] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:04.174582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:04.175531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:04.193804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:04.194396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:04.194917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:04.195727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:04.196436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:04.197174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:04.700155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:04.716433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:04.718710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:04.720800 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-138693ac-07c5-471d-ad53-04722404e024 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.559207 Sep 18 01:07:04.746840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 806/1588] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:04 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:04.746840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:04.746840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:04.761008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:04.761744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:04.780818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:04.784191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:04.789308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:04.791239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:05.571493 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:05.953440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:05.973695 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-24d7c345-1cac-41ec-a00c-7a11a507fbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1308 microversion: 2.1 time: 1.233741 Sep 18 01:07:05.975562 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 807/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:04 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1308 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:05.982078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:05.982993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:05.991822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:05.992552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:05.993182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:05.994109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:05.994715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:05.995377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:06.241994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:06.252940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:06.257018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:06.257018 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-934560e2-4d65-47b4-a616-e3d36faca699 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.278365 Sep 18 01:07:06.270219 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 808/1590] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:05 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:06.281885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:06.282510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:06.289082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:06.289604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:06.290033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:06.291110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:06.291577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:06.292001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:06.970849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:06.987437 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7fff4ec6-1b8f-44a1-9a3e-fb85f33a7039 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1210 microversion: 2.1 time: 0.716178 Sep 18 01:07:06.988699 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 809/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:06 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1210 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:06.995458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:06.996399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:07.006261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:07.007366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:07.008060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:07.009063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:07.011295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:07.012047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:07.158338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:07.170752 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b56cc44-0078-47d3-af46-129aaa6e2ff0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1345 microversion: 2.1 time: 0.179811 Sep 18 01:07:07.172701 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 810/1592] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:06 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:07.175123 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:07.182977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:07.183668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:07.198091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:07.198930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:07.199650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:07.204881 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=7 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:07.207164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:07.208230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:07.209971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:07.700413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:07.712523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1cc287f-28e9-4156-b9e4-95bf20ccde6b tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1379 microversion: 2.1 time: 0.535248 Sep 18 01:07:07.727994 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 811/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:07 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1379 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:07.733440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:07.734216 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:07.740776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:07.741433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:07.741994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:07.742799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:07.743446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:07.744001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:07.990279 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=30 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:08.165837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:08.174841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:08.176308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:08.177501 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-415cc55e-6246-40a2-b1f2-50c3922b57fc tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.448015 Sep 18 01:07:08.178409 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 812/1594] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:07 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:08.195572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c74bd5f-0704-461c-8500-d822d23e6a8e", "name": "network-vif-deleted", "tag": "db78602f-9af9-4361-af1d-c9ed25921482"}, {"name": "network-changed", "server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}, {"name": "network-changed", "server_uuid": "6817d787-8c57-4c31-9d3d-787ff28ce6b6", "tag": "58e0419d-f921-4818-8610-d972ee40fa0c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:08.208647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:08.209194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:08.209793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:08.225754 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] Creating event network-vif-deleted:db78602f-9af9-4361-af1d-c9ed25921482 for instance 7c74bd5f-0704-461c-8500-d822d23e6a8e on n-h1-master-1 Sep 18 01:07:08.226455 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] Creating event network-changed:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h1-master-1 Sep 18 01:07:08.227079 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] Creating event network-changed:58e0419d-f921-4818-8610-d972ee40fa0c for instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 on n-h1-master-1 Sep 18 01:07:08.236422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-cded2c0e-36dc-4d74-87aa-004e67fd4994 req-375c6726-6fd5-4984-8bd6-75625314903d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.044773 Sep 18 01:07:08.237388 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 813/1595] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:08.245836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:08.246700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:08.254543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:08.255185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:08.255727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:08.256533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:08.257143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:08.257653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:08.940051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Building network info cache for instance {{(pid=122373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:07:09.043416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:09.058289 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e7450b05-86e8-4711-97a4-e6e60ea1a77b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1308 microversion: 2.1 time: 0.818878 Sep 18 01:07:09.059844 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 814/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:08 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:09.089338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:09.090180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:09.131379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:09.132018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:09.132506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:09.133228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:09.135873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:09.136510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:09.381545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:09.402595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:09.409332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:09.414310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4507b84-9857-4015-a5c3-08121a9cc312 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.353149 Sep 18 01:07:09.429578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 815/1597] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:09 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:09.440405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:09.440405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:09.456399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:09.458313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:09.459081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:09.460008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:09.460544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:09.461038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.062064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:10.078746 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-23abe265-c5c2-4280-8aa8-ed07489050e8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1210 microversion: 2.1 time: 0.658983 Sep 18 01:07:10.079876 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 816/1598] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:09 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1210 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:10.098191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:10.098909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:10.105290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.105828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.106272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.106999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.107463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.107898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.290473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:10.311084 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1ad91ce3-1c0f-4751-b23f-a172c04ac224 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1345 microversion: 2.1 time: 0.229850 Sep 18 01:07:10.311725 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 817/1599] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:10 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1345 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:10.322462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:10.325217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:10.334863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.335452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.335970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.336815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.337772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.338549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.755793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:10.780135 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c9b3fb9-66ed-4e5b-a959-688e40863ad2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1379 microversion: 2.1 time: 0.465564 Sep 18 01:07:10.781955 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 818/1600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:10 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1379 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:10.792174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e258c602-e010-420b-bbfc-6a655dcc9668 req-1e747698-49c7-484b-9d86-299a7fca5feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a800f78-79ec-46a5-9d3e-25001ec3ef48", "tag": "e9994924-bf5f-4e5e-8eeb-121c201122ef"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:10.809228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e258c602-e010-420b-bbfc-6a655dcc9668 req-1e747698-49c7-484b-9d86-299a7fca5feb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.809809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e258c602-e010-420b-bbfc-6a655dcc9668 req-1e747698-49c7-484b-9d86-299a7fca5feb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.810348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e258c602-e010-420b-bbfc-6a655dcc9668 req-1e747698-49c7-484b-9d86-299a7fca5feb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.820627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Updating instance_info_cache with network_info: [{"id": "bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7", "address": "fa:16:3e:08:d3:bc", "network": {"id": "f76c0a81-41f2-4839-941e-afd3fdd1ae18", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-383311098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b48892f4faf4b9193663a17a6d6c4a9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbcad7e6b-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:07:10.834670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Releasing lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:07:10.836423 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-49113f8f-2211-40e7-a270-2f81e66a0299 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action" status: 202 len: 0 microversion: 2.1 time: 7.132412 Sep 18 01:07:10.837419 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e258c602-e010-420b-bbfc-6a655dcc9668 req-1e747698-49c7-484b-9d86-299a7fca5feb service nova] Creating event network-changed:e9994924-bf5f-4e5e-8eeb-121c201122ef for instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 on n-h1-master-1 Sep 18 01:07:10.839071 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 783/1601] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:03 2022] POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action => generated 0 bytes in 7136 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:07:10.846937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:10.847655 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e258c602-e010-420b-bbfc-6a655dcc9668 req-1e747698-49c7-484b-9d86-299a7fca5feb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063356 Sep 18 01:07:10.848015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:10.849753 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 819/1602] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:10.855175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:10.855980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:10.856522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.857013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.857477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.858422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.858875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.859521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.863582 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:10.864783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.865910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.867252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:10.868642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:10.869724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:10.870555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.086360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.095767 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-105ed407-48b1-43a4-812c-c75b40d11949 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1308 microversion: 2.1 time: 0.244545 Sep 18 01:07:11.110269 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 820/1603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:10 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:11.110269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:11.110269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:11.118476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.119616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.120602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.121573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.123004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.123655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.129338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.144727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.147458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.149661 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4a25687f-f0b2-47c8-a4e9-548a07154337 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.308736 Sep 18 01:07:11.166264 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 784/1604] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:10 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:11.180625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77f6efdd-00e5-4de3-a445-a484354deb5c tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'create', calling method: .version_select at 0x7f7006b33040>, body: {"pool": "240606ee-92d0-43ce-a525-7d5ea98509b1"} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:11.209784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.219335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.220970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.222260 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b9eb90e9-efb2-46d6-b6af-02c0f7487749 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.123593 Sep 18 01:07:11.222831 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 821/1605] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:11 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:11.227753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:11.228598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:11.230813 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:11.253495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.254009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.254426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.255343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.257049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.257049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.460654 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.470710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0880ba25-6ea8-4f6c-b3ef-8cb14432a030 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1210 microversion: 2.1 time: 0.245826 Sep 18 01:07:11.471578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 822/1606] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:11 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1210 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:11.479053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:11.480055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:11.490569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.491323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.492145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.493399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.494238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.495130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.503507 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:11.624420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:11.636855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9f0d1681-81b8-4121-90fe-3af8232d8f83 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 200 len: 1345 microversion: 2.1 time: 0.163997 Sep 18 01:07:11.637910 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 823/1607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:11 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 1345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:11.807140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:11.808148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:11.820373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.820856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.822030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:11.822891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:11.824550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:11.824997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:12.138402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:12.162297 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02962d33-4ac6-452b-b92c-38a93b9be1a9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1379 microversion: 2.1 time: 0.360971 Sep 18 01:07:12.165054 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 824/1608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:11 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1379 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:12.182423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:12.183915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:12.201532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:12.203530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:12.204250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:12.205348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:12.210125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:12.212045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:12.885860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:12.896218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-45f04aad-8537-4520-8e21-cd95c82a4056 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1308 microversion: 2.1 time: 0.728921 Sep 18 01:07:12.910120 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 825/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:12 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:12.920314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:12.921302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:12.928689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:12.929784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:12.930421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:12.931385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:12.932358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:12.933339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:13.391982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:13.422553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:13.427020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:13.429792 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b837b837-4283-4e3c-adab-49143d435dc9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.517694 Sep 18 01:07:13.430906 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 826/1610] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:12 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:13.435777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:13.436625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:13.446188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:13.446989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:13.447600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:13.448501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:13.449120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:13.449759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.008788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:14.021177 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:14.025006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:14.026366 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88d0ecef-1a97-4c28-b551-8d2bd92d75dc tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.593904 Sep 18 01:07:14.027442 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 827/1611] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:13 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:14.038026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-19e1d5fd-c480-41b7-a81d-b505bbac2dc1 req-69d62f15-6bc9-4606-8e25-4fd5b71f0259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "name": "network-vif-plugged", "status": "completed", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:14.057363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-19e1d5fd-c480-41b7-a81d-b505bbac2dc1 req-69d62f15-6bc9-4606-8e25-4fd5b71f0259 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.059489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-19e1d5fd-c480-41b7-a81d-b505bbac2dc1 req-69d62f15-6bc9-4606-8e25-4fd5b71f0259 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.060538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-19e1d5fd-c480-41b7-a81d-b505bbac2dc1 req-69d62f15-6bc9-4606-8e25-4fd5b71f0259 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.084417 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-19e1d5fd-c480-41b7-a81d-b505bbac2dc1 req-69d62f15-6bc9-4606-8e25-4fd5b71f0259 service nova] Creating event network-vif-plugged:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h1-master-1 Sep 18 01:07:14.096634 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-19e1d5fd-c480-41b7-a81d-b505bbac2dc1 req-69d62f15-6bc9-4606-8e25-4fd5b71f0259 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067022 Sep 18 01:07:14.097742 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 828/1612] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:14.106919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:14.108418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:14.114832 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77f6efdd-00e5-4de3-a445-a484354deb5c tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.946812 Sep 18 01:07:14.118605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 785/1613] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:07:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:14.120733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.121610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.122386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.123720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.124615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.125748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.131670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:14.132772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:14.144916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.146624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.148084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.149662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.150779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.151535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.170476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e HTTP/1.1 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '7c74bd5f-0704-461c-8500-d822d23e6a8e'} Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:14.174326 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b46832b9-d26d-4f92-a273-6e9f177de197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 404 len: 111 microversion: 2.1 time: 0.056129 Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 786/1614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:14 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:07:14.189878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-767f2df5-946a-4ba1-b0a5-550456808655 req-82cd00c7-5f8d-451b-8f7c-df2c093d5154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b111d2-6cb9-40c2-b63e-319247c07f3e", "tag": "bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7"}, {"name": "network-changed", "server_uuid": "254d59b9-ce47-47a8-9350-54779b2f2d75", "tag": "6462c0cf-490d-4eff-bc24-c442fae53aaa"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:14.200586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-767f2df5-946a-4ba1-b0a5-550456808655 req-82cd00c7-5f8d-451b-8f7c-df2c093d5154 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.201370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-767f2df5-946a-4ba1-b0a5-550456808655 req-82cd00c7-5f8d-451b-8f7c-df2c093d5154 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.202273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-767f2df5-946a-4ba1-b0a5-550456808655 req-82cd00c7-5f8d-451b-8f7c-df2c093d5154 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.229673 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-767f2df5-946a-4ba1-b0a5-550456808655 req-82cd00c7-5f8d-451b-8f7c-df2c093d5154 service nova] Creating event network-changed:bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 for instance e2b111d2-6cb9-40c2-b63e-319247c07f3e on n-h2-master-1 Sep 18 01:07:14.230543 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-767f2df5-946a-4ba1-b0a5-550456808655 req-82cd00c7-5f8d-451b-8f7c-df2c093d5154 service nova] Creating event network-changed:6462c0cf-490d-4eff-bc24-c442fae53aaa for instance 254d59b9-ce47-47a8-9350-54779b2f2d75 on n-h2-master-1 Sep 18 01:07:14.244335 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-767f2df5-946a-4ba1-b0a5-550456808655 req-82cd00c7-5f8d-451b-8f7c-df2c093d5154 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064388 Sep 18 01:07:14.246016 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 787/1615] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:14.256344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:14.257805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:14.271736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.272816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.273812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.275073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.276014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.277058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.606157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:14.618757 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f000fc3-6bdf-4874-87a6-af9c83241a85 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.519574 Sep 18 01:07:14.619492 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 829/1616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:14 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:14.625949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:14.627203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:14.636073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.636966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.637662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.638713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.639361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.639859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.771164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:14.786947 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2a5baaea-e403-4d7c-bfb8-28eb721678c5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1379 microversion: 2.1 time: 0.538543 Sep 18 01:07:14.788080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 788/1617] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:14 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1379 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:14.797840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.140"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:14.803690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:14.816280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.817284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.818159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.819567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:14.820445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:14.821437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:14.867715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:07:14.868977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquired lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:07:15.044149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:15.065106 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6653f4d-ea0a-4a4f-ba79-38c2672391e7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1308 microversion: 2.1 time: 0.442587 Sep 18 01:07:15.066017 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 830/1618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:14 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:15.078041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:15.079334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:15.088478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.089773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.091566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.092830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.093331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.093805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.564441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:15.583477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:15.586376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:15.588771 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a50b488a-69fd-4332-bc24-28b21f2464b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.520557 Sep 18 01:07:15.589809 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 831/1619] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:15 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:15.598651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:15.602873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:15.615405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.616199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.617078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.618309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.619165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.619938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.645979 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e/os-volume_attachments HTTP/1.1 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '7c74bd5f-0704-461c-8500-d822d23e6a8e'} Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:07:15.649373 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:15.655115 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f8681c17-669e-47a3-bd5a-6b79d6c80fab tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060514 Sep 18 01:07:15.658605 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 832/1620] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:07:15 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:07:15.667659 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:15.668709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:15.683348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.684092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.685107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.686404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.687499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.688311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.822697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:15.836795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:15.838399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:15.840225 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-255c53be-556b-4c2f-b12b-de6fd17b438a tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.179938 Sep 18 01:07:15.843241 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1.", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:07:15.845475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Releasing lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:07:15.846412 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] HTTP exception thrown: Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1. Sep 18 01:07:15.846412 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-ec4b23e4-eacb-43fe-a251-e4402a6e04fe'] Sep 18 01:07:15.854492 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 833/1621] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:15 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Request method failure captured: Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action HTTP/1.1 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 46 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm8aAMmvnKqJFfReo_YkqiPUqYKj0fcwO8FF5pbjpNF-jPuhGluvNl9aLwqvI57AfHS1T0AnVmPEZoxeVIkowh8qHzydFbXzwgKfshZQuwELKGF9GB3A2LCot7Cg3mx5DRWvW9k5Z6ZVzTMY39SUVQvx0zKMpnrWB2EVEJmMKmp-_Z0 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 0fa4005cb3944bd6b85bbc64021fa705 Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: {"addFloatingIp": {"address": "172.35.3.140"}} Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1. Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-ec4b23e4-eacb-43fe-a251-e4402a6e04fe'] Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e2b111d2-6cb9-40c2-b63e-319247c07f3e', 'body': {'addFloatingIp': {'address': '172.35.3.140'}}} Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:07:15.855928 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1. Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec4b23e4-eacb-43fe-a251-e4402a6e04fe'] Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1. Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec4b23e4-eacb-43fe-a251-e4402a6e04fe'] Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1. Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec4b23e4-eacb-43fe-a251-e4402a6e04fe'] Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1. Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec4b23e4-eacb-43fe-a251-e4402a6e04fe'] Sep 18 01:07:15.869693 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Returning 400 to user: Cannot associate floating IP 172.35.3.140 (dd866281-2b73-4afc-97fb-6e557ef1e573) with port bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 240606ee-92d0-43ce-a525-7d5ea98509b1. Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-ec4b23e4-eacb-43fe-a251-e4402a6e04fe'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3320ae2d-07f4-46ca-99c3-1f3d4cb6aa09 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action" status: 400 len: 381 microversion: 2.1 time: 1.069095 Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 789/1622] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:14 2022] POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action => generated 381 bytes in 1071 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.889703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.895776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:15.896519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:15.905586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.906295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.906851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:15.908536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:15.909296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:15.910000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:16.166306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:16.179843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e02c919-d609-4533-b8ab-23a0d1b092e4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1379 microversion: 2.1 time: 0.317961 Sep 18 01:07:16.180794 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 790/1623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:15 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1379 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:16.186199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc8da070-c054-48d2-bc8d-bff743af78d5 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '.version_select at 0x7f7006512e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:16.193243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:16.206142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af979763-aad6-46f3-8387-40192ef5b8de tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.349874 Sep 18 01:07:16.207437 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 834/1624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:15 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:16.213642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1797196180", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b66b4645-3540-45b7-82ac-f51c6140e547"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:16.289243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] validate_networks() for [('b66b4645-3540-45b7-82ac-f51c6140e547', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:07:17.387015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:07:17.387958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:07:17.388425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:07:17.388847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:07:17.389275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:07:17.401253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.401782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.402285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.403284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.403822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.404252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.427906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:07:17.432035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for user 253b3027efb74403a9bfaa4d2cbfd31e and project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:07:17.453512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:07:17.456755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:07:17.509656 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9009205-50c2-459d-aebe-71562b2abd86 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300302 Sep 18 01:07:17.518807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 835/1625] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:07:17.522838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:17.523463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:17.533744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.534571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.535393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.536676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.537447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.538348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.726639 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc8da070-c054-48d2-bc8d-bff743af78d5 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/dd866281-2b73-4afc-97fb-6e557ef1e573" status: 202 len: 0 microversion: 2.1 time: 1.544051 Sep 18 01:07:17.734483 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 791/1626] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:07:16 2022] DELETE /compute/v2.1/os-floating-ips/dd866281-2b73-4afc-97fb-6e557ef1e573 => generated 0 bytes in 1547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:17.748613 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-01cd739a-7db1-4b0f-b200-4389287c153c req-5c1bafce-7beb-4344-8f8e-8bd77f3c43e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a800f78-79ec-46a5-9d3e-25001ec3ef48", "name": "network-vif-plugged", "status": "completed", "tag": "e9994924-bf5f-4e5e-8eeb-121c201122ef"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:17.763587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:17.774436 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4c2cc273-c721-410d-9db2-bf2637b31c46 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1308 microversion: 2.1 time: 0.255800 Sep 18 01:07:17.775339 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 836/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:17 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:17.775983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-01cd739a-7db1-4b0f-b200-4389287c153c req-5c1bafce-7beb-4344-8f8e-8bd77f3c43e5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.776677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-01cd739a-7db1-4b0f-b200-4389287c153c req-5c1bafce-7beb-4344-8f8e-8bd77f3c43e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.777312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-01cd739a-7db1-4b0f-b200-4389287c153c req-5c1bafce-7beb-4344-8f8e-8bd77f3c43e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.781006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:17.781806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:17.788408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.789117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.789830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.790745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.791413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.792059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.808199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-01cd739a-7db1-4b0f-b200-4389287c153c req-5c1bafce-7beb-4344-8f8e-8bd77f3c43e5 service nova] Creating event network-vif-plugged:e9994924-bf5f-4e5e-8eeb-121c201122ef for instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 on n-h1-master-1 Sep 18 01:07:17.818888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-01cd739a-7db1-4b0f-b200-4389287c153c req-5c1bafce-7beb-4344-8f8e-8bd77f3c43e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088251 Sep 18 01:07:17.820938 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 792/1628] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:17.829288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:17.830458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:17.838032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.838740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.839441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.840425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:17.841107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:17.841516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:17.962852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:17.977587 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:17.979926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:17.982310 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a88783e-77b5-4b32-92a7-23f7958d9392 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.157969 Sep 18 01:07:17.984432 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 793/1629] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:17 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:17.990511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:17.991488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:18.002000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.003385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.004174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.005182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.006051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.006593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.057475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:18.067866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:18.069815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:18.071682 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f348b22-6d72-497f-8b9f-98a4276d382c tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.295248 Sep 18 01:07:18.073115 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 837/1630] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:17 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:18.085392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:18.086982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:18.099004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.099942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.100654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.102048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.103968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.104518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.322255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:18.333079 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9a5c3f7-2209-419a-823a-a13ed75d0f40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1529 microversion: 2.1 time: 0.346764 Sep 18 01:07:18.335519 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 794/1631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:17 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1529 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:18.341740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:18.343110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:18.349109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.349631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.350075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.350894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.351287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.351710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.379457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:18.401759 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4438c3ca-81ae-4ccc-8a36-886f140ddd81 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.325824 Sep 18 01:07:18.403310 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 838/1632] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:18 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:18.409404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.181"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:18.784681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:18.802083 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4bc83cb6-8108-4e42-913d-454b942e6b81 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2" status: 200 len: 1211 microversion: 2.1 time: 0.464844 Sep 18 01:07:18.818126 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 795/1633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:18 2022] GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 => generated 1211 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:18.827452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:18.830571 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:18.844116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.845069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.845912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.847718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.849412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.850219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.978491 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:18.987006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.987784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.988426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:18.989275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:18.989903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:18.990690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.101314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:19.113481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e804850-4125-4b85-abbd-94950894f122 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1529 microversion: 2.1 time: 0.292624 Sep 18 01:07:19.114784 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 796/1634] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:18 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1529 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:19.122144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:19.123093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:19.133067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.134452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.135507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.136714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.137495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.138467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.406993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:07:19.409680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquired lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:07:19.492665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:19.503950 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d394cd4b-72ad-4221-9323-eaf02a0c1178 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1308 microversion: 2.1 time: 0.387461 Sep 18 01:07:19.504915 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 797/1635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:19 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:19.510697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:19.511463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:19.521539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.522347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.523113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.524029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.524647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.525242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.571081 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:07:19.744057 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57feccd5-5458-4e21-84a7-0bf8f13512e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2" status: 204 len: 0 microversion: 2.1 time: 0.237154 Sep 18 01:07:19.747878 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 798/1636] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:07:19 2022] DELETE /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:07:19.754548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:19.755618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:19.762117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.762946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.763898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.764732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.765325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.765909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.868756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:19.888404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:19.890823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:19.898136 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0eaffbdb-9e37-42b0-8d0e-c4cd891b4193 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.143440 Sep 18 01:07:19.900750 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 799/1637] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:19 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:19.910801 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:19.912696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:19.935585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.936073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.936705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:19.937765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:19.938393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:19.938883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:20.292221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:20.302443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:20.304104 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:20.305300 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0785e348-d056-43d3-981d-0fe857bec28a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.402431 Sep 18 01:07:20.305914 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 800/1638] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:19 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:20.310449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f39583ab-5494-4723-b157-e908269bdbc0 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:20.332286 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f39583ab-5494-4723-b157-e908269bdbc0 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/899f774b-26ad-46c7-941b-a6beccc58a5b" status: 202 len: 0 microversion: 2.1 time: 0.024859 Sep 18 01:07:20.333981 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 801/1639] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:07:20 2022] DELETE /compute/v2.1/flavors/899f774b-26ad-46c7-941b-a6beccc58a5b => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:20.343442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:20.344497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:20.353079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:20.353586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:20.354025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:20.355099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:20.355222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:20.355649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:20.714655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:20.730054 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a859b5a7-af15-4b92-9331-daf165a5ad5c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.393662 Sep 18 01:07:20.733250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 802/1640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:20 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:20.736881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:20.737661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:20.747628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:20.748146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:20.748803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:20.749946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:20.750235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:20.750645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:20.846734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:07:20.881962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:20.894766 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a3b04da1-b973-46e0-a11b-09900f832954 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2" status: 200 len: 1217 microversion: 2.1 time: 0.162912 Sep 18 01:07:20.895488 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 803/1641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:20 2022] GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:20.915790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-58358ac2-c5ae-4706-8caf-8e0c3b7f967a tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:20.943391 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-58358ac2-c5ae-4706-8caf-8e0c3b7f967a tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039397 Sep 18 01:07:20.944101 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 804/1642] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:07:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:20.957657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:20.959727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:20.973602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:20.974630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:20.975782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:20.977180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:20.978170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:20.979084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:21.011643 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:21.483143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:21.502421 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96e443de-ba30-47a0-947c-2b2fbf23b5de tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1487 microversion: 2.1 time: 0.555517 Sep 18 01:07:21.503130 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 805/1643] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:20 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1487 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:21.509744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-357472f6-a78f-40ad-9223-991050f9db57 req-773b8f61-1815-4631-b0c0-fab4d9f0ed02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b111d2-6cb9-40c2-b63e-319247c07f3e", "tag": "bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:21.525269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-357472f6-a78f-40ad-9223-991050f9db57 req-773b8f61-1815-4631-b0c0-fab4d9f0ed02 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:21.526222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-357472f6-a78f-40ad-9223-991050f9db57 req-773b8f61-1815-4631-b0c0-fab4d9f0ed02 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:21.526846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-357472f6-a78f-40ad-9223-991050f9db57 req-773b8f61-1815-4631-b0c0-fab4d9f0ed02 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:21.548889 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-357472f6-a78f-40ad-9223-991050f9db57 req-773b8f61-1815-4631-b0c0-fab4d9f0ed02 service nova] Creating event network-changed:bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 for instance e2b111d2-6cb9-40c2-b63e-319247c07f3e on n-h2-master-1 Sep 18 01:07:21.561257 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-357472f6-a78f-40ad-9223-991050f9db57 req-773b8f61-1815-4631-b0c0-fab4d9f0ed02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056476 Sep 18 01:07:21.563311 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 806/1644] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:21.572710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:21.573412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:21.582620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:21.583110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:21.583544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:21.584259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:21.584726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:21.585142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:21.793640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:21.804177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:21.805887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:21.807083 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f556375-be27-42f9-b5cf-ec192f626489 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.239848 Sep 18 01:07:21.809749 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 807/1645] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:21 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:21.816034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:21.822049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:21.833093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:21.834692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:21.835698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:21.836933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:21.838696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:21.838696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:21.971130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:21.978174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Old instance type tempest-test_resize_flavor_-1813796279, new instance type m1.heat {{(pid=122373) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:07:21.986717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:07:21.986717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:07:21.988300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:07:21.988300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:07:21.988300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:07:22.140612 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-71f81d92-3ff2-438a-9564-99440ea90c54 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b/action" status: 202 len: 0 microversion: 2.1 time: 0.329430 Sep 18 01:07:22.141414 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 808/1646] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:21 2022] POST /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:22.146866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:22.147480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:22.154710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:22.155334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:22.155778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:22.156494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:22.157164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:22.158153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.014990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Updating instance_info_cache with network_info: [{"id": "bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7", "address": "fa:16:3e:08:d3:bc", "network": {"id": "f76c0a81-41f2-4839-941e-afd3fdd1ae18", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-383311098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b48892f4faf4b9193663a17a6d6c4a9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbcad7e6b-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:07:23.040783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Releasing lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:07:23.041946 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64e28dda-c454-4631-9039-a7359174b59d tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action" status: 202 len: 0 microversion: 2.1 time: 4.637015 Sep 18 01:07:23.042849 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 839/1647] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:18 2022] POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action => generated 0 bytes in 4639 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:07:23.060435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:23.060797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.063050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:23.074595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.075383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.076032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.076974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.077629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.078233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.099441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.101267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.103520 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c6872e25-4416-409b-9d42-39a01d7788f9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1813 microversion: 2.25 time: 0.960625 Sep 18 01:07:23.122806 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 809/1648] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:22 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1813 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:23.139843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:23.140644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:23.151356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.153876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.153876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.154730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.155474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.156570 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:23.159873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.272929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55536e84-36e3-4e89-85f8-ce52f697943c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48/action" status: 202 len: 0 microversion: 2.1 time: 0.227704 Sep 18 01:07:23.285350 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 840/1649] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:23 2022] POST /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:23.302206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:23.303325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:23.321681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.323027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.325009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.326947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.328227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.330088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.482827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.521465 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1ce62135-36ce-4144-be37-f54e7c351836 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2" status: 200 len: 1219 microversion: 2.1 time: 0.233299 Sep 18 01:07:23.525603 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 841/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:23 2022] GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 => generated 1219 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:23.547397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:23.556153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:23.564749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.585217 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d5289ec9-4799-45cd-984a-bbca3252cfdc tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.459882 Sep 18 01:07:23.585943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.586155 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 810/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:23 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:23.596327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.597375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.600019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.601035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:23.602720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:23.607053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.607885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.613722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.615433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.616223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.617235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:23.618728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:23.620690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:23.867834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.884576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.889087 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:23.897477 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9c28bde-cfab-4903-9f83-2184f825fbb8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.303794 Sep 18 01:07:23.898979 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 811/1652] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:23 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:23.904547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d49ecf9-e917-4f5a-88fc-c47bdcc08877 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '.version_select at 0x7f7005eade50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:23.994329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:24.026590 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6778c270-fb66-40ca-a5f3-48dc7f6d8f95 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1538 microversion: 2.1 time: 0.496293 Sep 18 01:07:24.027594 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 842/1653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:23 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1538 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:24.038774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:24.053806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:24.063963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:24.065522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:24.066728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:24.068705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:24.069895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:24.070743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:24.465603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:24.478027 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6bf8ace-dab8-482a-8633-bf2afce0da7e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 200 len: 1472 microversion: 2.1 time: 0.446286 Sep 18 01:07:24.478988 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 843/1654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:24 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:24.508163 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:24.508842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:24.520567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:24.521101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:24.521544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:24.522582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:24.523218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:24.523856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:24.937923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:24.956561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:24.958983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:24.961998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba6b0200-5af9-4a27-b70f-0e243d653de0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1803 microversion: 2.25 time: 0.469897 Sep 18 01:07:24.963046 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 844/1655] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:24 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1803 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:24.971237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1906870460"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:24.974057 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:24.982060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:24.982925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:24.983602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:24.984817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:24.986190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:24.986994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.242209 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ce634bc-376e-4fba-9a2a-4ad9f417741a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48/action" status: 202 len: 0 microversion: 2.1 time: 0.276865 Sep 18 01:07:25.243281 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 845/1656] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:24 2022] POST /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:07:25.250744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:25.252740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:25.262947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.264221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.265199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.266807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.267595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.268281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.293375 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 HTTP/1.1 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: exception: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'fc3a2593-1d08-492c-b6dc-8bf8657aa9a2'} Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:25.296439 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-600af31d-6ec1-49d4-aef7-62c252a18a4b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2" status: 404 len: 111 microversion: 2.1 time: 0.054355 Sep 18 01:07:25.307124 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 846/1657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:25 2022] GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:07:25.324874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:25.325884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:25.337321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.338866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.339335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.340099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.340565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.341002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.412420 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d49ecf9-e917-4f5a-88fc-c47bdcc08877 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/4fb01eb2-6021-4256-be2d-b7a6d9c5dcf0" status: 202 len: 0 microversion: 2.1 time: 1.511952 Sep 18 01:07:25.421526 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 812/1658] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:07:23 2022] DELETE /compute/v2.1/os-floating-ips/4fb01eb2-6021-4256-be2d-b7a6d9c5dcf0 => generated 0 bytes in 1521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:25.430117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:25.431122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:25.447073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.447588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.448202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.449212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.450025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.450669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.550591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:25.562216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:25.564478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:25.566072 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15fbd3d5-6e62-4356-b9dd-fbd154820784 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.142325 Sep 18 01:07:25.581591 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 813/1659] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:25 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:25.590954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a570bb0-c39c-44b4-84e5-717b93ab6452 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '.version_select at 0x7f7006dfef70>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:25.596708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a570bb0-c39c-44b4-84e5-717b93ab6452 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.597221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a570bb0-c39c-44b4-84e5-717b93ab6452 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.597740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a570bb0-c39c-44b4-84e5-717b93ab6452 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.607855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:25.619458 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-29b8ad08-70dc-486b-9987-be7c40a71e63 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.317249 Sep 18 01:07:25.621487 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 847/1660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:25 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:25.623498 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a570bb0-c39c-44b4-84e5-717b93ab6452 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 4050 microversion: 2.25 time: 0.048139 Sep 18 01:07:25.625057 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 814/1661] 10.222.0.25 () {60 vars in 1184 bytes} [Sun Sep 18 01:07:25 2022] GET /compute/v2.1/os-migrations => generated 4050 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:25.631583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61aacc13-bb26-4c28-9db8-90648762c51c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005f229d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:25.640027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:25.641105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:25.654235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.654875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.655406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.656227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:25.656794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:25.657692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:25.706934 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61aacc13-bb26-4c28-9db8-90648762c51c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.080154 Sep 18 01:07:25.707831 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 815/1662] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:25 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:25.713373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1011596045", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b66b4645-3540-45b7-82ac-f51c6140e547"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:25.776005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] validate_networks() for [('b66b4645-3540-45b7-82ac-f51c6140e547', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:07:25.973156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:25.982209 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3baaadb6-2cb9-44ec-92c7-1356e471dd5c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1538 microversion: 2.1 time: 0.358567 Sep 18 01:07:25.988641 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 848/1663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:25 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1538 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:25.988641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76cf0131-a20a-4ca4-b4eb-40156f4a6344 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76cf0131-a20a-4ca4-b4eb-40156f4a6344 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Request method failure captured: Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action HTTP/1.1 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 34 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8aAMmvnKqJFfReo_YkqiPUqYKj0fcwO8FF5pbjpNF-jPuhGluvNl9aLwqvI57AfHS1T0AnVmPEZoxeVIkowh8qHzydFbXzwgKfshZQuwELKGF9GB3A2LCot7Cg3mx5DRWvW9k5Z6ZVzTMY39SUVQvx0zKMpnrWB2EVEJmMKmp-_Z0 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0fa4005cb3944bd6b85bbc64021fa705 Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: {"addFloatingIp": {"address": ""}} Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e2b111d2-6cb9-40c2-b63e-319247c07f3e', 'body': {'addFloatingIp': {'address': ''}}} Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '' Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:07:25.992480 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76cf0131-a20a-4ca4-b4eb-40156f4a6344 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:25.999845 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76cf0131-a20a-4ca4-b4eb-40156f4a6344 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action" status: 400 len: 142 microversion: 2.1 time: 0.009557 Sep 18 01:07:26.002985 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 849/1664] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:25 2022] POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:07:26.006716 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:26.007481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:26.017873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.018686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.019537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.020405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.021219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.022002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.345956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 6817d787-8c57-4c31-9d3d-787ff28ce6b6 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:07:26.370573 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37580496-8d32-48a8-b5ca-46417f865d20 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 2421 microversion: 2.25 time: 0.368318 Sep 18 01:07:26.371427 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 850/1665] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:26 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 2421 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:26.379287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-09454ff0-03b5-45e6-98b1-a375c2ad17eb req-516745d0-fb45-4e80-a6fa-109c4f75a45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254d59b9-ce47-47a8-9350-54779b2f2d75", "name": "network-vif-plugged", "status": "completed", "tag": "6462c0cf-490d-4eff-bc24-c442fae53aaa"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:26.396217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-09454ff0-03b5-45e6-98b1-a375c2ad17eb req-516745d0-fb45-4e80-a6fa-109c4f75a45f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.396905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-09454ff0-03b5-45e6-98b1-a375c2ad17eb req-516745d0-fb45-4e80-a6fa-109c4f75a45f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.397528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-09454ff0-03b5-45e6-98b1-a375c2ad17eb req-516745d0-fb45-4e80-a6fa-109c4f75a45f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.413377 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-09454ff0-03b5-45e6-98b1-a375c2ad17eb req-516745d0-fb45-4e80-a6fa-109c4f75a45f service nova] Creating event network-vif-plugged:6462c0cf-490d-4eff-bc24-c442fae53aaa for instance 254d59b9-ce47-47a8-9350-54779b2f2d75 on n-h2-master-1 Sep 18 01:07:26.418748 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-09454ff0-03b5-45e6-98b1-a375c2ad17eb req-516745d0-fb45-4e80-a6fa-109c4f75a45f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045668 Sep 18 01:07:26.419699 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 851/1666] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:26.425966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:26.428676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:26.436063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.436572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.437019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.437814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.438281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.439576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.475030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:07:26.475668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquired lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:07:26.599669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:07:26.602421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:07:26.603218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:07:26.604147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:07:26.606223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:07:26.620709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.621499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.622528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.624097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.624863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.625589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.659839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:07:26.666357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for user 253b3027efb74403a9bfaa4d2cbfd31e and project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:07:26.681624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:07:26.684070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:07:26.741946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Releasing lock "refresh_cache-e2b111d2-6cb9-40c2-b63e-319247c07f3e" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:07:26.742515 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] HTTP exception thrown: floating IP not found Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Request method failure captured: Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action HTTP/1.1 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 41 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8aAMmvnKqJFfReo_YkqiPUqYKj0fcwO8FF5pbjpNF-jPuhGluvNl9aLwqvI57AfHS1T0AnVmPEZoxeVIkowh8qHzydFbXzwgKfshZQuwELKGF9GB3A2LCot7Cg3mx5DRWvW9k5Z6ZVzTMY39SUVQvx0zKMpnrWB2EVEJmMKmp-_Z0 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0fa4005cb3944bd6b85bbc64021fa705 Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: exception: floating IP not found Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e2b111d2-6cb9-40c2-b63e-319247c07f3e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 18 01:07:26.744360 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 18 01:07:26.749455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:26.751655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Returning 404 to user: floating IP not found {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:26.752793 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-536c0274-5cb2-49b0-a6fc-fbc4682b51b2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action" status: 404 len: 67 microversion: 2.1 time: 0.332009 Sep 18 01:07:26.753984 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 852/1667] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:26 2022] POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action => generated 67 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:07:26.759079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:26.760082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:26.767992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.768856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.769525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.770511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.771351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.772065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.781867 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c30b24d-c183-4425-a306-2bda89a1d2ca tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071725 Sep 18 01:07:26.784093 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 816/1668] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:07:26.791888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:26.793037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:26.807219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.808070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.808838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.810172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:26.812100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:26.813334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:26.969956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:26.979340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:26.981783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:26.983073 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-41c1065a-31c2-4d73-a84d-e962dc9979fb tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.197614 Sep 18 01:07:26.983936 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 817/1669] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:26 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:26.989712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:26.990509 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:26.999759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.000716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.002053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.002955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.003574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.004915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.197643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 6817d787-8c57-4c31-9d3d-787ff28ce6b6 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:07:27.218715 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-263cd0e5-22bb-4151-8b33-b65b69dd5b67 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 2421 microversion: 2.25 time: 0.463294 Sep 18 01:07:27.220101 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 853/1670] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:26 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 2421 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:27.225536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a68779f-56d5-4e0b-9794-bd8a0b425bab tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005f093a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:27.286920 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a68779f-56d5-4e0b-9794-bd8a0b425bab tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.065334 Sep 18 01:07:27.287880 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 854/1671] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:27 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:27.294742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70aff777-0369-4b17-b877-70333bfe5dc1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:27.358020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:27.365980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d1406e96-c943-43d9-8b05-8ba2e0b19c7e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.380643 Sep 18 01:07:27.366990 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 818/1672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:26 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:27.371796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-daeb8dcc-8db0-4b5e-ace0-133f0bf733d1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:27.372425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-daeb8dcc-8db0-4b5e-ace0-133f0bf733d1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:27.386312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-70aff777-0369-4b17-b877-70333bfe5dc1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70aff777-0369-4b17-b877-70333bfe5dc1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Request method failure captured: Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action HTTP/1.1 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 44 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8aAMmvnKqJFfReo_YkqiPUqYKj0fcwO8FF5pbjpNF-jPuhGluvNl9aLwqvI57AfHS1T0AnVmPEZoxeVIkowh8qHzydFbXzwgKfshZQuwELKGF9GB3A2LCot7Cg3mx5DRWvW9k5Z6ZVzTMY39SUVQvx0zKMpnrWB2EVEJmMKmp-_Z0 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0fa4005cb3944bd6b85bbc64021fa705 Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: exception: Floating IP not found for address 0.0.0.0. Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e2b111d2-6cb9-40c2-b63e-319247c07f3e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 18 01:07:27.388007 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70aff777-0369-4b17-b877-70333bfe5dc1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:27.392654 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70aff777-0369-4b17-b877-70333bfe5dc1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action" status: 404 len: 88 microversion: 2.1 time: 0.099081 Sep 18 01:07:27.395535 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 855/1673] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:27 2022] POST /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e/action => generated 88 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:07:27.400110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:27.400783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:27.414869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.416282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.416722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.417474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.417962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.418406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.418990 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:27.445635 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:27.461008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-daeb8dcc-8db0-4b5e-ace0-133f0bf733d1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:27.471154 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-daeb8dcc-8db0-4b5e-ace0-133f0bf733d1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1215 microversion: 2.1 time: 0.103066 Sep 18 01:07:27.472715 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 819/1674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:27 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:27.478358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:27.479202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:27.488561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.489059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.489610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.490421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.490888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.491313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.622233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lazy-loading 'services' on Instance uuid 6817d787-8c57-4c31-9d3d-787ff28ce6b6 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:07:27.623786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:27.640398 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c7b6ac9-78ff-432f-9040-929077dd4920 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1538 microversion: 2.1 time: 0.243928 Sep 18 01:07:27.641339 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 856/1675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:27 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1538 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:27.647442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:27.648062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:27.655815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.656720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.658124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.658692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.659357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.659872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.692609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:07:27.766051 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8941f44c-8c3c-480a-b9a3-46dadccb15d1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments/930140c5-2d9e-452c-8cce-fb5d9ce2fc45" status: 202 len: 0 microversion: 2.25 time: 0.291522 Sep 18 01:07:27.767633 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:27.768933 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 820/1676] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Sep 18 01:07:27 2022] DELETE /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments/930140c5-2d9e-452c-8cce-fb5d9ce2fc45 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:07:27.785498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:27.790717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:27.812322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.813808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.814749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.816894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.817898 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0768135-35c3-4d39-8b30-ddfcf2d19f3a tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 204 len: 0 microversion: 2.1 time: 0.173620 Sep 18 01:07:27.818306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.819121 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 857/1677] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:07:27 2022] DELETE /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:07:27.819659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.838364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:27.839123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:27.846174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.846784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.847307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.848059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:27.848524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:27.849411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:27.885711 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8863577-3e38-466d-ad77-f486cb823e70 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109080 Sep 18 01:07:27.887308 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 821/1678] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:27 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:28.026938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:28.027639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:28.028334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:28.031513 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:28.038956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.039707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.040246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.041115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.041799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.042331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.045383 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-180e5074-0c48-42c6-b03d-a6fee6ba65e2 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1540 microversion: 2.1 time: 0.218740 Sep 18 01:07:28.049943 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 858/1679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:27 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1540 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:28.158785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:28.169705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:28.171794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:28.173949 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c6d43e03-9c27-4fe1-9eca-5009aa1bce02 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.156979 Sep 18 01:07:28.174832 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 822/1680] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:28 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:07:28.308517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2758a7eb-2020-45e6-a522-ab2941cd8bd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005f54dc0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:28.375705 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2758a7eb-2020-45e6-a522-ab2941cd8bd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.071115 Sep 18 01:07:28.377348 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 859/1681] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:28 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:28.393281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:28.394554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:28.405624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.406210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.406788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.407776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.408555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.409277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.508388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:28.509208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:28.521640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.521986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.522455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.524461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.525067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.525810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.670643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:28.696021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:28.696693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00037b42-c60c-4895-bb10-fb21a6061f6d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1267 microversion: 2.1 time: 0.195620 Sep 18 01:07:28.698205 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 860/1682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:28 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:28.704731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:28.705367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:28.721942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.722716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.723228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.724326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.724897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.730490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.736240 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-71114a45-ddca-45e2-9fd5-d436a6c40839 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.349128 Sep 18 01:07:28.737250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 823/1683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:28 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:28.904213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:28.907775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:28.919654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.920652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.921310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.922277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:28.923888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:28.924670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:28.990131 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b22bd8d-440e-42b0-9935-3701cf6e75a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090209 Sep 18 01:07:28.991978 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 824/1684] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:28 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:29.027143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:29.040488 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88d12b4f-6e17-4f70-9a66-36f6074696af tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.340341 Sep 18 01:07:29.041847 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 861/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:28 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:29.073157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:29.073836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:29.084271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.085103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.085940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:29.087201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.088123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.088869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:29.097159 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:29.221675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:29.222578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:29.233637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.234457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.235185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:29.236427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.237188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.237931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:29.394652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:29.409665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:29.412531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:29.415490 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db1b360c-b3be-4cdd-b8e9-e540ef3277c8 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.201661 Sep 18 01:07:29.416060 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 862/1686] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:29 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:07:29.421250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94034af7-4095-4329-9800-17a4f8dbdd92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005ea7d30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:29.454288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:29.474369 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40d2d3a1-b38e-4719-bfa2-9ef2e1f133ea tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1540 microversion: 2.1 time: 0.405317 Sep 18 01:07:29.475948 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 825/1687] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:29 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1540 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:29.480048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-94034af7-4095-4329-9800-17a4f8dbdd92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.062788 Sep 18 01:07:29.488763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 863/1688] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:29 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:29.739692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:29.740495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:29.747638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.748430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.749011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:29.749846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.750324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.750760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:29.770671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:29.771505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:29.781741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.782916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.783885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:29.784921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:29.786134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:29.787442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.157788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:30.170173 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eb164bbd-c975-41c8-9418-a95fd389d289 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.435477 Sep 18 01:07:30.185917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:30.187328 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 826/1689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:29 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:30.200978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:30.202306 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91b72d5d-0206-4402-b696-6efe39fea23f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1198 microversion: 2.1 time: 0.437051 Sep 18 01:07:30.203126 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 864/1690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:29 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1198 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:30.214151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:30.215394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:30.218143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:30.225376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.226126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.226742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.227628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.228250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.228809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.229020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.229642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.230179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.231538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.232018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.232661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.304968 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1219d751-2366-4841-91ab-cd5f59d72208 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115015 Sep 18 01:07:30.306562 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 827/1691] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:30 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:30.516833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:30.528581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:30.552055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.553260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.554365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.557840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.559424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.560168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.706106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:30.720500 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d40b3279-0761-4ef6-8a17-9a40b12a6143 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.515056 Sep 18 01:07:30.720674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:30.721101 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 865/1692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:30 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:30.729887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:30.730632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:30.742044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:30.749785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:30.750872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.752593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.753501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.754241 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b0f4b919-5e5f-4275-8d2f-baeac21ba6f7 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.296369 Sep 18 01:07:30.755955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.756933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.757518 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 828/1693] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:30 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:07:30.757874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.765603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68f31864-e1eb-4508-b6a3-7641b2e56b76 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005ead160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:30.838093 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68f31864-e1eb-4508-b6a3-7641b2e56b76 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.078892 Sep 18 01:07:30.846469 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 829/1694] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:30 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:30.851614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-226173b2-01fb-426c-8d06-26b4b363426e req-8564d637-49df-412b-8946-a28539aba80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a800f78-79ec-46a5-9d3e-25001ec3ef48", "name": "network-vif-plugged", "status": "completed", "tag": "e9994924-bf5f-4e5e-8eeb-121c201122ef"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:30.866141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-226173b2-01fb-426c-8d06-26b4b363426e req-8564d637-49df-412b-8946-a28539aba80a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:30.866620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-226173b2-01fb-426c-8d06-26b4b363426e req-8564d637-49df-412b-8946-a28539aba80a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:30.870333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-226173b2-01fb-426c-8d06-26b4b363426e req-8564d637-49df-412b-8946-a28539aba80a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:30.891961 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-226173b2-01fb-426c-8d06-26b4b363426e req-8564d637-49df-412b-8946-a28539aba80a service nova] Creating event network-vif-plugged:e9994924-bf5f-4e5e-8eeb-121c201122ef for instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 on n-h1-master-1 Sep 18 01:07:30.901149 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-226173b2-01fb-426c-8d06-26b4b363426e req-8564d637-49df-412b-8946-a28539aba80a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052262 Sep 18 01:07:30.904975 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 830/1695] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:31.060298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:31.071494 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-879bd359-77b4-42cc-993f-8ece5540fc28 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1540 microversion: 2.1 time: 0.349210 Sep 18 01:07:31.072600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 866/1696] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:30 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1540 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:31.203059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:31.204263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:31.211593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.212463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.213154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:31.214197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.214676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.215283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:31.232420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:31.233233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:31.237447 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:31.267741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.270344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.270937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:31.272029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.272576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.273072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:31.895000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:31.908800 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd799e76-db07-491a-afec-68e633a9fdc0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.709782 Sep 18 01:07:31.911968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:31.914985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 831/1697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:31 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:07:31.926886 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b80f58c2-c7fd-4274-8e9a-92891181038f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1380 microversion: 2.1 time: 0.699944 Sep 18 01:07:31.927500 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 867/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:31 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1380 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:31.937701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:31.941622 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:31.952527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:31.953166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:31.960773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.961787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.962402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.963082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:31.963988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.964617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.965242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:31.965887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.966401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:31.967162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:31.967644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:31.968071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:32.048392 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-322ce27a-8eb9-4a3a-a6e2-5effadf253fb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130080 Sep 18 01:07:32.049454 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 832/1699] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:31 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:32.060246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:32.061150 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:32.070738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:32.071562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:32.072196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:32.072930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:32.073395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:32.073844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:32.260871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:32.281208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:32.287821 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:32.292612 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9300ad12-aee1-4dcb-a9b0-2689972989ba tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1364 microversion: 2.57 time: 0.233953 Sep 18 01:07:32.298512 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 833/1700] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:32 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:32.303826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f27fea8-743e-419f-90d0-1526a4f1903a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70065bac10>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:32.429890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:32.435871 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f27fea8-743e-419f-90d0-1526a4f1903a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.135883 Sep 18 01:07:32.445800 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 834/1701] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:32 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:32.468484 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2697f02-4137-44f7-8faf-a85ef1428c76 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.521000 Sep 18 01:07:32.470361 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 868/1702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:31 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:32.498086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:32.498983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:32.506803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:32.507292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:32.507726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:32.508443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:32.508894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:32.509325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:32.778691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:32.780266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:32.788610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:32.789132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:32.789851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:32.790785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:32.791787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:32.792757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.010123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:33.023463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-387ee4ad-247f-4630-a3db-a0a776ce9e62 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1540 microversion: 2.1 time: 0.530087 Sep 18 01:07:33.025787 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 869/1703] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:32 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1540 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:33.033733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a195a7d5-8592-4b98-bc06-7804bd4aadf9 req-4490d5a4-9fb8-4492-8c21-e02691879632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62040783-8dea-4d6d-bfe9-83be6ee37e7e", "tag": "5650a7ad-daaa-4369-9785-3105031432c4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:33.050662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a195a7d5-8592-4b98-bc06-7804bd4aadf9 req-4490d5a4-9fb8-4492-8c21-e02691879632 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.051911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a195a7d5-8592-4b98-bc06-7804bd4aadf9 req-4490d5a4-9fb8-4492-8c21-e02691879632 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.052547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a195a7d5-8592-4b98-bc06-7804bd4aadf9 req-4490d5a4-9fb8-4492-8c21-e02691879632 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.072896 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a195a7d5-8592-4b98-bc06-7804bd4aadf9 req-4490d5a4-9fb8-4492-8c21-e02691879632 service nova] Creating event network-changed:5650a7ad-daaa-4369-9785-3105031432c4 for instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e on n-h1-master-1 Sep 18 01:07:33.084761 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a195a7d5-8592-4b98-bc06-7804bd4aadf9 req-4490d5a4-9fb8-4492-8c21-e02691879632 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056647 Sep 18 01:07:33.085794 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 870/1704] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:33.092392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:33.093915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:33.101415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.102202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.102803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.104948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.105645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.106262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.277603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-becd7f15-ec4e-4c7e-bde4-4eb21bad2b6b tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1531 microversion: 2.1 time: 0.837515 Sep 18 01:07:33.281701 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 835/1705] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:32 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1531 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:33.313605 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:33.323496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:33.340516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.341575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.342358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.345445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.347070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.347878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.464106 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2f11cd1-c90b-46fe-a5b4-d1cdd03582e0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.177143 Sep 18 01:07:33.465374 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 836/1706] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:33 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:33.476826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:33.477536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:33.505149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.505149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.505149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.505149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.505149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.505149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.752804 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:33.773089 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a0f09d0-9990-4327-9335-1397e282a197 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.685320 Sep 18 01:07:33.788280 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 871/1707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:33 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:33.788280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:33.788280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:33.799467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.799975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.800493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.801383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:33.801890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:33.802323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:33.922263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:33.930762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:33.932225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:33.933404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78966b89-cf97-45a9-bbd0-36c53962f185 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1370 microversion: 2.57 time: 0.157517 Sep 18 01:07:33.934271 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 872/1708] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:33 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:33.950373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f22ebfd-8622-4a3f-8bbc-c42861782f35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005ea7d30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:34.008072 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2c493ccd-3ca6-4a97-aea5-5a143deed930 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1531 microversion: 2.1 time: 0.541464 Sep 18 01:07:34.010240 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 837/1709] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:33 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1531 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:34.027487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:34.029191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:34.056356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.057178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.057911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.058075 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f22ebfd-8622-4a3f-8bbc-c42861782f35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.111112 Sep 18 01:07:34.061918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.062701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.064226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.073101 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 873/1710] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:33 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:34.080952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:34.087818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.088987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.089972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.091498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.092550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.093525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.129337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2e6ab2a-2135-41e1-a191-d57935f8eced tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054699 Sep 18 01:07:34.130289 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 874/1711] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:07:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:34.143549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:34.145449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:34.152131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.153531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.154194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.155095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.155747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.156405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.256974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:34.265704 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ec226fa-1449-43dc-a745-b925924c68ae tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1498 microversion: 2.1 time: 0.126494 Sep 18 01:07:34.267425 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 875/1712] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:34 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1498 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:34.272750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:34.276422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:34.289691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.290486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.291086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.291994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.292642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.293259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.325820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lazy-loading 'flavor' on Instance uuid 254d59b9-ce47-47a8-9350-54779b2f2d75 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:07:34.340991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Going to try to live migrate instance to n-h1-master-1 {{(pid=122374) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:07:34.341917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:34.350068 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98cb7a22-19e3-45fb-9a9b-ce13dda60933 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.338389 Sep 18 01:07:34.361355 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 838/1713] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:34 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:34.424116 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:34.477678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:34.484837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:34.501062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.505811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.506709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.507453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.507919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.508359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.596297 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf81b7d3-f298-442d-94d9-0ccbf965887a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123055 Sep 18 01:07:34.601778 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 839/1714] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:34 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:34.817634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:34.817634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:34.840752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.841756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.841756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:34.842483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:34.849344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:34.852049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:35.447705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:35.462394 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8baa010b-c80b-4f28-a347-c11eb86a386e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.658534 Sep 18 01:07:35.468011 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 840/1715] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:34 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:07:35.508095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:35.509347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:35.535109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:35.536601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:35.542790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:35.543834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:35.544573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:35.545748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:35.775028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:35.791232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:35.795384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:35.800626 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f5f9f242-cef5-4c08-81d7-1b7b89aa2832 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1370 microversion: 2.57 time: 0.331040 Sep 18 01:07:35.824584 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 841/1716] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:35 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1370 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:35.833057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e27872af-0a42-4abb-95d1-cdb0141961c3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005f220d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:35.923750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e27872af-0a42-4abb-95d1-cdb0141961c3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.095564 Sep 18 01:07:35.930162 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 842/1717] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:35 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:35.956473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-13e23de0-dc49-48a9-9478-70c5f2b791d7 req-90c27a3b-be2a-4512-83f7-ebb34872de91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b111d2-6cb9-40c2-b63e-319247c07f3e", "name": "network-vif-deleted", "tag": "bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:35.974154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-13e23de0-dc49-48a9-9478-70c5f2b791d7 req-90c27a3b-be2a-4512-83f7-ebb34872de91 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:35.975347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-13e23de0-dc49-48a9-9478-70c5f2b791d7 req-90c27a3b-be2a-4512-83f7-ebb34872de91 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:35.975995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-13e23de0-dc49-48a9-9478-70c5f2b791d7 req-90c27a3b-be2a-4512-83f7-ebb34872de91 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:35.992704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-13e23de0-dc49-48a9-9478-70c5f2b791d7 req-90c27a3b-be2a-4512-83f7-ebb34872de91 service nova] Creating event network-vif-deleted:bcad7e6b-de2e-4644-8215-b0fe2bb6bbc7 for instance e2b111d2-6cb9-40c2-b63e-319247c07f3e on n-h2-master-1 Sep 18 01:07:35.998140 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-13e23de0-dc49-48a9-9478-70c5f2b791d7 req-90c27a3b-be2a-4512-83f7-ebb34872de91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056914 Sep 18 01:07:35.998848 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 843/1718] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:36.005403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:36.006457 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:36.013644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.014247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.014814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.015652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.016252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.016929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.060362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.060994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.061608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.062190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lazy-loading 'fault' on Instance uuid e2b111d2-6cb9-40c2-b63e-319247c07f3e {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:07:36.186714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:36.195231 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52de1b7f-132b-43b0-bb3b-0ce56c22e572 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1321 microversion: 2.1 time: 0.195076 Sep 18 01:07:36.205985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 844/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:35 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:36.216427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:36.217459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:36.225057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.225997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.226702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.227731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.228464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.229128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.531041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:36.547178 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:36.553216 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-66b2d5ff-b237-4155-ae4e-f8d706e4784e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.345491 Sep 18 01:07:36.554750 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 845/1720] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:36 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:36.565673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:36.569106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:36.578237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.580340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.581006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.582271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.583072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.583865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.629641 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e446ed4d-c62e-44e1-8673-e5d6eafa7f42 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071129 Sep 18 01:07:36.635395 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 846/1721] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:36 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:36.642852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:36.644852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:36.657625 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:36.660610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.661694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.662610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.664812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.665842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:36.666749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:36.964021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:36.978393 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-969ee7c6-304e-41ae-b90a-61e4f60a00f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.346353 Sep 18 01:07:36.981171 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 847/1722] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:36 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:36.986320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:36.987339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:36.995678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:36.999256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.002409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.003364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.004139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.004673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.096232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:37.108387 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:37.110254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:37.111727 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8cc5e717-e39b-4950-880e-2a086e672501 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1370 microversion: 2.57 time: 0.129237 Sep 18 01:07:37.126741 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 848/1723] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:36 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:37.147930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db1d5e9c-3ff1-453a-99f6-d31404b8eab3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005eada60>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:37.232325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-db1d5e9c-3ff1-453a-99f6-d31404b8eab3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.103941 Sep 18 01:07:37.263248 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 849/1724] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:37 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:37.269822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:37.272453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:37.291658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.292634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.293308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.297258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.298792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.300095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.303047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a39ecac-9b55-4202-bcf2-e6ae613d3330 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75/action" status: 202 len: 0 microversion: 2.1 time: 3.033759 Sep 18 01:07:37.309403 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 876/1725] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:34 2022] POST /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75/action => generated 0 bytes in 3041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:37.336592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:37.350774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.351178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.351740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:37.351866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.352293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lazy-loading 'fault' on Instance uuid e2b111d2-6cb9-40c2-b63e-319247c07f3e {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:07:37.393881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.396063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.396847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.402198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.405403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.409208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.414756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa4005cb3944bd6b85bbc64021fa705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b48892f4faf4b9193663a17a6d6c4a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:37.424750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe64ecb9-4b41-4ab1-a414-86de66129ef1 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 200 len: 1321 microversion: 2.1 time: 0.158903 Sep 18 01:07:37.425734 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 850/1726] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:37 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:37.585020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:37.586740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:37.600767 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:37.608472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.611799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.612773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.616037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.618265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.619998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.811056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:37.823412 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed70a87b-bc0a-4ea3-ad28-5e1f3b49051c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.511425 Sep 18 01:07:37.823996 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 877/1727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:37 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:37.829850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:37.832074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:37.874866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.884859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.885350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.886145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:37.886617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:37.887037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:37.966004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:37.972659 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c799c615-360b-4266-a26c-28d0e60c9c26 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147239 Sep 18 01:07:37.973687 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 878/1728] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:37 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:37.983423 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcdc2758-e6b3-4857-b2a0-d6dcd9f7927e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.404375 Sep 18 01:07:37.984743 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 851/1729] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:37 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:07:38.040421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:38.041460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:38.054779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.074917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.075651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.077418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.078241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.079369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.148979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:38.150041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:38.163796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.164986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.165751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.167053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.167870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.168473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.397159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:38.413165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:38.414853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:38.416069 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-907fdc77-5124-40a7-bc27-a671800abaa9 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1355 microversion: 2.57 time: 0.275271 Sep 18 01:07:38.416857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 852/1730] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:38 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1355 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:38.431902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b84a9da1-fe12-4944-90c0-4f6082f713e4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7006b33af0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:38.495814 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b84a9da1-fe12-4944-90c0-4f6082f713e4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.077749 Sep 18 01:07:38.496567 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 853/1731] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:38 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:38.511797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:38.512806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:38.517807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:38.521450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.522114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.522648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.523535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.524091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.524614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.531911 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed0122aa-6252-4dd0-b26d-dcca03f8e4aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.501477 Sep 18 01:07:38.549392 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 879/1732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:38 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:38.554759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:38.559911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] [instance: e2b111d2-6cb9-40c2-b63e-319247c07f3e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:38.582850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.588067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.589117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.590169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.590627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.591319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.599663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:07:38.623661 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] HTTP exception thrown: Instance e2b111d2-6cb9-40c2-b63e-319247c07f3e could not be found. Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Request method failure captured: Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e HTTP/1.1 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8aAMmvnKqJFfReo_YkqiPUqYKj0fcwO8FF5pbjpNF-jPuhGluvNl9aLwqvI57AfHS1T0AnVmPEZoxeVIkowh8qHzydFbXzwgKfshZQuwELKGF9GB3A2LCot7Cg3mx5DRWvW9k5Z6ZVzTMY39SUVQvx0zKMpnrWB2EVEJmMKmp-_Z0 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b48892f4faf4b9193663a17a6d6c4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 6b48892f4faf4b9193663a17a6d6c4a9 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0fa4005cb3944bd6b85bbc64021fa705 Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e2b111d2-6cb9-40c2-b63e-319247c07f3e could not be found. Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e2b111d2-6cb9-40c2-b63e-319247c07f3e'} Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b111d2-6cb9-40c2-b63e-319247c07f3e could not be found. Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b111d2-6cb9-40c2-b63e-319247c07f3e could not be found. Sep 18 01:07:38.625296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b111d2-6cb9-40c2-b63e-319247c07f3e could not be found. Sep 18 01:07:38.631975 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:38.634146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] Returning 404 to user: Instance e2b111d2-6cb9-40c2-b63e-319247c07f3e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:38.635413 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-49e368d0-f246-46bc-9f03-e1ff204815e9 tempest-FloatingIPsAssociationNegativeTestJSON-817621275 tempest-FloatingIPsAssociationNegativeTestJSON-817621275-project] 10.222.0.25 "GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e" status: 404 len: 111 microversion: 2.1 time: 0.084625 Sep 18 01:07:38.639823 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 880/1733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:38 2022] GET /compute/v2.1/servers/e2b111d2-6cb9-40c2-b63e-319247c07f3e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:07:38.773038 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-851fe11d-b7ea-47c3-bfc3-c88d97f33dbd tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 204 len: 0 microversion: 2.57 time: 0.273147 Sep 18 01:07:38.774554 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 854/1734] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:07:38 2022] DELETE /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:07:38.798553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:38.802600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:38.823453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.828758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.835384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:38.835774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.837389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.838494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.843427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.844308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:38.845724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Searching by: {'deleted': False, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:07:38.864433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.864433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.882294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.884611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:38.885217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:38.889807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:38.952918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:07:38.988238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:39.008803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:39.018741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:39.020357 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee5ae3fb-7e3d-4c6a-b6c3-d000cc5361b2 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1361 microversion: 2.57 time: 0.236625 Sep 18 01:07:39.041345 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 881/1735] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:38 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:39.045266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:39.050436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:39.076769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.079826 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-16a8a853-789f-48e4-b06f-3b08fdec9227 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.248451 Sep 18 01:07:39.080424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.080918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:39.081702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.082181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.082608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:39.096168 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 855/1736] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:07:38 2022] GET /compute/v2.1/servers => generated 339 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:07:39.120006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:39.126408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:39.151468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.151850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.152302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:39.153054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.153811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.163260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:39.243244 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f56ccc8-18b1-4e19-8b07-8cd4abff7ba1 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145733 Sep 18 01:07:39.249418 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 856/1737] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:39 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:39.287603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:39.289253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:39.297887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.298672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.299324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:39.300226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.301086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.303259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:39.921068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:39.929246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:39.946640 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-176d5729-afec-4f7c-8f03-9f2273e7f806 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.918574 Sep 18 01:07:39.952788 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-db9a88d5-bf94-4f92-b421-d1eec0066ded tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.701442 Sep 18 01:07:39.954296 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 857/1738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:39 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:39.965580 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 882/1739] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:39 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:39.965811 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:39.966188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:39.966897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Searching by: {'deleted': False, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:07:39.977326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e1861611-4b25-46d6-ae68-3e0d989fe8ff tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005ee2f70>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:39.977596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.977596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.977596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:39.977596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:39.977596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:39.977596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.020418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:07:40.097747 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e1861611-4b25-46d6-ae68-3e0d989fe8ff tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.138349 Sep 18 01:07:40.106018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:40.120101 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 883/1740] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:39 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:40.127025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.127514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.127943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.131778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:40.134718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:40.162949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.170266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.170991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.172374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.173057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.173598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.417980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ec5b5b8-4310-4a15-a79e-b9ccd30406ba tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1708 microversion: 2.1 time: 0.461823 Sep 18 01:07:40.420026 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 858/1741] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:07:39 2022] GET /compute/v2.1/servers/detail => generated 1708 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:40.435321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:40.440589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:40.463212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.470916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.472247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.473508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.474230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.474979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.572466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:40.596685 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9abae09-a600-4555-b842-ec9c4ba6bddf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.474123 Sep 18 01:07:40.598058 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 884/1742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:40 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:40.603362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:40.617526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:40.624516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.625647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.628543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.629820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.630568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.634460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.683981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:40.713040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:40.719794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:40.723908 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f99a439-8a1f-4dd8-9542-1bb0e263d1c6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1361 microversion: 2.57 time: 0.299884 Sep 18 01:07:40.741592 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 859/1743] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:40 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:40.741592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5617ccfc-fe9f-4f72-9398-1131e3ba9c23 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:40.755400 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-94051f83-52f2-4342-9da1-3a95ce4dded4 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.155761 Sep 18 01:07:40.759222 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 885/1744] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:40 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:07:40.763333 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5617ccfc-fe9f-4f72-9398-1131e3ba9c23 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028953 Sep 18 01:07:40.767117 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 860/1745] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:07:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:40.779243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-93fbd97e-68ad-4bc9-af2b-614e7738556f req-7d3bea63-5e3b-44ac-9a24-ba928b1088cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62040783-8dea-4d6d-bfe9-83be6ee37e7e", "name": "network-vif-plugged", "status": "completed", "tag": "5650a7ad-daaa-4369-9785-3105031432c4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:40.805097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-93fbd97e-68ad-4bc9-af2b-614e7738556f req-7d3bea63-5e3b-44ac-9a24-ba928b1088cf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:40.814459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-93fbd97e-68ad-4bc9-af2b-614e7738556f req-7d3bea63-5e3b-44ac-9a24-ba928b1088cf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:40.815518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-93fbd97e-68ad-4bc9-af2b-614e7738556f req-7d3bea63-5e3b-44ac-9a24-ba928b1088cf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:40.856514 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-93fbd97e-68ad-4bc9-af2b-614e7738556f req-7d3bea63-5e3b-44ac-9a24-ba928b1088cf service nova] Creating event network-vif-plugged:5650a7ad-daaa-4369-9785-3105031432c4 for instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e on n-h1-master-1 Sep 18 01:07:40.876745 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-93fbd97e-68ad-4bc9-af2b-614e7738556f req-7d3bea63-5e3b-44ac-9a24-ba928b1088cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106931 Sep 18 01:07:40.877682 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 886/1746] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:40.994784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:41.001240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:41.002051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:41.015038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:41.024465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.024971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.025417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.029057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.029588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.030044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.085653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.096172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.098263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.100433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.105246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.115094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.591079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:41.609076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:41.621075 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa47cd70-28e9-4d64-a1c9-6c4472bb141c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.624524 Sep 18 01:07:41.624172 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 887/1747] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:40 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:41.626910 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a8b9dec3-af02-404a-b2f7-fd1fcfc0210e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.645864 Sep 18 01:07:41.634114 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-acf22fa9-ddc7-46cb-8952-7df2e6321539 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005ee2430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:41.635038 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 861/1748] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:40 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:41.639989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:41.640494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:41.654199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.654880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.655343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.656147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.657281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.657807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.713866 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-acf22fa9-ddc7-46cb-8952-7df2e6321539 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.084360 Sep 18 01:07:41.725363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 888/1749] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:41 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:41.727478 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:41.731258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:41.732029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:41.732884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:07:41.739578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.740398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.741014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.741990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.742631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.743239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.914573 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e7197337-c6bc-4c38-8c55-f328a87734a5 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 204 len: 0 microversion: 2.1 time: 0.277050 Sep 18 01:07:41.919892 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 862/1750] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:07:41 2022] DELETE /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:07:41.935046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:41.949485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:41.963992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.967593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.968490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.968692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:41.971630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:41.972444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:41.972797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:41.983819 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-69b9ac77-ef6d-4e16-8fec-012c38266cfd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.256992 Sep 18 01:07:41.985921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 889/1751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:41 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:42.075214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.075813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.076132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.076590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lazy-loading 'fault' on Instance uuid cfb698de-1942-4139-8a65-a415c3259b4b {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:07:42.179549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:42.196712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:42.198221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206cf85ae8a844aebbdd08ba8e5c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e7bb6cb7ff4520950600ef2e371488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:42.199431 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ec5b335-0d75-40a8-b33c-7060022c9cae tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 200 len: 1366 microversion: 2.57 time: 0.277899 Sep 18 01:07:42.209906 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 863/1752] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:41 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:07:42.215819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:42.224138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:42.229358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:42.234095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:42.245096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.245096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.245096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.245096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.246056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.246497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.259251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.259923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.261153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.264051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.267267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.267843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.289844 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a78a55d1-4bd3-4c21-96ea-39cca7ba3a90 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.302582 Sep 18 01:07:42.292338 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 890/1753] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:07:41 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6/os-volume_attachments => generated 25 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:42.640889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:42.651104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:42.655517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:42.673428 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed1165a1-af38-49a6-8d47-f3f28a741a55 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1711 microversion: 2.1 time: 0.458935 Sep 18 01:07:42.683289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.683998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.684330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.685109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.685528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.686030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.687220 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 864/1754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:42 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1711 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:42.699592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:42.700258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:42.716798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.717760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.723127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:42.724134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:42.724777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:42.725523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:43.176423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:43.196850 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ea6bea1d-307a-4ba8-8654-ae83ecbdad29 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.550995 Sep 18 01:07:43.216847 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 891/1755] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:42 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:07:43.231404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8f49e1c-abef-493a-892b-bdcea96af473 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005ea7ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:43.382945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:43.385449 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f8f49e1c-abef-493a-892b-bdcea96af473 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1414 microversion: 2.1 time: 0.167041 Sep 18 01:07:43.386785 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 892/1756] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:43 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:43.395239 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89158d4f-3b93-454b-a713-a10e9c4c3444 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.706728 Sep 18 01:07:43.399710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:43.400574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:43.400735 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 865/1757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:42 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:43.409521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:43.410526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] [instance: cfb698de-1942-4139-8a65-a415c3259b4b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:43.418912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:43.422737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:43.426443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:43.429076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:43.431659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:43.432892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:43.433749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:43.434234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:43.434746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:43.437408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:43.439088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:43.439971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:43.487515 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] HTTP exception thrown: Instance cfb698de-1942-4139-8a65-a415c3259b4b could not be found. Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Request method failure captured: Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b HTTP/1.1 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm8mafjdg9h7q9YvrGnleu9URwFIrMAOPxvBjSr1QpQRpXPbMdiVUa8kd2uttw_V8ULDkP6_f-LoNG3XD9RuKKixb4CTUhlrL05Dse9S5Vq-JTucXeAnop3KqqMU_cDLf6SVL4buiHQMe25DMY0kee2QxOIE-p7nKuvjqzvYRBe4egg Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.57 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 00e7bb6cb7ff4520950600ef2e371488 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerShowV257Test-1897824796 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00e7bb6cb7ff4520950600ef2e371488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00e7bb6cb7ff4520950600ef2e371488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00e7bb6cb7ff4520950600ef2e371488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00e7bb6cb7ff4520950600ef2e371488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerShowV257Test-1897824796 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 00e7bb6cb7ff4520950600ef2e371488 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerShowV257Test-1897824796 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerShowV257Test-1897824796-project Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 206cf85ae8a844aebbdd08ba8e5c0207 Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerShowV257Test-1897824796-project Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: exception: Instance cfb698de-1942-4139-8a65-a415c3259b4b could not be found. Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'cfb698de-1942-4139-8a65-a415c3259b4b'} Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb698de-1942-4139-8a65-a415c3259b4b could not be found. Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb698de-1942-4139-8a65-a415c3259b4b could not be found. Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:43.495803 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb698de-1942-4139-8a65-a415c3259b4b could not be found. Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] Returning 404 to user: Instance cfb698de-1942-4139-8a65-a415c3259b4b could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:43.504289 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3031773c-0bd7-4bcd-9b5c-6f9118504eb6 tempest-ServerShowV257Test-1897824796 tempest-ServerShowV257Test-1897824796-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b" status: 404 len: 111 microversion: 2.57 time: 0.095861 Sep 18 01:07:43.506821 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 866/1758] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:07:43 2022] GET /compute/v2.1/servers/cfb698de-1942-4139-8a65-a415c3259b4b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:07:43.713691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:43.714451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:43.720656 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:43.740875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:43.753686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:43.754282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:43.755103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:43.755588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:43.763753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:43.963557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:43.979973 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74ba8ef6-0995-4d64-b667-8f9426f10b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1315 microversion: 2.1 time: 0.591711 Sep 18 01:07:43.980606 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 893/1759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:43 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:44.231076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:44.232034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:44.263084 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:44.274460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:44.274981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:44.275850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:44.277721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:44.282460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:44.290298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:44.394924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:44.413387 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ba0f63b-9126-46e8-9767-2d58f06b6b9b tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1711 microversion: 2.1 time: 0.700115 Sep 18 01:07:44.416988 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 867/1760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:43 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1711 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:44.428989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91f22ae8-73e9-464a-a7d4-ee4c4e2e3350 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005e29ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:44.643945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:44.660157 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eae91e6d-0fcb-4457-b9e1-c9cc002ee9f9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.435431 Sep 18 01:07:44.661397 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 894/1761] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:44 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:07:44.677435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:44.680041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:44.698914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:44.700478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:44.701210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:44.705023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:44.706260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:44.707259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:45.890133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:45.901974 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abe557f5-49c6-4821-92cd-5faf1eaba45a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 1.237768 Sep 18 01:07:45.904025 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 895/1762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:44 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:45.915042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:45.916757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:45.931906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:45.933970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:45.941536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:45.942900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:45.945390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:45.947682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:46.352224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:46.365891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dccc29c0-77b3-4e10-8039-de247afc597a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1503 microversion: 2.1 time: 0.456759 Sep 18 01:07:46.369991 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 896/1763] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:45 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1503 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:46.389016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:46.392655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:46.418280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:46.421026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:46.423986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:46.426008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:46.427723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:46.428427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:46.496570 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:47.062689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:47.098783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42996194-0bd8-483e-b0c5-1bbf7061e367 tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1711 microversion: 2.1 time: 0.712777 Sep 18 01:07:47.099484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 897/1764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:46 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1711 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:47.104564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:47.116815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:47.140521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:47.143592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:47.144315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:47.149890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:47.150805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:47.151497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:48.162203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:48.189967 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9e7f1dd4-8c8d-495d-b26f-8f41c65f72c9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 1.077584 Sep 18 01:07:48.221787 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 898/1765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:47 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:48.285190 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:48.285931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:48.387949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:48.388456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:48.388900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:48.389700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:48.390345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:48.397805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:48.711609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d422e7b8-883d-4669-8061-dec39f4c4c29 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e/action" status: 202 len: 0 microversion: 2.1 time: 0.499197 Sep 18 01:07:48.717530 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 899/1766] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:07:48 2022] POST /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:48.730189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:48.732680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:48.756519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:48.763823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:48.764946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:48.767727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:48.769514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:48.771332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:49.316627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:49.325849 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a839650c-eb8c-4344-a493-009e3d6d7b31 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1543 microversion: 2.1 time: 0.605375 Sep 18 01:07:49.327983 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 900/1767] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:48 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1543 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:49.333791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:49.334735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:49.342299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:49.343521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:49.344786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:49.345837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:49.346542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:49.347194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:49.570613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804bfb9582ff401189047339238b7b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b3a5a9208e40b49db56f6692a7c22f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:49.597645 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-381c9e30-d7e0-47e4-97a6-53cf5daf496c tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 200 len: 1644 microversion: 2.1 time: 0.267586 Sep 18 01:07:49.617631 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 901/1768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:49 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 1644 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:49.628927 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:49.630150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:49.638393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:49.639360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:49.640026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:49.642338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:49.643053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:49.643730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:49.990601 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:50.104423 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:50.394192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:50.420992 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0251f6ba-2e9b-4a63-9cd4-7791bb0a8b4c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1508 microversion: 2.1 time: 0.792945 Sep 18 01:07:50.423257 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 902/1769] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:49 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1508 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:50.437863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ad484f4d-eb2a-4f69-bfa2-5512ecbea665 req-e2873787-ceda-4b46-85e7-ecfce67f3867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e521a43a-d173-4504-ab89-b570bee4ef51", "name": "network-vif-deleted", "tag": "d21a6986-3af5-4e71-a913-31d36ca03e81"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:50.501725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ad484f4d-eb2a-4f69-bfa2-5512ecbea665 req-e2873787-ceda-4b46-85e7-ecfce67f3867 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:50.501725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ad484f4d-eb2a-4f69-bfa2-5512ecbea665 req-e2873787-ceda-4b46-85e7-ecfce67f3867 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:50.501725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ad484f4d-eb2a-4f69-bfa2-5512ecbea665 req-e2873787-ceda-4b46-85e7-ecfce67f3867 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:50.557640 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ad484f4d-eb2a-4f69-bfa2-5512ecbea665 req-e2873787-ceda-4b46-85e7-ecfce67f3867 service nova] Creating event network-vif-deleted:d21a6986-3af5-4e71-a913-31d36ca03e81 for instance e521a43a-d173-4504-ab89-b570bee4ef51 on n-h1-master-1 Sep 18 01:07:50.592320 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ad484f4d-eb2a-4f69-bfa2-5512ecbea665 req-e2873787-ceda-4b46-85e7-ecfce67f3867 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156370 Sep 18 01:07:50.593119 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 903/1770] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:50.652436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:50.659244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:50.705917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:50.718426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:50.729281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:50.733572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:50.741169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:50.747793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:51.472422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:51.485197 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-159865b3-821c-48fe-9b38-6b373a363dc2 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.875324 Sep 18 01:07:51.508839 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 904/1771] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:50 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:51.533421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:51.544261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:51.572653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:51.576622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:51.577292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:51.578273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:51.580981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:51.583161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:52.383166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:52.398927 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-859f355c-13c1-426c-bea2-ce8eed69191e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1542 microversion: 2.1 time: 0.885127 Sep 18 01:07:52.399542 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 905/1772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:51 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1542 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:52.443617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:52.444512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] [instance: e521a43a-d173-4504-ab89-b570bee4ef51] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:52.460688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:52.461234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:52.463888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:52.464717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:52.465193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:52.469748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:52.512597 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] HTTP exception thrown: Instance e521a43a-d173-4504-ab89-b570bee4ef51 could not be found. Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Request method failure captured: Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 HTTP/1.1 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8Kht5kN6-rlc1SiI8_xaoA_En8kQERUUytQGVukQ9gbTFPnWj44kpeQujk1o0SbtzRDTNF6QwK_GIAlLBWbv3o5CqfVggSNfv-d1URZj0sEuGEVVgr6S8B0zqiAZLYYatWATsA9vV7WhZ3lLagMYWWJfDqkMkFGRvzkTzaXkOZYIA Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: a7b3a5a9208e40b49db56f6692a7c22f Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestManualDisk-1644916354 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7b3a5a9208e40b49db56f6692a7c22f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7b3a5a9208e40b49db56f6692a7c22f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7b3a5a9208e40b49db56f6692a7c22f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7b3a5a9208e40b49db56f6692a7c22f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestManualDisk-1644916354 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: a7b3a5a9208e40b49db56f6692a7c22f Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestManualDisk-1644916354 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestManualDisk-1644916354-project Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 804bfb9582ff401189047339238b7b71 Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestManualDisk-1644916354-project Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e521a43a-d173-4504-ab89-b570bee4ef51 could not be found. Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e521a43a-d173-4504-ab89-b570bee4ef51'} Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e521a43a-d173-4504-ab89-b570bee4ef51 could not be found. Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e521a43a-d173-4504-ab89-b570bee4ef51 could not be found. Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:07:52.518514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:52.527569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:07:52.527569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:07:52.527569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:07:52.527569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:07:52.527569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:07:52.527569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e521a43a-d173-4504-ab89-b570bee4ef51 could not be found. Sep 18 01:07:52.527569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:07:52.530797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Returning 404 to user: Instance e521a43a-d173-4504-ab89-b570bee4ef51 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:07:52.533109 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08d7154a-ec9a-459c-836f-445f11ff4c0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51" status: 404 len: 111 microversion: 2.1 time: 0.130623 Sep 18 01:07:52.534208 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 906/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:52 2022] GET /compute/v2.1/servers/e521a43a-d173-4504-ab89-b570bee4ef51 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:07:52.541278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:52.543766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:52.556108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:52.557059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:52.557961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:52.559276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:52.560446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:52.561119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:53.048699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:53.064251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b061de0-d6a4-4d62-9710-b7a93d17075d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1488 microversion: 2.1 time: 0.527024 Sep 18 01:07:53.080934 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 907/1774] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:52 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1488 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:53.096120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:53.110081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:53.131511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:53.132183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:53.132628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:53.134612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:53.135416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:53.136219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:53.487343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:53.508692 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96f5f94e-f537-49fb-b1bf-5c3bc7968b4c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.424764 Sep 18 01:07:53.512436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 908/1775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:53 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:53.525850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b91cc468-63d1-48ed-b26f-572fbe3fcf0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] Calling method '.version_select at 0x7f7005e8c280>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:53.591284 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b91cc468-63d1-48ed-b26f-572fbe3fcf0f tempest-ServersTestManualDisk-1644916354 tempest-ServersTestManualDisk-1644916354-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337735045" status: 202 len: 0 microversion: 2.1 time: 0.076735 Sep 18 01:07:53.598189 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 909/1776] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337735045 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:07:53.610183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-62d52403-2cbc-43a7-9a7f-8a6598f54bf9 req-52e2e01c-685c-4417-93a2-0fada0e79838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "name": "network-vif-unplugged", "status": "completed", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:53.688415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-62d52403-2cbc-43a7-9a7f-8a6598f54bf9 req-52e2e01c-685c-4417-93a2-0fada0e79838 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:53.689954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-62d52403-2cbc-43a7-9a7f-8a6598f54bf9 req-52e2e01c-685c-4417-93a2-0fada0e79838 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:53.692256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-62d52403-2cbc-43a7-9a7f-8a6598f54bf9 req-52e2e01c-685c-4417-93a2-0fada0e79838 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:53.749108 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-62d52403-2cbc-43a7-9a7f-8a6598f54bf9 req-52e2e01c-685c-4417-93a2-0fada0e79838 service nova] Creating event network-vif-unplugged:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h2-master-1 Sep 18 01:07:53.770710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-62d52403-2cbc-43a7-9a7f-8a6598f54bf9 req-52e2e01c-685c-4417-93a2-0fada0e79838 service nova] Instance f0609259-cd22-41ef-884b-479b79a2bf7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:07:53.803713 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-62d52403-2cbc-43a7-9a7f-8a6598f54bf9 req-52e2e01c-685c-4417-93a2-0fada0e79838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.202329 Sep 18 01:07:53.804602 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 910/1777] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:53.821008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:53.822779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:53.845949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:53.846548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:53.848296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:53.851053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:53.851547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:53.853360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:53.945492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:07:53.958074 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:54.149300 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96385be8-b7b8-45c7-b5f1-156c83a44a74 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 204 len: 0 microversion: 2.1 time: 0.338906 Sep 18 01:07:54.157714 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 911/1778] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:07:53 2022] DELETE /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:07:54.178487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:54.181238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:54.203888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:54.224132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:54.229060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:54.236619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:54.237406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:54.242557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:54.411097 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91f22ae8-73e9-464a-a7d4-ee4c4e2e3350 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1423 microversion: 2.1 time: 9.992624 Sep 18 01:07:54.412520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 868/1779] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:44 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1423 bytes in 9995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:54.417605 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:54.418442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:54.425509 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:54.443937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:54.445182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:54.445909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:54.448455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:54.449187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:54.449892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:54.689628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:54.704643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-12cd29a9-8d1b-45b1-8f7d-b05224d8d0fd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1542 microversion: 2.1 time: 0.543381 Sep 18 01:07:54.705434 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 912/1780] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:54 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1542 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:54.717230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-99ac6e4e-ece4-4152-8398-b271d8236e36 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005f54dc0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:54.841098 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-99ac6e4e-ece4-4152-8398-b271d8236e36 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 200 len: 1423 microversion: 2.1 time: 0.131501 Sep 18 01:07:54.844797 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 913/1781] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:07:54 2022] GET /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:54.872883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:54.872883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:54.894936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:54.895513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:54.896308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:54.899029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:54.899697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:54.902914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:54.914150 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:54.936754 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d633212-44c8-4f5b-94d4-a203b41b236e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1494 microversion: 2.1 time: 0.514689 Sep 18 01:07:54.939188 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 869/1782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:54 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1494 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:54.958287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9845e00b-c174-4441-903e-869aaf2a5f12 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005e839d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:55.177596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:55.192375 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6a935b3-a178-41bf-9e10-faa0e1b22451 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.343314 Sep 18 01:07:55.194086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 914/1783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:54 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:55.779450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:55.788328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:55.809169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:55.810304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:55.810304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:55.810859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:55.811319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:55.817895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:55.871473 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:56.372226 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9845e00b-c174-4441-903e-869aaf2a5f12 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 204 len: 0 microversion: 2.1 time: 1.427439 Sep 18 01:07:56.379108 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 870/1784] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:54 2022] DELETE /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 0 bytes in 1434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:07:56.387855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-166aaf89-222c-4b6d-bf49-d91e2eea0aa6 req-4e3ec59a-ff1d-41f5-9af5-d50540c11b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:56.445390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-166aaf89-222c-4b6d-bf49-d91e2eea0aa6 req-4e3ec59a-ff1d-41f5-9af5-d50540c11b5e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:56.455954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-166aaf89-222c-4b6d-bf49-d91e2eea0aa6 req-4e3ec59a-ff1d-41f5-9af5-d50540c11b5e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:56.455954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-166aaf89-222c-4b6d-bf49-d91e2eea0aa6 req-4e3ec59a-ff1d-41f5-9af5-d50540c11b5e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:56.508956 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-166aaf89-222c-4b6d-bf49-d91e2eea0aa6 req-4e3ec59a-ff1d-41f5-9af5-d50540c11b5e service nova] Creating event network-changed:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h2-master-1 Sep 18 01:07:56.521970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-166aaf89-222c-4b6d-bf49-d91e2eea0aa6 req-4e3ec59a-ff1d-41f5-9af5-d50540c11b5e service nova] Instance f0609259-cd22-41ef-884b-479b79a2bf7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:07:56.547082 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-166aaf89-222c-4b6d-bf49-d91e2eea0aa6 req-4e3ec59a-ff1d-41f5-9af5-d50540c11b5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169097 Sep 18 01:07:56.548964 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 871/1785] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:07:56.567501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:56.569697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:56.594346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:56.595279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:56.596072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:56.597406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:56.598283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:56.599073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:57.161702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:57.171452 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1477169d-1f69-46be-a435-ba45aa63271a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1474 microversion: 2.1 time: 1.429067 Sep 18 01:07:57.172619 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 915/1786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:55 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1474 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:57.201097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:57.201787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:57.203896 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:07:57.241040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:57.241618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:57.242071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:57.242801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:57.243262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:57.243693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:58.296506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:58.330139 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-728f9a8f-bd1d-412f-826f-7a5be428ef30 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1494 microversion: 2.1 time: 1.778010 Sep 18 01:07:58.331206 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 872/1787] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:56 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1494 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:58.342366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:58.344638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:58.371256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:58.380875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:58.382279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:58.383056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:58.383562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:58.383965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:58.435696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:58.463269 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a513cb64-f068-4345-91a9-95ccc386ee77 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 1.272329 Sep 18 01:07:58.464170 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 916/1788] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:57 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:58.469591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:07:58.471815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:58.473454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:58.506824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:58.507859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:58.518980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:58.520728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:58.522058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:58.523540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:58.765538 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2cc56036-b318-45b0-9916-65dc4864d936 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 204 len: 0 microversion: 2.1 time: 0.430329 Sep 18 01:07:58.769622 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 873/1789] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:07:58 2022] DELETE /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:07:59.018405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1634721504", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8549b193-9309-4447-b854-895b85b228c7"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:07:59.158594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] validate_networks() for [('8549b193-9309-4447-b854-895b85b228c7', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:07:59.824779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:07:59.851538 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53a8240f-eeb9-4af2-8f02-60ac1db0f4a4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1471 microversion: 2.1 time: 1.385758 Sep 18 01:07:59.870520 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 917/1790] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:58 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1471 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:07:59.907110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:07:59.911462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:07:59.947641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:59.950764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:59.951236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:07:59.952001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:07:59.952463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:07:59.952885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:02.641739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:02.659569 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bc2c0baf-9878-4622-8685-d9874f4d885b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 200 len: 1494 microversion: 2.1 time: 2.786853 Sep 18 01:08:02.665245 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 918/1791] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:07:59 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 1494 bytes in 2794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:02.686736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:02.694886 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:02.725152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:02.727657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:02.733379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:02.734484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:02.751926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:02.753893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:04.287887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:04.301836 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e3ffa56c-b0c0-4321-b6d0-ad3138f248c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 1.630963 Sep 18 01:08:04.302842 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 919/1792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:02 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:04.317714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:04.331206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:04.340146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:04.340863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:04.341659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:04.342633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:04.344176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:04.345001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:04.455406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:04.456375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:04.457209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:04.458575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:04.459431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:04.460277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:04.548257 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:04.579945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for user 666826ce8e51441ea7c271be4c5d8eb9 and project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:04.685726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:08:04.688674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:08:04.691635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:08:04.694495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:08:04.699830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:08:04.736865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:04.737684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:04.738899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:04.741373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:04.742660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:04.743665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:04.877959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:04.904209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for user a7b979a402b74d679ec79f0b39255155 and project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:04.953076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:08:04.984927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:08:05.034722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f740e1e6-bd4d-42f0-a4d5-de26151c89dd tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b/action" status: 202 len: 0 microversion: 2.1 time: 0.722703 Sep 18 01:08:05.039891 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 920/1793] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:08:04 2022] POST /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:08:05.045962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-96821a53-9809-4ea6-b226-40ff21e3810f req-b09654e9-bc17-4aad-a7d8-7fd98c1fd2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254d59b9-ce47-47a8-9350-54779b2f2d75", "name": "network-vif-unplugged", "status": "completed", "tag": "6462c0cf-490d-4eff-bc24-c442fae53aaa"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:05.063699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-96821a53-9809-4ea6-b226-40ff21e3810f req-b09654e9-bc17-4aad-a7d8-7fd98c1fd2ab service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:05.064194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-96821a53-9809-4ea6-b226-40ff21e3810f req-b09654e9-bc17-4aad-a7d8-7fd98c1fd2ab service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:05.064864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-96821a53-9809-4ea6-b226-40ff21e3810f req-b09654e9-bc17-4aad-a7d8-7fd98c1fd2ab service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:05.108741 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-96821a53-9809-4ea6-b226-40ff21e3810f req-b09654e9-bc17-4aad-a7d8-7fd98c1fd2ab service nova] Creating event network-vif-unplugged:6462c0cf-490d-4eff-bc24-c442fae53aaa for instance 254d59b9-ce47-47a8-9350-54779b2f2d75 on n-h2-master-1 Sep 18 01:08:05.135189 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-96821a53-9809-4ea6-b226-40ff21e3810f req-b09654e9-bc17-4aad-a7d8-7fd98c1fd2ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093329 Sep 18 01:08:05.138537 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 921/1794] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:05.149865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-888e79e9-efff-44be-9517-b3430f639e41 req-5b94746a-aa63-4cd5-9ee3-691ce9b025a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62040783-8dea-4d6d-bfe9-83be6ee37e7e", "name": "network-vif-deleted", "tag": "5650a7ad-daaa-4369-9785-3105031432c4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:05.165859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-888e79e9-efff-44be-9517-b3430f639e41 req-5b94746a-aa63-4cd5-9ee3-691ce9b025a2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:05.167276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-888e79e9-efff-44be-9517-b3430f639e41 req-5b94746a-aa63-4cd5-9ee3-691ce9b025a2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:05.168313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-888e79e9-efff-44be-9517-b3430f639e41 req-5b94746a-aa63-4cd5-9ee3-691ce9b025a2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:05.192421 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-888e79e9-efff-44be-9517-b3430f639e41 req-5b94746a-aa63-4cd5-9ee3-691ce9b025a2 service nova] Creating event network-vif-deleted:5650a7ad-daaa-4369-9785-3105031432c4 for instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e on n-h1-master-1 Sep 18 01:08:05.199421 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-888e79e9-efff-44be-9517-b3430f639e41 req-5b94746a-aa63-4cd5-9ee3-691ce9b025a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058674 Sep 18 01:08:05.200953 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 922/1795] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:05.210075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-43132b89-eacb-4c02-b5fa-60d52974e6a5 req-8d65d0c2-b942-44ad-830a-e9d2288a559e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "name": "network-vif-plugged", "status": "completed", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:05.230107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-43132b89-eacb-4c02-b5fa-60d52974e6a5 req-8d65d0c2-b942-44ad-830a-e9d2288a559e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:05.231161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-43132b89-eacb-4c02-b5fa-60d52974e6a5 req-8d65d0c2-b942-44ad-830a-e9d2288a559e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:05.231836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-43132b89-eacb-4c02-b5fa-60d52974e6a5 req-8d65d0c2-b942-44ad-830a-e9d2288a559e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:05.247568 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75204e98-51a0-49c3-9bf7-1e8e32addee2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.232808 Sep 18 01:08:05.248581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 874/1796] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 6238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:08:05.258429 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-43132b89-eacb-4c02-b5fa-60d52974e6a5 req-8d65d0c2-b942-44ad-830a-e9d2288a559e service nova] Creating event network-vif-plugged:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h2-master-1 Sep 18 01:08:05.264885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-43132b89-eacb-4c02-b5fa-60d52974e6a5 req-8d65d0c2-b942-44ad-830a-e9d2288a559e service nova] Instance f0609259-cd22-41ef-884b-479b79a2bf7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:08:05.279795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:05.281914 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-43132b89-eacb-4c02-b5fa-60d52974e6a5 req-8d65d0c2-b942-44ad-830a-e9d2288a559e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079122 Sep 18 01:08:05.283261 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 923/1797] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:05.292959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:05.293272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:05.294328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:05.308554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:05.309336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:05.310086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:05.311526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:05.312144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:05.313115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:05.337099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:05.337981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:05.338706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:05.339871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:05.340640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:05.341364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:05.445830 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e HTTP/1.1 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '62040783-8dea-4d6d-bfe9-83be6ee37e7e'} Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:05.450563 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:05.456294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:05.456294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:05.456294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:05.456294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:08:05.456294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:08:05.456294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:08:05.456294 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:05.457739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:08:05.462220 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-857c9cec-9dde-4d06-9acc-f27f51cc1fb3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 404 len: 111 microversion: 2.1 time: 0.212545 Sep 18 01:08:05.463574 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 875/1798] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:05 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:08:05.533282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-baddd90f-2d52-4b5e-9555-9a5e9964a56d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:05.538330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-baddd90f-2d52-4b5e-9555-9a5e9964a56d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:05.964976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-baddd90f-2d52-4b5e-9555-9a5e9964a56d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:05.987544 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-baddd90f-2d52-4b5e-9555-9a5e9964a56d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1208 microversion: 2.1 time: 0.470489 Sep 18 01:08:05.988560 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 876/1799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:05 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1208 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:05.994696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:05.995305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:06.016111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:06.018549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:06.021420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:06.023699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:06.027187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:06.029606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:06.239538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:06.268246 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28b54f9d-ec7e-40fc-9fb6-760549d2981d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1470 microversion: 2.1 time: 0.980174 Sep 18 01:08:06.269326 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 924/1800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:05 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1470 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:06.307248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-870387304", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b66b4645-3540-45b7-82ac-f51c6140e547"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:06.494911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] validate_networks() for [('b66b4645-3540-45b7-82ac-f51c6140e547', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:08:07.483228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:07.499444 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0be4745b-5e30-4aaf-b035-c3d6dde3bc35 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 1.508561 Sep 18 01:08:07.500447 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 877/1801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:05 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:07.538775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:07.541816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:07.556643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:07.557722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:07.561962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:07.572646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:07.575465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:07.576192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:07.837133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:07.870880 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d18d37f-517a-45bd-9f6f-31d2b7803802 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1260 microversion: 2.1 time: 0.357023 Sep 18 01:08:07.873823 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 878/1802] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:07 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1260 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:07.890553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b1f48fe8-f6ab-4843-a947-dadbe6d18e60 req-4f567142-9dbc-4be5-8835-2c8e937a74f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a800f78-79ec-46a5-9d3e-25001ec3ef48", "name": "network-vif-deleted", "tag": "e9994924-bf5f-4e5e-8eeb-121c201122ef"}, {"name": "network-changed", "server_uuid": "254d59b9-ce47-47a8-9350-54779b2f2d75", "tag": "6462c0cf-490d-4eff-bc24-c442fae53aaa"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:07.942447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b1f48fe8-f6ab-4843-a947-dadbe6d18e60 req-4f567142-9dbc-4be5-8835-2c8e937a74f1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:07.943707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b1f48fe8-f6ab-4843-a947-dadbe6d18e60 req-4f567142-9dbc-4be5-8835-2c8e937a74f1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:07.952445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b1f48fe8-f6ab-4843-a947-dadbe6d18e60 req-4f567142-9dbc-4be5-8835-2c8e937a74f1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:08.045735 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b1f48fe8-f6ab-4843-a947-dadbe6d18e60 req-4f567142-9dbc-4be5-8835-2c8e937a74f1 service nova] Creating event network-vif-deleted:e9994924-bf5f-4e5e-8eeb-121c201122ef for instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 on n-h1-master-1 Sep 18 01:08:08.054134 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b1f48fe8-f6ab-4843-a947-dadbe6d18e60 req-4f567142-9dbc-4be5-8835-2c8e937a74f1 service nova] Creating event network-changed:6462c0cf-490d-4eff-bc24-c442fae53aaa for instance 254d59b9-ce47-47a8-9350-54779b2f2d75 on n-h2-master-1 Sep 18 01:08:08.092155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b1f48fe8-f6ab-4843-a947-dadbe6d18e60 req-4f567142-9dbc-4be5-8835-2c8e937a74f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.215255 Sep 18 01:08:08.119228 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 879/1803] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:08.129345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:08.130450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:08.139449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:08.140437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:08.141201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:08.142397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:08.143117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:08.143844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:08.840607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:08.862010 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6248f540-196c-4336-bbf8-f6faf97eb84c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1470 microversion: 2.1 time: 0.731345 Sep 18 01:08:08.863974 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 880/1804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:08 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1470 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:08.886019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:08.886933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:08.909249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:08.910271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:08.911116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:08.912819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:08.913882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:08.917804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:09.452642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:08:09.453672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:08:09.455201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:08:09.455924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:08:09.456845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:08:09.492041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:09.497438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:09.498784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:09.500851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:09.504629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:09.507681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:09.567067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:09.583037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for user 253b3027efb74403a9bfaa4d2cbfd31e and project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:09.618624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:08:09.627022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:08:09.635990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:09.654181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1bc826a-fa3c-47aa-84d6-287ed31d430f tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.788769 Sep 18 01:08:09.670333 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 881/1805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:08 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:09.707790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:09.712294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:09.753140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:09.753923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:09.754900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:09.755903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:09.756574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:09.758203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:09.848160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-13f8db41-bc30-48cc-80b4-8ab99fbecf62 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.562114 Sep 18 01:08:09.854200 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 925/1806] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:08:09.886741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adf16a7e-d5bb-4ed9-ab6e-63766dad4c60 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:09.900044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adf16a7e-d5bb-4ed9-ab6e-63766dad4c60 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:10.799854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adf16a7e-d5bb-4ed9-ab6e-63766dad4c60 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:10.815148 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adf16a7e-d5bb-4ed9-ab6e-63766dad4c60 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1214 microversion: 2.1 time: 0.951143 Sep 18 01:08:10.817836 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 926/1807] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:09 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1214 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:10.837162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:10.847053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:10.867800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:10.869446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:10.872711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:10.876095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:10.876850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:10.878204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:11.963428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:11.987728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eabec788-f646-4c28-8c73-29c9d509f860 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1470 microversion: 2.1 time: 1.168226 Sep 18 01:08:11.995950 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 927/1808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:10 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1470 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:12.010832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:12.012639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:12.040113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:12.041788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:12.043529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:12.045115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:12.047309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:12.048801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:12.613953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:12.625798 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0bfc45c-5c9d-4156-a316-91f29db5db0d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 2.943684 Sep 18 01:08:12.626418 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 882/1809] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:09 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 2956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:12.660826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:12.661453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:12.687719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:12.688493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:12.691469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:12.693815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:12.694415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:12.702531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:12.911150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:12.949294 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af0d4420-764e-4111-b2c7-3de107553a6e tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.949389 Sep 18 01:08:12.952123 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 928/1810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:11 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:13.020941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:13.022705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:13.036518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:13.037610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:13.038463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:13.039460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:13.042649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:13.042902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:14.097027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:14.113603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d43483e7-4a4b-44b6-bcfc-2fc318dca7e6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1266 microversion: 2.1 time: 1.470175 Sep 18 01:08:14.116081 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 883/1811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:12 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1266 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:14.134959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0b6a2fd6-2a24-4170-aa2b-6c7db28308d2 req-586ccd68-96d2-4ac7-b480-e3ee4d26c6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "name": "network-vif-unplugged", "status": "completed", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:14.166637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b6a2fd6-2a24-4170-aa2b-6c7db28308d2 req-586ccd68-96d2-4ac7-b480-e3ee4d26c6a0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:14.169852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b6a2fd6-2a24-4170-aa2b-6c7db28308d2 req-586ccd68-96d2-4ac7-b480-e3ee4d26c6a0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:14.172556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b6a2fd6-2a24-4170-aa2b-6c7db28308d2 req-586ccd68-96d2-4ac7-b480-e3ee4d26c6a0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:14.201035 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0b6a2fd6-2a24-4170-aa2b-6c7db28308d2 req-586ccd68-96d2-4ac7-b480-e3ee4d26c6a0 service nova] Creating event network-vif-unplugged:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h1-master-1 Sep 18 01:08:14.226302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-0b6a2fd6-2a24-4170-aa2b-6c7db28308d2 req-586ccd68-96d2-4ac7-b480-e3ee4d26c6a0 service nova] Instance f0609259-cd22-41ef-884b-479b79a2bf7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:08:14.251879 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0b6a2fd6-2a24-4170-aa2b-6c7db28308d2 req-586ccd68-96d2-4ac7-b480-e3ee4d26c6a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134103 Sep 18 01:08:14.252689 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 884/1812] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:14.266317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:14.270230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:14.287903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:14.297232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:14.298026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:14.299012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:14.299684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:14.300321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:14.820931 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:15.418265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:15.426826 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55d6356f-affe-4f0d-93b7-0176b11f3557 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1536 microversion: 2.1 time: 2.410069 Sep 18 01:08:15.432153 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 929/1813] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:13 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1536 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:08:15.437015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:15.444928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:15.454010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:15.461374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:15.461912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:15.462882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:15.467442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:15.468402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:15.745780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:15.758688 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6ec32409-b45c-4c17-888d-0e989707ba0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 1.503185 Sep 18 01:08:15.775528 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 885/1814] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:14 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:15.801764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:15.804190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:15.822041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:15.822652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:15.823107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:15.823856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:15.824313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:15.830136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:15.978087 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:16.465742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:16.476675 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c905a31a-18c7-4c41-b36f-81d3ce637630 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1272 microversion: 2.1 time: 0.699848 Sep 18 01:08:16.477304 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 886/1815] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:15 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1272 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:16.496711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:16.496711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:16.513949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:16.514452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:16.514890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:16.516135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:16.516592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:16.517015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:16.894488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:16.942270 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1ec9f5f3-3a3f-49a6-b85b-3b5fa977cbff tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 1.508892 Sep 18 01:08:16.945088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 930/1816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:15 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:16.964450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:16.967113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:17.001418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:17.003608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:17.006395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:17.007416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:17.010565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:17.011283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:17.105478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:17.127198 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1253af38-c585-4b72-a77c-b37d8e257f6c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1536 microversion: 2.1 time: 0.648672 Sep 18 01:08:17.129989 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 887/1817] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:16 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1536 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:17.516842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:17.517782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:17.526914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:17.528624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:17.529771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:17.530902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:17.531542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:17.532144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:17.584333 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:18.045530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:18.072166 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd9853ad-8718-4e3a-9ba0-1155e08491a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 1.123805 Sep 18 01:08:18.088768 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 931/1818] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:16 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:18.105535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1b1e7883-bffd-4cb9-b827-25138532236f req-7c256c5f-4e27-40be-b53a-0beda5d10d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:18.164257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1b1e7883-bffd-4cb9-b827-25138532236f req-7c256c5f-4e27-40be-b53a-0beda5d10d99 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:18.165063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1b1e7883-bffd-4cb9-b827-25138532236f req-7c256c5f-4e27-40be-b53a-0beda5d10d99 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:18.167529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1b1e7883-bffd-4cb9-b827-25138532236f req-7c256c5f-4e27-40be-b53a-0beda5d10d99 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:18.184272 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:18.241039 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1b1e7883-bffd-4cb9-b827-25138532236f req-7c256c5f-4e27-40be-b53a-0beda5d10d99 service nova] Creating event network-changed:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h1-master-1 Sep 18 01:08:18.267879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-1b1e7883-bffd-4cb9-b827-25138532236f req-7c256c5f-4e27-40be-b53a-0beda5d10d99 service nova] Instance f0609259-cd22-41ef-884b-479b79a2bf7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:08:18.317242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1b1e7883-bffd-4cb9-b827-25138532236f req-7c256c5f-4e27-40be-b53a-0beda5d10d99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222850 Sep 18 01:08:18.323211 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 932/1819] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:18.340350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:18.351264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:18.375436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:18.382453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:18.384078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:18.386720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:18.388283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:18.390166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:18.680073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:18.694803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-821779f0-7f28-41aa-b2f5-9edac4b3d765 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1314 microversion: 2.1 time: 1.184594 Sep 18 01:08:18.698208 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 888/1820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:17 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1314 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:18.709160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:18.710259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:18.726906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:18.730429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:18.732067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:18.734484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:18.736522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:18.737180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:19.262130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:19.274327 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cffaa548-634b-4f0b-b349-f9324d0e8cc0 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1390 microversion: 2.1 time: 0.945718 Sep 18 01:08:19.274939 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 933/1821] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:18 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1390 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:19.282946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:19.283600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:19.309152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:19.310065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:19.310731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:19.311460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:19.313503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:19.314053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:19.319849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:19.350271 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cda1b8c2-2568-42ab-9e13-79a36de198cb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1536 microversion: 2.1 time: 0.648822 Sep 18 01:08:19.351608 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 889/1822] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:18 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1536 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:19.553527 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=5 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:19.704547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:19.723012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:19.725157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:19.737932 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50f56c50-f11b-4978-98df-ea004c686463 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 0.458643 Sep 18 01:08:19.738450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 934/1823] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:19 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:19.775409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:19.775923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:19.776379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:19.777206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:19.783406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:19.783950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:20.008501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-7e14f54d-b05a-45a9-b1b4-16f53d647fc0 req-988a24f6-dfe2-4504-a1f6-09f586eedef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a49915-3f71-4dd6-be9d-f338b8b4b9bd", "tag": "6bc7822e-cef8-4029-a6cb-9afec75df693"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:20.037906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7e14f54d-b05a-45a9-b1b4-16f53d647fc0 req-988a24f6-dfe2-4504-a1f6-09f586eedef4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:20.047107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7e14f54d-b05a-45a9-b1b4-16f53d647fc0 req-988a24f6-dfe2-4504-a1f6-09f586eedef4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:20.048780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7e14f54d-b05a-45a9-b1b4-16f53d647fc0 req-988a24f6-dfe2-4504-a1f6-09f586eedef4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:20.077341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-7e14f54d-b05a-45a9-b1b4-16f53d647fc0 req-988a24f6-dfe2-4504-a1f6-09f586eedef4 service nova] Creating event network-changed:6bc7822e-cef8-4029-a6cb-9afec75df693 for instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd on n-h2-master-1 Sep 18 01:08:20.085746 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-7e14f54d-b05a-45a9-b1b4-16f53d647fc0 req-988a24f6-dfe2-4504-a1f6-09f586eedef4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080413 Sep 18 01:08:20.087391 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 935/1824] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:08:20.324121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:20.332717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:20.374548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:20.376676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:20.378152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:20.384390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:20.391553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:20.392692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:20.816419 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:21.201291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:21.222568 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2e18b21-a52b-46e3-a25b-9606f05972b6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1314 microversion: 2.1 time: 1.501066 Sep 18 01:08:21.231768 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 890/1825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:19 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1314 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:08:21.257625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:21.262730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:21.286973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:21.287936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:21.289829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:21.290965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:21.293098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:21.331427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:21.335255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:21.350796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1688fefc-7454-44da-b236-ab872651d344 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1380 microversion: 2.1 time: 1.035230 Sep 18 01:08:21.356538 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 936/1826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:20 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1380 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:21.364813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5f86f445-4aef-4cf4-a73c-47dac44af1af req-f05e2a0e-6037-45c9-9353-6213a21d2771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e17de0-e432-4be3-968d-1bd921fe322d", "tag": "0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:21.438247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5f86f445-4aef-4cf4-a73c-47dac44af1af req-f05e2a0e-6037-45c9-9353-6213a21d2771 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:21.442251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5f86f445-4aef-4cf4-a73c-47dac44af1af req-f05e2a0e-6037-45c9-9353-6213a21d2771 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:21.442904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5f86f445-4aef-4cf4-a73c-47dac44af1af req-f05e2a0e-6037-45c9-9353-6213a21d2771 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:21.489624 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5f86f445-4aef-4cf4-a73c-47dac44af1af req-f05e2a0e-6037-45c9-9353-6213a21d2771 service nova] Creating event network-changed:0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191 for instance 30e17de0-e432-4be3-968d-1bd921fe322d on n-h1-master-1 Sep 18 01:08:21.500860 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5f86f445-4aef-4cf4-a73c-47dac44af1af req-f05e2a0e-6037-45c9-9353-6213a21d2771 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140323 Sep 18 01:08:21.501969 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 937/1827] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:21.516843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:21.519945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:21.546721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:21.547294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:21.548209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:21.549120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:21.549731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:21.550391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:21.839861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:21.849581 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a53c3e9-4f55-4e70-9b78-e3a71b32b927 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1536 microversion: 2.1 time: 0.616797 Sep 18 01:08:21.856890 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 891/1828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:21 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1536 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:22.023624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:22.036467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd18c7e8-0486-4e5b-b431-952c1b7e974b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 0.529763 Sep 18 01:08:22.057503 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 938/1829] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:21 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:22.082714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a3d2943-37ef-475c-895c-01d6b977ec9c tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '.version_select at 0x7f7005ef9c10>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:22.101868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a3d2943-37ef-475c-895c-01d6b977ec9c tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:22.105162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a3d2943-37ef-475c-895c-01d6b977ec9c tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:22.108115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a3d2943-37ef-475c-895c-01d6b977ec9c tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:22.177378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a3d2943-37ef-475c-895c-01d6b977ec9c tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3881 microversion: 2.1 time: 0.119057 Sep 18 01:08:22.179894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 939/1830] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:08:22 2022] GET /compute/v2.1/os-migrations => generated 3881 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:22.193752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1765631681", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3946aa63-a4f2-4eee-aaa3-ec460267890e"}], "block_device_mapping_v2": [{"uuid": "a56d8651-1b47-41ca-a2a4-382553ac9714", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:22.283765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-404a1348-3793-4ceb-b48d-78b036986fd5 tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Calling method '.version_select at 0x7f7005e5a5e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:22.317123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] validate_networks() for [('3946aa63-a4f2-4eee-aaa3-ec460267890e', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:08:22.440607 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-404a1348-3793-4ceb-b48d-78b036986fd5 tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.583436 Sep 18 01:08:22.449822 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 892/1831] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:08:21 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:08:22.450419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:22.463169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:22.486155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:22.486806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:22.487233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:22.488009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:22.488543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:22.488957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:22.980014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56b10828-de71-49ce-9ba2-8ff77b15bdc9 tempest-LiveMigrationTest-180889011 tempest-LiveMigrationTest-180889011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1531 microversion: 2.1 time: 0.536908 Sep 18 01:08:22.981070 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 893/1832] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:22 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1531 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:22.987345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:22.988512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:22.998598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:22.999569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:23.000567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:23.001765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:23.002466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:23.003148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:23.567797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:23.575967 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89a26830-94d0-4bf8-ac6f-fc6684518d2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1314 microversion: 2.1 time: 0.593154 Sep 18 01:08:23.576566 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 894/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:22 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:23.588527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0d6d428-9ff3-44d0-833d-90d59d7643f5 tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Action: 'create', calling method: .version_select at 0x7f7005e834c0>, body: {"pool": "non_exist_pool"} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:23.631483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:08:23.632062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:08:23.632460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:08:23.632963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:08:23.633448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:08:23.673468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:23.679231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:23.680999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:23.688583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:23.689475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:23.690594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:23.764826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:23.783787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Getting quotas for user bb1c3f4298d34bb2a820ec5de46a76c2 and project a91519f8a3e34e8a880239a3dc33b7fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:23.841379 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-c0d6d428-9ff3-44d0-833d-90d59d7643f5 tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] HTTP exception thrown: Floating IP pool not found. Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0d6d428-9ff3-44d0-833d-90d59d7643f5 tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Request method failure captured: Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 26 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-EstJAKDOoHreO-xmv4rLQyTAwH4ZEt_oXdjwQCJqmGPdZUba4kGprtIUsC_V0KHo_hA3yyBUMRcfK8etZ_JA4SrMCHBqx7uXZ8L3qEawJyOwDy0ULVhJXxPjUjWGz4PpfiooJJ31ZcsfIup87qpeza-uJSbvDZej554F1BrewNcY Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d87bec26951c432781745b591db83c54 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1637014218 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d87bec26951c432781745b591db83c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d87bec26951c432781745b591db83c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d87bec26951c432781745b591db83c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d87bec26951c432781745b591db83c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1637014218 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d87bec26951c432781745b591db83c54 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1637014218 Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPsNegativeTestJSON-1637014218-project Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a567ef623db54a5ca7b5a011d559775c Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1637014218-project Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: {"pool": "non_exist_pool"} Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: exception: Floating IP pool not found. Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:08:23.843736 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:08:23.850096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 18 01:08:23.850096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:23.850096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0d6d428-9ff3-44d0-833d-90d59d7643f5 tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Returning 404 to user: Floating IP pool not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:08:23.850096 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c0d6d428-9ff3-44d0-833d-90d59d7643f5 tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.260454 Sep 18 01:08:23.852120 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 895/1834] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:08:23 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:08:23.866219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:23.869888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:23.895761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:23.896448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:23.896891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:23.897632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:23.903043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:23.904012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:23.959052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:08:23.961175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a56d8651-1b47-41ca-a2a4-382553ac9714',volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:08:24.293275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-66c2c4e7-8a89-451a-9423-c9001f416942 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.111945 Sep 18 01:08:24.298292 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 940/1835] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:08:24.307103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:24.311105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:24.326588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:24.327859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:24.328455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:24.329266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:24.329918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:24.330439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:24.398658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:08:24.607375 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:24.615857 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-456b4858-a0dc-44c6-b533-b766634a791a tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 204 len: 0 microversion: 2.1 time: 0.316131 Sep 18 01:08:24.617894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 941/1836] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:08:24 2022] DELETE /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:24.633874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:24.635655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:24.670873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:24.674972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:24.676425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:24.678513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:24.680178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:24.682225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:24.825962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:24.848986 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d23cf48-4ce1-46d1-9012-0be2c9987188 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1529 microversion: 2.1 time: 0.995565 Sep 18 01:08:24.860537 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 896/1837] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:23 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1529 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:24.885746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-daa2599b-f1d1-4540-bb61-5ebd9c15130a tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Calling method '.version_select at 0x7f7005ead160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:25.166517 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-daa2599b-f1d1-4540-bb61-5ebd9c15130a tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3af94208-fc1e-4c1b-9f5c-797a5442c860 could not be found", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:08:25.168241 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-daa2599b-f1d1-4540-bb61-5ebd9c15130a tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] HTTP exception thrown: Floating IP not found for ID 3af94208-fc1e-4c1b-9f5c-797a5442c860 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-daa2599b-f1d1-4540-bb61-5ebd9c15130a tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Request method failure captured: Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-floating-ips/3af94208-fc1e-4c1b-9f5c-797a5442c860 HTTP/1.1 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-EstJAKDOoHreO-xmv4rLQyTAwH4ZEt_oXdjwQCJqmGPdZUba4kGprtIUsC_V0KHo_hA3yyBUMRcfK8etZ_JA4SrMCHBqx7uXZ8L3qEawJyOwDy0ULVhJXxPjUjWGz4PpfiooJJ31ZcsfIup87qpeza-uJSbvDZej554F1BrewNcY Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d87bec26951c432781745b591db83c54 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1637014218 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d87bec26951c432781745b591db83c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d87bec26951c432781745b591db83c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d87bec26951c432781745b591db83c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d87bec26951c432781745b591db83c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1637014218 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d87bec26951c432781745b591db83c54 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1637014218 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPsNegativeTestJSON-1637014218-project Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a567ef623db54a5ca7b5a011d559775c Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1637014218-project Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: exception: Floating IP not found for ID 3af94208-fc1e-4c1b-9f5c-797a5442c860 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3af94208-fc1e-4c1b-9f5c-797a5442c860'} Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3af94208-fc1e-4c1b-9f5c-797a5442c860 could not be found Sep 18 01:08:25.169997 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d95a49a9-2742-42dd-9d01-e6d124de918c'] Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3af94208-fc1e-4c1b-9f5c-797a5442c860. Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3af94208-fc1e-4c1b-9f5c-797a5442c860 Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3af94208-fc1e-4c1b-9f5c-797a5442c860 Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-daa2599b-f1d1-4540-bb61-5ebd9c15130a tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] Returning 404 to user: Floating IP not found for ID 3af94208-fc1e-4c1b-9f5c-797a5442c860 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-daa2599b-f1d1-4540-bb61-5ebd9c15130a tempest-FloatingIPsNegativeTestJSON-1637014218 tempest-FloatingIPsNegativeTestJSON-1637014218-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/3af94208-fc1e-4c1b-9f5c-797a5442c860" status: 404 len: 111 microversion: 2.1 time: 0.309588 Sep 18 01:08:25.176167 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 897/1838] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:08:24 2022] DELETE /compute/v2.1/os-floating-ips/3af94208-fc1e-4c1b-9f5c-797a5442c860 => generated 111 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:08:25.191295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1b2b66b3-34a3-49c8-8487-d398aebfa82e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:25.191929 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1b2b66b3-34a3-49c8-8487-d398aebfa82e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:25.193960 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:25.412830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:25.429002 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-535ec1a8-4aa2-4a5b-b9dd-b9238d1e59a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 0.809282 Sep 18 01:08:25.446157 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 942/1839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:24 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:25.452776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:25.453819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:25.463982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:25.475380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:25.475832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:25.479848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:25.487035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:25.489315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:25.637645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1b2b66b3-34a3-49c8-8487-d398aebfa82e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:25.651466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1b2b66b3-34a3-49c8-8487-d398aebfa82e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:25.656928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1b2b66b3-34a3-49c8-8487-d398aebfa82e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:25.666230 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1b2b66b3-34a3-49c8-8487-d398aebfa82e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1104 microversion: 2.25 time: 0.485338 Sep 18 01:08:25.668707 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 898/1840] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:25 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1104 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:25.695738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:25.697528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:25.708872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:25.710649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:25.715094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:25.716912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:25.719459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:25.723054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:26.378444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:26.390582 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9aece8b5-94a4-477b-b7b1-7a9714c32a71 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1386 microversion: 2.1 time: 0.700572 Sep 18 01:08:26.409518 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 899/1841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:25 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1386 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:26.419685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:26.421123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:26.430389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:26.431390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:26.432415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:26.433598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:26.434353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:26.435971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:26.574823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:26.588847 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d0b295f8-26e4-433a-a0bd-b2b1c1eadb04 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1314 microversion: 2.1 time: 1.141193 Sep 18 01:08:26.589988 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 943/1842] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:25 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1314 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:26.656233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:26.667646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dce272db-e06e-40d8-b47d-dd7d4032e364 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1529 microversion: 2.1 time: 0.255912 Sep 18 01:08:26.668620 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 900/1843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:26 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1529 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:26.691760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:26.692341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:26.702011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:26.702810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:26.703639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:26.704525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:26.705302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:26.705973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:26.922384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:26.937655 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2d31732-b7be-4121-8886-22f5f24a9b0c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 0.263642 Sep 18 01:08:26.951283 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 901/1844] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:26 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:26.955826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1209650589", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "3f9accfb-f6de-4d5d-a2b3-c8e4eefdc789"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:26.964156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89828391-6503-4989-9c09-8b6f35623114 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:26.979185 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-89828391-6503-4989-9c09-8b6f35623114 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] HTTP exception thrown: Flavor 899f774b-26ad-46c7-941b-a6beccc58a5b could not be found. Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89828391-6503-4989-9c09-8b6f35623114 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Request method failure captured: Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/flavors/899f774b-26ad-46c7-941b-a6beccc58a5b HTTP/1.1 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm55nWDFJqOEqHOW5eSnFkAzbRPRW0so_oWXtqV3mAqpwP-KZg0OvgkKHrbRKj55Dbuk1IwVxpbW9Z_WYZ1eKl2bBCQpa-P9fQ0tG9BH8JHcfAC2CvubcFOZUE1ri2EXfs-Di3PtP010P_vD19JThIF3qr6ZXTSsEzCZw1Ca3JTU8uk Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 445992bf3ef04a8e989aff66eba42917 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-MigrationsAdminTest-809533897 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/445992bf3ef04a8e989aff66eba42917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/445992bf3ef04a8e989aff66eba42917"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_445992bf3ef04a8e989aff66eba42917"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/445992bf3ef04a8e989aff66eba42917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-MigrationsAdminTest-809533897 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 445992bf3ef04a8e989aff66eba42917 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-MigrationsAdminTest-809533897 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-MigrationsAdminTest-809533897-project-admin Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 7440ddf0e81c427e891af0ff670ce460 Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-MigrationsAdminTest-809533897-project-admin Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: exception: Flavor 899f774b-26ad-46c7-941b-a6beccc58a5b could not be found. Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '899f774b-26ad-46c7-941b-a6beccc58a5b'} Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 899f774b-26ad-46c7-941b-a6beccc58a5b could not be found. Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 899f774b-26ad-46c7-941b-a6beccc58a5b could not be found. Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:26.982630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 899f774b-26ad-46c7-941b-a6beccc58a5b could not be found. Sep 18 01:08:26.991380 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:08:26.993843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89828391-6503-4989-9c09-8b6f35623114 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Returning 404 to user: Flavor 899f774b-26ad-46c7-941b-a6beccc58a5b could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:08:26.994916 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89828391-6503-4989-9c09-8b6f35623114 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/899f774b-26ad-46c7-941b-a6beccc58a5b" status: 404 len: 109 microversion: 2.1 time: 0.042587 Sep 18 01:08:27.005443 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 902/1845] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:08:26 2022] DELETE /compute/v2.1/flavors/899f774b-26ad-46c7-941b-a6beccc58a5b => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:08:27.056132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] validate_networks() for [('3f9accfb-f6de-4d5d-a2b3-c8e4eefdc789', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:08:27.080518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:27.081155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:27.107420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:27.107927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:27.108369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:27.118335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:27.118936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:27.119390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:27.444775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:27.454743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:27.462546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:27.464649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09f71de2-97d8-4631-95da-dd6665e12ba8 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1241 microversion: 2.25 time: 0.428180 Sep 18 01:08:27.465713 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 903/1846] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:27 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1241 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:27.471370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ddf438c6-0be3-4d3e-be93-9817122778ca req-0996ccae-15f2-4c30-bb4c-23672612550c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254d59b9-ce47-47a8-9350-54779b2f2d75", "name": "network-vif-deleted", "tag": "6462c0cf-490d-4eff-bc24-c442fae53aaa"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:27.483927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ddf438c6-0be3-4d3e-be93-9817122778ca req-0996ccae-15f2-4c30-bb4c-23672612550c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:27.484801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ddf438c6-0be3-4d3e-be93-9817122778ca req-0996ccae-15f2-4c30-bb4c-23672612550c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:27.485531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ddf438c6-0be3-4d3e-be93-9817122778ca req-0996ccae-15f2-4c30-bb4c-23672612550c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:27.500472 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ddf438c6-0be3-4d3e-be93-9817122778ca req-0996ccae-15f2-4c30-bb4c-23672612550c service nova] Creating event network-vif-deleted:6462c0cf-490d-4eff-bc24-c442fae53aaa for instance 254d59b9-ce47-47a8-9350-54779b2f2d75 on n-h1-master-1 Sep 18 01:08:27.526565 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ddf438c6-0be3-4d3e-be93-9817122778ca req-0996ccae-15f2-4c30-bb4c-23672612550c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059233 Sep 18 01:08:27.530406 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 904/1847] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:27.557907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1157897447", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:27.666268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:08:29.428212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:08:29.429631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:08:29.430508 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:08:29.431512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:08:29.432550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:08:29.455323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.456015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.456619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:29.457895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.458295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.458827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:29.508851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:29.521366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Getting quotas for user 666826ce8e51441ea7c271be4c5d8eb9 and project ab0fa7e3f2044f08b64e08b60e2ca39a. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:29.549630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:08:29.552103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:08:29.661495 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-946129d3-0a3a-4817-a0af-4e6dd6658ea4 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.124393 Sep 18 01:08:29.662340 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 905/1848] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:08:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:08:29.673680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:29.674676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:29.681968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.682807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.683536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:29.684563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.685413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.686117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:29.818295 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:08:29.818808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:08:29.819184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:08:29.819620 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:08:29.820899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:08:29.836511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.837408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.838146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:29.839149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.839854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.840525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:29.865156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Getting quotas for project 36c54fe985874691b9b648f92da02020. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:29.876306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Getting quotas for user 6818e1bed08b4b84a729108fcd4f6e60 and project 36c54fe985874691b9b648f92da02020. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:29.892631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:08:29.895732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:08:29.910396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:29.919781 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1700aa0-1d46-4df9-8ab9-4860aadf05bb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1183 microversion: 2.1 time: 0.250431 Sep 18 01:08:29.938654 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 906/1849] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:29 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:29.952769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:29.957919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:29.969791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.970363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.971915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:29.973975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:29.981868 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53a635d4-a6ac-40a8-ae10-fd941becd25f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.387388 Sep 18 01:08:29.989285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:29.990742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:30.007127 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 944/1850] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:08:30.041790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:30.042435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:30.059297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:30.062720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:30.063372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:30.066518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:30.067370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:30.083971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:31.334065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:31.341693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:31.376950 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f001222e-b52e-47a5-ab5d-677293a3f331 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 1.367849 Sep 18 01:08:31.379500 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03086ce1-bc85-413c-bfdf-980abae62ba0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1314 microversion: 2.1 time: 1.439475 Sep 18 01:08:31.382160 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 945/1851] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:30 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:31.386497 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 907/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:29 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1314 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:31.399000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:31.400173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:31.402759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:31.405428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:31.438575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:31.439086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:31.439531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:31.440267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:31.440942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:31.441904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:31.445771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:31.446827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:31.447955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:31.448736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:31.450857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:31.451021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:31.753774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:31.764484 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-be53169d-8f83-4933-8627-a70285e18ef7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1265 microversion: 2.1 time: 0.376442 Sep 18 01:08:31.767400 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 908/1853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:31 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:31.773414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1659011240", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "3f9accfb-f6de-4d5d-a2b3-c8e4eefdc789"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:31.935812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] validate_networks() for [('3f9accfb-f6de-4d5d-a2b3-c8e4eefdc789', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:08:32.048417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:32.063361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:32.064859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:32.066242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56d6ca81-9409-4a2c-b7d1-6ce419c72e66 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1293 microversion: 2.25 time: 0.682838 Sep 18 01:08:32.066854 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 946/1854] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:31 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1293 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:32.086494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:32.087336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:32.108368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:32.108879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:32.109587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:32.110887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:32.111604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:32.112135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:32.312354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:32.327127 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50f21de8-bcb0-48a0-9742-93fb387a41d6 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1183 microversion: 2.1 time: 0.258986 Sep 18 01:08:32.328722 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 947/1855] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:32 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:32.333743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-34c1071d-1d64-45fd-a9bb-be0118279a46 req-eddb624f-1bf0-4665-901f-203645af8249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "name": "network-vif-plugged", "status": "completed", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:32.362479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34c1071d-1d64-45fd-a9bb-be0118279a46 req-eddb624f-1bf0-4665-901f-203645af8249 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:32.363791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34c1071d-1d64-45fd-a9bb-be0118279a46 req-eddb624f-1bf0-4665-901f-203645af8249 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:32.364434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34c1071d-1d64-45fd-a9bb-be0118279a46 req-eddb624f-1bf0-4665-901f-203645af8249 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:32.393954 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-34c1071d-1d64-45fd-a9bb-be0118279a46 req-eddb624f-1bf0-4665-901f-203645af8249 service nova] Creating event network-vif-plugged:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h1-master-1 Sep 18 01:08:32.411742 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-34c1071d-1d64-45fd-a9bb-be0118279a46 req-eddb624f-1bf0-4665-901f-203645af8249 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081202 Sep 18 01:08:32.416247 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 948/1856] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:32.433211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:32.435066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:32.450769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:32.452012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:32.452985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:32.454762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:32.455660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:32.457880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:33.709134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:33.725664 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16132ed4-f944-4613-96ea-70fc4ce09b17 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1314 microversion: 2.1 time: 1.296009 Sep 18 01:08:33.726358 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 949/1857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:32 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:33.732244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:33.742458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:33.749521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:33.750288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:33.762279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:33.763315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:33.763959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:33.764577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.188188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:08:34.188737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:08:34.189485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:08:34.190023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:08:34.191002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:08:34.210174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.211308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.228573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.229907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.230409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.231018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.284752 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Getting quotas for project 36c54fe985874691b9b648f92da02020. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:34.300387 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Getting quotas for user 6818e1bed08b4b84a729108fcd4f6e60 and project 36c54fe985874691b9b648f92da02020. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:34.326616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:08:34.329460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:08:34.447904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-85b563ed-bee2-4956-8dbe-ba50e6af29b7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.678194 Sep 18 01:08:34.453905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:34.460452 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 909/1858] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:08:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:08:34.469668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:34.470937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:34.485922 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3026d2d8-82b5-461c-b6b0-7f6b26800bb8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 0.754847 Sep 18 01:08:34.486590 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 950/1859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:33 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:34.488544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.489054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.489485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.493642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.498678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.500138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.508551 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:34.512557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:34.557970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.558497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.560350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.565222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.569735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.570953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.724559 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:34.847031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:34.916810 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7ae292fe-4e27-438e-a31c-1a1a11c90fa5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1271 microversion: 2.1 time: 0.449808 Sep 18 01:08:34.943827 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 910/1860] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:34 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1271 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:34.948910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:34.956063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:34.967167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.975780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.977712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:34.978586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:34.979145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:34.980189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:35.054720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:35.059804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:35.060951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:35.062502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lazy-loading 'fault' on Instance uuid 254d59b9-ce47-47a8-9350-54779b2f2d75 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:08:35.292394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:35.298197 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:35.311362 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb4488c8-7ed3-493c-bd0c-47ae656e1e14 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 200 len: 1142 microversion: 2.1 time: 0.366229 Sep 18 01:08:35.312201 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 911/1861] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:34 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 1142 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:35.317651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f7caee80-a9bc-42bc-a0d3-9480673406c9 req-fad3c5ec-1ffc-4999-96d5-6e9205df6e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e17de0-e432-4be3-968d-1bd921fe322d", "name": "network-vif-plugged", "status": "completed", "tag": "0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191"}, {"server_uuid": "65a49915-3f71-4dd6-be9d-f338b8b4b9bd", "name": "network-vif-plugged", "status": "completed", "tag": "6bc7822e-cef8-4029-a6cb-9afec75df693"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:35.329802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f7caee80-a9bc-42bc-a0d3-9480673406c9 req-fad3c5ec-1ffc-4999-96d5-6e9205df6e69 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:35.330524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f7caee80-a9bc-42bc-a0d3-9480673406c9 req-fad3c5ec-1ffc-4999-96d5-6e9205df6e69 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:35.331141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f7caee80-a9bc-42bc-a0d3-9480673406c9 req-fad3c5ec-1ffc-4999-96d5-6e9205df6e69 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:35.347281 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f7caee80-a9bc-42bc-a0d3-9480673406c9 req-fad3c5ec-1ffc-4999-96d5-6e9205df6e69 service nova] Creating event network-vif-plugged:0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191 for instance 30e17de0-e432-4be3-968d-1bd921fe322d on n-h1-master-1 Sep 18 01:08:35.349210 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f7caee80-a9bc-42bc-a0d3-9480673406c9 req-fad3c5ec-1ffc-4999-96d5-6e9205df6e69 service nova] Creating event network-vif-plugged:6bc7822e-cef8-4029-a6cb-9afec75df693 for instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd on n-h2-master-1 Sep 18 01:08:35.362163 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f7caee80-a9bc-42bc-a0d3-9480673406c9 req-fad3c5ec-1ffc-4999-96d5-6e9205df6e69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047965 Sep 18 01:08:35.363571 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 912/1862] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:35.372675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1176915979", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "451", "networks": [{"uuid": "3f9accfb-f6de-4d5d-a2b3-c8e4eefdc789"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:35.487671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] validate_networks() for [('3f9accfb-f6de-4d5d-a2b3-c8e4eefdc789', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:08:35.794246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:35.812112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:35.822685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:35.822685 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61757e81-04d3-4182-94dd-d031d40ee287 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1293 microversion: 2.25 time: 1.332938 Sep 18 01:08:35.855640 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 951/1863] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:34 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1293 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:35.861528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:35.867075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:35.884434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:35.884947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:35.885412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:35.886191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:35.886660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:35.887105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:36.758928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:36.798073 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26b73786-7649-47a7-aa92-d3a57267b895 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1314 microversion: 2.1 time: 0.933772 Sep 18 01:08:36.799425 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 952/1864] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:35 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:36.807499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:36.818844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:36.840931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:36.842853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:36.844347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:36.850769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:36.855810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:36.857035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:37.543898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:08:37.544967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:08:37.546293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:08:37.547156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:08:37.547957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:08:37.570445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:37.571421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:37.573523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:37.576551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:37.579014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:37.579927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:37.644319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Getting quotas for project 36c54fe985874691b9b648f92da02020. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:37.667776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Getting quotas for user 6818e1bed08b4b84a729108fcd4f6e60 and project 36c54fe985874691b9b648f92da02020. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:37.742300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:08:37.749467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:08:37.866598 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1dfc6d91-43e6-4086-ba5f-dd3fda0dc7fd tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.500465 Sep 18 01:08:37.874677 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 913/1865] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:08:37.918327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:37.919586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:37.965045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:37.965849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:37.967047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:37.968606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:37.969066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:37.970081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:38.169211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:38.195213 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a5cfa21-5d25-45db-9e0d-9230958fe44a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1308 microversion: 2.1 time: 1.389199 Sep 18 01:08:38.195962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 953/1866] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:36 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1308 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:38.210714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:38.214801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 254d59b9-ce47-47a8-9350-54779b2f2d75] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:38.229795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:38.247156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:38.247724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:38.248493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:38.249016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:38.249561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:38.325481 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] HTTP exception thrown: Instance 254d59b9-ce47-47a8-9350-54779b2f2d75 could not be found. Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Request method failure captured: Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 HTTP/1.1 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm3RkI8XLc52DjnjcakjWVh_PEBgoUxYNUlnb5juwL8f52vGg8jCDJBQQfNA66vQG7HOK56QkzWdq4cmM_MvvBedWgr_gUUpVy30ziRQq9tO16aJYN2YkV4ouK_3JlAbzMO1sLyMKLcaPIvoAmMAZWeQzTuh7kf_jDd5MIr9nVdo_e0 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-LiveMigrationTest-1016262571 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-LiveMigrationTest-1016262571-project Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: cf8f60e6d52b498c90dd1ace5418ae13 Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-LiveMigrationTest-1016262571-project Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 254d59b9-ce47-47a8-9350-54779b2f2d75 could not be found. Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '254d59b9-ce47-47a8-9350-54779b2f2d75'} Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254d59b9-ce47-47a8-9350-54779b2f2d75 could not be found. Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254d59b9-ce47-47a8-9350-54779b2f2d75 could not be found. Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:38.344715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254d59b9-ce47-47a8-9350-54779b2f2d75 could not be found. Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Returning 404 to user: Instance 254d59b9-ce47-47a8-9350-54779b2f2d75 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:08:38.350569 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bce4f01c-3c42-4c7a-8aaa-e061e119de86 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75" status: 404 len: 111 microversion: 2.1 time: 0.151799 Sep 18 01:08:38.351482 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 954/1867] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:38 2022] GET /compute/v2.1/servers/254d59b9-ce47-47a8-9350-54779b2f2d75 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:08:38.379843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:38.383710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:38.407006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:38.410724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:38.412252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:38.414422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:38.417853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:38.422339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:38.927447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:38.943173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:38.944870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:38.946274 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d291827f-2e79-44a1-b3a1-60a02adbda35 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1293 microversion: 2.25 time: 0.592429 Sep 18 01:08:38.965972 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 955/1868] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:38 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1293 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:38.974747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-652b2556-961b-4cad-9837-9976fa1ed25a req-7f13b2e4-ee6e-47e9-b1fa-d5a5b3cb12a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188661e5-1bef-4e00-b59d-8def426eb404", "tag": "b344c9d6-d712-42e7-8ffc-b3a6a5b360f3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:38.987541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-652b2556-961b-4cad-9837-9976fa1ed25a req-7f13b2e4-ee6e-47e9-b1fa-d5a5b3cb12a8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:38.988291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-652b2556-961b-4cad-9837-9976fa1ed25a req-7f13b2e4-ee6e-47e9-b1fa-d5a5b3cb12a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:38.988907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-652b2556-961b-4cad-9837-9976fa1ed25a req-7f13b2e4-ee6e-47e9-b1fa-d5a5b3cb12a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:39.010755 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-652b2556-961b-4cad-9837-9976fa1ed25a req-7f13b2e4-ee6e-47e9-b1fa-d5a5b3cb12a8 service nova] Creating event network-changed:b344c9d6-d712-42e7-8ffc-b3a6a5b360f3 for instance 188661e5-1bef-4e00-b59d-8def426eb404 on n-h1-master-1 Sep 18 01:08:39.019314 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-652b2556-961b-4cad-9837-9976fa1ed25a req-7f13b2e4-ee6e-47e9-b1fa-d5a5b3cb12a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051989 Sep 18 01:08:39.030615 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 956/1869] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:39.036189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:39.037098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:39.043866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:39.045188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:39.046763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:39.048622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:39.049476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:39.050222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:39.067410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:39.091206 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-770e7a58-16db-4c4b-9409-8aeeed800c5a tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 1.205984 Sep 18 01:08:39.092146 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 914/1870] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:37 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:39.102475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:39.104763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:39.120693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:39.122900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:39.124262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:39.125945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:39.127714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:39.130308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:39.370914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:39.381601 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-372e2c5e-8a9e-4de6-8544-2bc2cae2bc3b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1217 microversion: 2.1 time: 0.285637 Sep 18 01:08:39.384268 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 915/1871] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:39 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1217 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:39.401919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:39.402787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:39.414113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:39.415741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:39.417256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:39.418770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:39.423333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:39.423825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:39.855576 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:39.885014 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:40.997908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:41.025275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-601c34ae-458b-4d97-80c5-0d0c07f9d577 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1501 microversion: 2.1 time: 1.993250 Sep 18 01:08:41.043948 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 957/1872] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:39 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1501 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:41.043948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:41.047436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:41.064120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:41.065308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:41.067462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:41.070650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:41.073252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:41.074249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:41.180982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:41.192755 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bc76d86b-bdb9-4938-8891-570a46572687 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1487 microversion: 2.1 time: 1.807185 Sep 18 01:08:41.193617 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 916/1873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:39 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1487 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:41.209112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:41.210170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:41.244434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:41.248610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:41.255633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:41.266269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:41.267885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:41.268552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:41.896768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:41.910119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:41.911743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:41.912897 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe25fece-1977-4ccf-8852-8b1e796df5cf tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1293 microversion: 2.25 time: 0.881365 Sep 18 01:08:41.918563 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 958/1874] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:41 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1293 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:41.932161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:41.933078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:41.944631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:41.948556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:41.952940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:41.954112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:41.954762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:41.957821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:41.989144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:42.001329 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b83127f5-7bfa-4da6-8f60-1ef8140c1af2 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.801830 Sep 18 01:08:42.002279 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 917/1875] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:41 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:42.017809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d8f32eec-d468-46c5-b3ba-643d3ef4a7d4 req-4c3801bb-e9fa-4af8-9632-ee30a30c2a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc4a839-803a-4ab3-a83e-9445e11c779f", "tag": "cf1ea48f-7e0e-4db6-a6c8-f6fbb05cbbdf"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:42.037491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d8f32eec-d468-46c5-b3ba-643d3ef4a7d4 req-4c3801bb-e9fa-4af8-9632-ee30a30c2a66 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:42.038015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d8f32eec-d468-46c5-b3ba-643d3ef4a7d4 req-4c3801bb-e9fa-4af8-9632-ee30a30c2a66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:42.038457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d8f32eec-d468-46c5-b3ba-643d3ef4a7d4 req-4c3801bb-e9fa-4af8-9632-ee30a30c2a66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:42.062036 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d8f32eec-d468-46c5-b3ba-643d3ef4a7d4 req-4c3801bb-e9fa-4af8-9632-ee30a30c2a66 service nova] Creating event network-changed:cf1ea48f-7e0e-4db6-a6c8-f6fbb05cbbdf for instance 5dc4a839-803a-4ab3-a83e-9445e11c779f on n-h2-master-1 Sep 18 01:08:42.069903 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d8f32eec-d468-46c5-b3ba-643d3ef4a7d4 req-4c3801bb-e9fa-4af8-9632-ee30a30c2a66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066330 Sep 18 01:08:42.070518 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 918/1876] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:42.075878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:42.076506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:42.097671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:42.098096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:42.098541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:42.099259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:42.099724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:42.100154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:42.113306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:42.121897 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e322a6ac-30ec-47e2-a537-de983848a557 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1279 microversion: 2.1 time: 0.201940 Sep 18 01:08:42.129610 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 959/1877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:41 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:42.143068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2504cf4-a952-4ca1-92f5-ca2772e384f4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:42.149625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lazy-loading 'flavor' on Instance uuid 65a49915-3f71-4dd6-be9d-f338b8b4b9bd {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:08:42.152707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-a952-4ca1-92f5-ca2772e384f4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:42.153705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-a952-4ca1-92f5-ca2772e384f4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:42.158486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-a952-4ca1-92f5-ca2772e384f4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:42.323072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2504cf4-a952-4ca1-92f5-ca2772e384f4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Going to try to stop instance {{(pid=122374) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:08:42.448180 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2504cf4-a952-4ca1-92f5-ca2772e384f4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d/action" status: 202 len: 0 microversion: 2.1 time: 0.319211 Sep 18 01:08:42.450752 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 960/1878] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:08:42 2022] POST /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:08:42.668731 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3819415-91f6-4c5d-83a5-8dc82aa2ec35 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd/action" status: 202 len: 0 microversion: 2.1 time: 0.595659 Sep 18 01:08:42.671922 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 919/1879] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:08:42 2022] POST /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:08:42.700299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:42.703419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:42.733056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:42.733638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:42.734040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:42.734764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:42.739211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:42.754015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.149963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dec96aa3-7982-469f-9bd8-3df13bd9b2b6 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f7005e4f3a0>, body: {"keypair": {"name": "tempest-keypair-455381822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1eHV0bOdDcW3bjEnvStyBPI6rpCZqPC5PlNkDep9Qj7cAqe9QH7j3itr8511SG1nvIVJebQGPcu0tqHkGVqOtBc7HkjikSbn7/wXha3LQwGw3D+0JzrHn2m4xEu1QiJA=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:43.185135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-dec96aa3-7982-469f-9bd8-3df13bd9b2b6 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:43.188666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:43.194176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-dec96aa3-7982-469f-9bd8-3df13bd9b2b6 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:43.215614 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e5c6ad87-2c85-4e70-acb9-2091c67f9d64 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.540824 Sep 18 01:08:43.217726 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 920/1880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:42 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:43.232787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-6b4dfd1f-5f76-4bdd-9c9b-84602ee78e6c req-5a6dfd1a-9c13-439d-98a1-e9c34c24388f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:43.251432 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dec96aa3-7982-469f-9bd8-3df13bd9b2b6 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.796630 Sep 18 01:08:43.252488 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 961/1881] 10.222.0.25 () {62 vars in 1199 bytes} [Sun Sep 18 01:08:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 801 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:08:43.262207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:43.262946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:43.270941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.272181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.273302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.274928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.276100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.278057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.280228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6b4dfd1f-5f76-4bdd-9c9b-84602ee78e6c req-5a6dfd1a-9c13-439d-98a1-e9c34c24388f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.281140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6b4dfd1f-5f76-4bdd-9c9b-84602ee78e6c req-5a6dfd1a-9c13-439d-98a1-e9c34c24388f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.281947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6b4dfd1f-5f76-4bdd-9c9b-84602ee78e6c req-5a6dfd1a-9c13-439d-98a1-e9c34c24388f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.325021 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-6b4dfd1f-5f76-4bdd-9c9b-84602ee78e6c req-5a6dfd1a-9c13-439d-98a1-e9c34c24388f service nova] Creating event network-changed:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h2-master-1 Sep 18 01:08:43.344302 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-6b4dfd1f-5f76-4bdd-9c9b-84602ee78e6c req-5a6dfd1a-9c13-439d-98a1-e9c34c24388f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123998 Sep 18 01:08:43.352119 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 921/1882] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:43.370682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:43.372246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:43.386621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.387405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.388177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.389479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.390583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.391348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.637899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:43.649616 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-257dcf28-ffaa-4371-9ba1-e9b9756b1e89 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.395673 Sep 18 01:08:43.651189 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 962/1883] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:43 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:43.659410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:43.661924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:43.675324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.676762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.679699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.683866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.685130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.688583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.852104 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:43.861402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:43.862970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:43.878459 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3134dce7-1369-4196-a8fb-4a46b001375d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1293 microversion: 2.25 time: 0.524297 Sep 18 01:08:43.878767 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 922/1884] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:43 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1293 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:43.904316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:43.910682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:43.931642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.932614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.933250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:43.942482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:43.943384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:43.944372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:44.408433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:44.416869 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d7764439-680c-4150-b349-bd3c44d122c6 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.524958 Sep 18 01:08:44.421329 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 923/1885] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:43 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:44.434019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-254e0a3e-0043-4af4-bc66-7dcba1b4142d tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f700a819af0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:44.458238 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-254e0a3e-0043-4af4-bc66-7dcba1b4142d tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-455381822" status: 200 len: 512 microversion: 2.2 time: 0.035342 Sep 18 01:08:44.459114 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 924/1886] 10.222.0.25 () {60 vars in 1255 bytes} [Sun Sep 18 01:08:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-455381822 => generated 512 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:44.464456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a6f99930-c98d-4e91-a78d-86136d3169b2 req-8cc5b5d4-22f6-49c0-8d88-951b574c041b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffa04fb-a41d-4238-b151-0a0252aaf8c0", "tag": "8c7e9c5d-6893-4687-971f-af5eb2b21481"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:44.472990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:44.474091 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:44.485529 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8374f23-6322-4830-8a11-53dd954dfcaa tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.832799 Sep 18 01:08:44.486618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a6f99930-c98d-4e91-a78d-86136d3169b2 req-8cc5b5d4-22f6-49c0-8d88-951b574c041b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:44.487444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a6f99930-c98d-4e91-a78d-86136d3169b2 req-8cc5b5d4-22f6-49c0-8d88-951b574c041b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:44.488147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 963/1887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:43 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:44.488690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a6f99930-c98d-4e91-a78d-86136d3169b2 req-8cc5b5d4-22f6-49c0-8d88-951b574c041b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:44.506220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:44.520422 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a6f99930-c98d-4e91-a78d-86136d3169b2 req-8cc5b5d4-22f6-49c0-8d88-951b574c041b service nova] Creating event network-changed:8c7e9c5d-6893-4687-971f-af5eb2b21481 for instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 on n-h1-master-1 Sep 18 01:08:44.520981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:44.529241 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a6f99930-c98d-4e91-a78d-86136d3169b2 req-8cc5b5d4-22f6-49c0-8d88-951b574c041b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068709 Sep 18 01:08:44.530489 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 925/1888] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:44.534725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:44.537442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:44.541721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:44.544796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:44.547496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bcbd50f0-577d-46e5-b0f6-3bc75c3c69e4 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f70061365e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:44.547830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:44.548464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:44.593527 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bcbd50f0-577d-46e5-b0f6-3bc75c3c69e4 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455381822" status: 204 len: 0 microversion: 2.2 time: 0.061601 Sep 18 01:08:44.594446 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 926/1889] 10.222.0.25 () {60 vars in 1258 bytes} [Sun Sep 18 01:08:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455381822 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:44.608733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80c3c5b2-3159-40a0-9335-b48708a7cd88 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f7005e4e310>, body: {"keypair": {"name": "tempest-keypair-455651617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf962I7U905Qzwvnnz3Rqcyhfk/t5itBSfERcqcQ1A5QA9jYvbK8u/V93/xV1vD4Ep1kLPPmec4kU3Ssd6hiPslLLUVwqgxtwbNdppbHf5MHxZZgXRVpLV5E6rfcIM4RQ=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:44.650454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-80c3c5b2-3159-40a0-9335-b48708a7cd88 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:44.659291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-80c3c5b2-3159-40a0-9335-b48708a7cd88 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:44.715832 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80c3c5b2-3159-40a0-9335-b48708a7cd88 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.113747 Sep 18 01:08:44.717047 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 927/1890] 10.222.0.25 () {62 vars in 1199 bytes} [Sun Sep 18 01:08:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:08:44.722020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:44.723043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:44.740365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:44.741176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:44.741841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:44.742758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:44.743403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:44.744023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:45.119514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:45.128314 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-247eb165-cb17-4bd0-b468-fb2b948742d5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.636657 Sep 18 01:08:45.136789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 964/1891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:44 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:45.154001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ea2c9eec-2454-4723-9b4c-381dfe3e6bc2 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f700a82db80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:45.192431 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ea2c9eec-2454-4723-9b4c-381dfe3e6bc2 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455651617" status: 204 len: 0 microversion: 2.2 time: 0.054004 Sep 18 01:08:45.193660 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 965/1892] 10.222.0.25 () {60 vars in 1258 bytes} [Sun Sep 18 01:08:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455651617 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:45.200340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:45.208824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:45.218740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:45.220105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:45.221062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:45.223591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:45.224610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:45.225533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:45.516709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:45.524959 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2779228d-8a73-488c-9ddf-ec92a25e7834 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.806582 Sep 18 01:08:45.527381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 928/1893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:44 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:45.532927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3460f546-52b8-4dd2-b060-226950b37613 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f7005e5ab80>, body: {"keypair": {"name": "tempest-keypair-1804404419", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:45.587619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3460f546-52b8-4dd2-b060-226950b37613 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:45.612051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3460f546-52b8-4dd2-b060-226950b37613 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:45.674562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:45.679666 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3460f546-52b8-4dd2-b060-226950b37613 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.150691 Sep 18 01:08:45.680943 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 929/1894] 10.222.0.25 () {62 vars in 1199 bytes} [Sun Sep 18 01:08:45 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:08:45.686179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:45.687152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:45.704651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:45.706920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:45.717904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:45.719228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:45.720173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:45.721823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:45.722883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:45.723561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:45.729767 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2312f904-73ac-4bc8-b2f7-c1502cba4911 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1293 microversion: 2.25 time: 0.528944 Sep 18 01:08:45.731281 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 966/1895] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:45 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1293 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:45.757384 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:45.767834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:45.795403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:45.796172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:45.796780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:45.798071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:45.802452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:45.804292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:46.384134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:46.404302 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f391ccce-26ee-47c6-8b2f-42f5b91eb7b8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.650741 Sep 18 01:08:46.405496 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 967/1896] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:45 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:46.420881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a175a2a-c067-479a-b77b-1db62b7bcebb tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f700a7d69d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:46.442585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:46.452023 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-74033e51-d099-42ac-a809-bc4749dc1975 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.769065 Sep 18 01:08:46.452603 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 930/1897] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:45 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:46.469139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:46.475367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:46.495378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a175a2a-c067-479a-b77b-1db62b7bcebb tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804404419" status: 204 len: 0 microversion: 2.2 time: 0.088787 Sep 18 01:08:46.495724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:46.496306 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 968/1898] 10.222.0.25 () {60 vars in 1261 bytes} [Sun Sep 18 01:08:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804404419 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:46.498246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:46.502099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:46.503131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:46.503788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:46.505913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:46.521403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e84c2826-c983-4e5d-abe7-412090a3e56c tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f7005ef9c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-973473996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr3kF8oPlxPdLxJ85RKflfCPUR9zqFO8JRcAlrIK069uXQOzm1I6uVWXvTpgGAgwhqLVG2s0p8eVGr+V0gq1OfyuUuTKBOoaEUiv2R3gV3fL52nwSvpt75+WYNMsO88QQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:46.565511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-e84c2826-c983-4e5d-abe7-412090a3e56c tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:46.579450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-e84c2826-c983-4e5d-abe7-412090a3e56c tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:46.641141 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e84c2826-c983-4e5d-abe7-412090a3e56c tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.124102 Sep 18 01:08:46.642120 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 969/1899] 10.222.0.25 () {62 vars in 1199 bytes} [Sun Sep 18 01:08:46 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 18 01:08:46.649594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:46.652818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:46.672759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:46.673966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:46.674666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:46.679395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:46.681208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:46.683355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:47.147844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:47.173745 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b86634a6-efa7-4728-92a6-db2f69bba7a4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.711936 Sep 18 01:08:47.174414 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 931/1900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:46 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:47.181506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:47.200550 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60682a84-85fa-41b9-8e31-60ae716e754b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.554220 Sep 18 01:08:47.202771 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 970/1901] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:46 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:47.206174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0201e44c-b614-4494-802c-91abf578abc8 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f7005f22310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-673825662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZSWshARZj6Bw/wXVxuLKeGWt4pEOAyLz4BqxYu1x4EVr2M2PClm8x/JJKMaPqawPmCtKGBZO6VZJmuSJ6vay8vJ+Eb6h5kec1OtihgmnC6XK83Wq0orCea29qyzmA76w=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:47.221586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:47.222727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:47.233682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:47.236104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:47.236855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:47.259379 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=29 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:47.261122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:47.261736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:47.266857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:47.271051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0201e44c-b614-4494-802c-91abf578abc8 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:47.289803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0201e44c-b614-4494-802c-91abf578abc8 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:47.382525 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0201e44c-b614-4494-802c-91abf578abc8 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.204781 Sep 18 01:08:47.393923 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 932/1902] 10.222.0.25 () {62 vars in 1199 bytes} [Sun Sep 18 01:08:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 219 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:08:47.400726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2db97df2-505f-424c-b6e2-2363b2a5da36 req-aa2bf0de-8d9b-4543-8f11-5451ddfd4a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064f68b3-f5c5-4502-a482-f4e4cd1b21bd", "tag": "79332c33-faac-419d-916c-9c2a289ab135"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:47.434046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2db97df2-505f-424c-b6e2-2363b2a5da36 req-aa2bf0de-8d9b-4543-8f11-5451ddfd4a42 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:47.435249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2db97df2-505f-424c-b6e2-2363b2a5da36 req-aa2bf0de-8d9b-4543-8f11-5451ddfd4a42 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:47.436887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2db97df2-505f-424c-b6e2-2363b2a5da36 req-aa2bf0de-8d9b-4543-8f11-5451ddfd4a42 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:47.507568 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2db97df2-505f-424c-b6e2-2363b2a5da36 req-aa2bf0de-8d9b-4543-8f11-5451ddfd4a42 service nova] Creating event network-changed:79332c33-faac-419d-916c-9c2a289ab135 for instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd on n-h1-master-1 Sep 18 01:08:47.559926 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2db97df2-505f-424c-b6e2-2363b2a5da36 req-aa2bf0de-8d9b-4543-8f11-5451ddfd4a42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163974 Sep 18 01:08:47.564205 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 933/1903] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:47.604854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-44f7c744-61c3-4a50-a399-1ef206383b3d tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f7005e4a430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-503625737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB90ndQkFrG8qJ6ZAhClIv7mUW/vhpE/f+eBYxuDevDKfZ+9dx5YnD5KpZx3gXNgvmAcjVqWUPMQzUJ1ZmwRK/X6gg6d9NFLvCALjsDloLVkLdeTTWlDr12cZQz3UnBUXg=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:47.625267 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:47.645512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:47.658424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-44f7c744-61c3-4a50-a399-1ef206383b3d tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:47.687574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:47.699401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-44f7c744-61c3-4a50-a399-1ef206383b3d tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:47.707994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:47.709343 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee575da8-f632-42bb-8b4a-82f6aa85804f tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1293 microversion: 2.25 time: 0.504773 Sep 18 01:08:47.710368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 971/1904] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:47 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1293 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:47.729052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:47.731607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:47.740504 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:47.754118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:47.755726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:47.757482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:47.760033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:47.761431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:47.764269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:47.780823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-44f7c744-61c3-4a50-a399-1ef206383b3d tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.208451 Sep 18 01:08:47.782796 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 934/1905] 10.222.0.25 () {62 vars in 1199 bytes} [Sun Sep 18 01:08:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:08:47.809646 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:47.818592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:47.823002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:47.854024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:47.855047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:47.858865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:47.861241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:47.863879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:47.865046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.129950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:48.143093 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93c2b2f2-76b7-4eb0-ae9e-f7a4de8b2232 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.426104 Sep 18 01:08:48.146701 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 972/1906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:47 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:48.174545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-149baa1e-6a4c-47e0-bdd3-845089666f32 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f700a7c9d30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.205181 n-d-master-1 devstack@n-api.service[122374]: WARNING oslo_db.sqlalchemy.utils [None req-149baa1e-6a4c-47e0-bdd3-845089666f32 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 18 01:08:48.230292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:48.232254 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-149baa1e-6a4c-47e0-bdd3-845089666f32 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.079563 Sep 18 01:08:48.238691 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 973/1907] 10.222.0.25 () {60 vars in 1177 bytes} [Sun Sep 18 01:08:48 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:48.244343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.245299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:48.249794 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d94b75a-febe-4917-95c7-d797ec0fb310 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.454713 Sep 18 01:08:48.251310 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 935/1908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:47 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:48.262905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.266408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:48.275684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.276602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.277290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.281108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.282649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.283976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.288033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.289044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.289854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.294184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.294683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.295126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.364670 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:48.533757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:48.548165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26664451-dded-49cb-ac1f-373a64701ea9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.307656 Sep 18 01:08:48.550164 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 974/1909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:48 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:48.559943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd13509e-3a5f-4ddc-9e86-f04f07c9135c tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f7005e69790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.583233 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd13509e-3a5f-4ddc-9e86-f04f07c9135c tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-503625737" status: 204 len: 0 microversion: 2.2 time: 0.031143 Sep 18 01:08:48.584371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 975/1910] 10.222.0.25 () {60 vars in 1318 bytes} [Sun Sep 18 01:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-503625737 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:48.592591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-41b89b86-26af-462c-9b52-770c83f02b5a req-7064c134-606e-4d95-80c4-d2fe0bc05c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc4a839-803a-4ab3-a83e-9445e11c779f", "name": "network-vif-plugged", "status": "completed", "tag": "cf1ea48f-7e0e-4db6-a6c8-f6fbb05cbbdf"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:48.605408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41b89b86-26af-462c-9b52-770c83f02b5a req-7064c134-606e-4d95-80c4-d2fe0bc05c57 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.606593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41b89b86-26af-462c-9b52-770c83f02b5a req-7064c134-606e-4d95-80c4-d2fe0bc05c57 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.608584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41b89b86-26af-462c-9b52-770c83f02b5a req-7064c134-606e-4d95-80c4-d2fe0bc05c57 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.625846 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-41b89b86-26af-462c-9b52-770c83f02b5a req-7064c134-606e-4d95-80c4-d2fe0bc05c57 service nova] Creating event network-vif-plugged:cf1ea48f-7e0e-4db6-a6c8-f6fbb05cbbdf for instance 5dc4a839-803a-4ab3-a83e-9445e11c779f on n-h2-master-1 Sep 18 01:08:48.629349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:48.638473 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80f9eaed-e3f8-4c78-99ad-4c6aa80db32b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.385659 Sep 18 01:08:48.653596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-41b89b86-26af-462c-9b52-770c83f02b5a req-7064c134-606e-4d95-80c4-d2fe0bc05c57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053746 Sep 18 01:08:48.653596 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 976/1911] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:48.653596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fcec6c7e-8349-4b67-938f-ee5ddfb287eb tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f700a7814c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.657246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 936/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:48 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:48.674418 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fcec6c7e-8349-4b67-938f-ee5ddfb287eb tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-673825662" status: 204 len: 0 microversion: 2.2 time: 0.032452 Sep 18 01:08:48.675520 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 977/1913] 10.222.0.25 () {60 vars in 1318 bytes} [Sun Sep 18 01:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-673825662 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:48.687245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78bf12c4-d6d8-4a08-9ea9-d1dffe6be446 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f7005e559d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.730083 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78bf12c4-d6d8-4a08-9ea9-d1dffe6be446 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-973473996" status: 204 len: 0 microversion: 2.2 time: 0.049490 Sep 18 01:08:48.738275 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 937/1914] 10.222.0.25 () {60 vars in 1318 bytes} [Sun Sep 18 01:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-973473996 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:48.745631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-654d3cbc-9e32-479f-816d-8ffe0c6f8ce3 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f700a7c9550>, body: {"keypair": {"name": "tempest-keypair-988166182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuT6fucRVQVb2HCHZkCRDUUp+sTsO9mE5K0+zBPKjqxgDMwHF6D0dDSU7lTr8U2tvjYA8WTzn7DjQY2BR6y61TFcV4p5H8QsxdV2jTgkPV/pwVgdPerAR5gQQ77a/CevQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:48.747951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.748643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:48.756256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.757226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.757693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.758559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.759318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.759809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.769737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-654d3cbc-9e32-479f-816d-8ffe0c6f8ce3 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:48.774461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-654d3cbc-9e32-479f-816d-8ffe0c6f8ce3 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:48.821966 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-654d3cbc-9e32-479f-816d-8ffe0c6f8ce3 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.081241 Sep 18 01:08:48.824050 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 978/1915] 10.222.0.25 () {62 vars in 1199 bytes} [Sun Sep 18 01:08:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:08:48.834651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:48.836319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:48.857225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.857972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.858841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.860208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:48.862896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:48.863876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:48.912236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:08:49.040629 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-beac8f8b-4193-4406-b24a-f0b8c3ecf3fb tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 204 len: 0 microversion: 2.1 time: 0.213901 Sep 18 01:08:49.041868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:49.045327 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 979/1916] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:08:48 2022] DELETE /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:49.054781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61fbe990-7bec-4f5a-8eca-91edce089904 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f7006633430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:49.055711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:49.057408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:49.059278 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d54a12d3-d3e2-423e-a4d4-08423153f734 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.315488 Sep 18 01:08:49.060287 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 938/1917] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:48 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:08:49.068798 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61fbe990-7bec-4f5a-8eca-91edce089904 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-988166182" status: 200 len: 512 microversion: 2.2 time: 0.019566 Sep 18 01:08:49.070615 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 980/1918] 10.222.0.25 () {60 vars in 1255 bytes} [Sun Sep 18 01:08:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-988166182 => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:49.080614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:49.080614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:49.089907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.091767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.091767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.091767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.092278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.092831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.098496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6aedc138-c2e4-4161-8874-34e0593aafe4 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f7005ede4c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:49.103750 n-d-master-1 devstack@n-api.service[122374]: WARNING oslo_db.sqlalchemy.utils [None req-6aedc138-c2e4-4161-8874-34e0593aafe4 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 18 01:08:49.111680 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6aedc138-c2e4-4161-8874-34e0593aafe4 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.025619 Sep 18 01:08:49.113593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 981/1919] 10.222.0.25 () {60 vars in 1177 bytes} [Sun Sep 18 01:08:49 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:49.142452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d9c280c-fbf9-4650-8b7b-6c36bb6b4bc5 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f7005e61f70>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:49.166206 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d9c280c-fbf9-4650-8b7b-6c36bb6b4bc5 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988166182" status: 204 len: 0 microversion: 2.2 time: 0.044508 Sep 18 01:08:49.167038 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 982/1920] 10.222.0.25 () {60 vars in 1258 bytes} [Sun Sep 18 01:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988166182 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:49.176770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:49.177543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:49.185518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.186838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.188248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.188248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.188518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.188855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.377206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:49.391144 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-617431d1-bd56-4971-839c-9430e029b63c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1667 microversion: 2.1 time: 0.329160 Sep 18 01:08:49.425836 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 939/1921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:49 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1667 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:49.439478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Action: 'create', calling method: .version_select at 0x7f700a7dde50>, body: {"keypair": {"name": "tempest-keypair-1102876075", "type": "x509"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:49.480438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:49.505215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:49.520721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:49.524372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.processutils [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp649i1ug0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp649i1ug0/temp.key -subj /CN=873a7c8b145440f483e6a55bdbc349a5 -extensions v3_req_client {{(pid=122373) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 18 01:08:49.534603 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed96ed0d-2797-4456-9c1e-818420bace68 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.365734 Sep 18 01:08:49.535698 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 983/1922] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:49 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:49.539989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:49.540751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:49.564167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.564681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.565213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.565968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.566437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.567470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.775832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:49.788131 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-423d3464-f712-4489-8e1b-ba63acbf90ff tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.251782 Sep 18 01:08:49.797815 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 984/1923] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:49 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:49.797815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:49.797815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:49.821666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.822170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.822609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.827155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:49.827642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:49.828074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:49.905318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.processutils [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp649i1ug0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp649i1ug0/temp.key -subj /CN=873a7c8b145440f483e6a55bdbc349a5 -extensions v3_req_client" returned: 0 in 0.380s {{(pid=122373) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 18 01:08:49.907037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.processutils [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp649i1ug0/temp.key -password pass: {{(pid=122373) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 18 01:08:49.934848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.processutils [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp649i1ug0/temp.key -password pass:" returned: 0 in 0.027s {{(pid=122373) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 18 01:08:49.986201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:08:49.990951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Getting quotas for user 873a7c8b145440f483e6a55bdbc349a5 and project 22820754c52946ed8f3202a270344b7e. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:08:50.004111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:50.010238 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ede41c2b-3dd8-4405-8f20-8dc215f84632 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.583014 Sep 18 01:08:50.012841 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 940/1924] 10.222.0.25 () {62 vars in 1198 bytes} [Sun Sep 18 01:08:49 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 586 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:50.018320 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-87be92b0-e733-405c-b9bd-8addadec1c34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.224989 Sep 18 01:08:50.019359 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 985/1925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:49 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:50.023960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.025287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:50.040546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-830022ac-f5cd-43d1-b2d7-9e8bc0651986 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f700635c8b0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.043642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.044314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.044832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.045735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.046266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.046854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.051827 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-830022ac-f5cd-43d1-b2d7-9e8bc0651986 tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1102876075" status: 200 len: 1534 microversion: 2.2 time: 0.018837 Sep 18 01:08:50.052641 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 986/1926] 10.222.0.25 () {60 vars in 1258 bytes} [Sun Sep 18 01:08:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1102876075 => generated 1534 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:50.070249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0fdc9e0b-a1c6-46c7-97bb-fed064da769e tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f7005e61af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.075726 n-d-master-1 devstack@n-api.service[122374]: WARNING oslo_db.sqlalchemy.utils [None req-0fdc9e0b-a1c6-46c7-97bb-fed064da769e tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 18 01:08:50.082934 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0fdc9e0b-a1c6-46c7-97bb-fed064da769e tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.017804 Sep 18 01:08:50.083813 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 987/1927] 10.222.0.25 () {60 vars in 1177 bytes} [Sun Sep 18 01:08:50 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:50.095101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.096114 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:50.105361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.106054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.106629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.107697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.108530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.109037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.319618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:50.335271 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09b834d0-d1ef-430c-8efb-049f504c9d96 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.320643 Sep 18 01:08:50.348320 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 941/1928] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:50 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:50.353615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:50.362261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a56b6600-288b-4aa1-9dbc-ddb1a0b6949e tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] Calling method '.version_select at 0x7f7005f223a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.363720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:50.365187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:50.366359 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b3a6bce-795c-4daf-9235-349c2c7a40ba tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.276073 Sep 18 01:08:50.366927 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 988/1929] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:50 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:50.411233 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:50.425792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.427133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:50.433101 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a56b6600-288b-4aa1-9dbc-ddb1a0b6949e tempest-KeyPairsV22TestJSON-1412066817 tempest-KeyPairsV22TestJSON-1412066817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102876075" status: 204 len: 0 microversion: 2.2 time: 0.080956 Sep 18 01:08:50.439103 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 942/1930] 10.222.0.25 () {60 vars in 1261 bytes} [Sun Sep 18 01:08:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102876075 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:50.440488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.442053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.442756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.443819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.444615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.446229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.558737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.559926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:50.580181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.581247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.584216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.586277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.587676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.590005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.655480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:50.672692 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b90815e1-2bac-49fd-8d53-c9094af821e5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1667 microversion: 2.1 time: 0.252820 Sep 18 01:08:50.681639 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 989/1931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:50 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1667 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:08:50.815396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:50.816286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:50.824795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.825501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.826127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.826954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:50.827487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:50.827992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:50.866071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:50.887014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d42c1c9c-dc8c-4a35-bc32-6d4b95e5edd6 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.332022 Sep 18 01:08:50.888997 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 943/1932] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:50 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:08:51.054359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:51.055289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:51.069792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.070940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.072281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.074390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.075576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.076742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.088821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:51.109811 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d93f2f5c-8f49-40c6-8797-c3370de23e3c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.298689 Sep 18 01:08:51.112651 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 990/1933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:50 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:51.307109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:51.325658 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7f875ab-dfcf-4ec8-b523-6e9c57197b6e tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.274474 Sep 18 01:08:51.329206 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 944/1934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:51 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:51.368554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:51.369865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:51.382918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.383784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.384444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.388405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.390569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.395621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.409060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:51.409708 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:51.422099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.423122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.423281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.424492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.424959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.428971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.822674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:51.838624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:51.850585 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-86be3a07-5993-4936-8390-33b340a808a4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.486600 Sep 18 01:08:51.853760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:51.856833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:51.859157 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 991/1935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:51 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:51.864477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0250959c-805c-46bd-b82f-13bdaf043eb0 req-fc6855c7-f262-4409-8f61-c1d6b2269a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffa04fb-a41d-4238-b151-0a0252aaf8c0", "name": "network-vif-plugged", "status": "completed", "tag": "8c7e9c5d-6893-4687-971f-af5eb2b21481"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:51.877683 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d352ba06-99b1-42e1-9e5d-69cd87e22b18 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.472613 Sep 18 01:08:51.884055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0250959c-805c-46bd-b82f-13bdaf043eb0 req-fc6855c7-f262-4409-8f61-c1d6b2269a5e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.884926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0250959c-805c-46bd-b82f-13bdaf043eb0 req-fc6855c7-f262-4409-8f61-c1d6b2269a5e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.885632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0250959c-805c-46bd-b82f-13bdaf043eb0 req-fc6855c7-f262-4409-8f61-c1d6b2269a5e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.899198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 945/1936] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:51 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:08:51.899896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:51.900099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:51.909119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.909927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.910556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.911440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.912171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.912768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.918612 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0250959c-805c-46bd-b82f-13bdaf043eb0 req-fc6855c7-f262-4409-8f61-c1d6b2269a5e service nova] Creating event network-vif-plugged:8c7e9c5d-6893-4687-971f-af5eb2b21481 for instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 on n-h1-master-1 Sep 18 01:08:51.927368 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0250959c-805c-46bd-b82f-13bdaf043eb0 req-fc6855c7-f262-4409-8f61-c1d6b2269a5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065569 Sep 18 01:08:51.928598 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 992/1937] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:51.937531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:51.940138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:51.949435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.949970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.952989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:51.953858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:51.954335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:51.954778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:52.354803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:52.375168 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7439c37-01bd-426e-9fe9-7954a9977e18 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1667 microversion: 2.1 time: 0.481364 Sep 18 01:08:52.375910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:52.376929 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 946/1938] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:51 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1667 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:52.388394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:52.389466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:52.398689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:52.399642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:52.400266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:52.401201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:52.401977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:52.402553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:52.423255 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1192acb0-caa4-44af-937e-062a9efe7739 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.491894 Sep 18 01:08:52.424838 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 993/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:51 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:52.434136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:52.435442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:52.449649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:52.453956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:52.455088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:52.459162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:52.462894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:52.464034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.260386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:53.269744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:53.281798 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f2b6a218-5b3b-4402-9ba5-921b2927c0ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.853815 Sep 18 01:08:53.283769 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-41346701-87f5-4e4a-9629-5c56d150e646 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.904672 Sep 18 01:08:53.288605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 947/1940] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:52 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:53.296370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:53.297380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:53.322900 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 994/1941] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:52 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:53.334863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.337121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.339101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.340778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.345332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.347188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.351810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:53.353191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:53.375149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.375644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.376079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.386333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.386858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.402672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.842017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:53.850940 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e70e18e0-64ca-43d5-8ae5-287d39f12cad tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.560481 Sep 18 01:08:53.851529 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 948/1942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:53 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:53.861024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-38dff150-f679-402c-84d5-89201314048a req-6e5eea7a-16f3-419a-b56d-36e5a8ae5bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ff9e6d-5612-447a-b317-dd1e6f1324b3", "name": "network-vif-deleted", "tag": "b7e00281-7e7f-4aed-af4e-b7dd24f7147a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:53.871385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-38dff150-f679-402c-84d5-89201314048a req-6e5eea7a-16f3-419a-b56d-36e5a8ae5bd6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.871863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-38dff150-f679-402c-84d5-89201314048a req-6e5eea7a-16f3-419a-b56d-36e5a8ae5bd6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.872287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-38dff150-f679-402c-84d5-89201314048a req-6e5eea7a-16f3-419a-b56d-36e5a8ae5bd6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.880756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:53.889511 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-38dff150-f679-402c-84d5-89201314048a req-6e5eea7a-16f3-419a-b56d-36e5a8ae5bd6 service nova] Creating event network-vif-deleted:b7e00281-7e7f-4aed-af4e-b7dd24f7147a for instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 on n-h1-master-1 Sep 18 01:08:53.891749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:53.895804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-38dff150-f679-402c-84d5-89201314048a req-6e5eea7a-16f3-419a-b56d-36e5a8ae5bd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042629 Sep 18 01:08:53.896807 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 949/1943] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:53.900876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:53.902068 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8fb53eb3-24fc-4e10-9ea2-106b25ed9303 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.574603 Sep 18 01:08:53.902624 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 995/1944] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:53 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:53.902784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:53.903608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:53.910970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.911692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.912300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.913740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.915027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.916289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.968383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:53.969652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:53.970499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:53.971239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lazy-loading 'fault' on Instance uuid f5ff9e6d-5612-447a-b317-dd1e6f1324b3 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:08:54.106456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:54.125141 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f27f3ec4-b5df-46e9-a632-b07c0471d606 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1324 microversion: 2.1 time: 0.226814 Sep 18 01:08:54.126268 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 950/1945] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:53 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1324 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:54.132401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b2ce5e34-540c-4dc9-a909-a86a663bb194 req-e1a44da1-5843-48f6-a20f-d6ce6728707b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "name": "network-vif-plugged", "status": "completed", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:54.144497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b2ce5e34-540c-4dc9-a909-a86a663bb194 req-e1a44da1-5843-48f6-a20f-d6ce6728707b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.145275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b2ce5e34-540c-4dc9-a909-a86a663bb194 req-e1a44da1-5843-48f6-a20f-d6ce6728707b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.146499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b2ce5e34-540c-4dc9-a909-a86a663bb194 req-e1a44da1-5843-48f6-a20f-d6ce6728707b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.160760 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b2ce5e34-540c-4dc9-a909-a86a663bb194 req-e1a44da1-5843-48f6-a20f-d6ce6728707b service nova] Creating event network-vif-plugged:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h2-master-1 Sep 18 01:08:54.167583 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b2ce5e34-540c-4dc9-a909-a86a663bb194 req-e1a44da1-5843-48f6-a20f-d6ce6728707b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039036 Sep 18 01:08:54.168792 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 951/1946] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:54.266736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:54.267351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:54.276543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.276543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.276543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.278330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.278498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.278859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.314227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:54.315681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:54.327401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.328206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.328823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.329758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.331584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.332203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.744041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:54.756074 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-09ea279c-d1fa-450f-9cde-b692b1d789ec tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.847087 Sep 18 01:08:54.773646 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 996/1947] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:53 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:54.775579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:54.785039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:54.786468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:54.792851 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bc0d21a0-6219-4bb9-9f6b-6d955b6b6ad9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.482297 Sep 18 01:08:54.808109 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 952/1948] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:54 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:54.808466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.808466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.808466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.808466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.808466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.808466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.880543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:54.883010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:54.902500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.905991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.908389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:54.911434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:54.912837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:54.915518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.200595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:55.205190 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:55.212111 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae08cc44-623a-4a44-bd11-4fb76864de35 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.434545 Sep 18 01:08:55.213495 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 997/1949] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:54 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:55.219449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:55.220473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:55.228063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.228938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.229656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.230663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.231368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.232029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.298760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:55.309600 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b53db7f-5fc2-447c-975f-b1b21e9ae31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.436382 Sep 18 01:08:55.322548 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 953/1950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:54 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:08:55.333613 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:55.334248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:55.345754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.346577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.347217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.348156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.348803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.349430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.389514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.390326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.391026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.391676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lazy-loading 'fault' on Instance uuid f5ff9e6d-5612-447a-b317-dd1e6f1324b3 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:08:55.494714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:55.510635 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03e6d257-83ec-43f6-9ec3-fb49ecb540c8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 200 len: 1324 microversion: 2.1 time: 0.186046 Sep 18 01:08:55.511567 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 954/1951] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:55 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:55.745837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:55.765283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:55.769177 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:55.772643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9eb785f9-a27d-43e9-9530-fc8a2beb736d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.557546 Sep 18 01:08:55.773899 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 998/1952] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:55 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:55.782902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:55.783728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:55.794023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.795582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.796219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.798379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.799107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.799885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.824022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:55.824723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:55.837367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.837915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.838355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:55.839073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:55.839530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:55.839962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.211537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:56.242672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-616afc86-3bf0-4cd1-811a-fdfa40b79ade tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1313 microversion: 2.1 time: 0.463598 Sep 18 01:08:56.248949 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 955/1953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:55 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:08:56.271834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c3a4d98b-1965-4ddc-89c9-3540807e9836 req-da94a8d7-ed5b-482e-be3c-03d63f53eeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064f68b3-f5c5-4502-a482-f4e4cd1b21bd", "name": "network-vif-plugged", "status": "completed", "tag": "79332c33-faac-419d-916c-9c2a289ab135"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:56.296552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c3a4d98b-1965-4ddc-89c9-3540807e9836 req-da94a8d7-ed5b-482e-be3c-03d63f53eeb1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.298563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c3a4d98b-1965-4ddc-89c9-3540807e9836 req-da94a8d7-ed5b-482e-be3c-03d63f53eeb1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.299698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c3a4d98b-1965-4ddc-89c9-3540807e9836 req-da94a8d7-ed5b-482e-be3c-03d63f53eeb1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.336742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:56.350929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-931d200c-0a51-485e-90e9-7b326ca5fa03 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.533548 Sep 18 01:08:56.351781 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 999/1954] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:55 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:08:56.361292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:56.365857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:56.376707 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c3a4d98b-1965-4ddc-89c9-3540807e9836 req-da94a8d7-ed5b-482e-be3c-03d63f53eeb1 service nova] Creating event network-vif-plugged:79332c33-faac-419d-916c-9c2a289ab135 for instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd on n-h1-master-1 Sep 18 01:08:56.380176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.380851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.382161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.384482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.386134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.386816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.393617 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c3a4d98b-1965-4ddc-89c9-3540807e9836 req-da94a8d7-ed5b-482e-be3c-03d63f53eeb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142417 Sep 18 01:08:56.394791 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 956/1955] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:08:56.417598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:56.426524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:56.440818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.442220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.443268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.444716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.445477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.446217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.547105 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:56.791417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:56.806839 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e6c7cb3-d27d-47e9-a183-4849f4073a0b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.451914 Sep 18 01:08:56.808688 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1000/1956] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:56 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:56.817010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:56.818717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: f5ff9e6d-5612-447a-b317-dd1e6f1324b3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:56.833444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.834862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.835333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.836064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.836536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.837102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.840413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:56.859242 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f68b5b36-b2fe-4bc6-a53c-7a8b53444fbc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.455592 Sep 18 01:08:56.863187 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 957/1957] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:56 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:56.892272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:56.892913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:56.896313 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] HTTP exception thrown: Instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 could not be found. Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Request method failure captured: Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 HTTP/1.1 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm3RkI8XLc52DjnjcakjWVh_PEBgoUxYNUlnb5juwL8f52vGg8jCDJBQQfNA66vQG7HOK56QkzWdq4cmM_MvvBedWgr_gUUpVy30ziRQq9tO16aJYN2YkV4ouK_3JlAbzMO1sLyMKLcaPIvoAmMAZWeQzTuh7kf_jDd5MIr9nVdo_e0 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-LiveMigrationTest-1016262571 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-LiveMigrationTest-1016262571-project Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: cf8f60e6d52b498c90dd1ace5418ae13 Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-LiveMigrationTest-1016262571-project Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: exception: Instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 could not be found. Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'f5ff9e6d-5612-447a-b317-dd1e6f1324b3'} Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 could not be found. Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 could not be found. Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:08:56.907992 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 could not be found. Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:08:56.913186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Returning 404 to user: Instance f5ff9e6d-5612-447a-b317-dd1e6f1324b3 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:08:56.914879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.915062 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0f3822b7-b3ce-4603-bb68-d67a75a8c886 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3" status: 404 len: 111 microversion: 2.1 time: 0.099817 Sep 18 01:08:56.915226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.915226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.915226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:56.915226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:56.917490 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1001/1958] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:56 2022] GET /compute/v2.1/servers/f5ff9e6d-5612-447a-b317-dd1e6f1324b3 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:08:56.921920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:56.923314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cde42996-290a-41fa-93e1-d5794cc6f424 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '.version_select at 0x7f700a7c9e50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:56.965081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cde42996-290a-41fa-93e1-d5794cc6f424 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441990173" status: 202 len: 0 microversion: 2.1 time: 0.046237 Sep 18 01:08:56.966491 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1002/1959] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441990173 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:08:57.238871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:57.272630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:57.276400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:57.282488 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-28e65984-ce71-4678-a559-8d5f4fba1c8e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.417876 Sep 18 01:08:57.285467 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 958/1960] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:56 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:57.299789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:57.302411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:57.325845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:57.327004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:57.330383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:57.330383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:57.330383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:57.330383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:57.405970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:57.410687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:57.429770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:57.430530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:57.431161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:57.432655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:57.433430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:57.437002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:58.198280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:58.222283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26dd4280-9d1d-4b70-a22e-d07a6b6dd0d1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1462 microversion: 2.1 time: 0.936172 Sep 18 01:08:58.234117 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1003/1961] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:57 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1462 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:58.243941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:58.245292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:58.261149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:58.262376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:58.263425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:58.265208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:58.266307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:58.267300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:58.352392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:58.368018 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9b9384bb-6b79-4411-9b6d-bf5e4497854c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1321 microversion: 2.1 time: 0.970835 Sep 18 01:08:58.380284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 959/1962] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:57 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1321 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:58.407293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:58.410055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:58.423332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:58.426640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:58.427229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:58.428992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:58.429813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:58.432592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:58.786479 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:08:58.953416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:58.974617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:58.984442 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-35b70684-52e4-42d7-a015-606f775f17b1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.745656 Sep 18 01:08:58.985993 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-32cefae4-74d1-492b-bf8e-73536c61b31f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.593624 Sep 18 01:08:58.987444 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1004/1963] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:58 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:58.987801 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 960/1964] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:58 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:58.999062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:59.000846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:59.016241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.017018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.017468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.021818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.023794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.024242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.053970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:59.055228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:59.067238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.068095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.068927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.069977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.070617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.071246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.554792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:59.566134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:59.567597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:59.572818 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9e2acf48-3a7e-4e05-858b-943a5fb56f19 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.556804 Sep 18 01:08:59.577838 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1005/1965] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:08:59 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:08:59.585106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:59.586764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:59.600027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.600722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.601935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.602941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.603659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.604316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.632556 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a8fcf352-bcec-40c4-b678-3d940cc43d7d tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1613 microversion: 2.1 time: 0.642785 Sep 18 01:08:59.646635 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 961/1966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:58 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1613 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:59.659080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:59.664479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:59.675519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.677338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.682444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.683733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.684511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.685231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.728895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:08:59.896061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:08:59.913247 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56bc1e61-94bc-47c1-a5db-aad85e56f556 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1511 microversion: 2.1 time: 0.330734 Sep 18 01:08:59.915524 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1006/1967] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:59 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:08:59.916298 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d89b226-250d-4a9a-a463-dba883a86ca5 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 204 len: 0 microversion: 2.1 time: 0.262705 Sep 18 01:08:59.919883 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 962/1968] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:08:59 2022] DELETE /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:08:59.926393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:08:59.927637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:08:59.929175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:59.938321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:08:59.949984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.952219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.954493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.954879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.955425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.959453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.959969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.960638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.961339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.961619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:08:59.962705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:08:59.963679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:08:59.999069 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=15 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:00.032052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7440ddf0e81c427e891af0ff670ce460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445992bf3ef04a8e989aff66eba42917', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:00.036409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] flavor_id is None. Assuming migration. {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 18 01:09:00.042899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:09:00.212211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:00.223412 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26f253eb-b290-4a17-b627-3bc7a049e2d8 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1484 microversion: 2.1 time: 0.301753 Sep 18 01:09:00.224534 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 963/1969] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:08:59 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1484 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:00.234616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:00.235687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:00.244234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:00.244728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:00.245893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:00.247349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:00.249468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:00.251535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:00.647564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:00.658442 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d01a4c62-2e4b-4628-b419-ce7f2ff43c7d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1510 microversion: 2.1 time: 0.432581 Sep 18 01:09:00.672898 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 964/1970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:00 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1510 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:00.684394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:00.685582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:00.695161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:00.695959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:00.696589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:00.697474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:00.698122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:00.698712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:00.984452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:00.994052 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-17eeb74e-9e46-487f-9974-4090b8d96097 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.319688 Sep 18 01:09:00.995174 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 965/1971] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:00 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:01.001041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:01.001934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:01.009572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.010488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.011108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.012991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.014010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.014614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.201435 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8291014-9a54-434a-9cbe-c3d903c2c169 tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2/action" status: 202 len: 0 microversion: 2.1 time: 1.275047 Sep 18 01:09:01.203000 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1007/1972] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:08:59 2022] POST /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2/action => generated 0 bytes in 1286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:09:01.224307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c02b7139-bc77-4bdc-be24-87eba657c959 req-b90a00ff-953e-40ac-ad6d-62f6777ae6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188661e5-1bef-4e00-b59d-8def426eb404", "name": "network-vif-plugged", "status": "completed", "tag": "b344c9d6-d712-42e7-8ffc-b3a6a5b360f3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:01.264318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c02b7139-bc77-4bdc-be24-87eba657c959 req-b90a00ff-953e-40ac-ad6d-62f6777ae6a1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.265161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c02b7139-bc77-4bdc-be24-87eba657c959 req-b90a00ff-953e-40ac-ad6d-62f6777ae6a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.266060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c02b7139-bc77-4bdc-be24-87eba657c959 req-b90a00ff-953e-40ac-ad6d-62f6777ae6a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.273141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:01.285747 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-85134bc2-b057-4046-af13-b89481a94a31 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.289282 Sep 18 01:09:01.295846 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 966/1973] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:00 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:01.300271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c02b7139-bc77-4bdc-be24-87eba657c959 req-b90a00ff-953e-40ac-ad6d-62f6777ae6a1 service nova] Creating event network-vif-plugged:b344c9d6-d712-42e7-8ffc-b3a6a5b360f3 for instance 188661e5-1bef-4e00-b59d-8def426eb404 on n-h1-master-1 Sep 18 01:09:01.307632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:01.308422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:01.309726 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c02b7139-bc77-4bdc-be24-87eba657c959 req-b90a00ff-953e-40ac-ad6d-62f6777ae6a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101726 Sep 18 01:09:01.311419 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1008/1974] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:01.326105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:01.326621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.327120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.327559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:01.334677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.335506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.336561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.337389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.345396 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:01.352913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.355757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.357735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.361266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.363245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.364808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.699961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:01.730745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:01.740334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:01.741517 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40786254-55fe-49ac-8a75-80060a022ad2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1281 microversion: 2.25 time: 0.451082 Sep 18 01:09:01.750596 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 967/1975] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:01 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1281 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:01.761588 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:01.762251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:01.769899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.774478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.774786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.775510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.776039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.776410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.776616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:01.786241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ab786c3-1819-489e-8666-c7e2ae85ca8e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 200 len: 1510 microversion: 2.1 time: 0.472961 Sep 18 01:09:01.789680 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1009/1976] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:01 2022] GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:01.801187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:01.808939 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:01.826236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.826820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.827260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:01.828017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:01.828474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:01.828904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:02.297709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:02.298895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:02.312339 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-efdde812-5b56-437f-a7e0-899a51d9fa95 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1484 microversion: 2.1 time: 0.517209 Sep 18 01:09:02.327331 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1010/1977] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:01 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1484 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:02.329871 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e5828800-d4fa-49f8-92eb-0a5bf0f5824d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1471 microversion: 2.1 time: 0.577650 Sep 18 01:09:02.334962 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 968/1978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:01 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:02.346612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:02.350680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:02.351757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:02.353871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:02.355555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:02.370965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:02.371696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:02.372296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:02.373809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:02.374474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:02.376311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:02.398097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:02.399264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:02.400329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:02.401874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:02.403757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:02.406701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:02.650953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:02.891174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:02.903859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:02.913650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:02.914332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:03.654471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:03.685956 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6c8e109f-7e11-44d5-a742-185f95edfbd7 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 1.346752 Sep 18 01:09:03.686843 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 969/1979] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:02 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:03.701782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:03.710325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:03.723759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:03.724366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:03.724825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:03.725577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:03.726039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:03.726473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.163517 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1ae89369-684d-41f3-81f6-3b3d22b65551 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.834731 Sep 18 01:09:04.179305 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1011/1980] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 18 01:09:02 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:04.207912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:04.210293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:04.247919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.249401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.251513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.254621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.260296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.270993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.436182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:04.444775 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7e3fd1f6-deb1-484f-9b39-ca7a245cf692 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.756359 Sep 18 01:09:04.469078 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 970/1981] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:03 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:04.486989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:04.487717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:04.501816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.502674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.503387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.504309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.504958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.505722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.559016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.559953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.561315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.562066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lazy-loading 'fault' on Instance uuid 63c7b5a9-2058-4743-b221-e1a277fbff9a {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:09:04.686692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:04.721791 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d05d4bb-0dd3-42f1-822d-120a3545bce9 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 200 len: 1301 microversion: 2.1 time: 0.251328 Sep 18 01:09:04.723336 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 971/1982] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:04 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 1301 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:04.728363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:04.729502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:04.737032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.741730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.742396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.743306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.743938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.744532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.767463 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:04.777165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:04.802926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:04.805393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:04.809302 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56960c23-cf51-4679-abaf-5d3876265297 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1476 microversion: 2.25 time: 0.619394 Sep 18 01:09:04.811833 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1012/1983] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:04 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1476 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:04.824761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f278e66e-1b7e-4fc9-a87c-22744bb70c26 req-4d707acc-360a-44f6-a2d6-bfbfd9f9bcad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c7b5a9-2058-4743-b221-e1a277fbff9a", "name": "network-vif-deleted", "tag": "f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:04.850756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f278e66e-1b7e-4fc9-a87c-22744bb70c26 req-4d707acc-360a-44f6-a2d6-bfbfd9f9bcad service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.854329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f278e66e-1b7e-4fc9-a87c-22744bb70c26 req-4d707acc-360a-44f6-a2d6-bfbfd9f9bcad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.854833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f278e66e-1b7e-4fc9-a87c-22744bb70c26 req-4d707acc-360a-44f6-a2d6-bfbfd9f9bcad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.881310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f278e66e-1b7e-4fc9-a87c-22744bb70c26 req-4d707acc-360a-44f6-a2d6-bfbfd9f9bcad service nova] Creating event network-vif-deleted:f2b55d2b-9f3c-454b-9b55-9cfe3a0a3193 for instance 63c7b5a9-2058-4743-b221-e1a277fbff9a on n-h2-master-1 Sep 18 01:09:04.888962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f278e66e-1b7e-4fc9-a87c-22744bb70c26 req-4d707acc-360a-44f6-a2d6-bfbfd9f9bcad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074771 Sep 18 01:09:04.890172 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1013/1984] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:04.896725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:04.905328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:04.907008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1209650589', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:04.918665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.920187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.921088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:04.922324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:04.922933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:04.923598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:05.050271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:05.065503 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03c6f2e1-3afa-4975-b640-2421a2caa46f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1471 microversion: 2.1 time: 0.339441 Sep 18 01:09:05.066946 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 972/1985] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:04 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1471 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:05.191019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:05.303902 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:05.320391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:05.331684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:05.332496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:05.333332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:05.355557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-295bbbb2-dcb5-428b-9177-f7777e76dd35 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f700a7adf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2038005754", "description": "tempest-description-1022210817"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:05.663623 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-afafc691-57a3-40c4-891d-a6eeff058b00 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1209650589" status: 200 len: 1513 microversion: 2.1 time: 0.771947 Sep 18 01:09:05.664516 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1014/1986] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:09:04 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1209650589 => generated 1513 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:05.670159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:05.671730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:05.678421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:05.679298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:05.679999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:05.681035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:05.681762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:05.682423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:05.930008 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-295bbbb2-dcb5-428b-9177-f7777e76dd35 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.859914 Sep 18 01:09:05.934689 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 973/1987] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:09:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:06.014690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:06.043249 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e89c3cd-6b0c-4c83-a7b0-53a3bff2bf19 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.376984 Sep 18 01:09:06.044339 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1015/1988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:05 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:06.057856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:06.066546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:06.083188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.084678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.084888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.086753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.088154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.089565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.246185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:06.247165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:06.257482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.258077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.258466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.259223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.259679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.260471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.538281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:06.546631 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-634e4b37-5604-43f8-8612-6a149d567804 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.496623 Sep 18 01:09:06.547549 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1016/1989] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:06 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:06.552581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:06.559077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:06.560233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:06.568679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.569807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.570518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.571389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.572058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.572718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.699213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:06.791297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:06.793237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 188661e5-1bef-4e00-b59d-8def426eb404 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:09:06.807550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.811100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.811686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.818562 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-163ec347-4441-46d5-8b0d-eadefdffde34 tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1969 microversion: 2.25 time: 0.882154 Sep 18 01:09:06.819742 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 974/1990] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:05 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1969 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:06.826629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:06.827975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 63c7b5a9-2058-4743-b221-e1a277fbff9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:06.836893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.837708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.838445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.839347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:06.839985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:06.840598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:06.860785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] HTTP exception thrown: Instance 63c7b5a9-2058-4743-b221-e1a277fbff9a could not be found. Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Request method failure captured: Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a HTTP/1.1 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm3RkI8XLc52DjnjcakjWVh_PEBgoUxYNUlnb5juwL8f52vGg8jCDJBQQfNA66vQG7HOK56QkzWdq4cmM_MvvBedWgr_gUUpVy30ziRQq9tO16aJYN2YkV4ouK_3JlAbzMO1sLyMKLcaPIvoAmMAZWeQzTuh7kf_jDd5MIr9nVdo_e0 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-LiveMigrationTest-1016262571 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-LiveMigrationTest-1016262571-project Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cf8f60e6d52b498c90dd1ace5418ae13 Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-LiveMigrationTest-1016262571-project Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 63c7b5a9-2058-4743-b221-e1a277fbff9a could not be found. Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '63c7b5a9-2058-4743-b221-e1a277fbff9a'} Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c7b5a9-2058-4743-b221-e1a277fbff9a could not be found. Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c7b5a9-2058-4743-b221-e1a277fbff9a could not be found. Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:06.863318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:06.868935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:06.868935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:06.868935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:06.868935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:09:06.868935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:09:06.868935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c7b5a9-2058-4743-b221-e1a277fbff9a could not be found. Sep 18 01:09:06.868935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:06.872178 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Returning 404 to user: Instance 63c7b5a9-2058-4743-b221-e1a277fbff9a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:09:06.873863 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-38809501-e462-4e1f-a5fd-375e51c4ab59 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a" status: 404 len: 111 microversion: 2.1 time: 0.052958 Sep 18 01:09:06.874907 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 975/1991] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:06 2022] GET /compute/v2.1/servers/63c7b5a9-2058-4743-b221-e1a277fbff9a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:09:06.882907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eaf673af-af2e-47ff-9e1e-3e9bd7fbb15d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f700a79b040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-910694658", "description": "tempest-description-159145600"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:07.203703 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-684b7da4-4ad7-465c-8752-2f4ad27d9b8f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.654857 Sep 18 01:09:07.217804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1017/1992] 10.222.0.25 () {58 vars in 1173 bytes} [Sun Sep 18 01:09:06 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:07.234852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:07.235778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:07.242591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.243444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.243877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.244790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.245416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.246050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.453014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eaf673af-af2e-47ff-9e1e-3e9bd7fbb15d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.576798 Sep 18 01:09:07.454563 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 976/1993] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:09:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:07.460165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:07.461243 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:07.471455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.472557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.473514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.474678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.476114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.476792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.652719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:07.664333 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01e20288-9d1b-459c-8627-d2b81bf08326 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1471 microversion: 2.1 time: 0.444892 Sep 18 01:09:07.665356 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1018/1994] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:07 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1471 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:07.671182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:07.672022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:07.682444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.686027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.686743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.687803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.688636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.689528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.750819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:09:07.891161 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-30c7704a-c9a5-4cdb-bd27-2e5058551970 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 204 len: 0 microversion: 2.1 time: 0.223116 Sep 18 01:09:07.895171 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1019/1995] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:09:07 2022] DELETE /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:09:07.904378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:07.906001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:07.915776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.916469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.917022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.920557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:07.921115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:07.921641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:07.974232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 188661e5-1bef-4e00-b59d-8def426eb404 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:09:08.001766 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-775bd79b-a707-4aa7-b2e6-2908d141fb5e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1969 microversion: 2.25 time: 0.545388 Sep 18 01:09:08.010350 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 977/1996] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:07 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1969 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:08.024330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:08.031663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:08.031823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.compute.servers [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Removing options 'limit' from query {{(pid=122373) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 18 01:09:08.032832 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:08.039282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:08.040259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:08.041159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:08.042441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:08.043948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:08.044717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:08.095082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:08.107210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:08.108123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:08.108893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:08.159011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:08.172030 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f4c6674-a4de-46d3-b06b-9a1553a04a90 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1497 microversion: 2.1 time: 0.275389 Sep 18 01:09:08.172639 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1020/1997] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:07 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1497 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:08.177693 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1087868173", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "41d13796-6021-4e18-b177-b1af05bcda5d"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:08.265181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] validate_networks() for [('41d13796-6021-4e18-b177-b1af05bcda5d', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:09:08.286216 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45abaf44-08c6-4325-9ef3-e9981e64dd8c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.272129 Sep 18 01:09:08.287665 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 978/1998] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:09:08 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:08.307564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:08.309337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:08.321638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:08.322210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:08.323170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:08.324246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:08.324725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:08.325220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:08.779019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:08.791746 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9538be12-0530-405e-9a2c-4ac665d69239 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.501348 Sep 18 01:09:08.792701 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 979/1999] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:08 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:08.805793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:08.806789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:08.823421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:08.824167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:08.824731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:08.826015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:08.826824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:08.827573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.282402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:09.301802 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de5d68b3-b3e6-45c0-9471-6cb31765b5e4 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1500 microversion: 2.1 time: 0.507006 Sep 18 01:09:09.303638 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 980/2000] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:08 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1500 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:09.315302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:09.326061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.328561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.329857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.331909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.333708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.334684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.376587 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75972492-ca16-4aed-8ace-11562dc1d68f tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.070944 Sep 18 01:09:09.377998 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 981/2001] 10.222.0.25 () {60 vars in 1217 bytes} [Sun Sep 18 01:09:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:09:09.386570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:09.393533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:09.394743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:09.402780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.404887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.406053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.407540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.409002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.410140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.418757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:09:09.419303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:09:09.419777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:09:09.420201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:09:09.420617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:09:09.441158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.442566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.443378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.448192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.452134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.453709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.509006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Getting quotas for project ec1e583f85c94264879e59720389d839. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:09:09.517483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Getting quotas for user 4dd8ef10d46d4f5390efdcd18d2e3059 and project ec1e583f85c94264879e59720389d839. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:09:09.537870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:09:09.540615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:09:09.562680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:09.639813 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-900a1907-5ca1-4d71-b0ed-7d5756cc222d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.260317 Sep 18 01:09:09.640891 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 982/2002] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:09:09 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:09.642527 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-297ee9a4-4160-456c-a9b1-3434e957b110 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.468542 Sep 18 01:09:09.643272 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1021/2003] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:09:09.645912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:09.646575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:09.648770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:09.650844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:09.654721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.655222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.655792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.656385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.656846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.657271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.667182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.668281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.669275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:09.670915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:09.671818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:09.672719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.081905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:10.090738 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1106bfb5-ab6e-4081-8466-7c1be793cce3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1476 microversion: 2.1 time: 0.448681 Sep 18 01:09:10.094635 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 983/2004] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:09 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:10.113422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:10.116190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:10.129626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.130344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.131020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.131970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.132656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.134351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:10.135146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.171008 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8a168ed-1383-4644-87a4-bf4b3a1d42d3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 200 len: 1474 microversion: 2.1 time: 0.517047 Sep 18 01:09:10.172317 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1022/2005] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:09 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 1474 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:10.180824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3094e58-49e8-4568-8b27-76c7ba0b3b4b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:10.181976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b3094e58-49e8-4568-8b27-76c7ba0b3b4b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:10.194661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'flavor' on Instance uuid 188661e5-1bef-4e00-b59d-8def426eb404 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:09:10.221978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Going to try to live migrate instance to n-h2-master-1 {{(pid=122373) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:09:10.311742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b3094e58-49e8-4568-8b27-76c7ba0b3b4b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:10.324419 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3094e58-49e8-4568-8b27-76c7ba0b3b4b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1216 microversion: 2.1 time: 0.150556 Sep 18 01:09:10.326193 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1023/2006] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:10 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:10.337218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:10.348025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:10.354651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.servers [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Removing options 'limit' from query {{(pid=122374) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 18 01:09:10.358136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:10.375020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.378935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.380774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.381878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.384634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.385399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.448718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:10.529694 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-728b089e-b0d4-4d98-b593-ebba64540c9f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.199661 Sep 18 01:09:10.531914 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1024/2007] 10.222.0.25 () {58 vars in 1150 bytes} [Sun Sep 18 01:09:10 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:10.555213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:10.558736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:10.590375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.591607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.592232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.593845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.594495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.595085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.816564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:10.840347 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5bcdeed5-7405-44d8-8360-d411a84c20b9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.306779 Sep 18 01:09:10.842537 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1025/2008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:10 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:10.850212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-aba70ffd-7a01-4765-8e86-cc325f807f49 req-ec7edb83-c817-4bb4-b0f4-77abaa3c6a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b6c25c-39a7-43a3-89ba-8fd79568ba47", "name": "network-vif-deleted", "tag": "454f8554-c3b3-44bd-96a8-a67b7c7bf570"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:10.865947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aba70ffd-7a01-4765-8e86-cc325f807f49 req-ec7edb83-c817-4bb4-b0f4-77abaa3c6a66 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.866742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aba70ffd-7a01-4765-8e86-cc325f807f49 req-ec7edb83-c817-4bb4-b0f4-77abaa3c6a66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.896252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aba70ffd-7a01-4765-8e86-cc325f807f49 req-ec7edb83-c817-4bb4-b0f4-77abaa3c6a66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.913681 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-aba70ffd-7a01-4765-8e86-cc325f807f49 req-ec7edb83-c817-4bb4-b0f4-77abaa3c6a66 service nova] Creating event network-vif-deleted:454f8554-c3b3-44bd-96a8-a67b7c7bf570 for instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 on n-h2-master-1 Sep 18 01:09:10.919290 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-aba70ffd-7a01-4765-8e86-cc325f807f49 req-ec7edb83-c817-4bb4-b0f4-77abaa3c6a66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074812 Sep 18 01:09:10.921105 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1026/2009] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:10.927215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-228789854"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:10.930212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:10.936720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.937212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.937930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:10.938653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:10.939111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:10.939738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.187733 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5bf5354a-227c-4d50-aa87-ba3dd3d4b8b2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d/action" status: 202 len: 0 microversion: 2.1 time: 0.264662 Sep 18 01:09:11.189264 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1027/2010] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:09:10 2022] POST /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:09:11.198966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:11.200041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:11.208533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.209037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.209486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.210258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.210766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.211158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.253828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.254325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.254859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.255323 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lazy-loading 'fault' on Instance uuid 71b6c25c-39a7-43a3-89ba-8fd79568ba47 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:09:11.320073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8f60e6d52b498c90dd1ace5418ae13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27153d8891d146b88d7ba3b5076ad538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:11.331179 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9ece2a3-8262-428d-934c-b98c13d6c045 tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 200 len: 1301 microversion: 2.1 time: 0.141649 Sep 18 01:09:11.331891 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1028/2011] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:11 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:11.336748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:11.342542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:11.344177 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:11.350839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.351321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.351752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.352495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.352940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.353588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.374465 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:11.397897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:11.442768 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c691f82-a2ab-4d37-8013-fbb17272dd77 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.109790 Sep 18 01:09:11.444294 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1029/2012] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:09:11 2022] GET /compute/v2.1/servers => generated 1012 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:11.449413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:11.450975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:11.462296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.463114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.463729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.464904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.465727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.467008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.688362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:11.700240 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-314e03d5-b828-4c04-8e77-40eaaac7f394 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1476 microversion: 2.1 time: 0.254589 Sep 18 01:09:11.701412 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1030/2013] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:11 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:11.707263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2568bebd-0c16-4569-8d19-d2a17106ee2a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70064db940>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:11.777490 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2568bebd-0c16-4569-8d19-d2a17106ee2a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 200 len: 1413 microversion: 2.1 time: 0.073445 Sep 18 01:09:11.779959 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1031/2014] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:09:11 2022] GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:11.788081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:11.789163 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:11.798297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.799283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.800246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.801313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.802043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.802922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.913888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:11.926791 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed56befd-6bdb-44d0-9c7c-549a71eaae82 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1268 microversion: 2.1 time: 0.145177 Sep 18 01:09:11.928277 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1032/2015] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:11 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:11.934783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:11.946029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:11.951587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:11.974892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.974892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.974892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:11.974892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:11.974892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:11.974892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.104890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:12.201949 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0410efb1-967f-4be0-ad81-3b5764c44a71 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.271453 Sep 18 01:09:12.214239 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1033/2016] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:09:11 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:12.229052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:12.229801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:12.237053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.237587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.238041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.238759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.239211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.239654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.423176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:12.440164 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b5c01136-ce1d-40a5-8120-0362a3ce68df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.224397 Sep 18 01:09:12.454461 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1034/2017] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:12 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:12.481116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:12.489010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:12.490568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.servers [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Removing options 'limit' from query {{(pid=122374) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 18 01:09:12.492073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:12.502216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.503347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.504264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.506597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.507531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.509319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.555252 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46750390-53bf-4dc6-aff3-d004b68a9bd7 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.098104 Sep 18 01:09:12.556379 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1035/2018] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Sep 18 01:09:12 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:12.579684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:12.581429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] [instance: 71b6c25c-39a7-43a3-89ba-8fd79568ba47] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:12.597038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.598294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.599111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.600128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.600700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.601401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.628074 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] HTTP exception thrown: Instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 could not be found. Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Request method failure captured: Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 HTTP/1.1 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm3RkI8XLc52DjnjcakjWVh_PEBgoUxYNUlnb5juwL8f52vGg8jCDJBQQfNA66vQG7HOK56QkzWdq4cmM_MvvBedWgr_gUUpVy30ziRQq9tO16aJYN2YkV4ouK_3JlAbzMO1sLyMKLcaPIvoAmMAZWeQzTuh7kf_jDd5MIr9nVdo_e0 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27153d8891d146b88d7ba3b5076ad538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-LiveMigrationTest-1016262571 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 27153d8891d146b88d7ba3b5076ad538 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-LiveMigrationTest-1016262571 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-LiveMigrationTest-1016262571-project Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: cf8f60e6d52b498c90dd1ace5418ae13 Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-LiveMigrationTest-1016262571-project Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 could not be found. Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '71b6c25c-39a7-43a3-89ba-8fd79568ba47'} Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 could not be found. Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 could not be found. Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:12.632556 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:12.641010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:12.641010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:12.641010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:12.641010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:09:12.641010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:09:12.641010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 could not be found. Sep 18 01:09:12.641010 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:12.644101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] Returning 404 to user: Instance 71b6c25c-39a7-43a3-89ba-8fd79568ba47 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:09:12.645292 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b1dd7c0a-f8f0-4391-bc2d-7d4b0847fb2c tempest-LiveMigrationTest-1016262571 tempest-LiveMigrationTest-1016262571-project] 10.222.0.25 "GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47" status: 404 len: 111 microversion: 2.1 time: 0.073889 Sep 18 01:09:12.646531 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1036/2019] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:12 2022] GET /compute/v2.1/servers/71b6c25c-39a7-43a3-89ba-8fd79568ba47 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:09:12.656596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:12.692219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:12.695531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1209650589', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:12.709651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.710817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.711693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:12.715240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:12.719725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:12.721234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:13.008532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:13.096094 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d7e4ed9-2f6f-4fe7-94b4-43f741a843db tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1209650589" status: 200 len: 346 microversion: 2.1 time: 0.447891 Sep 18 01:09:13.107379 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1037/2020] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:09:12 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1209650589 => generated 346 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:13.115004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:13.128261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:13.143144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:13.147526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:13.148248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:13.149035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:13.150756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:13.151228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:13.401929 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b91e6eb-84ae-4bf4-92b8-a3bc7db500ab tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404/action" status: 202 len: 0 microversion: 2.25 time: 3.304724 Sep 18 01:09:13.407907 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 984/2021] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:09:10 2022] POST /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404/action => generated 0 bytes in 3309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:09:13.418551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a149c216-bba0-46a4-9fe4-d7493b61eab4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005e758b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:13.535828 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a149c216-bba0-46a4-9fe4-d7493b61eab4 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 200 len: 1413 microversion: 2.1 time: 0.129128 Sep 18 01:09:13.546521 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 985/2022] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:09:13 2022] GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:13.552322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:13.553038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:13.572403 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:13.578445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:13.579216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:13.580105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:13.581477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:13.594715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:13.595744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:13.954229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:13.998056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-659e60d0-c906-491e-a04c-ae085595481f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1274 microversion: 2.1 time: 0.448674 Sep 18 01:09:13.998688 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 986/2023] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:13 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1274 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:14.023133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ec5d7f1-37af-48ba-b550-e0656c5ab7ae tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:14.035937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec5d7f1-37af-48ba-b550-e0656c5ab7ae tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:14.036850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec5d7f1-37af-48ba-b550-e0656c5ab7ae tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:14.037602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec5d7f1-37af-48ba-b550-e0656c5ab7ae tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:14.159532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ec5d7f1-37af-48ba-b550-e0656c5ab7ae tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Going to try to stop instance {{(pid=122373) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:09:14.251850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ec5d7f1-37af-48ba-b550-e0656c5ab7ae tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f/action" status: 202 len: 0 microversion: 2.1 time: 0.247417 Sep 18 01:09:14.252861 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 987/2024] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:09:13 2022] POST /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:09:14.253414 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:14.258985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:14.259701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:14.271054 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-71e94164-5bb9-41fc-94c3-11b34c95f449 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1476 microversion: 2.1 time: 1.161447 Sep 18 01:09:14.273609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:14.279804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1038/2025] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:13 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1476 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:14.295760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:14.300858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:14.307796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:14.314039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:14.314672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:14.317005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:14.317576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:14.336902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:14.344899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:14.346965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:14.351933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:14.352434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:14.352894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:14.956697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:14.970905 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3398d597-8069-420f-9a55-3171fb0a9f91 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1507 microversion: 2.1 time: 0.667834 Sep 18 01:09:14.973627 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1039/2026] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:14 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1507 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:14.986092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:14.987019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:14.997843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:14.998621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:15.000538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:15.009439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:15.010657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:15.012303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:15.089980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:15.102596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:15.106426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:15.110214 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d6c8dc68-fad9-47fa-bf20-852584bf096e tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.855518 Sep 18 01:09:15.112078 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 988/2027] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:14 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:15.121161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0052517d-1a0b-4ab8-b242-686effc5ca6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f700a6da310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:15.206714 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0052517d-1a0b-4ab8-b242-686effc5ca6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 200 len: 1413 microversion: 2.1 time: 0.092401 Sep 18 01:09:15.218607 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 989/2028] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:09:15 2022] GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:15.233968 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:15.236646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:15.247687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:15.248653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:15.249292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:15.250309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:15.251002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:15.251991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:15.297300 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:15.519151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:15.542010 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6860403d-1fd2-43d0-8c3b-1534eb9a2134 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1274 microversion: 2.1 time: 0.313073 Sep 18 01:09:15.558000 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 990/2029] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:15 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:15.573120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:15.582495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:15.600797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:15.601809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:15.602263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:15.604032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:15.604694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:15.605302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:15.849194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:15.926243 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3768ac2-8040-4221-882f-ca34544b949f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1520 microversion: 2.1 time: 0.952621 Sep 18 01:09:15.930661 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1040/2030] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:14 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1520 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:16.003106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:16.004579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:16.022098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:16.023681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:16.025466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:16.026467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:16.030429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:16.032228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:16.191663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:16.219318 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d8afc3c-3348-41b3-9ca6-a79b5460e1ea tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1476 microversion: 2.1 time: 0.655020 Sep 18 01:09:16.233859 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 991/2031] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:15 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:16.250850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:16.251724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:16.268958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:16.269443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:16.272367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:16.273924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:16.277116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:16.290349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:16.991075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:17.014486 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1bc520e-5192-48e7-9798-e088864473ff tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1528 microversion: 2.1 time: 1.018024 Sep 18 01:09:17.016722 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1041/2032] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:15 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1528 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:09:17.031805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1de6977e-ac5e-4f3f-9dfe-cb35dfb4eefb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70067e3160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:17.117408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:17.123692 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1de6977e-ac5e-4f3f-9dfe-cb35dfb4eefb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 200 len: 1413 microversion: 2.1 time: 0.105495 Sep 18 01:09:17.124791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1042/2033] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:09:17 2022] GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:17.129367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-375d4d91-1630-4f1d-a115-c06f0f349f5a req-07b38637-d453-4982-bdd6-3d6ca39e8087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e17de0-e432-4be3-968d-1bd921fe322d", "name": "network-vif-plugged", "status": "completed", "tag": "0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:17.133225 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:17.137000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:17.143068 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb83851c-039f-45d2-90b8-d5f2db414fb2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.905341 Sep 18 01:09:17.144269 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 992/2034] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:16 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:17.163080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:17.164403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:17.194172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-375d4d91-1630-4f1d-a115-c06f0f349f5a req-07b38637-d453-4982-bdd6-3d6ca39e8087 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:17.195384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-375d4d91-1630-4f1d-a115-c06f0f349f5a req-07b38637-d453-4982-bdd6-3d6ca39e8087 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:17.196276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-375d4d91-1630-4f1d-a115-c06f0f349f5a req-07b38637-d453-4982-bdd6-3d6ca39e8087 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:17.198936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:17.199714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:17.200616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:17.202013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:17.202646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:17.203395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:17.221491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-375d4d91-1630-4f1d-a115-c06f0f349f5a req-07b38637-d453-4982-bdd6-3d6ca39e8087 service nova] Creating event network-vif-plugged:0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191 for instance 30e17de0-e432-4be3-968d-1bd921fe322d on n-h1-master-1 Sep 18 01:09:17.233708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-375d4d91-1630-4f1d-a115-c06f0f349f5a req-07b38637-d453-4982-bdd6-3d6ca39e8087 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104541 Sep 18 01:09:17.234892 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1043/2035] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:17.258115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:17.259539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:17.275500 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:17.286847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:17.287528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:17.288164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:17.289169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:17.289796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:17.290353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:17.435292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:17.456912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9406eaf-23d2-42ad-86e6-8e5116276fcd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1274 microversion: 2.1 time: 0.311312 Sep 18 01:09:17.460383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 993/2036] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:17 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:17.501766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:17.506302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:17.522663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:17.534190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:17.534988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:17.536550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:17.537342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:17.538257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:18.088958 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:18.457666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:18.472575 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9303bd04-622e-459c-8114-21bee4b19a0f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1520 microversion: 2.1 time: 1.236252 Sep 18 01:09:18.513892 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1044/2037] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:17 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1520 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:18.519210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:18.539101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:18.556711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:18.560740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:18.561508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:18.563931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:18.565521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:18.574203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:18.724862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:18.734346 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bae62fcb-3009-4b08-a081-d7fa9885ad4f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1476 microversion: 2.1 time: 1.246185 Sep 18 01:09:18.747970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 994/2038] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:17 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1476 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:18.753081 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-caeb20e9-17b7-4162-96c6-b052d5812415 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005eadc10>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:18.964115 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-caeb20e9-17b7-4162-96c6-b052d5812415 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 200 len: 1413 microversion: 2.1 time: 0.213524 Sep 18 01:09:18.965203 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 995/2039] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:09:18 2022] GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 1413 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:18.974862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:18.974862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:19.012546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:19.020928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:19.021845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:19.022905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:19.023570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:19.024201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:19.051105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:19.067086 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd079a4f-e58e-40d8-a4c2-369281f4add0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1523 microversion: 2.1 time: 0.551638 Sep 18 01:09:19.070330 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1045/2040] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:18 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1523 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:19.082576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:19.083597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:19.113199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:19.113957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:19.114466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:19.115475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:19.116244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:19.116960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:19.493110 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:20.358476 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=14 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:20.487219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:20.504888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:20.512089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:20.515998 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3ee1d27-9fc8-4933-bb3f-e467bd69c352 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 1.549254 Sep 18 01:09:20.521413 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 996/2041] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:18 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:20.534502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:20.535384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:20.547870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:20.552469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:20.553765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:20.554688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:20.556428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:20.564212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:20.907383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:20.932201 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68994de9-eb68-43e6-86bd-087c57d44f4f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1316 microversion: 2.1 time: 1.860459 Sep 18 01:09:20.933099 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1046/2042] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:19 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1316 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:20.945738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:20.961154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:20.984110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:20.992289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:20.998454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:21.001152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:21.003690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:21.005530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:21.103917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:21.117504 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c0d7092e-b4d7-4a43-ab0c-5a5b4aa0870c tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1520 microversion: 2.1 time: 0.587191 Sep 18 01:09:21.130525 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 997/2043] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:20 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:21.130525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ffb438d7-866c-479e-86eb-0a69ea427716 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f700a655700>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:21.850959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:21.885513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e15fd3e-8f89-4a4a-97f3-ae168b45360e tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1476 microversion: 2.1 time: 0.942938 Sep 18 01:09:21.891744 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1047/2044] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:20 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1476 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:21.911251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:21.914302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:21.928432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:21.934920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:21.935769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:21.937288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:21.938065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:21.940603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:22.891213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:22.894258 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:22.912223 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=18 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:22.922266 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bbad1057-73b1-436e-8be2-9c7b47034efb tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1523 microversion: 2.1 time: 1.027437 Sep 18 01:09:22.927366 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1048/2045] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:21 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1523 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:22.968514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b5bd80bc-75bb-434b-bcf2-71d7b4312038 req-cf827632-24c3-4976-b6bd-329bd05851ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a49915-3f71-4dd6-be9d-f338b8b4b9bd", "name": "network-vif-plugged", "status": "completed", "tag": "6bc7822e-cef8-4029-a6cb-9afec75df693"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:23.010854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b5bd80bc-75bb-434b-bcf2-71d7b4312038 req-cf827632-24c3-4976-b6bd-329bd05851ff service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:23.020776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b5bd80bc-75bb-434b-bcf2-71d7b4312038 req-cf827632-24c3-4976-b6bd-329bd05851ff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:23.021712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b5bd80bc-75bb-434b-bcf2-71d7b4312038 req-cf827632-24c3-4976-b6bd-329bd05851ff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:23.068653 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b5bd80bc-75bb-434b-bcf2-71d7b4312038 req-cf827632-24c3-4976-b6bd-329bd05851ff service nova] Creating event network-vif-plugged:6bc7822e-cef8-4029-a6cb-9afec75df693 for instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd on n-h2-master-1 Sep 18 01:09:23.098593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b5bd80bc-75bb-434b-bcf2-71d7b4312038 req-cf827632-24c3-4976-b6bd-329bd05851ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145787 Sep 18 01:09:23.100450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1049/2046] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:23.123033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:23.131293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:23.151612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:23.154251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:23.157012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:23.161764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:23.162635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:23.163447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:23.852783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:23.872757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:23.882126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:23.883578 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04149d68-517f-4b34-8e9e-7859394318ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.781596 Sep 18 01:09:23.899844 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1050/2047] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:23 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:23.954424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:23.958287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:23.995766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:23.996241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:23.996870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:23.997998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:24.013885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:24.014975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:25.105975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:25.127312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c91690a-905c-4442-a73f-15a50bfef0a0 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1316 microversion: 2.1 time: 1.205234 Sep 18 01:09:25.143993 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1051/2048] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:23 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1316 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:25.154410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:25.155085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:25.189060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:25.195142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:25.195797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:25.196586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:25.197072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:25.208404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:25.565347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:25.580789 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a4b838d5-bc50-4ef8-8ada-a3f5b418fee3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1520 microversion: 2.1 time: 0.441006 Sep 18 01:09:25.582184 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1052/2049] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:25 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:25.605822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:25.609688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:25.649254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:25.650814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:25.654651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:25.656292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:25.658361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:25.659047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:26.542344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:26.552606 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c9002ea-61fb-4a03-9cde-af283db5d6b7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1476 microversion: 2.1 time: 0.969103 Sep 18 01:09:26.555107 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1053/2050] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:25 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1476 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:26.571905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:26.578075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:26.604134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:26.610394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:26.611043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:26.616111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:26.616811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:26.618347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:28.039710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:28.063588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e47c824a-ca58-438f-ad26-b1f139a071a3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1523 microversion: 2.1 time: 1.501096 Sep 18 01:09:28.067002 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1054/2051] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:26 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1523 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:28.103370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1aa95975-f141-4888-bc2a-9e6cb35f5266 req-4e6bb836-c061-4562-a618-973edb09204d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8260bffc-93e7-4f80-97dd-ab880f38e22b", "tag": "f027a876-45e4-4a6f-ac37-d90685693687"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:28.163842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1aa95975-f141-4888-bc2a-9e6cb35f5266 req-4e6bb836-c061-4562-a618-973edb09204d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:28.164503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1aa95975-f141-4888-bc2a-9e6cb35f5266 req-4e6bb836-c061-4562-a618-973edb09204d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:28.166742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1aa95975-f141-4888-bc2a-9e6cb35f5266 req-4e6bb836-c061-4562-a618-973edb09204d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:28.215432 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1aa95975-f141-4888-bc2a-9e6cb35f5266 req-4e6bb836-c061-4562-a618-973edb09204d service nova] Creating event network-changed:f027a876-45e4-4a6f-ac37-d90685693687 for instance 8260bffc-93e7-4f80-97dd-ab880f38e22b on n-h2-master-1 Sep 18 01:09:28.237079 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1aa95975-f141-4888-bc2a-9e6cb35f5266 req-4e6bb836-c061-4562-a618-973edb09204d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166964 Sep 18 01:09:28.250260 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1055/2052] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:28.256639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:28.274242 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:28.288758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:28.313674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:28.318329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:28.322481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:28.332348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:28.332348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:28.918395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:28.927827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:28.929705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:28.931120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d2d02bd-e348-4294-8bdd-c493d359606d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.679237 Sep 18 01:09:28.932200 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1056/2053] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:28 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:28.956042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:28.967641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:28.978647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:28.979454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:28.980082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:28.981078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:28.988295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:28.989352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:30.006547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:30.023514 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c80583cb-64d5-4c8a-98ef-c95c43d9d355 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1316 microversion: 2.1 time: 1.087160 Sep 18 01:09:30.035724 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1057/2054] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:28 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1316 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:30.058788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:30.059501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:30.073662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:30.074431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:30.081733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:30.082603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:30.087453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:30.088010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:30.547443 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=19 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:31.109311 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=39 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:31.299401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:31.317936 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-337449b0-9555-4355-8130-6ca344a3148e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1520 microversion: 2.1 time: 1.277934 Sep 18 01:09:31.328746 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1058/2055] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:30 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1520 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:31.344416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:31.345055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:31.375457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:31.384697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:31.385742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:31.387168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:31.388029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:31.388474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:32.083242 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:32.112438 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c516e194-4bc2-428e-9d9a-e207c1dccc7f tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1475 microversion: 2.1 time: 0.782340 Sep 18 01:09:32.133787 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1059/2056] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:31 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1475 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:32.159594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:32.161035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:32.177128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:32.178202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:32.178947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:32.180101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:32.180874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:32.181608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:32.662563 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:32.715545 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-708ccd5c-ca7b-451f-bacc-c2e0a6dd47ef tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1523 microversion: 2.1 time: 0.579556 Sep 18 01:09:32.716077 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1060/2057] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:32 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:32.747789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-cbc87fbb-2ef9-41e7-aea7-f6b4824063bd req-3c553817-bd8c-4ab5-9423-8a13c027389a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "name": "network-vif-unplugged", "status": "completed", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:32.780281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cbc87fbb-2ef9-41e7-aea7-f6b4824063bd req-3c553817-bd8c-4ab5-9423-8a13c027389a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:32.780763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cbc87fbb-2ef9-41e7-aea7-f6b4824063bd req-3c553817-bd8c-4ab5-9423-8a13c027389a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:32.781200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cbc87fbb-2ef9-41e7-aea7-f6b4824063bd req-3c553817-bd8c-4ab5-9423-8a13c027389a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:32.801929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-cbc87fbb-2ef9-41e7-aea7-f6b4824063bd req-3c553817-bd8c-4ab5-9423-8a13c027389a service nova] Creating event network-vif-unplugged:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h1-master-1 Sep 18 01:09:32.811155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-cbc87fbb-2ef9-41e7-aea7-f6b4824063bd req-3c553817-bd8c-4ab5-9423-8a13c027389a service nova] Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:09:32.826595 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-cbc87fbb-2ef9-41e7-aea7-f6b4824063bd req-3c553817-bd8c-4ab5-9423-8a13c027389a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109047 Sep 18 01:09:32.827576 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1061/2058] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:32.832887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:32.833618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:32.848105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:32.848856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:32.849466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:32.850502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:32.851118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:32.851703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:33.219542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:33.232517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:33.236254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:33.238602 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cbb3fc3d-b1d9-48b7-9297-f058a40457df tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.409710 Sep 18 01:09:33.240021 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1062/2059] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:32 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:33.246049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:33.249403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:33.258767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:33.259576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:33.260449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:33.261470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:33.262503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:33.264942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:33.577475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:33.586385 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0e3263cd-4bc7-4e24-9329-5efe6d00c35b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1316 microversion: 2.1 time: 0.344742 Sep 18 01:09:33.604585 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1063/2060] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:33 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:33.611008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:33.612159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:33.620310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:33.621046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:33.621734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:33.622670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:33.623341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:33.624230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:33.934184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:33.946999 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-278d68b1-ee96-49d8-b871-fb28f58bbbe1 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1520 microversion: 2.1 time: 0.340794 Sep 18 01:09:33.948306 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1064/2061] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:33 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:33.974247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:33.980701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:33.998568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:34.001280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:34.002857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:34.003849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:34.005807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:34.009285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:34.364113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:34.394114 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ec9ba457-a45d-4b40-9e12-c2bd395a34fc tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1475 microversion: 2.1 time: 0.441227 Sep 18 01:09:34.397466 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1065/2062] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:33 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:34.418293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:34.420967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:34.444641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:34.447082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:34.450534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:34.451935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:34.452936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:34.454905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:34.847562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:34.857853 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-444575e1-0142-494d-856f-aa69c42f67fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1523 microversion: 2.1 time: 0.457119 Sep 18 01:09:34.874662 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1066/2063] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:34 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:34.879279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:34.879855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:34.887731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:34.888431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:34.889024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:34.889924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:34.890513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:34.891091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:34.895434 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:35.130527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:35.145316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:35.147104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:35.150179 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-69c802c4-cf67-4536-a8b9-e08efef5f73a tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.274859 Sep 18 01:09:35.169910 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1067/2064] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:34 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:35.181216 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-2c98391f-c705-4d96-9f5c-10c928390548 req-03c8185b-cf34-443c-acba-01a338ca07f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8260bffc-93e7-4f80-97dd-ab880f38e22b", "name": "network-vif-plugged", "status": "completed", "tag": "f027a876-45e4-4a6f-ac37-d90685693687"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:35.193377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2c98391f-c705-4d96-9f5c-10c928390548 req-03c8185b-cf34-443c-acba-01a338ca07f7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.194560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2c98391f-c705-4d96-9f5c-10c928390548 req-03c8185b-cf34-443c-acba-01a338ca07f7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.194824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2c98391f-c705-4d96-9f5c-10c928390548 req-03c8185b-cf34-443c-acba-01a338ca07f7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:35.209726 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-2c98391f-c705-4d96-9f5c-10c928390548 req-03c8185b-cf34-443c-acba-01a338ca07f7 service nova] Creating event network-vif-plugged:f027a876-45e4-4a6f-ac37-d90685693687 for instance 8260bffc-93e7-4f80-97dd-ab880f38e22b on n-h2-master-1 Sep 18 01:09:35.219088 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-2c98391f-c705-4d96-9f5c-10c928390548 req-03c8185b-cf34-443c-acba-01a338ca07f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047552 Sep 18 01:09:35.220344 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1068/2065] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:35.233229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:35.236215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:35.250305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.250816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.251233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:35.251956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.252510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.252838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:35.410677 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ffb438d7-866c-479e-86eb-0a69ea427716 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 200 len: 1422 microversion: 2.1 time: 14.287809 Sep 18 01:09:35.411352 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 998/2066] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:09:21 2022] GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 1422 bytes in 14290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:35.416040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a277d561-1568-4335-aaac-331157881f1f req-91043cb3-6c1e-497f-9282-8b23b96a6357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:35.436788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a277d561-1568-4335-aaac-331157881f1f req-91043cb3-6c1e-497f-9282-8b23b96a6357 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.437651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a277d561-1568-4335-aaac-331157881f1f req-91043cb3-6c1e-497f-9282-8b23b96a6357 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.438228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a277d561-1568-4335-aaac-331157881f1f req-91043cb3-6c1e-497f-9282-8b23b96a6357 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:35.462176 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a277d561-1568-4335-aaac-331157881f1f req-91043cb3-6c1e-497f-9282-8b23b96a6357 service nova] Creating event network-changed:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h1-master-1 Sep 18 01:09:35.470895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-a277d561-1568-4335-aaac-331157881f1f req-91043cb3-6c1e-497f-9282-8b23b96a6357 service nova] Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:09:35.490011 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a277d561-1568-4335-aaac-331157881f1f req-91043cb3-6c1e-497f-9282-8b23b96a6357 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077174 Sep 18 01:09:35.491250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 999/2067] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:35.500848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:35.502253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:35.514626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.517875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.519099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:35.520518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.522429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.524293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:35.649967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:35.665715 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c512c65b-f5e1-43ec-91cc-2dd1f975e684 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1316 microversion: 2.1 time: 0.443895 Sep 18 01:09:35.668512 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1069/2068] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:35 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:35.687701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f662bc9-d8e1-4797-9ae6-3d6dfab67e30 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7006d11d30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:35.812854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f662bc9-d8e1-4797-9ae6-3d6dfab67e30 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 200 len: 1422 microversion: 2.1 time: 0.142237 Sep 18 01:09:35.814113 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1070/2069] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:09:35 2022] GET /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:35.822495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:35.827429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:35.843585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.858197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.859743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:35.861320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:35.863305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:35.863762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:36.133487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:36.150823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96783b26-40be-4aa2-9b91-8d167a1c19bc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1520 microversion: 2.1 time: 0.657808 Sep 18 01:09:36.178651 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1000/2070] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:35 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1520 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:36.200661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8226e0ba-4cb4-4310-94a1-1fc30ed26f25 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005e5a040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:36.397819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:36.422545 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e841920-1cc9-4607-b288-b7e65884c315 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1475 microversion: 2.1 time: 0.604340 Sep 18 01:09:36.423916 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1071/2071] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:35 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1475 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:36.428985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:36.429846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:36.437830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:36.438486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:36.439071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:36.439943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:36.440546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:36.441139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:36.707003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:36.720581 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c912f655-4051-43dc-8a92-ac2bd1a40c53 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1523 microversion: 2.1 time: 0.294728 Sep 18 01:09:36.726807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1072/2072] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:36 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:36.737307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:36.738219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:36.745186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:36.745897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:36.747232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:36.748074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:36.748600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:36.749132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:37.082809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:37.134990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:37.144410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:37.149043 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca68af38-d631-42be-9125-1b75d0c0d6e7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.419957 Sep 18 01:09:37.167895 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1073/2073] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:36 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:37.189162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:37.198519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:37.213071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:37.214014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:37.214611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:37.215684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:37.216342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:37.216932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:37.484755 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8226e0ba-4cb4-4310-94a1-1fc30ed26f25 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 204 len: 0 microversion: 2.1 time: 1.302302 Sep 18 01:09:37.485345 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1001/2074] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:36 2022] DELETE /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 0 bytes in 1305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:09:37.491149 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:37.492148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:37.508740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:37.510078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:37.512116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:37.513379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:37.516299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:37.517026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:37.651885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:37.683971 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f4ac4767-a19a-44fb-9a99-9281b997a4bf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1316 microversion: 2.1 time: 0.513970 Sep 18 01:09:37.691149 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1074/2075] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:37 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:37.696004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:37.696614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:37.710499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:37.713434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:37.718519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:37.725904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:37.726787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:37.727538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:38.190321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:38.211446 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d1a3f3e4-626d-4c3f-93bd-0c20511b4deb tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1497 microversion: 2.1 time: 0.724747 Sep 18 01:09:38.222738 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1002/2076] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:37 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1497 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:38.231883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:38.234199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:38.246053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:38.247606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:38.248397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:38.249424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:38.250615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:38.251257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:38.273267 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:38.285813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa57c4db-6cc1-487f-bb97-e35078b517cf tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1473 microversion: 2.1 time: 0.593384 Sep 18 01:09:38.286933 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1075/2077] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:37 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1473 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:38.292128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:09:38.292746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-85b1f370-1c7f-4269-ac8a-98eacaf6d024 req-32d7a67e-a41e-4f5f-adf9-3733efbfb7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188661e5-1bef-4e00-b59d-8def426eb404", "name": "network-vif-unplugged", "status": "completed", "tag": "b344c9d6-d712-42e7-8ffc-b3a6a5b360f3"}, {"name": "network-changed", "server_uuid": "188661e5-1bef-4e00-b59d-8def426eb404", "tag": "b344c9d6-d712-42e7-8ffc-b3a6a5b360f3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:38.348605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85b1f370-1c7f-4269-ac8a-98eacaf6d024 req-32d7a67e-a41e-4f5f-adf9-3733efbfb7e5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:38.356674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85b1f370-1c7f-4269-ac8a-98eacaf6d024 req-32d7a67e-a41e-4f5f-adf9-3733efbfb7e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:38.360193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85b1f370-1c7f-4269-ac8a-98eacaf6d024 req-32d7a67e-a41e-4f5f-adf9-3733efbfb7e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:38.423099 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-85b1f370-1c7f-4269-ac8a-98eacaf6d024 req-32d7a67e-a41e-4f5f-adf9-3733efbfb7e5 service nova] Creating event network-vif-unplugged:b344c9d6-d712-42e7-8ffc-b3a6a5b360f3 for instance 188661e5-1bef-4e00-b59d-8def426eb404 on n-h1-master-1 Sep 18 01:09:38.425218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-85b1f370-1c7f-4269-ac8a-98eacaf6d024 req-32d7a67e-a41e-4f5f-adf9-3733efbfb7e5 service nova] Creating event network-changed:b344c9d6-d712-42e7-8ffc-b3a6a5b360f3 for instance 188661e5-1bef-4e00-b59d-8def426eb404 on n-h1-master-1 Sep 18 01:09:38.470204 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c00b7a0-e1cf-429b-9639-0b8efa4c716f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 204 len: 0 microversion: 2.1 time: 0.244995 Sep 18 01:09:38.471103 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1003/2078] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:09:38 2022] DELETE /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:09:38.472127 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-85b1f370-1c7f-4269-ac8a-98eacaf6d024 req-32d7a67e-a41e-4f5f-adf9-3733efbfb7e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.174689 Sep 18 01:09:38.475588 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1076/2079] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:38.484522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:38.486007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:38.495678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:38.496104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:38.496915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:38.499204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:38.512091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:38.517895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:38.519150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:38.523184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:38.535527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:38.536433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:38.537406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:38.538734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:38.540030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:38.551450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:39.341506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:39.363362 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb562805-37a9-4f47-bb64-1b72dcc5d89b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1523 microversion: 2.1 time: 0.886355 Sep 18 01:09:39.379923 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1004/2080] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:38 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1523 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:39.481711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:39.508288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:39.512489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:39.532226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:39.539681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:39.541200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:39.550412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:39.551543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:39.552557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:39.640139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:39.709015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:39.722783 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15bd5903-96ab-473d-9297-168f0ef52af3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.339473 Sep 18 01:09:39.736860 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1005/2081] 10.222.0.25 () {58 vars in 1154 bytes} [Sun Sep 18 01:09:39 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:39.744161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:39.759800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:39.761920 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:39.766272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:39.769378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7900dee3-2fda-4673-9254-dcae9206fc8d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 1.284972 Sep 18 01:09:39.790368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:39.792362 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1077/2082] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:38 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:39.796133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:39.797928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:39.800386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:39.803920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:39.805413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:39.813231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1105959037", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8549b193-9309-4447-b854-895b85b228c7"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:40.018770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] validate_networks() for [('8549b193-9309-4447-b854-895b85b228c7', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:09:41.380842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:41.402194 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f32d857b-f67e-4c01-9e9a-4768a8865ba3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1504 microversion: 2.1 time: 1.664820 Sep 18 01:09:41.411351 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1006/2083] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:39 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1504 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:41.428818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:41.445902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:41.459522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:41.478357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:41.483707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:41.485279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:41.490971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:41.491988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:43.758389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:09:43.760108 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:09:43.762975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:09:43.764086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:09:43.765214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:09:43.811009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:43.815251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:43.816506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:43.831496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:43.834150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:43.843178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:43.856554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:43.925340 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e89ad851-2630-46bd-913a-45f44ec8abb0 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1470 microversion: 2.1 time: 2.511791 Sep 18 01:09:43.974236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:09:43.989345 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1007/2084] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:41 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1470 bytes in 2577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:43.989842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for user a7b979a402b74d679ec79f0b39255155 and project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:09:44.000235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7cc267b-784a-493b-8ace-234e82e0872d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:44.017147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cc267b-784a-493b-8ace-234e82e0872d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:44.018414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cc267b-784a-493b-8ace-234e82e0872d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:44.019922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7cc267b-784a-493b-8ace-234e82e0872d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:44.081308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:09:44.096359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:09:44.136315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b7cc267b-784a-493b-8ace-234e82e0872d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Going to try to start instance {{(pid=122373) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 01:09:44.272142 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7cc267b-784a-493b-8ace-234e82e0872d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f/action" status: 202 len: 0 microversion: 2.1 time: 0.280400 Sep 18 01:09:44.282150 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1649389e-3df5-47f2-a6fd-bb9395fc724d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.482153 Sep 18 01:09:44.283921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1078/2085] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:09:44.304356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:44.305157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:44.307391 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1008/2086] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:09:43 2022] POST /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:09:44.330380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:44.331213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:44.340895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:44.356542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:44.357142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:44.357742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:44.358510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:44.358963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:44.359504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:44.361675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:44.365639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:44.367387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:44.370390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:44.375151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:44.981631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:44.994349 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01474aa6-e8c3-4586-bafd-c2867fb0ff8f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1505 microversion: 2.1 time: 0.706034 Sep 18 01:09:44.997814 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1079/2087] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:44 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:45.009247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-88c100ba-9896-4f52-ab98-0bca72f68df7 req-23cb855d-701f-4409-a5ce-ca2b854f96cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e17de0-e432-4be3-968d-1bd921fe322d", "name": "network-vif-unplugged", "status": "completed", "tag": "0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:45.032674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-88c100ba-9896-4f52-ab98-0bca72f68df7 req-23cb855d-701f-4409-a5ce-ca2b854f96cc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.036690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-88c100ba-9896-4f52-ab98-0bca72f68df7 req-23cb855d-701f-4409-a5ce-ca2b854f96cc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.037979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-88c100ba-9896-4f52-ab98-0bca72f68df7 req-23cb855d-701f-4409-a5ce-ca2b854f96cc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:45.068694 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-88c100ba-9896-4f52-ab98-0bca72f68df7 req-23cb855d-701f-4409-a5ce-ca2b854f96cc service nova] Creating event network-vif-unplugged:0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191 for instance 30e17de0-e432-4be3-968d-1bd921fe322d on n-h1-master-1 Sep 18 01:09:45.080974 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-88c100ba-9896-4f52-ab98-0bca72f68df7 req-23cb855d-701f-4409-a5ce-ca2b854f96cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079319 Sep 18 01:09:45.083868 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1080/2088] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:45.100833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2038005754"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:45.104111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:45.125061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.126142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.130371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:45.132170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.132798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.133389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:45.232557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:45.266139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:45.280340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:45.282530 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dbe40fbd-5e06-45dd-98e4-912daca4759d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.972938 Sep 18 01:09:45.297581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1009/2089] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:44 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:45.303141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d200fc51-2d88-428e-acd3-86a4a594086e req-b928a89d-a500-43b2-bb6a-aefe4e9f2705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e17de0-e432-4be3-968d-1bd921fe322d", "name": "network-vif-deleted", "tag": "0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:45.333897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d200fc51-2d88-428e-acd3-86a4a594086e req-b928a89d-a500-43b2-bb6a-aefe4e9f2705 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.334383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d200fc51-2d88-428e-acd3-86a4a594086e req-b928a89d-a500-43b2-bb6a-aefe4e9f2705 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.334817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d200fc51-2d88-428e-acd3-86a4a594086e req-b928a89d-a500-43b2-bb6a-aefe4e9f2705 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:45.367159 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d200fc51-2d88-428e-acd3-86a4a594086e req-b928a89d-a500-43b2-bb6a-aefe4e9f2705 service nova] Creating event network-vif-deleted:0c9cf628-9ad6-4fd0-a6b9-1bf5123a4191 for instance 30e17de0-e432-4be3-968d-1bd921fe322d on n-h1-master-1 Sep 18 01:09:45.386786 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d200fc51-2d88-428e-acd3-86a4a594086e req-b928a89d-a500-43b2-bb6a-aefe4e9f2705 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098047 Sep 18 01:09:45.389292 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1010/2090] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:45.408585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:45.411663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:45.462001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.462519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.462963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:45.463679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.464138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.464565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:45.617851 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Adding security group ed377af1-c520-4969-a1bc-71f9dad6d404 to port f027a876-45e4-4a6f-ac37-d90685693687 Sep 18 01:09:45.770966 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f4746fd-b3f9-473a-87b6-2c4b4f390c8d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "POST /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2/action" status: 202 len: 0 microversion: 2.1 time: 0.378123 Sep 18 01:09:45.771810 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1011/2091] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:09:45 2022] POST /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:09:45.777271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:45.778506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:45.788670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.789392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.790029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:45.790921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:45.791526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:45.792092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:46.778352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:46.799380 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:46.831272 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5813705b-661c-4ada-a924-b0d04417938d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1506 microversion: 2.1 time: 1.058075 Sep 18 01:09:46.858151 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1012/2092] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:45 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1506 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:46.888656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:46.889766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:46.903961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:46.906572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:46.907512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:46.908499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:46.909149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:46.909782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:47.113460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:47.166075 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e6ad0d06-dc85-4541-9f97-1fba4111da57 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1260 microversion: 2.1 time: 0.300364 Sep 18 01:09:47.177290 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1013/2093] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:46 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1260 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:47.191526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:47.193741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:47.228643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-87b840d2-804c-40cd-a0d8-4d6683fa70bc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b/action" status: 202 len: 0 microversion: 2.1 time: 2.142395 Sep 18 01:09:47.233985 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1081/2094] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:09:45 2022] POST /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b/action => generated 0 bytes in 2149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:09:47.241815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:47.243568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:47.244183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:47.251254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:47.252840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:47.256711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:47.257808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:47.261196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:47.271604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:47.272511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:47.273282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:47.275089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:47.276273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:47.278075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:48.177139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:48.195367 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-14e947ab-d561-4619-a176-2a5ef5e9d2db tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1469 microversion: 2.1 time: 1.016491 Sep 18 01:09:48.197237 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1014/2095] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:47 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1469 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:48.220531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:48.223264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:48.238853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:48.240031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:48.241136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:48.243266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:48.244401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:48.246644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:48.283761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:48.318661 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-886f9671-3a0e-4949-9d0a-bcbfd0e76baa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1505 microversion: 2.1 time: 1.080899 Sep 18 01:09:48.322294 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1082/2096] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:47 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1505 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:48.348564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "name": "network-vif-plugged", "status": "completed", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}, {"server_uuid": "65a49915-3f71-4dd6-be9d-f338b8b4b9bd", "name": "network-vif-unplugged", "status": "completed", "tag": "6bc7822e-cef8-4029-a6cb-9afec75df693"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:48.374256 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:48.391083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:48.394223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:48.395507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:48.419276 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] Creating event network-vif-plugged:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h1-master-1 Sep 18 01:09:48.421326 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] Creating event network-vif-unplugged:6bc7822e-cef8-4029-a6cb-9afec75df693 for instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd on n-h2-master-1 Sep 18 01:09:48.430828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:09:48.454965 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3a39b088-19db-43b4-a32e-e8a277c92cdf req-431591f7-eb4a-44a8-9513-b0e65ee4ab95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.128297 Sep 18 01:09:48.459751 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1083/2097] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:48.466553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-910694658"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:48.467287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:48.478372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:48.479360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:48.480311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:48.481340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:48.482115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:48.482756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:48.800085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:48.840530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:48.854636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:48.860285 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a3b2670a-71e4-4fc0-bde9-74e3a1e9b1a9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.660903 Sep 18 01:09:48.862924 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1015/2098] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:48 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:48.876114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-395328d4-5df8-480d-a001-146820bef026 req-5e5ac0b3-b8a1-424c-ac7e-87a772fb83be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8260bffc-93e7-4f80-97dd-ab880f38e22b", "tag": "f027a876-45e4-4a6f-ac37-d90685693687"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:48.898134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-395328d4-5df8-480d-a001-146820bef026 req-5e5ac0b3-b8a1-424c-ac7e-87a772fb83be service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:48.899087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-395328d4-5df8-480d-a001-146820bef026 req-5e5ac0b3-b8a1-424c-ac7e-87a772fb83be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:48.899958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-395328d4-5df8-480d-a001-146820bef026 req-5e5ac0b3-b8a1-424c-ac7e-87a772fb83be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:48.958387 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-395328d4-5df8-480d-a001-146820bef026 req-5e5ac0b3-b8a1-424c-ac7e-87a772fb83be service nova] Creating event network-changed:f027a876-45e4-4a6f-ac37-d90685693687 for instance 8260bffc-93e7-4f80-97dd-ab880f38e22b on n-h2-master-1 Sep 18 01:09:48.971328 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-395328d4-5df8-480d-a001-146820bef026 req-5e5ac0b3-b8a1-424c-ac7e-87a772fb83be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105516 Sep 18 01:09:48.973122 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1016/2099] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:48.984228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:48.985990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:49.003478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:49.018090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:49.019293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:49.021351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:49.023271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:49.024583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:49.103472 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Adding security group ce0da2ca-af4d-4b0c-974b-de600342f0d4 to port f027a876-45e4-4a6f-ac37-d90685693687 Sep 18 01:09:49.598682 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:49.615262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:49.646810 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3c857bb-48d6-4278-8501-72dc138c4a58 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1506 microversion: 2.1 time: 0.667544 Sep 18 01:09:49.647819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1017/2100] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:48 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:49.667430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:49.669429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:49.696686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:49.698698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:49.701462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:49.708369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:49.709361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:49.710836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:50.400905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:50.424923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3cc93dc0-d7f1-424d-953d-a99e4a812da6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1308 microversion: 2.1 time: 0.775795 Sep 18 01:09:50.433030 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1018/2101] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:49 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1308 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:50.449308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:50.458421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:50.478513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:50.478833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:50.482669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:50.487624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:50.490752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:50.493092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:50.560667 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a59ebac-3f64-434f-bacb-b8872fe0246e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b/action" status: 202 len: 0 microversion: 2.1 time: 2.099429 Sep 18 01:09:50.561880 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1084/2102] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:09:48 2022] POST /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b/action => generated 0 bytes in 2102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:09:50.567054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:50.569197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:50.583772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:50.587654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:50.588421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:50.590194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:50.596165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:50.598469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:51.132774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:51.141897 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c8f9fa48-f38b-441f-a086-6eed34fd8bb9 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1469 microversion: 2.1 time: 0.706584 Sep 18 01:09:51.149107 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1019/2103] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:50 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1469 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:51.155207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:51.159691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:51.172545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:51.173265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:51.173893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:51.175297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:51.175755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:51.178164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:51.248417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:51.262916 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9dc24523-21ac-4af8-aa8f-1e63bef14bf0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 200 len: 1448 microversion: 2.1 time: 0.699728 Sep 18 01:09:51.267525 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1085/2104] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:50 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 1448 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:51.278492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:51.288095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:51.296775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:51.300665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:51.304555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:51.307254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:51.308337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:51.315930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:51.779318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:51.798213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:51.801447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:51.803916 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1d2965de-253c-457a-9572-44a22adb07ef tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1486 microversion: 2.25 time: 0.652308 Sep 18 01:09:51.804742 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1020/2105] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:51 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1486 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:51.812074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:51.813250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:51.822851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:51.825038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:51.825941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:51.827112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:51.829507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:51.830385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.008572 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e111310c-9f48-4bb6-9c30-d8edbbd6d015 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.737400 Sep 18 01:09:52.011383 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1086/2106] 10.222.0.25 () {58 vars in 1293 bytes} [Sun Sep 18 01:09:51 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b/os-security-groups => generated 1157 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:52.021951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-08ceaf8c-c2af-4cab-ac7f-a62f25622a3a req-e0d41410-adc1-416d-bbd6-554d1e6f811c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8260bffc-93e7-4f80-97dd-ab880f38e22b", "tag": "f027a876-45e4-4a6f-ac37-d90685693687"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:52.052560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08ceaf8c-c2af-4cab-ac7f-a62f25622a3a req-e0d41410-adc1-416d-bbd6-554d1e6f811c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:52.053478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08ceaf8c-c2af-4cab-ac7f-a62f25622a3a req-e0d41410-adc1-416d-bbd6-554d1e6f811c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:52.054332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08ceaf8c-c2af-4cab-ac7f-a62f25622a3a req-e0d41410-adc1-416d-bbd6-554d1e6f811c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.075255 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-08ceaf8c-c2af-4cab-ac7f-a62f25622a3a req-e0d41410-adc1-416d-bbd6-554d1e6f811c service nova] Creating event network-changed:f027a876-45e4-4a6f-ac37-d90685693687 for instance 8260bffc-93e7-4f80-97dd-ab880f38e22b on n-h2-master-1 Sep 18 01:09:52.080609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-08ceaf8c-c2af-4cab-ac7f-a62f25622a3a req-e0d41410-adc1-416d-bbd6-554d1e6f811c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067103 Sep 18 01:09:52.082000 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1087/2107] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:52.209476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:52.236759 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6772e566-f105-463f-8411-988ae0343fa4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1510 microversion: 2.1 time: 0.430387 Sep 18 01:09:52.263493 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1021/2108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:51 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:52.263493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:52.263493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:52.269464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:52.270583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:52.271888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.273370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:52.275464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:52.276646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.364845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:09:52.384235 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Working on deleting snapshot 16efb9cb-4b2a-4fdb-b722-4bf38f275832 from shelved instance... Sep 18 01:09:52.413286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:52.424602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:52.425081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:52.427804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.428946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:52.437110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:52.437970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.519572 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-559ec0d4-aaf4-44f1-83d6-04e7ac29251c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.436158 Sep 18 01:09:52.520508 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1088/2109] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:09:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:52.526132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:52.528194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:52.539501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:52.540591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:52.541749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.547370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:52.548918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:52.550192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:52.974226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:52.984673 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bbacb856-7b37-4c71-8a3d-87d8abf003cd tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1308 microversion: 2.1 time: 0.462863 Sep 18 01:09:52.990363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1089/2110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:52 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:53.000919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c4c7b078-f354-4983-b40d-84cfff11b0dd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f70067c78b0>, body: {"security_group": {"name": " tempest-securitygroup -1323638208 ", "description": "tempest-description-943736236"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:53.480552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Doing local delete in cell bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=122373) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 18 01:09:53.483515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:53.484644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:53.485646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:53.486449 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 18 01:09:53.498140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] deallocate_for_instance() {{(pid=122373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 18 01:09:53.541377 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c4c7b078-f354-4983-b40d-84cfff11b0dd tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.547436 Sep 18 01:09:53.547430 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1090/2111] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:09:52 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:53.563694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:53.565600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:53.591649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:53.592337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:53.592895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:53.594068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:53.594644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:53.595176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:53.602838 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:54.018018 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:54.351423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:54.362156 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9cd907b6-1c87-42ee-a836-f9358f65d4c8 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1469 microversion: 2.1 time: 0.811083 Sep 18 01:09:54.363129 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1091/2112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:53 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1469 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:54.384245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:54.391812 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:54.392346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.servers [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Removing options 'limit' from query {{(pid=122374) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 18 01:09:54.393451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:54.395260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:54.395933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:54.396572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:54.397721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:54.398818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:54.399448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:54.401844 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8ca7d896-6ad6-4775-ab46-687f2343537e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.037539 Sep 18 01:09:54.403861 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1092/2113] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Sep 18 01:09:54 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:09:54.410751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:54.415624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:54.418229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:54.419259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:54.421049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:54.422124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:54.423370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:54.489932 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e236ba44-611b-409c-ab8a-bf5a558125e0 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.084095 Sep 18 01:09:54.491084 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1093/2114] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 18 01:09:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:54.496679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-26ac9aa3-b600-4553-a64b-af4161397245 req-a0c18031-edbf-4304-bf62-6ae9f17614d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8d0ab8-22db-4c08-b2db-be4f1b9b983a", "tag": "9a1b7e56-f05d-48b3-9e98-6e0303265579"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:54.508559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-26ac9aa3-b600-4553-a64b-af4161397245 req-a0c18031-edbf-4304-bf62-6ae9f17614d1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:54.509291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-26ac9aa3-b600-4553-a64b-af4161397245 req-a0c18031-edbf-4304-bf62-6ae9f17614d1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:54.509768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-26ac9aa3-b600-4553-a64b-af4161397245 req-a0c18031-edbf-4304-bf62-6ae9f17614d1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:54.526735 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-26ac9aa3-b600-4553-a64b-af4161397245 req-a0c18031-edbf-4304-bf62-6ae9f17614d1 service nova] Creating event network-changed:9a1b7e56-f05d-48b3-9e98-6e0303265579 for instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a on n-h1-master-1 Sep 18 01:09:54.535215 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-26ac9aa3-b600-4553-a64b-af4161397245 req-a0c18031-edbf-4304-bf62-6ae9f17614d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042364 Sep 18 01:09:54.536264 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1094/2115] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:54.541664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:54.542817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:54.549657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:54.550157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:54.550616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:54.551762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:54.552769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:54.553356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:54.906587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:54.923036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:54.934440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:54.935718 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fbb378eb-9228-4c81-be2c-85fb8cb91d82 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1476 microversion: 2.25 time: 0.398348 Sep 18 01:09:54.937108 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1095/2116] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:54 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:54.944394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1c8bf4c-1aa6-4c54-a99a-8767e26b224e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7006be09d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:55.104194 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1c8bf4c-1aa6-4c54-a99a-8767e26b224e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e" status: 200 len: 223 microversion: 2.1 time: 0.165292 Sep 18 01:09:55.104805 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1096/2117] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:09:54 2022] GET /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e => generated 223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:55.112070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:55.113137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:55.122916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.125638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.126244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.127180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.127780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.128662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.341897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Updating instance_info_cache with network_info: [] {{(pid=122373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:09:55.507497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:55.518772 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8345384e-3342-4c9b-b589-d2b98b21bde1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1308 microversion: 2.1 time: 0.412090 Sep 18 01:09:55.519912 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1097/2118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:55 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:55.525819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "name": "network-vif-unplugged", "status": "completed", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}, {"name": "network-changed", "server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:55.545603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.546460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.547123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.582310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] Creating event network-vif-unplugged:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h2-master-1 Sep 18 01:09:55.584491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] Creating event network-changed:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h2-master-1 Sep 18 01:09:55.599042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:09:55.620606 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-397a32d1-7791-4bae-a05e-e90c76067f1a req-6cf12b9a-2dd6-4463-8bd1-a166a6a3b844 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.098996 Sep 18 01:09:55.622261 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1098/2119] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:55.631389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:55.632303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:55.640260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.641227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.641934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.642798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.643516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.644241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.840001 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf2a1b4c-59ac-4a39-90a5-323292fb207e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 204 len: 0 microversion: 2.1 time: 3.589221 Sep 18 01:09:55.840887 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1022/2120] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:09:52 2022] DELETE /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 0 bytes in 3593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:09:55.847524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:55.852712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.853601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.854062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.854887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.855613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.856398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.893888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-95ee181e-4c7a-43f9-91cf-d23050565d79 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051072 Sep 18 01:09:55.894854 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1023/2121] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:09:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:55.904998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3ee77c0-dea9-45f5-b80f-477c6d3cbf1e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '.version_select at 0x7f700a78e820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:55.910441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3ee77c0-dea9-45f5-b80f-477c6d3cbf1e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.914257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3ee77c0-dea9-45f5-b80f-477c6d3cbf1e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.914257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3ee77c0-dea9-45f5-b80f-477c6d3cbf1e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.936608 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3ee77c0-dea9-45f5-b80f-477c6d3cbf1e tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3386 microversion: 2.25 time: 0.040167 Sep 18 01:09:55.941934 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1024/2122] 10.222.0.25 () {60 vars in 1184 bytes} [Sun Sep 18 01:09:55 2022] GET /compute/v2.1/os-migrations => generated 3386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:55.942194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:55.951254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ad9221f-5bf9-4bea-9aee-5342ee499f64 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f700a8225e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:55.964881 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b3b58f3-85c3-4af9-b696-276b906cb945 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1510 microversion: 2.1 time: 0.340877 Sep 18 01:09:55.977591 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1099/2123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:55 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:55.977591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:55.977591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:55.992621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.992621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.992621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:55.992621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:55.992621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:55.992621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.272364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:56.288066 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-818d9bdd-9b6b-4d8d-9bf8-825a8bb2a5e1 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1469 microversion: 2.1 time: 0.319280 Sep 18 01:09:56.289450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1100/2124] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:55 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1469 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:56.305349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:56.306868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:56.320660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.321209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.321712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.322458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.322935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.330454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.335712 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ad9221f-5bf9-4bea-9aee-5342ee499f64 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e" status: 202 len: 0 microversion: 2.1 time: 0.390894 Sep 18 01:09:56.343845 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1025/2125] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:09:55 2022] DELETE /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:09:56.348935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:56.360334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.367460 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:09:56.369632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.370240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.371967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.372605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd HTTP/1.1 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '65a49915-3f71-4dd6-be9d-f338b8b4b9bd'} Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:56.373164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.377440 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:56.377440 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:56.377440 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:56.377440 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:09:56.377440 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:09:56.377440 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:09:56.377440 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.378216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.379151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:09:56.382132 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b98170f3-3239-4c5a-bb33-dccf8bb2aa14 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 404 len: 111 microversion: 2.1 time: 0.088710 Sep 18 01:09:56.386804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1101/2126] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:56 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:09:56.394124 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:09:56.398593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:56.400458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:56.421479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.422021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.422531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.423319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.423986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.424749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.427409 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7948dc89-0f99-4407-88ca-4a3eb6f6217e tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.083101 Sep 18 01:09:56.435610 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1026/2127] 10.222.0.25 () {58 vars in 1194 bytes} [Sun Sep 18 01:09:56 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:09:56.440757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:56.448264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:56.470958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.471788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.472633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.473892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.474741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.475489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.822127 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:56.837116 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7d5e4e19-ec68-4f67-a292-5b51e2681e2e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 200 len: 1510 microversion: 2.1 time: 0.405421 Sep 18 01:09:56.840491 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1027/2128] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:56 2022] GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:56.848516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f11fcceb-00c7-4029-9663-555136985d1a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7005e83a60>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:56.894279 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-f11fcceb-00c7-4029-9663-555136985d1a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:09:56.894988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-f11fcceb-00c7-4029-9663-555136985d1a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group e2b6ff8b-70ee-4c01-b809-35b302da880e not found {{(pid=122373) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:09:56.900452 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f11fcceb-00c7-4029-9663-555136985d1a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:09:56.900452 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-1c916626-eec0-495f-baf2-abae03288a40'] Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f11fcceb-00c7-4029-9663-555136985d1a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e HTTP/1.1 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: exception: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-1c916626-eec0-495f-baf2-abae03288a40'] Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e2b6ff8b-70ee-4c01-b809-35b302da880e'} Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:09:56.904525 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c916626-eec0-495f-baf2-abae03288a40'] Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c916626-eec0-495f-baf2-abae03288a40'] Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c916626-eec0-495f-baf2-abae03288a40'] Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c916626-eec0-495f-baf2-abae03288a40'] Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f11fcceb-00c7-4029-9663-555136985d1a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:09:56.909808 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-1c916626-eec0-495f-baf2-abae03288a40'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:09:56.924149 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f11fcceb-00c7-4029-9663-555136985d1a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e" status: 404 len: 194 microversion: 2.1 time: 0.083176 Sep 18 01:09:56.924742 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1028/2129] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:09:56 2022] GET /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:09:56.941302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:56.945198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.945822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.946345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.947327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:56.947880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:56.948468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:56.981594 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c256b17-cc56-4c6e-a57e-0676753c6267 tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.054451 Sep 18 01:09:56.986324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] Lazy-loading 'services' on Instance uuid 188661e5-1bef-4e00-b59d-8def426eb404 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:09:56.990195 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1029/2130] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:09:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:56.997085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:56.997975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:57.005442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:57.006320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:57.006862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:57.008066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:57.008595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:57.009261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:57.010490 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-81ca725c-7d37-421a-9f29-5b87aec4f3fe tempest-LiveAutoBlockMigrationV225Test-578565836 tempest-LiveAutoBlockMigrationV225Test-578565836-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1969 microversion: 2.25 time: 0.623227 Sep 18 01:09:57.024697 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1102/2131] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:56 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1969 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:09:57.064640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-359411373", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b66b4645-3540-45b7-82ac-f51c6140e547"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:57.172454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] validate_networks() for [('b66b4645-3540-45b7-82ac-f51c6140e547', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:09:57.422650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:57.432485 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-222e7953-ee89-4abd-afc5-268196df0b8c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1308 microversion: 2.1 time: 0.440748 Sep 18 01:09:57.446585 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1030/2132] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:56 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:57.466418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:57.467851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:57.476070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:57.476638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:57.477438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:57.478335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:57.478996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:57.479551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:57.761719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:57.770837 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-956804f0-c57b-4b62-894f-0de37ae1ec1b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1511 microversion: 2.1 time: 0.322278 Sep 18 01:09:57.771417 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1031/2133] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:57 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:57.776312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4403b224-a066-4a54-9427-8414d88b9bda tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f7005e96a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-173417080", "description": "tempest-description-2015372927"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:58.002016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:09:58.002744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:09:58.003100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:09:58.003861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:09:58.004299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:09:58.016098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.016596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.017037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.018159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.019427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.020078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.060236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:09:58.069053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for user 253b3027efb74403a9bfaa4d2cbfd31e and project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:09:58.100191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:09:58.107305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:09:58.229884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7c6e307a-0ab1-40de-8951-39aadb19ab55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197403 Sep 18 01:09:58.233395 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1103/2134] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:09:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:09:58.248700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:58.261920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.263714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.264775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.266096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.266831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.268080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.274697 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4403b224-a066-4a54-9427-8414d88b9bda tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.500575 Sep 18 01:09:58.275881 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1032/2135] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:09:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:58.294985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:58.295664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:58.321992 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b568db0e-aa9f-45fb-a9ed-16bab428589c tempest-ServicesAdminNegativeTestJSON-776529046 tempest-ServicesAdminNegativeTestJSON-776529046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.085553 Sep 18 01:09:58.332445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.333376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.334245 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1104/2136] 10.222.0.25 () {58 vars in 1198 bytes} [Sun Sep 18 01:09:58 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:09:58.339063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.343803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:58.345147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.345418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:58.345922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.346420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.354618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.355734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.356835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.358353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.359355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.360440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.425981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:09:58.586649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f07d32d5-1091-41b6-9241-931f248e3b3b tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "DELETE /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 204 len: 0 microversion: 2.25 time: 0.308296 Sep 18 01:09:58.588032 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1033/2137] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:09:58 2022] DELETE /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:09:58.598699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-27d64542-65d5-4d51-87aa-2961bfc48866 req-c8a35e5e-2961-4bc9-869c-67cdcf33715c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a49915-3f71-4dd6-be9d-f338b8b4b9bd", "name": "network-vif-deleted", "tag": "6bc7822e-cef8-4029-a6cb-9afec75df693"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:58.615552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-27d64542-65d5-4d51-87aa-2961bfc48866 req-c8a35e5e-2961-4bc9-869c-67cdcf33715c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:58.616353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-27d64542-65d5-4d51-87aa-2961bfc48866 req-c8a35e5e-2961-4bc9-869c-67cdcf33715c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:58.617061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-27d64542-65d5-4d51-87aa-2961bfc48866 req-c8a35e5e-2961-4bc9-869c-67cdcf33715c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:58.637884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.compute.server_external_events [req-27d64542-65d5-4d51-87aa-2961bfc48866 req-c8a35e5e-2961-4bc9-869c-67cdcf33715c service nova] Unable to find a host for instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd. Dropping event network-vif-deleted {{(pid=122373) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 18 01:09:58.639376 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-27d64542-65d5-4d51-87aa-2961bfc48866 req-c8a35e5e-2961-4bc9-869c-67cdcf33715c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049546 Sep 18 01:09:58.640691 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1034/2138] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 18 01:09:58.646579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:58.655937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:58.656779 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:09:58.733382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:58.743721 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ec8e384-16c1-4302-b5fa-9e101f570e2d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1469 microversion: 2.1 time: 0.407746 Sep 18 01:09:58.744335 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1105/2139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:58 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:58.753883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a759056-651a-407e-b743-b9ca650b5dcd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:58.754868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a759056-651a-407e-b743-b9ca650b5dcd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:58.880872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a759056-651a-407e-b743-b9ca650b5dcd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:58.891313 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a759056-651a-407e-b743-b9ca650b5dcd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1214 microversion: 2.1 time: 0.143385 Sep 18 01:09:58.891910 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1106/2140] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:58 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:09:58.915963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ce714f6-883c-4997-9fd5-904ab0ad0848 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f70064db310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1550509979", "description": "tempest-description-1910807420"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:09:59.056322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:59.068158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:59.070137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:59.072605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:59.075108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:59.077427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:59.296354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:09:59.468113 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ce714f6-883c-4997-9fd5-904ab0ad0848 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.574020 Sep 18 01:09:59.477288 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1107/2141] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:09:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:59.504985 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c90006af-5be7-4554-baca-c6b8fd353f45 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.862465 Sep 18 01:09:59.514181 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1035/2142] 10.222.0.25 () {58 vars in 1154 bytes} [Sun Sep 18 01:09:58 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:09:59.530661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:59.535538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:59.563887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:59.564837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:59.565609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:59.566831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:59.567705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:59.569953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:59.716771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34d1438a-eba9-43f2-b082-e69e907f0ea6 tempest-ServicesAdminNegativeTestJSON-719851005 tempest-ServicesAdminNegativeTestJSON-719851005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:59.722201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-34d1438a-eba9-43f2-b082-e69e907f0ea6 tempest-ServicesAdminNegativeTestJSON-719851005 tempest-ServicesAdminNegativeTestJSON-719851005-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '807c0a4b440a4ba59b7b658d9e0c68bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d5fefd6b54a0f8e777ea8977e25ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34d1438a-eba9-43f2-b082-e69e907f0ea6 tempest-ServicesAdminNegativeTestJSON-719851005 tempest-ServicesAdminNegativeTestJSON-719851005-project] Request method failure captured: Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm_dSzUsaVz3tT3Dy6BgO89EJ--ue-8aPYfGGkSwv-_1og06ynHR9-EeU7tDOxOBpAHxKs9lbzUcVhxEjgOcrR7XxbDTLqbY6IGsAwLiM9W3ktSNuUJHENKWR5FFMgWdWpyAjRG3DSgvXgEz5OTQhNX-UxC7jtDHHtAsKl98qEhwET4 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c35d5fefd6b54a0f8e777ea8977e25ac Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-719851005 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c35d5fefd6b54a0f8e777ea8977e25ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c35d5fefd6b54a0f8e777ea8977e25ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c35d5fefd6b54a0f8e777ea8977e25ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c35d5fefd6b54a0f8e777ea8977e25ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-719851005 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c35d5fefd6b54a0f8e777ea8977e25ac Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-719851005 Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServicesAdminNegativeTestJSON-719851005-project Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 807c0a4b440a4ba59b7b658d9e0c68bb Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-719851005-project Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 18 01:09:59.724401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 18 01:09:59.728375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:09:59.729870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34d1438a-eba9-43f2-b082-e69e907f0ea6 tempest-ServicesAdminNegativeTestJSON-719851005 tempest-ServicesAdminNegativeTestJSON-719851005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:09:59.731823 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34d1438a-eba9-43f2-b082-e69e907f0ea6 tempest-ServicesAdminNegativeTestJSON-719851005 tempest-ServicesAdminNegativeTestJSON-719851005-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.252633 Sep 18 01:09:59.733539 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1108/2143] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:09:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:09:59.750973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:09:59.751970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:09:59.769285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:59.770253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:59.770900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:59.772171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:09:59.774170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:09:59.775373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:09:59.955324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:09:59.971177 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6fb275fa-e824-4df5-9ef7-59517bc37ac3 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1308 microversion: 2.1 time: 0.458458 Sep 18 01:09:59.991192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1036/2144] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:09:59 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:00.015792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5225d86b-b9f9-4d84-882a-9f978acfe4a6 req-17542ca3-d41f-4d93-8ab6-ac3783b01fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8d0ab8-22db-4c08-b2db-be4f1b9b983a", "name": "network-vif-plugged", "status": "completed", "tag": "9a1b7e56-f05d-48b3-9e98-6e0303265579"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:00.050912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5225d86b-b9f9-4d84-882a-9f978acfe4a6 req-17542ca3-d41f-4d93-8ab6-ac3783b01fc1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:00.051435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5225d86b-b9f9-4d84-882a-9f978acfe4a6 req-17542ca3-d41f-4d93-8ab6-ac3783b01fc1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:00.051881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5225d86b-b9f9-4d84-882a-9f978acfe4a6 req-17542ca3-d41f-4d93-8ab6-ac3783b01fc1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:00.110780 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5225d86b-b9f9-4d84-882a-9f978acfe4a6 req-17542ca3-d41f-4d93-8ab6-ac3783b01fc1 service nova] Creating event network-vif-plugged:9a1b7e56-f05d-48b3-9e98-6e0303265579 for instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a on n-h1-master-1 Sep 18 01:10:00.128121 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5225d86b-b9f9-4d84-882a-9f978acfe4a6 req-17542ca3-d41f-4d93-8ab6-ac3783b01fc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121573 Sep 18 01:10:00.129211 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1037/2145] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:00.135784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11eca63e-d8f4-46b4-a765-181ff32747cb tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f700a7b0820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1510226916", "description": "tempest-description-760079208"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:00.371901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:00.387946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:00.393874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:00.400696 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-476a4b47-00ce-420d-949a-6dc6b7cfe874 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1482 microversion: 2.25 time: 0.664493 Sep 18 01:10:00.404473 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1109/2146] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:09:59 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1482 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:00.414715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:00.416736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:00.436086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:00.439667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:00.440562 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:00.443801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:00.445745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:00.447865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:00.751731 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11eca63e-d8f4-46b4-a765-181ff32747cb tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.621073 Sep 18 01:10:00.752444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1038/2147] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:10:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:00.768948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:00.770018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:00.779425 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:00.782878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:00.783722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:00.785425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:00.786442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:00.787145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:00.787825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:00.877109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:00.891913 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0fd0746d-b5d0-4118-a57d-66aa67f6c750 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1510 microversion: 2.1 time: 0.485782 Sep 18 01:10:00.893783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1110/2148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:00 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1510 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:00.919392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:00.926530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:00.948542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:00.950091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:00.950723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:00.952356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:00.955153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:00.956082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:01.050005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:01.072064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b1248857-b67e-4125-af50-e739cc57db1d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1266 microversion: 2.1 time: 0.175522 Sep 18 01:10:01.073147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1111/2149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:00 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:01.085871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-042506ac-0c3b-4e17-920f-d47e1bbaebf8 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f700624ad30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:01.177335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:01.190739 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9de28f07-340b-43f8-9b79-358d34dc73f3 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1462 microversion: 2.1 time: 0.427044 Sep 18 01:10:01.193279 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1039/2150] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:00 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1462 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:01.203659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:01.204366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:01.215853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:01.217464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:01.217464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:01.219240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:01.219597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:01.220339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:01.704927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:01.716207 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d33d0894-2741-427d-b46e-7e36a557097f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 200 len: 1510 microversion: 2.1 time: 0.521074 Sep 18 01:10:01.716796 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1040/2151] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:01 2022] GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:01.730210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:01.739443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:01.775481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:01.776245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:01.793905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:01.796600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:01.797247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:01.799748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:02.067862 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-042506ac-0c3b-4e17-920f-d47e1bbaebf8 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.992556 Sep 18 01:10:02.069323 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1112/2152] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:10:01 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:02.604851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:02.606836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:02.639992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:02.643113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:02.644076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:02.646038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:02.649387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:02.650674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:02.957238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:02.979178 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d89e17df-41f4-427f-8ed6-87b5be4e6bf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1308 microversion: 2.1 time: 1.257261 Sep 18 01:10:02.979843 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1041/2153] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:01 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1308 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:02.984959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:02.985953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:03.003689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:03.004457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:03.005065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:03.005988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:03.006606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:03.007191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:03.051558 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1327e94d-4bb3-4ff5-948c-179dadc7640f tempest-MigrationsAdminTest-809533897 tempest-MigrationsAdminTest-809533897-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1613 microversion: 2.1 time: 0.979768 Sep 18 01:10:03.069980 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1113/2154] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:02 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1613 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:03.085318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ebe61435-a3f2-44eb-8f30-cd897ffdc0b1 req-01db2c71-64c1-4ae2-95b9-3f7e149ff8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188661e5-1bef-4e00-b59d-8def426eb404", "name": "network-vif-deleted", "tag": "b344c9d6-d712-42e7-8ffc-b3a6a5b360f3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:03.130507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ebe61435-a3f2-44eb-8f30-cd897ffdc0b1 req-01db2c71-64c1-4ae2-95b9-3f7e149ff8b8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:03.131843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ebe61435-a3f2-44eb-8f30-cd897ffdc0b1 req-01db2c71-64c1-4ae2-95b9-3f7e149ff8b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:03.132934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ebe61435-a3f2-44eb-8f30-cd897ffdc0b1 req-01db2c71-64c1-4ae2-95b9-3f7e149ff8b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:03.134121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:03.146016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:03.148350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:03.150250 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09c9d439-019b-47b1-a328-e288a6bdada0 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1266 microversion: 2.25 time: 0.169093 Sep 18 01:10:03.162395 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1042/2155] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:02 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:03.175580 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ebe61435-a3f2-44eb-8f30-cd897ffdc0b1 req-01db2c71-64c1-4ae2-95b9-3f7e149ff8b8 service nova] Creating event network-vif-deleted:b344c9d6-d712-42e7-8ffc-b3a6a5b360f3 for instance 188661e5-1bef-4e00-b59d-8def426eb404 on n-h2-master-1 Sep 18 01:10:03.183722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ebe61435-a3f2-44eb-8f30-cd897ffdc0b1 req-01db2c71-64c1-4ae2-95b9-3f7e149ff8b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109431 Sep 18 01:10:03.185852 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1114/2156] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:03.189958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:03.191735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:03.199070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:03.199937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:03.200629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:03.201625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:03.202343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:03.202984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:03.216563 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d61aa220-7459-49f9-9072-4694c1d87b83 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70064db550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:03.746440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:03.756126 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5bc070f8-0916-4b2a-a54f-53b5fdcc689f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1511 microversion: 2.1 time: 0.592324 Sep 18 01:10:03.763070 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1043/2157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:03 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:03.769020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:03.786153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:03.795563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:03.796126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:03.796787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:03.813598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:03.815506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:03.816101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.224251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d61aa220-7459-49f9-9072-4694c1d87b83 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a" status: 202 len: 0 microversion: 2.1 time: 1.035896 Sep 18 01:10:04.225150 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1115/2158] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:10:03 2022] DELETE /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:10:04.230818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5944eabf-a2ea-4a0e-bf84-094210986760 req-26780b08-7689-431f-8ac8-ead8919120e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "name": "network-vif-plugged", "status": "completed", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:04.250665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:04.261635 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-410d99e9-256c-40f8-9aa0-ce84752d7aec tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 0.497087 Sep 18 01:10:04.262471 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1044/2159] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:03 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:04.266302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5944eabf-a2ea-4a0e-bf84-094210986760 req-26780b08-7689-431f-8ac8-ead8919120e1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.267017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5944eabf-a2ea-4a0e-bf84-094210986760 req-26780b08-7689-431f-8ac8-ead8919120e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.267602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5944eabf-a2ea-4a0e-bf84-094210986760 req-26780b08-7689-431f-8ac8-ead8919120e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.278501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:04.282507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:04.307918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.313226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.314561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.318174 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5944eabf-a2ea-4a0e-bf84-094210986760 req-26780b08-7689-431f-8ac8-ead8919120e1 service nova] Creating event network-vif-plugged:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h2-master-1 Sep 18 01:10:04.319772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.320803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.326014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.350346 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5944eabf-a2ea-4a0e-bf84-094210986760 req-26780b08-7689-431f-8ac8-ead8919120e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123165 Sep 18 01:10:04.351438 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1116/2160] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:04.381205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:04.398094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:04.404673 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:10:04.421247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.422093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.422734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.423769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.424445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.425098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.426619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:04.478771 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:04.534530 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05645abf-dd2c-4727-996a-782c12d0e0d7 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 204 len: 0 microversion: 2.1 time: 0.270235 Sep 18 01:10:04.535398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1045/2161] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:04 2022] DELETE /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:04.547777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:04.549966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:04.567553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.568241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.568833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.569915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.572381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.573010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:04.617154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:10:04.738887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:04.748927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:04.749756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:04.750364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.119067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:05.137609 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fd2a0c5f-c947-4625-bc55-294fbcdd33cf tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1487 microversion: 2.1 time: 0.600385 Sep 18 01:10:05.138836 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1046/2162] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:04 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1487 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:05.158015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:05.159581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:05.172952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.173994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.175039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.176987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.178224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.179275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.310081 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:05.316810 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ce11f1c-ef28-41fd-892b-8dbb9b951982 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.942486 Sep 18 01:10:05.318643 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1117/2163] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:10:04 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:05.331145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49b14461-6af6-47b3-a462-3d982c910431 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70066983a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:05.357703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:05.364689 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:05.367816 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dfc20857-1d3f-40b4-9a99-562ac61f9087 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1266 microversion: 2.25 time: 0.226830 Sep 18 01:10:05.369712 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1047/2164] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:05 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:05.378364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:05.379758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:05.391243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.392261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.392720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.393461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.393965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.394390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.397785 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-49b14461-6af6-47b3-a462-3d982c910431 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:10:05.399330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-49b14461-6af6-47b3-a462-3d982c910431 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:10:05.400393 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-49b14461-6af6-47b3-a462-3d982c910431 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:10:05.400393 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-6e11512a-9122-4b61-87a1-a78af0487aa0'] Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49b14461-6af6-47b3-a462-3d982c910431 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a HTTP/1.1 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: exception: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-6e11512a-9122-4b61-87a1-a78af0487aa0'] Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '7b219fa0-bece-4790-9993-2cbe5bf7b19a'} Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:10:05.406017 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e11512a-9122-4b61-87a1-a78af0487aa0'] Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e11512a-9122-4b61-87a1-a78af0487aa0'] Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e11512a-9122-4b61-87a1-a78af0487aa0'] Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e11512a-9122-4b61-87a1-a78af0487aa0'] Sep 18 01:10:05.411669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:05.419059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49b14461-6af6-47b3-a462-3d982c910431 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:10:05.419059 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-6e11512a-9122-4b61-87a1-a78af0487aa0'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:05.420059 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-49b14461-6af6-47b3-a462-3d982c910431 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a" status: 404 len: 194 microversion: 2.1 time: 0.097774 Sep 18 01:10:05.421731 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1118/2165] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:10:05 2022] GET /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:05.446220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:05.455198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:05.478307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.478822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.483066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.492073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.500761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.501458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.614447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lazy-loading 'flavor' on Instance uuid db8d0ab8-22db-4c08-b2db-be4f1b9b983a {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:10:05.702194 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:05.839673 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8360dbb-7852-4de4-b087-07574e36ad91 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a/action" status: 202 len: 0 microversion: 2.1 time: 0.414442 Sep 18 01:10:05.841889 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1119/2166] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:10:05 2022] POST /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:10:05.854189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:05.857470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:05.868346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.869249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.869941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:05.872174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:05.872989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:05.873727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:06.195286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:06.215201 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e5c21b4-94a8-45e6-9659-fbcc58c4a89d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1468 microversion: 2.1 time: 0.842760 Sep 18 01:10:06.231764 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1048/2167] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:05 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1468 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:06.242412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:06.242412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:06.248924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:10:06.386287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:06.404405 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d152ae18-34d3-4e41-abe5-8bf7f0ba5e37 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 0.560740 Sep 18 01:10:06.407203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1120/2168] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:05 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:06.433984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2d44841-7a89-4420-9b1f-a294eed12d8b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f700680adc0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:06.630128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:06.637222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:06.638382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:06.640244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:06.647480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:06.649909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:06.761806 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2d44841-7a89-4420-9b1f-a294eed12d8b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111" status: 202 len: 0 microversion: 2.1 time: 0.331573 Sep 18 01:10:06.762973 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1121/2169] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:10:06 2022] DELETE /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:10:06.769002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:06.769942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:06.789245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:06.795525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:06.796435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:06.797982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:06.801629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:06.802966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:06.839626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:10:06.951094 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-147c1992-960a-4089-a890-602a6284b91d tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.728969 Sep 18 01:10:06.952683 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1049/2170] 10.222.0.25 () {58 vars in 1150 bytes} [Sun Sep 18 01:10:06 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:06.960101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a1c934cd-2a77-45fa-b68d-1ff35ced1748 req-5a525a16-1ecc-47e3-b0d4-34555d522115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb3142d-5147-43e9-b2f4-653d52b7f265", "tag": "f65fd6db-79a6-4955-babd-630e6a9fc218"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:06.971284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a1c934cd-2a77-45fa-b68d-1ff35ced1748 req-5a525a16-1ecc-47e3-b0d4-34555d522115 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:06.972499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a1c934cd-2a77-45fa-b68d-1ff35ced1748 req-5a525a16-1ecc-47e3-b0d4-34555d522115 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:06.973212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a1c934cd-2a77-45fa-b68d-1ff35ced1748 req-5a525a16-1ecc-47e3-b0d4-34555d522115 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:06.994060 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a1c934cd-2a77-45fa-b68d-1ff35ced1748 req-5a525a16-1ecc-47e3-b0d4-34555d522115 service nova] Creating event network-changed:f65fd6db-79a6-4955-babd-630e6a9fc218 for instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 on n-h1-master-1 Sep 18 01:10:07.004586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a1c934cd-2a77-45fa-b68d-1ff35ced1748 req-5a525a16-1ecc-47e3-b0d4-34555d522115 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049920 Sep 18 01:10:07.006346 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1050/2171] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:07.019046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:07.020685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:07.033704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:07.034986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:07.036441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:07.038372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:07.039576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:07.040613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:07.327646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:07.355642 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0255a5c3-7459-4912-a2e1-db5f47b3dd4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 200 len: 1478 microversion: 2.1 time: 0.590378 Sep 18 01:10:07.370412 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1122/2172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:06 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 1478 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:07.382252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:07.394547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fcdbb21c-13a0-44ac-96b5-49594b421980 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70067c7a60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:07.405193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:07.408401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:07.420029 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5eb2bf43-e84c-462e-9427-fa3a3b3d0eac tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 200 len: 1266 microversion: 2.25 time: 0.411240 Sep 18 01:10:07.421481 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1051/2173] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:07 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 1266 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:07.434461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:07.460822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:07.462406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:10:07.474056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:07.475286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:07.476103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:07.477524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:07.478385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:07.479153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:07.623234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:10:07.724799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4de77c34-1112-488d-88fa-b7c05c01dd5b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.301277 Sep 18 01:10:07.726764 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1052/2174] 10.222.0.25 () {58 vars in 1212 bytes} [Sun Sep 18 01:10:07 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:07.738951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:07.739790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:07.756258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:07.757063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:07.757694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:07.762826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:07.763411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:07.764019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:08.085593 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-fcdbb21c-13a0-44ac-96b5-49594b421980 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:10:08.086621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-fcdbb21c-13a0-44ac-96b5-49594b421980 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group 0b13d626-befe-4b07-a025-82bbcda23111 not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:10:08.087156 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-fcdbb21c-13a0-44ac-96b5-49594b421980 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:10:08.087156 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-8ac2cf18-076d-443d-b1a0-f7d23aa2601c'] Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fcdbb21c-13a0-44ac-96b5-49594b421980 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111 HTTP/1.1 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: exception: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-8ac2cf18-076d-443d-b1a0-f7d23aa2601c'] Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0b13d626-befe-4b07-a025-82bbcda23111'} Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:10:08.089587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ac2cf18-076d-443d-b1a0-f7d23aa2601c'] Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ac2cf18-076d-443d-b1a0-f7d23aa2601c'] Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ac2cf18-076d-443d-b1a0-f7d23aa2601c'] Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ac2cf18-076d-443d-b1a0-f7d23aa2601c'] Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fcdbb21c-13a0-44ac-96b5-49594b421980 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-8ac2cf18-076d-443d-b1a0-f7d23aa2601c'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:08.097876 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fcdbb21c-13a0-44ac-96b5-49594b421980 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111" status: 404 len: 194 microversion: 2.1 time: 0.724359 Sep 18 01:10:08.107561 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1123/2175] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:10:07 2022] GET /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111 => generated 194 bytes in 737 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:08.109033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1302079991"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:08.117435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:08.135475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:08.137267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:08.137914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:08.139022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:08.139658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:08.140093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:08.500554 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9877919-da6c-43e9-9ecf-027b45310e7b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a/action" status: 202 len: 0 microversion: 2.1 time: 0.395906 Sep 18 01:10:08.502919 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1124/2176] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:10:08 2022] POST /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:10:08.509418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:08.510201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:08.555812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:08.556913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:08.561137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:08.568701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:08.569410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:08.572252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:08.782276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:08.799134 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f5bae22-6248-436c-8068-28ab5af8ecef tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1468 microversion: 2.1 time: 1.070664 Sep 18 01:10:08.800135 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1053/2177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:07 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1468 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:08.831439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:08.838301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:08.839845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:10:08.846798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:08.847604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:08.848412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:08.849628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:08.850479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:08.851806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:08.987378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:10:09.059574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30995bbf-9ed3-49c4-9a5c-a272bcf8e0d9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.240889 Sep 18 01:10:09.067590 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1054/2178] 10.222.0.25 () {58 vars in 1196 bytes} [Sun Sep 18 01:10:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:09.067590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7aa201af-c82f-4281-bcb4-a35f0a2d567d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7005ecd310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:10.438700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:10.475171 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1038ec40-7667-4991-8598-6122c029b910 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 1.970003 Sep 18 01:10:10.476884 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1125/2179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:08 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:10.485756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:10.486971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 188661e5-1bef-4e00-b59d-8def426eb404] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:10.503419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:10.504370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:10.505127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:10.506530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:10.507826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:10.508718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:10.566900 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] HTTP exception thrown: Instance 188661e5-1bef-4e00-b59d-8def426eb404 could not be found. Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Request method failure captured: Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 HTTP/1.1 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4hJnRLsbjlYw9cPwehTsELaIY-Or2dqyONr38QZANR-RcguUMNJdPCYvWxNlo4DxPs61eTgt__L7Z5ygQMBY4ZkkZBJHbiM38dG2YxQhg5lpMjEtyfeE4CQnSlgGtm1_eA4JCMkvxfiuE19cb-CP2w4ZtM8oomP5wxIko-xb4uegY Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.25 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: bb1c3f4298d34bb2a820ec5de46a76c2 Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 188661e5-1bef-4e00-b59d-8def426eb404 could not be found. Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '188661e5-1bef-4e00-b59d-8def426eb404'} Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188661e5-1bef-4e00-b59d-8def426eb404 could not be found. Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188661e5-1bef-4e00-b59d-8def426eb404 could not be found. Sep 18 01:10:10.569093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188661e5-1bef-4e00-b59d-8def426eb404 could not be found. Sep 18 01:10:10.573608 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:10.583751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Returning 404 to user: Instance 188661e5-1bef-4e00-b59d-8def426eb404 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:10.586646 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ff30804c-711f-4a4b-b24a-459b1d881832 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404" status: 404 len: 111 microversion: 2.25 time: 0.106907 Sep 18 01:10:10.607310 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1126/2180] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:10 2022] GET /compute/v2.1/servers/188661e5-1bef-4e00-b59d-8def426eb404 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:10:10.627315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f123cf9-f9cd-4758-81d1-b63e342a6884 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f700651d820>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:10.690182 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7aa201af-c82f-4281-bcb4-a35f0a2d567d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc" status: 202 len: 0 microversion: 2.1 time: 1.628386 Sep 18 01:10:10.694922 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1055/2181] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:10:09 2022] DELETE /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc => generated 0 bytes in 1634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:10:10.706151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:10.737722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:10.738503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'name': '1209650589', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:10:10.745069 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f123cf9-f9cd-4758-81d1-b63e342a6884 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.133190 Sep 18 01:10:10.746825 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1127/2182] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:10 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:10.769912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:10.778729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:10.779348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:10.780280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:10.780760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:10.781256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:10.798301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:10.801029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:10.828463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:10.829380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:10.830150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:10.831051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:10.836267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:10.836992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:10.911352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:10.911843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:10.912273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:10.913435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lazy-loading 'fault' on Instance uuid 5a4e3456-2c65-471b-be29-bd51da95d5b2 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:10:11.024105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:10:11.159229 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57eabdc7-898c-4db5-83b9-3e2ee9998e40 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?name=1209650589" status: 200 len: 346 microversion: 2.1 time: 0.462953 Sep 18 01:10:11.159844 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1056/2183] 10.222.0.25 () {58 vars in 1156 bytes} [Sun Sep 18 01:10:10 2022] GET /compute/v2.1/servers?name=1209650589 => generated 346 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:11.171831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0560bbf7-b674-4414-8b38-a9907fccb9d0 req-f005567b-75d9-418b-8490-a0ee7913ea92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4e3456-2c65-471b-be29-bd51da95d5b2", "name": "network-vif-deleted", "tag": "270b066b-1143-4280-a0cb-b9bb7917849f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:11.200091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0560bbf7-b674-4414-8b38-a9907fccb9d0 req-f005567b-75d9-418b-8490-a0ee7913ea92 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:11.201596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0560bbf7-b674-4414-8b38-a9907fccb9d0 req-f005567b-75d9-418b-8490-a0ee7913ea92 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:11.202071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0560bbf7-b674-4414-8b38-a9907fccb9d0 req-f005567b-75d9-418b-8490-a0ee7913ea92 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:11.230013 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0560bbf7-b674-4414-8b38-a9907fccb9d0 req-f005567b-75d9-418b-8490-a0ee7913ea92 service nova] Creating event network-vif-deleted:270b066b-1143-4280-a0cb-b9bb7917849f for instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 on n-h2-master-1 Sep 18 01:10:11.237661 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0560bbf7-b674-4414-8b38-a9907fccb9d0 req-f005567b-75d9-418b-8490-a0ee7913ea92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069517 Sep 18 01:10:11.247207 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1057/2184] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:11.252970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33bd3080-0313-4d06-857f-59f9318b9b1c tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7005e83ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:11.312737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:11.339295 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb243b88-3714-4613-bebf-3d9716d5815d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 200 len: 1303 microversion: 2.1 time: 0.586274 Sep 18 01:10:11.340692 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1128/2185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:10 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 1303 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:11.357709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:11.381637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:11.387020 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-33bd3080-0313-4d06-857f-59f9318b9b1c tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:10:11.387735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-33bd3080-0313-4d06-857f-59f9318b9b1c tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group d5482b97-39ea-4310-a024-d99e8eee29dc not found {{(pid=122373) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:10:11.388527 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-33bd3080-0313-4d06-857f-59f9318b9b1c tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:10:11.388527 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-9cb2f3eb-0874-454a-a58a-71c8b6f51dbd'] Sep 18 01:10:11.389592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33bd3080-0313-4d06-857f-59f9318b9b1c tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc HTTP/1.1 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: exception: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-9cb2f3eb-0874-454a-a58a-71c8b6f51dbd'] Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd5482b97-39ea-4310-a024-d99e8eee29dc'} Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:10:11.393463 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cb2f3eb-0874-454a-a58a-71c8b6f51dbd'] Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cb2f3eb-0874-454a-a58a-71c8b6f51dbd'] Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cb2f3eb-0874-454a-a58a-71c8b6f51dbd'] Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cb2f3eb-0874-454a-a58a-71c8b6f51dbd'] Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33bd3080-0313-4d06-857f-59f9318b9b1c tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-9cb2f3eb-0874-454a-a58a-71c8b6f51dbd'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33bd3080-0313-4d06-857f-59f9318b9b1c tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc" status: 404 len: 194 microversion: 2.1 time: 0.146381 Sep 18 01:10:11.397624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1058/2186] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:10:11 2022] GET /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:11.409413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:11.410544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ffe256c9-ebae-42e4-86f0-0716eee3bd5f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7005ecd160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:11.416441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:11.418622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:11.421982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:11.426708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:11.430707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:11.697904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:10:11.860534 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52fb7016-e5d4-4079-b480-1142efd79cdc tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.518172 Sep 18 01:10:11.869411 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1129/2187] 10.222.0.25 () {58 vars in 1154 bytes} [Sun Sep 18 01:10:11 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:11.884456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:11.885702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:11.897389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:11.905781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:11.906501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:11.907411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:11.908039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:11.908620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:12.574507 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ffe256c9-ebae-42e4-86f0-0716eee3bd5f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.173179 Sep 18 01:10:12.575418 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1059/2188] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:10:11 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:12.581468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3cf15321-4909-4248-af7b-e930bd412027 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005e838b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:12.628458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:12.638637 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-034c01c2-ebbd-40fa-8903-78d269bb4014 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 0.767414 Sep 18 01:10:12.639443 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1130/2189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:11 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:12.658137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:12.683955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:12.692449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-120965058', 'deleted': False, 'project_id': '36c54fe985874691b9b648f92da02020'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:10:12.700523 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:12.709696 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3cf15321-4909-4248-af7b-e930bd412027 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.132939 Sep 18 01:10:12.710295 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1060/2190] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:12 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:12.717092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:12.719053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:12.719734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:12.722878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:12.726618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:12.728090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:12.732933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 5a4e3456-2c65-471b-be29-bd51da95d5b2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:12.733424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:12.755767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:12.756127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:12.756574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:12.757297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:12.767732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:12.768284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:12.835481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] HTTP exception thrown: Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 could not be found. Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Request method failure captured: Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 HTTP/1.1 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm54AtMUV9jtJ0DI1QOslB9KIGJot8iuJrkx4XhPvEFPfgNbfLTmlOU0XTXOYXC8mmusuYgboAWtFcCE1xd3GsBCmuAuGYMAfyWNlCJDj8WfS0PB8cfVjk3Iv9_6iXAKvniW5pJRl0PIL9G1PKNplzSbTIM4tqEWnTHRCMCuQj8IW30 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 666826ce8e51441ea7c271be4c5d8eb9 Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 could not be found. Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5a4e3456-2c65-471b-be29-bd51da95d5b2'} Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 could not be found. Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 could not be found. Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:12.842590 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:12.846891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:12.846891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:12.846891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:12.846891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:12.846891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:12.846891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 could not be found. Sep 18 01:10:12.846891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:12.849378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Returning 404 to user: Instance 5a4e3456-2c65-471b-be29-bd51da95d5b2 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:12.850502 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae5b3b1b-7f06-4bbf-9ae3-a1822c1b0c1d tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2" status: 404 len: 111 microversion: 2.1 time: 0.139272 Sep 18 01:10:12.858771 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1061/2191] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:12 2022] GET /compute/v2.1/servers/5a4e3456-2c65-471b-be29-bd51da95d5b2 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:12.872740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad6a4f05-d77c-41fc-bd4c-ba425a82c1a5 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f7005e839d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1931875344", "description": "tempest-description-342213115"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:13.145685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:10:13.353621 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-815a4cf1-189a-42f1-94cd-ed389ef91962 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-120965058" status: 200 len: 346 microversion: 2.1 time: 0.701036 Sep 18 01:10:13.365572 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1131/2192] 10.222.0.25 () {58 vars in 1228 bytes} [Sun Sep 18 01:10:12 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-120965058 => generated 346 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:13.371173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:13.371173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:13.388612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:13.394721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:13.395711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:13.397870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:13.398485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:13.399281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:13.443695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:13.566539 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8e2294f5-1068-41ed-9741-8eddadbe7684 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 204 len: 0 microversion: 2.1 time: 0.205013 Sep 18 01:10:13.568045 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1132/2193] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:13 2022] DELETE /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:13.577336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:13.579339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:13.588571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:13.590006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:13.590937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:13.592700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:13.593598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:13.594900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:13.632356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:13.700721 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:13.822127 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82cce4e6-d32c-48dd-b1aa-83d24572e1f3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 204 len: 0 microversion: 2.1 time: 0.251263 Sep 18 01:10:13.828243 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1133/2194] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:13 2022] DELETE /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:13.835272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:13.835997 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:13.855895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:13.858618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:13.859392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:13.864414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:13.864987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:13.865446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:13.936027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ad6a4f05-d77c-41fc-bd4c-ba425a82c1a5 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.074757 Sep 18 01:10:13.936027 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1062/2195] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:10:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:13.942388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:13.957499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:13.986324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:13.992598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:13.995616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:13.998196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:14.008880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:14.011166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:14.734181 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:15.052678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:15.067215 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5af88270-72e2-45eb-b965-d88a34bbe0ee tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1535 microversion: 2.1 time: 1.237544 Sep 18 01:10:15.068096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1134/2196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:13 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1535 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:15.082578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1dae56ce-2457-41ce-b12f-92e394a2cf34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7006411550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:15.086047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:15.102914 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c97e5347-6994-4816-8239-7800a8ae757f tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 1.165974 Sep 18 01:10:15.108170 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1063/2197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:13 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:15.119168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:15.123582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:15.151799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:15.152801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:15.153402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:15.154382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:15.154988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:15.156364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:15.195079 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1dae56ce-2457-41ce-b12f-92e394a2cf34 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.125130 Sep 18 01:10:15.196046 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1135/2198] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:15 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:15.206699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76139211-31b9-46ef-8eb0-599a45499e12 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f7006d34ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1647832118", "description": "tempest-description-856712217"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:16.057464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:16.079056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f490ce95-e8d6-4145-a851-a10910114b30 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1517 microversion: 2.1 time: 0.967933 Sep 18 01:10:16.081030 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1064/2199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:15 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1517 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:16.109306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-22c61dc3-64af-4bb5-a1b5-3aa76fd81e8d req-856c7e22-ad35-4af0-ba04-31bb240a06f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8d0ab8-22db-4c08-b2db-be4f1b9b983a", "name": "network-vif-plugged", "status": "completed", "tag": "9a1b7e56-f05d-48b3-9e98-6e0303265579"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:16.149058 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76139211-31b9-46ef-8eb0-599a45499e12 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.951101 Sep 18 01:10:16.149900 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1136/2200] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:10:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:16.156716 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:16.158807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:16.164652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-22c61dc3-64af-4bb5-a1b5-3aa76fd81e8d req-856c7e22-ad35-4af0-ba04-31bb240a06f0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:16.189996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-22c61dc3-64af-4bb5-a1b5-3aa76fd81e8d req-856c7e22-ad35-4af0-ba04-31bb240a06f0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:16.194864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-22c61dc3-64af-4bb5-a1b5-3aa76fd81e8d req-856c7e22-ad35-4af0-ba04-31bb240a06f0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:16.248245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:16.252313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:16.253919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:16.254969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:16.255450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:16.255881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:16.282627 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-22c61dc3-64af-4bb5-a1b5-3aa76fd81e8d req-856c7e22-ad35-4af0-ba04-31bb240a06f0 service nova] Creating event network-vif-plugged:9a1b7e56-f05d-48b3-9e98-6e0303265579 for instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a on n-h1-master-1 Sep 18 01:10:16.312199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-22c61dc3-64af-4bb5-a1b5-3aa76fd81e8d req-856c7e22-ad35-4af0-ba04-31bb240a06f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228389 Sep 18 01:10:16.314415 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1065/2201] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:16.337770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:16.338520 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:16.360650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:16.361150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:16.361612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:16.372087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:16.372890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:16.373621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:17.369511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:17.385411 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06425ed8-2473-43ec-808e-06d7934d4963 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1535 microversion: 2.1 time: 1.234274 Sep 18 01:10:17.395640 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1137/2202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:16 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1535 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:17.415118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2a445b5-04dc-47f4-9791-d67c64677333 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7006698b80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:17.514908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:17.527798 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-25f503fb-54b1-403f-bfa3-25cffeec7084 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 1.210320 Sep 18 01:10:17.543090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1066/2203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:16 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:17.550154 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2a445b5-04dc-47f4-9791-d67c64677333 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.153256 Sep 18 01:10:17.550736 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1138/2204] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:17 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:17.564965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1228760463", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "41d13796-6021-4e18-b177-b1af05bcda5d"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:17.573494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:17.577804 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:17.619436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:17.620849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:17.626663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:17.627668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:17.628488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:17.629090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:17.706923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] validate_networks() for [('41d13796-6021-4e18-b177-b1af05bcda5d', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:10:18.147313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:18.163122 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f85eb944-c94d-48ec-a346-4ae03ad66b6f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1517 microversion: 2.1 time: 0.607888 Sep 18 01:10:18.164531 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1139/2205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:17 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1517 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:18.430071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:18.430715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:18.460458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:18.461051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:18.462863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:18.468341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:18.468854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:18.469302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:20.013304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:20.024339 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-afa4ed6f-41f8-46c7-ac1a-c9fa8c235b40 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 200 len: 1535 microversion: 2.1 time: 1.603984 Sep 18 01:10:20.046222 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1140/2206] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:18 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 1535 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:20.053976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6cbe79dd-3f48-4c53-86b3-c3c08dd20dd6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f700646cb80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:20.188082 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6cbe79dd-3f48-4c53-86b3-c3c08dd20dd6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.139965 Sep 18 01:10:20.193356 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1141/2207] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:20 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:20.236791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:20.237930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:20.272705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:20.288707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:20.289883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:20.302796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:20.303940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:20.305744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:20.904990 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=16 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:21.219242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:10:21.220569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:10:21.221191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:10:21.221799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:10:21.222554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:10:21.225027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:21.233995 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3c9bff41-bd47-4bb7-aebc-bb9d42290697 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 1.038681 Sep 18 01:10:21.234589 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1142/2208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:20 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:21.238835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.241912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.242557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.246289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.246987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.247574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.289641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:21.290220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:21.301986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Getting quotas for project ec1e583f85c94264879e59720389d839. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:10:21.313873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Getting quotas for user 4dd8ef10d46d4f5390efdcd18d2e3059 and project ec1e583f85c94264879e59720389d839. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:10:21.341148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:10:21.345080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.345690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.346141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.352565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.353281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.357545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.376326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:10:21.439485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:21.524675 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07193fe2-8ab0-4f55-ae82-0c362510c846 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.978129 Sep 18 01:10:21.531826 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1067/2209] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:10:21.540805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:21.541843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:21.556789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.558210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.558889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.559922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.560684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.561327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.588354 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:21.617699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.618853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.620420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.621947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lazy-loading 'fault' on Instance uuid 064f68b3-f5c5-4502-a482-f4e4cd1b21bd {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:10:21.677135 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-595d20eb-eac9-435c-9f36-a2e84ea399bd tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 204 len: 0 microversion: 2.25 time: 0.402300 Sep 18 01:10:21.680863 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1143/2210] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:10:21 2022] DELETE /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:10:21.688132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6387d8a9-60be-4015-b883-8e919e409b78 req-2e9e5b1c-2fa5-4925-a188-0509e6eab71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb3142d-5147-43e9-b2f4-653d52b7f265", "name": "network-vif-plugged", "status": "completed", "tag": "f65fd6db-79a6-4955-babd-630e6a9fc218"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:21.720207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6387d8a9-60be-4015-b883-8e919e409b78 req-2e9e5b1c-2fa5-4925-a188-0509e6eab71b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.722811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6387d8a9-60be-4015-b883-8e919e409b78 req-2e9e5b1c-2fa5-4925-a188-0509e6eab71b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.726103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6387d8a9-60be-4015-b883-8e919e409b78 req-2e9e5b1c-2fa5-4925-a188-0509e6eab71b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.775931 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6387d8a9-60be-4015-b883-8e919e409b78 req-2e9e5b1c-2fa5-4925-a188-0509e6eab71b service nova] Creating event network-vif-plugged:f65fd6db-79a6-4955-babd-630e6a9fc218 for instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 on n-h1-master-1 Sep 18 01:10:21.793153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:21.819216 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6387d8a9-60be-4015-b883-8e919e409b78 req-2e9e5b1c-2fa5-4925-a188-0509e6eab71b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131892 Sep 18 01:10:21.824416 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca02ddd4-0b6c-4282-bb29-ef6e4c855c7f tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 200 len: 1311 microversion: 2.1 time: 0.290838 Sep 18 01:10:21.830714 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1144/2211] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:21.835672 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1068/2212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:21 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:21.842480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:21.843492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: f0609259-cd22-41ef-884b-479b79a2bf7b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:21.860037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6d33cee2-f4a7-437b-93f4-8f3b77531053 req-088a9f5c-cdaf-4127-9dfd-8bbacf3290ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0609259-cd22-41ef-884b-479b79a2bf7b", "name": "network-vif-deleted", "tag": "173181ac-358d-4fae-8652-e1afd96f7913"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:21.878719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.878855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.882069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.882454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.882944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.883405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.907915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6d33cee2-f4a7-437b-93f4-8f3b77531053 req-088a9f5c-cdaf-4127-9dfd-8bbacf3290ff service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:21.908199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6d33cee2-f4a7-437b-93f4-8f3b77531053 req-088a9f5c-cdaf-4127-9dfd-8bbacf3290ff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:21.913351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6d33cee2-f4a7-437b-93f4-8f3b77531053 req-088a9f5c-cdaf-4127-9dfd-8bbacf3290ff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:21.950568 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] HTTP exception thrown: Instance f0609259-cd22-41ef-884b-479b79a2bf7b could not be found. Sep 18 01:10:21.967240 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6d33cee2-f4a7-437b-93f4-8f3b77531053 req-088a9f5c-cdaf-4127-9dfd-8bbacf3290ff service nova] Creating event network-vif-deleted:173181ac-358d-4fae-8652-e1afd96f7913 for instance f0609259-cd22-41ef-884b-479b79a2bf7b on n-h1-master-1 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Request method failure captured: Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b HTTP/1.1 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm54AtMUV9jtJ0DI1QOslB9KIGJot8iuJrkx4XhPvEFPfgNbfLTmlOU0XTXOYXC8mmusuYgboAWtFcCE1xd3GsBCmuAuGYMAfyWNlCJDj8WfS0PB8cfVjk3Iv9_6iXAKvniW5pJRl0PIL9G1PKNplzSbTIM4tqEWnTHRCMCuQj8IW30 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 666826ce8e51441ea7c271be4c5d8eb9 Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: exception: Instance f0609259-cd22-41ef-884b-479b79a2bf7b could not be found. Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'f0609259-cd22-41ef-884b-479b79a2bf7b'} Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0609259-cd22-41ef-884b-479b79a2bf7b could not be found. Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0609259-cd22-41ef-884b-479b79a2bf7b could not be found. Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:21.972568 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0609259-cd22-41ef-884b-479b79a2bf7b could not be found. Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:21.980477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Returning 404 to user: Instance f0609259-cd22-41ef-884b-479b79a2bf7b could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:21.983941 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d3155916-fb9c-4815-9398-fc67979c5243 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b" status: 404 len: 111 microversion: 2.1 time: 0.145099 Sep 18 01:10:21.988208 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1069/2213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:21 2022] GET /compute/v2.1/servers/f0609259-cd22-41ef-884b-479b79a2bf7b => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:21.991046 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6d33cee2-f4a7-437b-93f4-8f3b77531053 req-088a9f5c-cdaf-4127-9dfd-8bbacf3290ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153035 Sep 18 01:10:21.998360 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1145/2214] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:22.004661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe5af338-4acd-4788-8f7d-7762d1845901 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70065cde50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:22.039601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ee0ea34-0010-4fa0-b543-8e102c40a227 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:22.055819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6ee0ea34-0010-4fa0-b543-8e102c40a227 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:22.216730 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe5af338-4acd-4788-8f7d-7762d1845901 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.227351 Sep 18 01:10:22.219959 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1070/2215] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:21 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:22.239294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:22.241736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:22.264734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:22.268296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:22.269599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:22.270563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:22.273845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:22.274635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:22.623142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6ee0ea34-0010-4fa0-b543-8e102c40a227 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:22.639471 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ee0ea34-0010-4fa0-b543-8e102c40a227 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1216 microversion: 2.1 time: 0.638138 Sep 18 01:10:22.653622 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1146/2216] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:21 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1216 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:22.699572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa46d8c2-626a-4d3c-8565-d47f9f487241 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '.version_select at 0x7f70062ec550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:22.765256 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa46d8c2-626a-4d3c-8565-d47f9f487241 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145241410" status: 202 len: 0 microversion: 2.1 time: 0.120999 Sep 18 01:10:22.772959 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1147/2217] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:10:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145241410 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:10:22.790761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:22.792301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:22.824236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:22.826343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:22.827030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:22.832118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:22.832762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:22.833356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:22.947273 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=16 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:23.679741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:23.702014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:23.707102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:23.713032 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57867584-9164-4d7c-8a20-297d03812d87 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1731 microversion: 2.25 time: 1.490691 Sep 18 01:10:23.716336 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1071/2218] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:22 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1731 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:23.729266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:23.730434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 064f68b3-f5c5-4502-a482-f4e4cd1b21bd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:23.750116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:23.751084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:23.751751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:23.752694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:23.756484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:23.757976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:23.804586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] HTTP exception thrown: Instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd could not be found. Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Request method failure captured: Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd HTTP/1.1 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-IktUJEG4dWuG9ArgoKrQA8zQoq8e62PH5DngRIENkMzIlkEaXulQoGbADrg1NVEJD9fb5DbnNnt9RQej45Q2nTVy9PG_0p0zqQyClu50HV7ydE8zYQVCLzhu5HWJ1dCt60t9jQpgMRQ45hufqkDXZf5OJIGyvfkGVLROjK_PLCbw Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 36c54fe985874691b9b648f92da02020 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36c54fe985874691b9b648f92da02020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36c54fe985874691b9b648f92da02020"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36c54fe985874691b9b648f92da02020"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36c54fe985874691b9b648f92da02020"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 36c54fe985874691b9b648f92da02020 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ListServerFiltersTestJSON-1236532218-project Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 6818e1bed08b4b84a729108fcd4f6e60 Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ListServerFiltersTestJSON-1236532218-project Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd could not be found. Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '064f68b3-f5c5-4502-a482-f4e4cd1b21bd'} Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd could not be found. Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd could not be found. Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:23.815348 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:23.821303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:23.821303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:23.821303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:23.821303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:23.821303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:23.821303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd could not be found. Sep 18 01:10:23.821303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:23.830033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Returning 404 to user: Instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:23.833816 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-25fed50b-9f8a-4c7a-bf13-9eb4ce8d6713 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd" status: 404 len: 111 microversion: 2.1 time: 0.116183 Sep 18 01:10:23.838339 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1072/2219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:23 2022] GET /compute/v2.1/servers/064f68b3-f5c5-4502-a482-f4e4cd1b21bd => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:23.864123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a119bc32-d50d-44a1-8ca0-2b2940cc33e8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70065679d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:23.970086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a119bc32-d50d-44a1-8ca0-2b2940cc33e8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.126717 Sep 18 01:10:23.970799 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1073/2220] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:23 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:24.003339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:24.004274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:24.033850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:24.034537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:24.037264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:24.038580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:24.044682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:24.045938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:24.428927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:24.467014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-932d0ad5-8e16-44fe-942e-00b30601789a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1212 microversion: 2.1 time: 0.485000 Sep 18 01:10:24.481587 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1074/2221] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:23 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1212 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:24.492777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:24.492777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:24.509345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:24.519723 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f341c03a-bccf-46e7-8af8-22d62191dca1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1314 microversion: 2.1 time: 1.748988 Sep 18 01:10:24.541829 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1148/2222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:22 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1314 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:24.542048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:24.542048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:24.549022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:24.552794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:24.554993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:24.561732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:24.592520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3f5d3f96-a1d3-415e-ae5a-24d97377101f req-c62248ff-197a-4597-8e9c-e3ab0a789874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064f68b3-f5c5-4502-a482-f4e4cd1b21bd", "name": "network-vif-deleted", "tag": "79332c33-faac-419d-916c-9c2a289ab135"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:24.643983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3f5d3f96-a1d3-415e-ae5a-24d97377101f req-c62248ff-197a-4597-8e9c-e3ab0a789874 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:24.658863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3f5d3f96-a1d3-415e-ae5a-24d97377101f req-c62248ff-197a-4597-8e9c-e3ab0a789874 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:24.664853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3f5d3f96-a1d3-415e-ae5a-24d97377101f req-c62248ff-197a-4597-8e9c-e3ab0a789874 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:24.715503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:24.749922 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3f5d3f96-a1d3-415e-ae5a-24d97377101f req-c62248ff-197a-4597-8e9c-e3ab0a789874 service nova] Creating event network-vif-deleted:79332c33-faac-419d-916c-9c2a289ab135 for instance 064f68b3-f5c5-4502-a482-f4e4cd1b21bd on n-h1-master-1 Sep 18 01:10:24.785389 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3f5d3f96-a1d3-415e-ae5a-24d97377101f req-c62248ff-197a-4597-8e9c-e3ab0a789874 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255250 Sep 18 01:10:24.787001 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1149/2223] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:24.798459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:24.807475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:24.822927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:24.823781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:24.824623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:24.825778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:24.827462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:24.832976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:24.976848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2aabf8e9-9380-4703-9805-95536a01acd3 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 204 len: 0 microversion: 2.1 time: 0.501596 Sep 18 01:10:24.979097 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1075/2224] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:24 2022] DELETE /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:24.995138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4771eab4-d3ea-4629-8ce4-9231ae2e3d4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70065d71f0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:25.108066 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4771eab4-d3ea-4629-8ce4-9231ae2e3d4a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.122947 Sep 18 01:10:25.109176 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1076/2225] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:24 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:10:25.129261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:25.131233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:25.163546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:25.166280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:25.167013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:25.175139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:25.175946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:25.176832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:26.527335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:26.549069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:26.551758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:26.553326 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b5f3c31-bff1-46a8-a073-8a1bd11bb1a2 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1731 microversion: 2.25 time: 1.764675 Sep 18 01:10:26.554172 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1150/2226] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:24 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1731 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:26.570715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:26.572853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:26.589885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:26.590845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:26.591533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:26.604934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:26.610427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:26.613603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:26.661098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:26.670134 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-25ab84c4-13de-4007-814d-79e4129aaa48 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 200 len: 1516 microversion: 2.1 time: 1.559566 Sep 18 01:10:26.692449 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1077/2227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:25 2022] GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 1516 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:26.708455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:26.709417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:26.719973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:26.720529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:26.721160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:26.722095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:26.722718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:26.723302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:27.363674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:27.378603 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27064b55-e8b8-40ed-811a-4b2878ffe1fc tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1274 microversion: 2.1 time: 0.819283 Sep 18 01:10:27.380026 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1151/2228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:26 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1274 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:27.388497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9fd8a547-ed9a-427a-8e4a-94899f11ccc9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7006247550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:27.487018 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9fd8a547-ed9a-427a-8e4a-94899f11ccc9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.103703 Sep 18 01:10:27.492881 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1152/2229] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:27 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:27.587003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:27.588765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:27.602299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:27.603977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:27.604713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:27.606550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:27.607912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:27.608933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:27.863697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:27.887125 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b05f716c-c0e1-45bc-ba15-7b9ad18f47aa tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1502 microversion: 2.1 time: 1.193048 Sep 18 01:10:27.891198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1078/2230] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:26 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1502 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:27.898533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:27.904061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:27.906544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:27.924092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:27.927964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:27.928225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:27.929118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:27.929582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:27.931783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:27.934179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:27.934802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:27.935676 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-20b06cd7-9deb-4449-a71b-454a8a550978 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1663 microversion: 2.25 time: 0.352906 Sep 18 01:10:27.936319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1153/2231] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:27 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1663 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:10:28.529023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7bcc26f-1784-4b1a-a90c-fca2911529c9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:28.547457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7bcc26f-1784-4b1a-a90c-fca2911529c9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:28.548676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7bcc26f-1784-4b1a-a90c-fca2911529c9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:28.549134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7bcc26f-1784-4b1a-a90c-fca2911529c9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:28.628127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7bcc26f-1784-4b1a-a90c-fca2911529c9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Going to try to stop instance {{(pid=122374) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:10:28.771424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7bcc26f-1784-4b1a-a90c-fca2911529c9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265/action" status: 202 len: 0 microversion: 2.1 time: 0.829642 Sep 18 01:10:28.778417 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1154/2232] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:10:27 2022] POST /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:10:28.817016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:28.824091 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:28.901221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:28.902359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:28.903008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:28.906755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:28.910972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:28.911968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:29.191479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:29.195382 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:29.220979 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-477429f7-fef3-47ed-9dba-050bcd375c89 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1274 microversion: 2.1 time: 0.434865 Sep 18 01:10:29.233066 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1155/2233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:28 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1274 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:29.237718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96ab8944-0269-49b2-8337-a2ff0404317d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70062ecee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:29.365599 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96ab8944-0269-49b2-8337-a2ff0404317d tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.131122 Sep 18 01:10:29.374325 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1156/2234] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:29 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:29.385054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:29.387554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:29.402504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:29.403014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:29.404127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:29.404274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:29.409758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:29.409758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:29.477354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:29.520758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7df91604-8b0e-43f3-a7bb-203dfa4a01a9 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 200 len: 1516 microversion: 2.1 time: 1.616666 Sep 18 01:10:29.524022 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1079/2235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:27 2022] GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 1516 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:29.552904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:29.554913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:29.591979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:29.597403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:29.599322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:29.602037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:29.606188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:29.610860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:29.705363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:29.719842 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be683c04-5c47-40cc-b830-36e2e9a28142 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.343139 Sep 18 01:10:29.727311 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1157/2236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:29 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:29.759758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:29.760757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:29.788857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:29.790448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:29.792715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:29.793968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:29.796059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:29.798783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:29.904852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:30.005595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:30.058233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:30.081482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:30.103037 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47ced60a-5684-4f03-8981-1ce1d906fa9d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1663 microversion: 2.25 time: 0.559360 Sep 18 01:10:30.122289 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1080/2237] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:29 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1663 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:30.156381 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d026965-7783-4b98-839b-49693d78651c tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 204 len: 0 microversion: 2.1 time: 0.420331 Sep 18 01:10:30.157052 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1158/2238] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:29 2022] DELETE /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:30.167489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ff62c20c-dc8d-47d6-b9d5-31b3ce203471 req-81c2ca9d-a844-4cc2-a386-b1c802d38fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffa04fb-a41d-4238-b151-0a0252aaf8c0", "name": "network-vif-deleted", "tag": "8c7e9c5d-6893-4687-971f-af5eb2b21481"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:30.196070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ff62c20c-dc8d-47d6-b9d5-31b3ce203471 req-81c2ca9d-a844-4cc2-a386-b1c802d38fe3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:30.197633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ff62c20c-dc8d-47d6-b9d5-31b3ce203471 req-81c2ca9d-a844-4cc2-a386-b1c802d38fe3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:30.198666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ff62c20c-dc8d-47d6-b9d5-31b3ce203471 req-81c2ca9d-a844-4cc2-a386-b1c802d38fe3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:30.225626 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ff62c20c-dc8d-47d6-b9d5-31b3ce203471 req-81c2ca9d-a844-4cc2-a386-b1c802d38fe3 service nova] Creating event network-vif-deleted:8c7e9c5d-6893-4687-971f-af5eb2b21481 for instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 on n-h1-master-1 Sep 18 01:10:30.241823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ff62c20c-dc8d-47d6-b9d5-31b3ce203471 req-81c2ca9d-a844-4cc2-a386-b1c802d38fe3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114938 Sep 18 01:10:30.243411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1081/2239] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:30.258247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:30.260132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:30.277474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:30.281150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:30.282810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:30.285801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:30.287407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:30.287945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:30.544047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-37d0871d-1902-417a-bd6d-cc856176bfe7 req-df30c54c-4a94-47cb-83de-bcc5d7024f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817d787-8c57-4c31-9d3d-787ff28ce6b6", "name": "network-vif-deleted", "tag": "58e0419d-f921-4818-8610-d972ee40fa0c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:30.606316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-37d0871d-1902-417a-bd6d-cc856176bfe7 req-df30c54c-4a94-47cb-83de-bcc5d7024f15 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:30.609923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-37d0871d-1902-417a-bd6d-cc856176bfe7 req-df30c54c-4a94-47cb-83de-bcc5d7024f15 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:30.613773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-37d0871d-1902-417a-bd6d-cc856176bfe7 req-df30c54c-4a94-47cb-83de-bcc5d7024f15 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:30.672611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-37d0871d-1902-417a-bd6d-cc856176bfe7 req-df30c54c-4a94-47cb-83de-bcc5d7024f15 service nova] Creating event network-vif-deleted:58e0419d-f921-4818-8610-d972ee40fa0c for instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 on n-h2-master-1 Sep 18 01:10:30.692154 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-37d0871d-1902-417a-bd6d-cc856176bfe7 req-df30c54c-4a94-47cb-83de-bcc5d7024f15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.525924 Sep 18 01:10:30.699162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1159/2240] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:30.728361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:30.735628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:30.770805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:30.776371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:30.779143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:30.784271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:30.785680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:30.786867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.181453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:31.217008 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15258a34-33dd-4f7b-bd50-9a3d5479f4ad tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1274 microversion: 2.1 time: 0.506657 Sep 18 01:10:31.221347 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1160/2241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:30 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1274 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:31.251201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2324e3b2-2c46-4230-909c-106e81becbbc tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70063c0310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:31.284534 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:31.333570 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:31.390347 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2324e3b2-2c46-4230-909c-106e81becbbc tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.166830 Sep 18 01:10:31.407573 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1161/2242] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:31 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:31.451691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:31.453165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:31.470259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.470841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.471996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.473476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.474013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.474557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.542651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.543366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.544551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.545066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lazy-loading 'fault' on Instance uuid 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:10:31.562134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:31.576937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae4845fc-2508-44e4-b69d-9cf3be5154ad tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1468 microversion: 2.1 time: 1.329798 Sep 18 01:10:31.579326 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1082/2243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:30 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1468 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:31.589412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:31.590046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:31.604221 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:31.626263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.629137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.632903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.635613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.642499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.650972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.705239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:31.743341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04ee402b-7176-43b6-a34f-d0143023a5a5 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 200 len: 1311 microversion: 2.1 time: 0.321721 Sep 18 01:10:31.751337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1162/2244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:31 2022] GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 1311 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:31.795354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:31.799238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:31.855447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.865807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.870344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.879391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.880751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.882765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.964943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:31.966304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:31.966777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:31.968386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lazy-loading 'fault' on Instance uuid 6817d787-8c57-4c31-9d3d-787ff28ce6b6 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:10:32.408036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:32.424414 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:32.443480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:32.444872 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2038bfe-e3a7-4635-ac90-24770cef33b9 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 200 len: 1374 microversion: 2.25 time: 0.686786 Sep 18 01:10:32.452728 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1163/2245] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:31 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 1374 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:32.459984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:32.460621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:32.477695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.479338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.479790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.480526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.480990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.490115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.566230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:32.582719 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56dd610c-5d27-4c20-923c-df6f25581cbd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.997569 Sep 18 01:10:32.593758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1083/2246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:31 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:32.611305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a55c75d9-4bc1-453c-ab11-f83a903505fc tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005ecddc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:32.630031 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:32.693784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:32.708200 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a55c75d9-4bc1-453c-ab11-f83a903505fc tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.113257 Sep 18 01:10:32.709373 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1084/2247] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:32 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:32.721896 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-39ebf244-f87f-47d6-a348-2acb6dbaff21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1274 microversion: 2.1 time: 0.267887 Sep 18 01:10:32.733579 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1164/2248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:32 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:32.734585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:32.739425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:32.746692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.747399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.747981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.748864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.749615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.750845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.780193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:32.780816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 8ffa04fb-a41d-4238-b151-0a0252aaf8c0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:32.791993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.793849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.795416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.797338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.797853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.798902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.814806 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] HTTP exception thrown: Instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 could not be found. Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Request method failure captured: Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 HTTP/1.1 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-IktUJEG4dWuG9ArgoKrQA8zQoq8e62PH5DngRIENkMzIlkEaXulQoGbADrg1NVEJD9fb5DbnNnt9RQej45Q2nTVy9PG_0p0zqQyClu50HV7ydE8zYQVCLzhu5HWJ1dCt60t9jQpgMRQ45hufqkDXZf5OJIGyvfkGVLROjK_PLCbw Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 36c54fe985874691b9b648f92da02020 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36c54fe985874691b9b648f92da02020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36c54fe985874691b9b648f92da02020"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36c54fe985874691b9b648f92da02020"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36c54fe985874691b9b648f92da02020"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 36c54fe985874691b9b648f92da02020 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServerFiltersTestJSON-1236532218-project Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 6818e1bed08b4b84a729108fcd4f6e60 Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServerFiltersTestJSON-1236532218-project Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 could not be found. Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8ffa04fb-a41d-4238-b151-0a0252aaf8c0'} Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 could not be found. Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 could not be found. Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:32.816641 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 could not be found. Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:32.820847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Returning 404 to user: Instance 8ffa04fb-a41d-4238-b151-0a0252aaf8c0 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:32.821912 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3a3f24b-d816-443a-a78d-56977970302e tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0" status: 404 len: 111 microversion: 2.1 time: 0.045815 Sep 18 01:10:32.823544 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1165/2249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:32 2022] GET /compute/v2.1/servers/8ffa04fb-a41d-4238-b151-0a0252aaf8c0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:32.836281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:32.836793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:32.845129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.845767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.845998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.846717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:32.847172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:32.847592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:32.887602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:33.082096 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c344ac91-9037-431c-a373-67f94ce64806 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 204 len: 0 microversion: 2.1 time: 0.253760 Sep 18 01:10:33.090099 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1166/2250] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:32 2022] DELETE /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:33.108301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:33.109487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:33.111468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:33.122816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:33.123475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:33.124029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:33.124740 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a41db8bd-b76b-490d-a89a-2492e60e3036 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 200 len: 1468 microversion: 2.1 time: 0.413183 Sep 18 01:10:33.128192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:33.143629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:33.143629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:33.147645 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1085/2251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:32 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 1468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:33.474197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:33.475125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 6817d787-8c57-4c31-9d3d-787ff28ce6b6] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:33.490555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:33.491356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:33.491965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:33.496926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:33.501704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:33.502610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:33.602724 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] HTTP exception thrown: Instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 could not be found. Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Request method failure captured: Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 HTTP/1.1 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm4hJnRLsbjlYw9cPwehTsELaIY-Or2dqyONr38QZANR-RcguUMNJdPCYvWxNlo4DxPs61eTgt__L7Z5ygQMBY4ZkkZBJHbiM38dG2YxQhg5lpMjEtyfeE4CQnSlgGtm1_eA4JCMkvxfiuE19cb-CP2w4ZtM8oomP5wxIko-xb4uegY Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.25 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: bb1c3f4298d34bb2a820ec5de46a76c2 Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 could not be found. Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6817d787-8c57-4c31-9d3d-787ff28ce6b6'} Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 could not be found. Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 could not be found. Sep 18 01:10:33.624122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 could not be found. Sep 18 01:10:33.629308 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:33.631132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Returning 404 to user: Instance 6817d787-8c57-4c31-9d3d-787ff28ce6b6 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:33.634880 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72c87127-f140-4f4f-966b-855ec6a3daa7 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6" status: 404 len: 111 microversion: 2.25 time: 0.162961 Sep 18 01:10:33.635570 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1086/2252] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:33 2022] GET /compute/v2.1/servers/6817d787-8c57-4c31-9d3d-787ff28ce6b6 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:10:33.645859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-12757115-09e1-4564-a31b-ed9268864ab7 req-936abb3e-8248-4e2e-a974-ffc87a21c961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3406f44-aa77-483c-9c1b-6a51773b5023", "name": "network-vif-deleted", "tag": "905d0978-cc22-487f-be72-d9e5d75cf1f8"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:33.708593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-12757115-09e1-4564-a31b-ed9268864ab7 req-936abb3e-8248-4e2e-a974-ffc87a21c961 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:33.719589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-12757115-09e1-4564-a31b-ed9268864ab7 req-936abb3e-8248-4e2e-a974-ffc87a21c961 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:33.720315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-12757115-09e1-4564-a31b-ed9268864ab7 req-936abb3e-8248-4e2e-a974-ffc87a21c961 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:33.778578 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-12757115-09e1-4564-a31b-ed9268864ab7 req-936abb3e-8248-4e2e-a974-ffc87a21c961 service nova] Creating event network-vif-deleted:905d0978-cc22-487f-be72-d9e5d75cf1f8 for instance d3406f44-aa77-483c-9c1b-6a51773b5023 on n-h1-master-1 Sep 18 01:10:33.792882 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-12757115-09e1-4564-a31b-ed9268864ab7 req-936abb3e-8248-4e2e-a974-ffc87a21c961 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154831 Sep 18 01:10:33.802937 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1087/2253] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:33.840400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:33.841843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:33.918763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:33.919123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:33.919581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:33.920830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:33.925836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:33.929877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:34.145422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:34.155729 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-782c40c7-4d94-48ce-9476-b9be102a2360 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1516 microversion: 2.1 time: 1.061242 Sep 18 01:10:34.156371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1167/2254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:33 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1516 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:34.197669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e6c3438e-22b2-4250-8544-f749aa1d5263 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '.version_select at 0x7f70061af310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:34.254371 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:34.274957 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e6c3438e-22b2-4250-8544-f749aa1d5263 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152895215" status: 204 len: 0 microversion: 2.25 time: 0.117144 Sep 18 01:10:34.287261 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1168/2255] 10.222.0.25 () {60 vars in 1259 bytes} [Sun Sep 18 01:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152895215 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:10:34.304170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8fe13180-c4f0-4b86-bb85-e9ab42de9500 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70063920d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:34.378208 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8fe13180-c4f0-4b86-bb85-e9ab42de9500 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.087682 Sep 18 01:10:34.379395 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1169/2256] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:34 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:34.398797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:34.399926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:34.408847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:34.412282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:34.413181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:34.414671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:34.415399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:34.416213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:34.895004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:34.919246 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dcac9b8f-a1d4-4ac1-8449-0021b6193989 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.524946 Sep 18 01:10:34.929594 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1170/2257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:34 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:34.929594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:34.931336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: d3406f44-aa77-483c-9c1b-6a51773b5023] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:34.940947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:34.942252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:34.942788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:34.944184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:34.944887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:34.945701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:34.947434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:34.969224 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] HTTP exception thrown: Instance d3406f44-aa77-483c-9c1b-6a51773b5023 could not be found. Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Request method failure captured: Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 HTTP/1.1 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm54AtMUV9jtJ0DI1QOslB9KIGJot8iuJrkx4XhPvEFPfgNbfLTmlOU0XTXOYXC8mmusuYgboAWtFcCE1xd3GsBCmuAuGYMAfyWNlCJDj8WfS0PB8cfVjk3Iv9_6iXAKvniW5pJRl0PIL9G1PKNplzSbTIM4tqEWnTHRCMCuQj8IW30 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 666826ce8e51441ea7c271be4c5d8eb9 Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: exception: Instance d3406f44-aa77-483c-9c1b-6a51773b5023 could not be found. Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'd3406f44-aa77-483c-9c1b-6a51773b5023'} Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3406f44-aa77-483c-9c1b-6a51773b5023 could not be found. Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3406f44-aa77-483c-9c1b-6a51773b5023 could not be found. Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:34.972887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3406f44-aa77-483c-9c1b-6a51773b5023 could not be found. Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Returning 404 to user: Instance d3406f44-aa77-483c-9c1b-6a51773b5023 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d87f8346-3b65-4021-ba59-c213167178eb tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023" status: 404 len: 111 microversion: 2.1 time: 0.053102 Sep 18 01:10:34.976894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1171/2258] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:34 2022] GET /compute/v2.1/servers/d3406f44-aa77-483c-9c1b-6a51773b5023 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:34.995863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:34.996928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:35.008400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.011375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.012045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:35.012954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.013618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.014338 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b05d55a-6aca-4ae4-83ac-91e5f0b6e2e2 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 1.204190 Sep 18 01:10:35.014610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:35.019694 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1088/2259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:33 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:35.089143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:35.182228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:35.183006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:35.198413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.199293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.199958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:35.203265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.204116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.209190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:35.288544 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:35.380251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f5fcbf04-3e12-41e3-b4eb-a950ed061283 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 204 len: 0 microversion: 2.1 time: 0.392366 Sep 18 01:10:35.381430 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1172/2260] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:34 2022] DELETE /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:35.391042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:35.396034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:35.422411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.422912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.423417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:35.424188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.424850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.425583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:35.737221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:35.745721 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-127c83db-ea42-4e6a-91d2-17901f146e0b tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1516 microversion: 2.1 time: 0.567785 Sep 18 01:10:35.749359 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1089/2261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:35 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1516 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:10:35.759313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a0549a2d-dee5-4db9-841e-c1b3c23b0271 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f700655b550>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:35.860616 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a0549a2d-dee5-4db9-841e-c1b3c23b0271 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.107205 Sep 18 01:10:35.872490 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1090/2262] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:35 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:35.949649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:35.951158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:35.963036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.967422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.976378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:35.980472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:35.981701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:35.982434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:36.028831 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:36.073261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666826ce8e51441ea7c271be4c5d8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fa7e3f2044f08b64e08b60e2ca39a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:36.081906 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2697e21e-702e-49dc-ae6d-7b463940ce56 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 200 len: 1467 microversion: 2.1 time: 0.695220 Sep 18 01:10:36.102506 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1173/2263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:35 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 1467 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:10:36.108757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:36.109613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:36.115822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:36.116598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:36.117171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:36.118044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:36.118635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:36.119767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:36.848406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:36.869671 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b377f6fa-f69c-4d8c-be59-387fd7c90f21 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.924058 Sep 18 01:10:36.891019 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1091/2264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:35 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:10:36.902803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:36.905259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:36.917923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:36.933887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:36.934394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:36.935435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:36.935912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:36.943045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:39.079282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6818e1bed08b4b84a729108fcd4f6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c54fe985874691b9b648f92da02020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:39.097346 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bfdfe689-a4e7-492c-a56f-1852b23bced4 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 200 len: 1474 microversion: 2.1 time: 2.203837 Sep 18 01:10:39.117926 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1092/2265] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:36 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 1474 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:39.145656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f460fc3-f0ce-4b1f-a689-99c3bf5da017 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005e66430>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:39.263940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:39.273428 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca6ff5b4-f74b-45d7-b36f-c2a7bcfec956 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 3.168987 Sep 18 01:10:39.276211 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1174/2266] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:36 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 3173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:39.291558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:39.298270 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] [instance: 76259e8b-809c-4d92-8e2e-5dd2c058a6eb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:39.320639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:39.334396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:39.335306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:39.336333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:39.339664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:39.342079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:39.400650 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] HTTP exception thrown: Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb could not be found. Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Request method failure captured: Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb HTTP/1.1 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm54AtMUV9jtJ0DI1QOslB9KIGJot8iuJrkx4XhPvEFPfgNbfLTmlOU0XTXOYXC8mmusuYgboAWtFcCE1xd3GsBCmuAuGYMAfyWNlCJDj8WfS0PB8cfVjk3Iv9_6iXAKvniW5pJRl0PIL9G1PKNplzSbTIM4tqEWnTHRCMCuQj8IW30 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab0fa7e3f2044f08b64e08b60e2ca39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ab0fa7e3f2044f08b64e08b60e2ca39a Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MigrationsAdminTest-9899961 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 666826ce8e51441ea7c271be4c5d8eb9 Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MigrationsAdminTest-9899961-project Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb could not be found. Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '76259e8b-809c-4d92-8e2e-5dd2c058a6eb'} Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb could not be found. Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb could not be found. Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:39.403116 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:39.406921 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:39.406921 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:39.406921 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:39.406921 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:39.406921 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:39.406921 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb could not be found. Sep 18 01:10:39.406921 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:39.414479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] Returning 404 to user: Instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:39.416299 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed8c7a71-adc3-4501-ba46-57dd4be83bc5 tempest-MigrationsAdminTest-9899961 tempest-MigrationsAdminTest-9899961-project] 10.222.0.25 "GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb" status: 404 len: 111 microversion: 2.1 time: 0.128860 Sep 18 01:10:39.417126 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1175/2267] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:39 2022] GET /compute/v2.1/servers/76259e8b-809c-4d92-8e2e-5dd2c058a6eb => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:39.440877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b0ee9440-4d1a-44b1-9f1b-6948a9b42b8a req-e4b9254b-8192-48d4-894d-0b3e3fab6c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76259e8b-809c-4d92-8e2e-5dd2c058a6eb", "name": "network-vif-deleted", "tag": "6bd27624-3292-471e-9c69-4045a4a44529"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:39.480883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b0ee9440-4d1a-44b1-9f1b-6948a9b42b8a req-e4b9254b-8192-48d4-894d-0b3e3fab6c63 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:39.497351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b0ee9440-4d1a-44b1-9f1b-6948a9b42b8a req-e4b9254b-8192-48d4-894d-0b3e3fab6c63 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:39.500521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b0ee9440-4d1a-44b1-9f1b-6948a9b42b8a req-e4b9254b-8192-48d4-894d-0b3e3fab6c63 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:39.544448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b0ee9440-4d1a-44b1-9f1b-6948a9b42b8a req-e4b9254b-8192-48d4-894d-0b3e3fab6c63 service nova] Creating event network-vif-deleted:6bd27624-3292-471e-9c69-4045a4a44529 for instance 76259e8b-809c-4d92-8e2e-5dd2c058a6eb on n-h1-master-1 Sep 18 01:10:39.564449 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b0ee9440-4d1a-44b1-9f1b-6948a9b42b8a req-e4b9254b-8192-48d4-894d-0b3e3fab6c63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143984 Sep 18 01:10:39.565637 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1176/2268] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:39.582945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:39.586552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:39.615311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:39.617540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:39.627943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:39.629353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:39.634447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:39.640400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:40.331235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:40.341243 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68e8a6c6-6b26-4b87-be10-afd66331e9f6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.772321 Sep 18 01:10:40.345895 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1177/2269] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:39 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:40.356793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f1532c7b-b68e-4bea-842b-2dc28e18af04 req-19b06938-d71e-4ff2-b1ec-bf991ba94459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc4a839-803a-4ab3-a83e-9445e11c779f", "name": "network-vif-deleted", "tag": "cf1ea48f-7e0e-4db6-a6c8-f6fbb05cbbdf"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:40.381199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1532c7b-b68e-4bea-842b-2dc28e18af04 req-19b06938-d71e-4ff2-b1ec-bf991ba94459 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:40.385803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1532c7b-b68e-4bea-842b-2dc28e18af04 req-19b06938-d71e-4ff2-b1ec-bf991ba94459 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:40.386495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1532c7b-b68e-4bea-842b-2dc28e18af04 req-19b06938-d71e-4ff2-b1ec-bf991ba94459 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:40.414529 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f1532c7b-b68e-4bea-842b-2dc28e18af04 req-19b06938-d71e-4ff2-b1ec-bf991ba94459 service nova] Creating event network-vif-deleted:cf1ea48f-7e0e-4db6-a6c8-f6fbb05cbbdf for instance 5dc4a839-803a-4ab3-a83e-9445e11c779f on n-h2-master-1 Sep 18 01:10:40.428604 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f1532c7b-b68e-4bea-842b-2dc28e18af04 req-19b06938-d71e-4ff2-b1ec-bf991ba94459 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078508 Sep 18 01:10:40.429938 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1178/2270] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:40.443476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:40.447492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:40.465843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:40.466606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:40.467403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:40.468291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:40.469949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:40.471875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:40.567154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:40.873180 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70ccdde6-1ffe-4217-b51b-a47da94dc904 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 204 len: 0 microversion: 2.25 time: 0.441339 Sep 18 01:10:40.877796 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1179/2271] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:10:40 2022] DELETE /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:10:40.900711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:40.901539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] [instance: 5dc4a839-803a-4ab3-a83e-9445e11c779f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:40.924771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:40.942378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:40.942965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:40.944071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:40.944635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:40.945068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:40.984777 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] HTTP exception thrown: Instance 5dc4a839-803a-4ab3-a83e-9445e11c779f could not be found. Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Request method failure captured: Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f HTTP/1.1 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-IktUJEG4dWuG9ArgoKrQA8zQoq8e62PH5DngRIENkMzIlkEaXulQoGbADrg1NVEJD9fb5DbnNnt9RQej45Q2nTVy9PG_0p0zqQyClu50HV7ydE8zYQVCLzhu5HWJ1dCt60t9jQpgMRQ45hufqkDXZf5OJIGyvfkGVLROjK_PLCbw Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 36c54fe985874691b9b648f92da02020 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36c54fe985874691b9b648f92da02020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36c54fe985874691b9b648f92da02020"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36c54fe985874691b9b648f92da02020"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36c54fe985874691b9b648f92da02020"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 36c54fe985874691b9b648f92da02020 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1236532218 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServerFiltersTestJSON-1236532218-project Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 6818e1bed08b4b84a729108fcd4f6e60 Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServerFiltersTestJSON-1236532218-project Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5dc4a839-803a-4ab3-a83e-9445e11c779f could not be found. Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5dc4a839-803a-4ab3-a83e-9445e11c779f'} Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc4a839-803a-4ab3-a83e-9445e11c779f could not be found. Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc4a839-803a-4ab3-a83e-9445e11c779f could not be found. Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:40.989258 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc4a839-803a-4ab3-a83e-9445e11c779f could not be found. Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] Returning 404 to user: Instance 5dc4a839-803a-4ab3-a83e-9445e11c779f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-873244a6-da29-43e4-ab1a-4c717b3e4660 tempest-ListServerFiltersTestJSON-1236532218 tempest-ListServerFiltersTestJSON-1236532218-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f" status: 404 len: 111 microversion: 2.1 time: 0.112339 Sep 18 01:10:40.995665 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1180/2272] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:40 2022] GET /compute/v2.1/servers/5dc4a839-803a-4ab3-a83e-9445e11c779f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:10:41.012383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:41.013009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:41.036298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:41.036865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:41.037370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:41.038222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:41.041955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:41.042528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:41.547538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:41.594068 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d40f8303-fb28-422b-881d-78673ee1a039 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.599972 Sep 18 01:10:41.594905 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1181/2273] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:40 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:41.624950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:41.628415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:41.641215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:41.642737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:41.644884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:41.647071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:41.647695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:41.649118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:41.835350 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f460fc3-f0ce-4b1f-a689-99c3bf5da017 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 2.715361 Sep 18 01:10:41.836054 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1093/2274] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:39 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 2717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:41.842223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:41.843135 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:41.850319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:41.851006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:41.851657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:41.854193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:41.854802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:41.855408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:42.532875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:42.586738 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-984ae316-251d-4e26-8b14-5d38b7abb009 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.748136 Sep 18 01:10:42.609802 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1094/2275] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:41 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:42.636232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:42.637154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:42.655968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:42.671161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:42.671870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:42.675990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:42.679790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:42.680402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:43.816373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:43.833282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:43.834783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:43.841210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:43.841799 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0e132105-ba8b-4347-9c11-02eb214587ad tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1549 microversion: 2.25 time: 2.225546 Sep 18 01:10:43.853759 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-be80eb70-b650-477c-9f29-0aac5681c85e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 1.230373 Sep 18 01:10:43.864673 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1182/2276] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:41 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1549 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:43.871432 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1095/2277] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:42 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:43.886428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1636ebc9-75f8-42bd-927d-648b06b6d650 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f700a7d6ca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:43.898585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a743f54b-c774-466d-b8c7-02f7ba4eb610 req-df9191d1-cecb-4e20-be67-59906c0b8501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a8d0f7-7fa4-4b35-9627-d1f591dec2c3", "tag": "7338d34c-c072-42e2-81f8-1be7fca3bc0e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:43.978517 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1636ebc9-75f8-42bd-927d-648b06b6d650 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.111990 Sep 18 01:10:43.987591 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1183/2278] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:43 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:43.999085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a743f54b-c774-466d-b8c7-02f7ba4eb610 req-df9191d1-cecb-4e20-be67-59906c0b8501 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:43.999874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a743f54b-c774-466d-b8c7-02f7ba4eb610 req-df9191d1-cecb-4e20-be67-59906c0b8501 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:44.004197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:44.005340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:44.008602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a743f54b-c774-466d-b8c7-02f7ba4eb610 req-df9191d1-cecb-4e20-be67-59906c0b8501 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:44.027167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:44.028367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:44.031079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:44.032928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:44.036579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:44.037304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:44.101949 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a743f54b-c774-466d-b8c7-02f7ba4eb610 req-df9191d1-cecb-4e20-be67-59906c0b8501 service nova] Creating event network-changed:7338d34c-c072-42e2-81f8-1be7fca3bc0e for instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 on n-h2-master-1 Sep 18 01:10:44.161075 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a743f54b-c774-466d-b8c7-02f7ba4eb610 req-df9191d1-cecb-4e20-be67-59906c0b8501 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282320 Sep 18 01:10:44.166270 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1096/2279] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:44.887138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:44.887877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:44.944931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:44.953384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:44.956878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:44.957728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:44.958224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:44.958663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:45.252638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:45.265304 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9966e299-ee71-4799-90ec-6de3c6f516ea tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 1.276346 Sep 18 01:10:45.266522 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1184/2280] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:43 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:45.271330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:45.291575 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:45.327366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:45.330622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:45.332919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:45.338783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:45.339404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:45.343035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:46.204994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:46.222253 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6952461e-59c3-43fd-ad76-badcfd65c4f8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.954161 Sep 18 01:10:46.231741 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1185/2281] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:45 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:46.250293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2c6aad67-12c8-4727-9534-54e7440db863 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70063c0040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:46.362312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:46.377358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:46.381991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:46.389484 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7eb677e7-39ee-4380-a0df-c457f3da1a02 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1549 microversion: 2.25 time: 1.510262 Sep 18 01:10:46.390759 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1097/2282] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:44 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1549 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:46.402833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:46.404336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:46.423535 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2c6aad67-12c8-4727-9534-54e7440db863 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1440 microversion: 2.1 time: 0.190187 Sep 18 01:10:46.434028 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1186/2283] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:46 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1440 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:46.438266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:46.439880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:46.440595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:46.442787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:46.443497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:46.444165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:47.136143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4b21b81c-bfa6-437d-886c-5b3f36c4f45c req-972a33f6-7557-4d41-bc3d-763ee530cc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ef5a3a-6c77-45a8-8d8a-0fa832b43783", "name": "network-vif-deleted", "tag": "c513b274-e342-4ba5-9347-e8e7434250f7"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:47.170913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b21b81c-bfa6-437d-886c-5b3f36c4f45c req-972a33f6-7557-4d41-bc3d-763ee530cc4a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:47.173208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b21b81c-bfa6-437d-886c-5b3f36c4f45c req-972a33f6-7557-4d41-bc3d-763ee530cc4a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:47.176285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b21b81c-bfa6-437d-886c-5b3f36c4f45c req-972a33f6-7557-4d41-bc3d-763ee530cc4a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:47.214574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:47.225495 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-453dc0d7-1129-4f91-8a57-262323154383 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.833277 Sep 18 01:10:47.230148 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4b21b81c-bfa6-437d-886c-5b3f36c4f45c req-972a33f6-7557-4d41-bc3d-763ee530cc4a service nova] Creating event network-vif-deleted:c513b274-e342-4ba5-9347-e8e7434250f7 for instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 on n-h2-master-1 Sep 18 01:10:47.241773 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1098/2284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:46 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:47.256596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4b21b81c-bfa6-437d-886c-5b3f36c4f45c req-972a33f6-7557-4d41-bc3d-763ee530cc4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125890 Sep 18 01:10:47.268929 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1187/2285] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:10:47.271554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:47.272436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:47.315396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:47.316364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:47.317327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:47.329890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:47.332779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:47.334810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:47.433364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:47.434929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:47.463653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:47.464516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:47.465272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:47.466267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:47.466935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:47.467583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:47.666544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:47.667826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:47.668392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:47.668952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lazy-loading 'fault' on Instance uuid 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:10:47.879656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:47.884519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:47.891847 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef5076c4-836e-4ce1-adea-df720e72876c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.630811 Sep 18 01:10:47.898130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:47.898932 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1099/2286] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:47 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:10:47.903038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:47.904543 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56876d49-f306-47f1-b38b-bc14c43e2bbb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 200 len: 1352 microversion: 2.25 time: 0.479508 Sep 18 01:10:47.917214 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1188/2287] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:47 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 1352 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:47.922066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-deee4f39-6e75-49d8-9d61-55123bce7fe9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70063fcaf0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:48.037136 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-deee4f39-6e75-49d8-9d61-55123bce7fe9 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1449 microversion: 2.1 time: 0.135600 Sep 18 01:10:48.052098 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1100/2288] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:47 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:48.069940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b6a4451-49d6-4922-8dc4-6e70e25e21cb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7005e9bee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:48.180885 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b6a4451-49d6-4922-8dc4-6e70e25e21cb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 200 len: 1449 microversion: 2.1 time: 0.110746 Sep 18 01:10:48.181576 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1189/2289] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:10:48 2022] GET /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 1449 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:48.211444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c4179c45-88ff-4c34-ab30-fc0242607eb5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70063f2e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:48.288355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:48.292666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:48.309049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:48.314972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:48.315557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:48.318701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:48.320441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:48.323606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:49.087071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:49.124170 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96d73f35-a192-4564-aca8-2836ab2c919e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.844452 Sep 18 01:10:49.137959 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1190/2290] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:48 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:10:49.161176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:49.163263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:49.186477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:49.188100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:49.190543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:49.192044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:49.194160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:49.196603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:49.535981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:49.562042 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55ed7a7c-61f3-4ad1-8672-52bba7da92cc tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.426023 Sep 18 01:10:49.570830 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1191/2291] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:49 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:49.589424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:49.590605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: 41ef5a3a-6c77-45a8-8d8a-0fa832b43783] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:49.610304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:49.611155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:49.611597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:49.614773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:49.615433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:49.616033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:49.641373 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] HTTP exception thrown: Instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 could not be found. Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Request method failure captured: Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 HTTP/1.1 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4hJnRLsbjlYw9cPwehTsELaIY-Or2dqyONr38QZANR-RcguUMNJdPCYvWxNlo4DxPs61eTgt__L7Z5ygQMBY4ZkkZBJHbiM38dG2YxQhg5lpMjEtyfeE4CQnSlgGtm1_eA4JCMkvxfiuE19cb-CP2w4ZtM8oomP5wxIko-xb4uegY Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.25 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: bb1c3f4298d34bb2a820ec5de46a76c2 Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 could not be found. Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '41ef5a3a-6c77-45a8-8d8a-0fa832b43783'} Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 could not be found. Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 could not be found. Sep 18 01:10:49.643709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 could not be found. Sep 18 01:10:49.647656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:49.650159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Returning 404 to user: Instance 41ef5a3a-6c77-45a8-8d8a-0fa832b43783 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:49.652796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f783fdf-f48d-4859-8a33-79ea21ef9efb tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783" status: 404 len: 111 microversion: 2.25 time: 0.079928 Sep 18 01:10:49.654046 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1192/2292] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:49 2022] GET /compute/v2.1/servers/41ef5a3a-6c77-45a8-8d8a-0fa832b43783 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:10:49.687508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:49.689810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:49.735862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:49.736375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:49.736815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:49.737535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:49.762411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:49.763182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:49.961699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:50.172038 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c4179c45-88ff-4c34-ab30-fc0242607eb5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 204 len: 0 microversion: 2.1 time: 1.963621 Sep 18 01:10:50.181640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1101/2293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:48 2022] DELETE /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 0 bytes in 1967 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:50.214468 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:50.454794 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34e44242-d869-42f5-965b-0766252e839d tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 204 len: 0 microversion: 2.25 time: 0.795209 Sep 18 01:10:50.459906 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1193/2294] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:10:49 2022] DELETE /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:10:50.469539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:50.470740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:50.478444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:50.479689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:50.480591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:50.481478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:50.482775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:50.484588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:50.734793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-221b42ac-1681-4eb8-9f11-5180f15bb267 tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] Calling method '.version_select at 0x7f7006512160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:50.778186 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-221b42ac-1681-4eb8-9f11-5180f15bb267 tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.593960 Sep 18 01:10:50.779147 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1102/2295] 10.222.0.25 () {58 vars in 1185 bytes} [Sun Sep 18 01:10:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:50.791856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:50.793052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:50.807110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:50.809787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:50.811169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:50.814393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:50.815248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:50.816212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:50.843828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:50.858568 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af9ae334-faa5-4c42-b701-7596fee8dbaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.392439 Sep 18 01:10:50.860917 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1194/2296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:50 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:50.885673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:10:51.045163 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-852b4c90-d726-4f0e-a148-5b847305fd0f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 204 len: 0 microversion: 2.1 time: 0.263613 Sep 18 01:10:51.046450 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1103/2297] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:10:50 2022] DELETE /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:10:51.052543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:51.053474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:51.060628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:51.061675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:51.062358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:51.063310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:51.064315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:51.064897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:51.067685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-27f8a263-cb03-4078-92a3-1e2f8eb1087f req-4e95cfb6-242e-4409-a0d0-946791d9ffe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a8d0f7-7fa4-4b35-9627-d1f591dec2c3", "name": "network-vif-plugged", "status": "completed", "tag": "7338d34c-c072-42e2-81f8-1be7fca3bc0e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:51.100211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-27f8a263-cb03-4078-92a3-1e2f8eb1087f req-4e95cfb6-242e-4409-a0d0-946791d9ffe2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:51.102551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-27f8a263-cb03-4078-92a3-1e2f8eb1087f req-4e95cfb6-242e-4409-a0d0-946791d9ffe2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:51.103119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-27f8a263-cb03-4078-92a3-1e2f8eb1087f req-4e95cfb6-242e-4409-a0d0-946791d9ffe2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:51.124688 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-27f8a263-cb03-4078-92a3-1e2f8eb1087f req-4e95cfb6-242e-4409-a0d0-946791d9ffe2 service nova] Creating event network-vif-plugged:7338d34c-c072-42e2-81f8-1be7fca3bc0e for instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 on n-h2-master-1 Sep 18 01:10:51.132584 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-27f8a263-cb03-4078-92a3-1e2f8eb1087f req-4e95cfb6-242e-4409-a0d0-946791d9ffe2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270028 Sep 18 01:10:51.134724 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1195/2298] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:51.141012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:51.142281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:51.150582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:51.151649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:51.152571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:51.153447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:51.154078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:51.154709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:51.765444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:51.780830 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ebdb9f7-828b-4e94-a00a-444b9eae6c15 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.644435 Sep 18 01:10:51.782108 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1196/2299] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:51 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:51.787040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01904809-876c-4240-9586-e28b7c07f58e tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] Action: 'update', calling method: .version_select at 0x7f70063ea160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:51.845006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:51.855076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:51.856541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:51.857760 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-237f7ec4-f985-41e1-8c97-86bf70110a27 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1562 microversion: 2.25 time: 0.809841 Sep 18 01:10:51.858325 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1104/2300] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:51 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1562 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:51.880827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1804846975", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8549b193-9309-4447-b854-895b85b228c7"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:51.990208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] validate_networks() for [('8549b193-9309-4447-b854-895b85b228c7', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:10:52.105703 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=84,nova_api:UPDATE=9,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:10:52.343373 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01904809-876c-4240-9586-e28b7c07f58e tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.559699 Sep 18 01:10:52.344051 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1197/2301] 10.222.0.25 () {60 vars in 1206 bytes} [Sun Sep 18 01:10:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:52.366781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:52.367453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:52.380453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:52.380971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:52.381492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:52.382670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:52.384425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:52.385074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:53.219417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:53.231214 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-987becf3-9d1e-4fcb-8865-9b35afa15d9d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1316 microversion: 2.1 time: 0.883214 Sep 18 01:10:53.232002 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1198/2302] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:52 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1316 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:53.239817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee215b8e-c246-4fe3-895a-7c011604dae7 tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] Calling method '.version_select at 0x7f7006cbaee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:53.275634 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee215b8e-c246-4fe3-895a-7c011604dae7 tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.042341 Sep 18 01:10:53.285515 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1199/2303] 10.222.0.25 () {58 vars in 1185 bytes} [Sun Sep 18 01:10:53 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:53.301165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:53.305736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:53.332308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:53.346206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:53.348097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:53.349985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:53.352318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:53.363030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:53.761602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:53.773858 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16f18d95-c2c9-4c3e-b4dc-987ac0c80d48 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.491979 Sep 18 01:10:53.788133 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1200/2304] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:53 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:53.799916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:53.809909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:53.829198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:53.830349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:53.831039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:53.832188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:53.833503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:53.835613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:53.941070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:53.941653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:53.942027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:53.946532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lazy-loading 'fault' on Instance uuid b1b4f360-e61a-4fea-8b7d-05c20f3f0743 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:10:54.102874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:10:54.103934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:10:54.104585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:10:54.105163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:10:54.105759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:10:54.123093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:54.141461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.142078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:54.144815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.145611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.146206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb1c3f4298d34bb2a820ec5de46a76c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91519f8a3e34e8a880239a3dc33b7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:54.147333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.148834 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-124946be-9daf-43b4-856f-7df74c739425 tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 200 len: 1351 microversion: 2.25 time: 0.359315 Sep 18 01:10:54.150100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.150876 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1201/2305] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:53 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 1351 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:10:54.151520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.158310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-64044125-2dcb-403b-8344-96a64e4d2c8e req-2f48c5aa-320a-467e-83d2-9436525f6ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8d0ab8-22db-4c08-b2db-be4f1b9b983a", "name": "network-vif-unplugged", "status": "completed", "tag": "9a1b7e56-f05d-48b3-9e98-6e0303265579"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:54.191610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-64044125-2dcb-403b-8344-96a64e4d2c8e req-2f48c5aa-320a-467e-83d2-9436525f6ec0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.199441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-64044125-2dcb-403b-8344-96a64e4d2c8e req-2f48c5aa-320a-467e-83d2-9436525f6ec0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.203359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-64044125-2dcb-403b-8344-96a64e4d2c8e req-2f48c5aa-320a-467e-83d2-9436525f6ec0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.214540 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:10:54.227085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Getting quotas for user a7b979a402b74d679ec79f0b39255155 and project da55a64967a14840a19106cc9a8a2c05. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:10:54.241583 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-64044125-2dcb-403b-8344-96a64e4d2c8e req-2f48c5aa-320a-467e-83d2-9436525f6ec0 service nova] Creating event network-vif-unplugged:9a1b7e56-f05d-48b3-9e98-6e0303265579 for instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a on n-h1-master-1 Sep 18 01:10:54.248854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:10:54.249697 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-64044125-2dcb-403b-8344-96a64e4d2c8e req-2f48c5aa-320a-467e-83d2-9436525f6ec0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096233 Sep 18 01:10:54.251790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:10:54.256749 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1202/2306] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:54.267138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c5d70f6-56b0-4442-9fa6-5f10b3f4a32d tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] Action: 'update', calling method: .version_select at 0x7f7005f54b80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:54.348657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcebf41f-3a54-4718-ae67-07a58ab42164 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.472760 Sep 18 01:10:54.349664 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1105/2307] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:10:54.361889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c63b0537-9bf3-4258-b3cc-f1cde268d88e req-82227aed-8783-400f-be94-9348c9f93a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b4f360-e61a-4fea-8b7d-05c20f3f0743", "name": "network-vif-deleted", "tag": "da3bd35c-65ba-4bd4-a22d-f10bb6509b6d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:54.398565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c63b0537-9bf3-4258-b3cc-f1cde268d88e req-82227aed-8783-400f-be94-9348c9f93a01 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.399566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c63b0537-9bf3-4258-b3cc-f1cde268d88e req-82227aed-8783-400f-be94-9348c9f93a01 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.400253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c63b0537-9bf3-4258-b3cc-f1cde268d88e req-82227aed-8783-400f-be94-9348c9f93a01 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.437589 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c63b0537-9bf3-4258-b3cc-f1cde268d88e req-82227aed-8783-400f-be94-9348c9f93a01 service nova] Creating event network-vif-deleted:da3bd35c-65ba-4bd4-a22d-f10bb6509b6d for instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 on n-h2-master-1 Sep 18 01:10:54.450435 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c63b0537-9bf3-4258-b3cc-f1cde268d88e req-82227aed-8783-400f-be94-9348c9f93a01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097575 Sep 18 01:10:54.451795 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1106/2308] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:54.467639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:54.477889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:54.479254 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c5d70f6-56b0-4442-9fa6-5f10b3f4a32d tempest-QuotaClassesAdminTestJSON-2120725564 tempest-QuotaClassesAdminTestJSON-2120725564-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.220123 Sep 18 01:10:54.481653 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1203/2309] 10.222.0.25 () {60 vars in 1206 bytes} [Sun Sep 18 01:10:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:54.496803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.497860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.498134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34c5b688-28fd-4651-a0ca-194b262587c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:54.498793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.499174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34c5b688-28fd-4651-a0ca-194b262587c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:54.499957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.500632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.502543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.834745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-34c5b688-28fd-4651-a0ca-194b262587c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:54.842527 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34c5b688-28fd-4651-a0ca-194b262587c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1208 microversion: 2.1 time: 0.359578 Sep 18 01:10:54.861582 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1204/2310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:54 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1208 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:54.861582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:54.861582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:54.912393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.913325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.913815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.917968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:54.918367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:54.918812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:54.997307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:55.012799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed12405a-2d85-4843-afd5-843ee45b57e3 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1505 microversion: 2.1 time: 0.557703 Sep 18 01:10:55.013416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1107/2311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:54 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:55.039062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1931875344"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:55.039906 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:55.046659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:55.052768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:55.053966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:55.058076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:55.058769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:55.062141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:55.298731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:55.312373 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2af023b3-1b08-4f3c-a12d-a1b82306f482 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 0.460916 Sep 18 01:10:55.327330 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1205/2312] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:54 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:55.348762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:55.348762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] [instance: b1b4f360-e61a-4fea-8b7d-05c20f3f0743] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:55.356938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:55.357433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:55.357899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:55.358858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:55.359240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:55.359662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:55.390745 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] HTTP exception thrown: Instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 could not be found. Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Request method failure captured: Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 HTTP/1.1 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm4hJnRLsbjlYw9cPwehTsELaIY-Or2dqyONr38QZANR-RcguUMNJdPCYvWxNlo4DxPs61eTgt__L7Z5ygQMBY4ZkkZBJHbiM38dG2YxQhg5lpMjEtyfeE4CQnSlgGtm1_eA4JCMkvxfiuE19cb-CP2w4ZtM8oomP5wxIko-xb4uegY Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.25 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a91519f8a3e34e8a880239a3dc33b7fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: a91519f8a3e34e8a880239a3dc33b7fc Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: bb1c3f4298d34bb2a820ec5de46a76c2 Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1834345343-project Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: exception: Instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 could not be found. Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'b1b4f360-e61a-4fea-8b7d-05c20f3f0743'} Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 could not be found. Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 could not be found. Sep 18 01:10:55.392431 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 could not be found. Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] Returning 404 to user: Instance b1b4f360-e61a-4fea-8b7d-05c20f3f0743 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:55.396115 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a47b34a0-154f-438f-9a80-c8242cad5eab tempest-LiveAutoBlockMigrationV225Test-1834345343 tempest-LiveAutoBlockMigrationV225Test-1834345343-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743" status: 404 len: 111 microversion: 2.25 time: 0.065436 Sep 18 01:10:55.396735 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1206/2313] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:10:55 2022] GET /compute/v2.1/servers/b1b4f360-e61a-4fea-8b7d-05c20f3f0743 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:10:55.429382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.network.security_group_api [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Adding security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 to port 7338d34c-c072-42e2-81f8-1be7fca3bc0e Sep 18 01:10:55.877772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:55.878413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:55.894412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:55.894908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:55.895337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:55.905376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:55.905702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:55.907261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:56.250355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:56.263222 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fedab35d-9261-4d62-a9a5-036fa44880a6 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1204 microversion: 2.1 time: 0.391013 Sep 18 01:10:56.264036 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1207/2314] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:55 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1204 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:10:56.578920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-85cdeeb8-1b30-4f4c-ab52-000c52ec800b req-d93506b7-181c-475c-9ee6-112630d6b158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8d0ab8-22db-4c08-b2db-be4f1b9b983a", "name": "network-vif-deleted", "tag": "9a1b7e56-f05d-48b3-9e98-6e0303265579"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:56.603273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85cdeeb8-1b30-4f4c-ab52-000c52ec800b req-d93506b7-181c-475c-9ee6-112630d6b158 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:56.604086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85cdeeb8-1b30-4f4c-ab52-000c52ec800b req-d93506b7-181c-475c-9ee6-112630d6b158 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:56.604541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85cdeeb8-1b30-4f4c-ab52-000c52ec800b req-d93506b7-181c-475c-9ee6-112630d6b158 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:56.637998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-85cdeeb8-1b30-4f4c-ab52-000c52ec800b req-d93506b7-181c-475c-9ee6-112630d6b158 service nova] Creating event network-vif-deleted:9a1b7e56-f05d-48b3-9e98-6e0303265579 for instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a on n-h1-master-1 Sep 18 01:10:56.650391 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-85cdeeb8-1b30-4f4c-ab52-000c52ec800b req-d93506b7-181c-475c-9ee6-112630d6b158 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383080 Sep 18 01:10:56.654253 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1208/2315] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:56.666830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:56.667982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:56.683158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:56.685091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:56.685733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:56.687401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:56.689226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:56.691051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:56.730946 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-274c77d4-402c-421c-b013-6a4e2bfbee68 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3/action" status: 202 len: 0 microversion: 2.1 time: 1.697091 Sep 18 01:10:56.732093 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1108/2316] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:10:55 2022] POST /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3/action => generated 0 bytes in 1699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:10:56.748599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e32be2f5-09d3-454d-b565-84cf34496f36 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7006536430>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:58.171653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:58.182964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-382a9c1e-0d52-4dd2-bdb7-0bf626fff3d3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 1.527297 Sep 18 01:10:58.186073 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1209/2317] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:56 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:58.198786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6cf06c6e-5e34-48f2-81ff-cfe41a674d83 req-122c0aa5-c013-4ac0-bdb6-89d7df72d5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a8d0f7-7fa4-4b35-9627-d1f591dec2c3", "tag": "7338d34c-c072-42e2-81f8-1be7fca3bc0e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:58.206186 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-e32be2f5-09d3-454d-b565-84cf34496f36 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use.", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:10:58.206964 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e32be2f5-09d3-454d-b565-84cf34496f36 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use. Sep 18 01:10:58.206964 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-3467e6b1-a5ad-4f2f-9547-299e13936038'] Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e32be2f5-09d3-454d-b565-84cf34496f36 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7 HTTP/1.1 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: exception: Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use. Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-3467e6b1-a5ad-4f2f-9547-299e13936038'] Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4288ca71-3e99-4ce6-9413-cb8c869f5cb7'} Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:10:58.209073 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use. Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3467e6b1-a5ad-4f2f-9547-299e13936038'] Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use. Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3467e6b1-a5ad-4f2f-9547-299e13936038'] Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use. Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3467e6b1-a5ad-4f2f-9547-299e13936038'] Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use. Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3467e6b1-a5ad-4f2f-9547-299e13936038'] Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e32be2f5-09d3-454d-b565-84cf34496f36 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 400 to user: Security Group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 in use. Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-3467e6b1-a5ad-4f2f-9547-299e13936038'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e32be2f5-09d3-454d-b565-84cf34496f36 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7" status: 400 len: 185 microversion: 2.1 time: 1.471921 Sep 18 01:10:58.216562 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1109/2318] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:10:56 2022] DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7 => generated 185 bytes in 1478 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:10:58.229411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6cf06c6e-5e34-48f2-81ff-cfe41a674d83 req-122c0aa5-c013-4ac0-bdb6-89d7df72d5b0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:58.229914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6cf06c6e-5e34-48f2-81ff-cfe41a674d83 req-122c0aa5-c013-4ac0-bdb6-89d7df72d5b0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:58.230348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6cf06c6e-5e34-48f2-81ff-cfe41a674d83 req-122c0aa5-c013-4ac0-bdb6-89d7df72d5b0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:58.230914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:58.231642 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:58.244325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:58.245995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:58.246543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:58.247699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:58.249402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:58.250145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:58.252543 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6cf06c6e-5e34-48f2-81ff-cfe41a674d83 req-122c0aa5-c013-4ac0-bdb6-89d7df72d5b0 service nova] Creating event network-changed:7338d34c-c072-42e2-81f8-1be7fca3bc0e for instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 on n-h2-master-1 Sep 18 01:10:58.270546 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6cf06c6e-5e34-48f2-81ff-cfe41a674d83 req-122c0aa5-c013-4ac0-bdb6-89d7df72d5b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082671 Sep 18 01:10:58.271175 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1210/2319] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:10:58.281012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:10:58.291608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:58.310269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:58.310758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:58.311192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:58.311903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:58.318925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:58.319398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:59.086562 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76d11821-8b9d-4de5-a4ab-697fec3558ec tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3/action" status: 202 len: 0 microversion: 2.1 time: 0.813863 Sep 18 01:10:59.088563 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1211/2320] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:10:58 2022] POST /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:10:59.109708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:59.111464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:59.140412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:59.149035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:59.152421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:59.153932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:59.155123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:59.179013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:59.204402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:10:59.219177 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6160bb1d-2e64-435b-9866-f21e4bbb93e5 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 1.001367 Sep 18 01:10:59.245167 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1110/2321] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:58 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:10:59.269328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:10:59.279086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:10:59.303121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:59.303871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:59.304320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:10:59.315507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:10:59.316013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:10:59.316463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:00.274528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:00.282549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-761c3758-aba5-4ede-a3ee-0afdbe85fada tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1576 microversion: 2.1 time: 1.190220 Sep 18 01:11:00.293981 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1212/2322] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:59 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1576 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:11:00.307464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:00.308427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:00.323221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:00.324476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:00.325265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:00.326553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:00.327407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:00.328117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:00.951661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:00.960488 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a121e1a-dd33-4ec9-b18f-b1403abd4a55 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1512 microversion: 2.1 time: 1.696683 Sep 18 01:11:00.973958 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1111/2323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:10:59 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1512 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:01.299124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:01.309944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:01.310567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:01.320199 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a6b7805-0a25-4c44-bf74-f0b62ed2aa92 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 1.024674 Sep 18 01:11:01.328805 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1213/2324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:00 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:01.329364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:01.330264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:01.330891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:01.331778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:01.332437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:01.333008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:01.920032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:01.938540 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-074de6bb-610f-4a85-9873-f845b417706e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1576 microversion: 2.1 time: 0.632640 Sep 18 01:11:01.940007 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1112/2325] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:01 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1576 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:11:01.991008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:01.995017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:02.009379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:02.010568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:02.052905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:02.059636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:02.075790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:02.079917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:02.377129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:02.381027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:02.406674 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:02.436045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:02.436820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:02.440040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:02.448179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:02.452697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:02.453295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:03.539158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:03.555277 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bf274d91-48c9-4649-8a86-c61b1e34a14d tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1489 microversion: 2.1 time: 1.571379 Sep 18 01:11:03.575635 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1214/2326] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:01 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1489 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:03.575635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:03.575635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:03.606581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:03.607226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:03.607677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:03.608422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:03.608870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:03.617847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:03.632790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:03.635298 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:03.654948 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d7e3cdc-88f9-4a42-bc2b-fd2fd41a5657 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 1.301004 Sep 18 01:11:03.667770 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1113/2327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:02 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:11:03.685296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-dff94c60-ddf8-418b-9b40-d55d053e07f9 req-5f7592e0-9af0-4db1-bdc6-ab0738305725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116b7b56-be0e-4e40-a523-58a7e112b8b9", "tag": "c68459d8-84d9-45c7-a559-5c49ef93e529"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:03.688889 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:03.753993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dff94c60-ddf8-418b-9b40-d55d053e07f9 req-5f7592e0-9af0-4db1-bdc6-ab0738305725 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:03.755415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dff94c60-ddf8-418b-9b40-d55d053e07f9 req-5f7592e0-9af0-4db1-bdc6-ab0738305725 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:03.756090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dff94c60-ddf8-418b-9b40-d55d053e07f9 req-5f7592e0-9af0-4db1-bdc6-ab0738305725 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:03.806543 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-dff94c60-ddf8-418b-9b40-d55d053e07f9 req-5f7592e0-9af0-4db1-bdc6-ab0738305725 service nova] Creating event network-changed:c68459d8-84d9-45c7-a559-5c49ef93e529 for instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 on n-h2-master-1 Sep 18 01:11:03.830533 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-dff94c60-ddf8-418b-9b40-d55d053e07f9 req-5f7592e0-9af0-4db1-bdc6-ab0738305725 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156771 Sep 18 01:11:03.832282 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1114/2328] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:03.845911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:03.859015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:03.884765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:03.887469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:03.888984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:03.891838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:03.899884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:03.900691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:04.004248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:04.182556 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:04.250484 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:04.271358 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91a0b379-187e-45c8-8ef7-9b118bcfc747 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 204 len: 0 microversion: 2.1 time: 0.427670 Sep 18 01:11:04.275633 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1115/2329] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:03 2022] DELETE /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:04.291328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:04.302993 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6ffc96c-5e30-47de-8922-2ca4c8909831 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1576 microversion: 2.1 time: 0.738514 Sep 18 01:11:04.309940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:04.315223 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1215/2330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:03 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1576 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:04.315645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:04.333612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:04.334678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:04.335119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:04.335841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:04.336292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:04.337341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:04.697045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:04.698546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:04.734094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:04.739010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:04.744038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:04.749176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:04.754880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:04.758856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:04.855103 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:05.449025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:05.469039 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b3b1f0f-cb54-4056-a3f6-45ae9af01b07 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1495 microversion: 2.1 time: 1.183724 Sep 18 01:11:05.473530 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1116/2331] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:04 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1495 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:11:05.483714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:05.485751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:05.500391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:05.502144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:05.508222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:05.509787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:05.510271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:05.510832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:06.361313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:06.378790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d463b1f8-f902-43ad-a946-a90d0d255d18 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1576 microversion: 2.1 time: 0.903894 Sep 18 01:11:06.379949 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1117/2332] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:05 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1576 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:06.614157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Action: 'update', calling method: .version_select at 0x7f70062a1940>, body: {"quota_set": {"ram": "5120"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:06.729482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:06.730334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:06.730935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:06.738582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:06.739323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:06.740088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:06.835995 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9a66d481-da7c-4a01-87c8-9f5690380edb tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a" status: 200 len: 240 microversion: 2.36 time: 0.454643 Sep 18 01:11:06.844317 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1118/2333] 10.222.0.25 () {62 vars in 1303 bytes} [Sun Sep 18 01:11:06 2022] PUT /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a => generated 240 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:11:06.948767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1295903466", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c185b33e-8b41-4cfc-b754-eb735cca7b3e"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:07.038362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] validate_networks() for [('c185b33e-8b41-4cfc-b754-eb735cca7b3e', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:11:07.150106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:07.195615 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d0654771-d02c-4736-9690-b55e01caae66 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 2.500493 Sep 18 01:11:07.200945 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1216/2334] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:04 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:07.223923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:07.227462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:07.241672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:07.243622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:07.244469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:07.247636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:07.249614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:07.251124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:07.521133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:07.553064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0af22dae-a511-45c7-97a5-7854b954de21 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 200 len: 1453 microversion: 2.1 time: 0.349073 Sep 18 01:11:07.557381 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1217/2335] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:07 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 1453 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:07.568259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Calling method '.version_select at 0x7f70063d2ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:07.703952 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:UPDATE=18,nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:07.727934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:07.739945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:07.745397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:07.748128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:07.751024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:07.751984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:07.826687 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e05d986a-492c-47e8-ac12-be2d87454328 tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a/detail" status: 200 len: 672 microversion: 2.36 time: 0.267670 Sep 18 01:11:07.834769 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1218/2336] 10.222.0.25 () {60 vars in 1304 bytes} [Sun Sep 18 01:11:07 2022] GET /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a/detail => generated 672 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:11:07.845228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:07.850013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:07.912601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:07.913674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:07.915688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:07.916349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:07.916986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:07.917590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:08.404517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:08.420812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ad8d89b-0f12-4f4f-af2e-17ec16247d44 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1576 microversion: 2.1 time: 0.583131 Sep 18 01:11:08.439103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1219/2337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:07 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1576 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:08.450017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-9212afc7-d9e3-4b97-843b-ef71e4f61dda req-0d570d5a-609e-453b-9e47-36bdfa6f2968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb3142d-5147-43e9-b2f4-653d52b7f265", "name": "network-vif-deleted", "tag": "f65fd6db-79a6-4955-babd-630e6a9fc218"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:08.477079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9212afc7-d9e3-4b97-843b-ef71e4f61dda req-0d570d5a-609e-453b-9e47-36bdfa6f2968 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:08.481040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9212afc7-d9e3-4b97-843b-ef71e4f61dda req-0d570d5a-609e-453b-9e47-36bdfa6f2968 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:08.482107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9212afc7-d9e3-4b97-843b-ef71e4f61dda req-0d570d5a-609e-453b-9e47-36bdfa6f2968 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:08.507239 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-9212afc7-d9e3-4b97-843b-ef71e4f61dda req-0d570d5a-609e-453b-9e47-36bdfa6f2968 service nova] Creating event network-vif-deleted:f65fd6db-79a6-4955-babd-630e6a9fc218 for instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 on n-h1-master-1 Sep 18 01:11:08.520944 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-9212afc7-d9e3-4b97-843b-ef71e4f61dda req-0d570d5a-609e-453b-9e47-36bdfa6f2968 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079938 Sep 18 01:11:08.522914 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1220/2338] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:08.538196 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Action: 'update', calling method: .version_select at 0x7f7006dd18b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:08.760283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:08.760908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:08.762544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:08.766634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:08.767351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:08.767915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:08.859899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:08.861962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:08.863576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:08.865933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:08.886794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:08.897282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:08.914755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:11:08.917918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:11:08.918697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:11:08.919418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:11:08.920041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:11:08.943671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:08.947445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:08.951472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:08.952800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:08.963964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:08.964593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:09.065136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Getting quotas for project 262b41491a1745808f4a16c0b447e245. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:11:09.093586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Getting quotas for user 9116b95ef91f4a8d9842f2d72d9718c9 and project 262b41491a1745808f4a16c0b447e245. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:11:09.160916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Going to run 3 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:11:09.174653 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:11:09.179967 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e5faad5d-6566-4226-8add-1377b0795c2d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a?user_id=df5bd2e6d4744479b315e0b5143df531" status: 200 len: 240 microversion: 2.36 time: 0.651551 Sep 18 01:11:09.181713 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1221/2339] 10.222.0.25 () {62 vars in 1384 bytes} [Sun Sep 18 01:11:08 2022] PUT /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a?user_id=df5bd2e6d4744479b315e0b5143df531 => generated 240 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:11:09.199226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:09.205864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:09.235299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:09.236870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:09.244357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:09.245271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:09.245902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:09.246437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:09.267691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=ffa3348f-42e7-4d3a-9100-17bb53be30ed,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:11:09.418608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=d0e703c1-a546-4491-806c-5dc57a328851,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:11:09.664608 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ad272aad-96c0-41fd-bfb6-9121d887458f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.818660 Sep 18 01:11:09.676380 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1119/2340] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:11:09.698208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:09.701481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:09.712404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:09.713229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:09.714009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:09.716094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:09.717035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:09.717978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:09.741402 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 HTTP/1.1 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '1bb3142d-5147-43e9-b2f4-653d52b7f265'} Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:09.743675 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:09.748132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:09.748132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:09.748132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:09.748132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:09.748132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:09.748132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:09.748132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:09.749648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:09.750669 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e67e4ce7-5a56-4208-a446-7e2c5dc7e7f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 404 len: 111 microversion: 2.1 time: 0.072707 Sep 18 01:11:09.754965 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1120/2341] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:09 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:09.760599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-93e2035b-ffae-4417-ae11-06dce2e2545d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] Calling method '.version_select at 0x7f7006551e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:09.913831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:09.928744 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80522ccc-636b-4830-8970-28e373036aac tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 0.739315 Sep 18 01:11:09.930351 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1222/2342] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:09 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:09.941400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:09.947043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:09.961350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:09.963199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:09.965703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:09.966951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:09.972839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:09.974746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:10.432493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-93e2035b-ffae-4417-ae11-06dce2e2545d tempest-QuotasAdminTestV236-2060946791 tempest-QuotasAdminTestV236-2060946791-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a?user_id=df5bd2e6d4744479b315e0b5143df531" status: 200 len: 282 microversion: 2.36 time: 0.676173 Sep 18 01:11:10.434416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1121/2343] 10.222.0.25 () {60 vars in 1364 bytes} [Sun Sep 18 01:11:09 2022] GET /compute/v2.1/os-quota-sets/1227863c0429497fa15341ef262c1d9a?user_id=df5bd2e6d4744479b315e0b5143df531 => generated 282 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:11:10.461472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:10.481390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:10.486607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:10.569784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:10.572823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:10.573412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:10.577776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:10.581480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:10.582976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:10.643467 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d88bbbd1-e098-4639-8448-8c70f1f81c3c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.206511 Sep 18 01:11:10.644586 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1122/2344] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:11:10 2022] GET /compute/v2.1/servers => generated 1018 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:10.658857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-902207458", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "b66b4645-3540-45b7-82ac-f51c6140e547"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:10.802730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] validate_networks() for [('b66b4645-3540-45b7-82ac-f51c6140e547', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:11:11.235614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:11.261038 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78b5a9c9-77e8-43b7-9bca-6b53baf3108d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1574 microversion: 2.1 time: 1.325423 Sep 18 01:11:11.263757 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1223/2345] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:09 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1574 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:11.269721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42325a38-a2a1-44ef-9dcf-3792a7faaff9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:11.270547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42325a38-a2a1-44ef-9dcf-3792a7faaff9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:11.560297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42325a38-a2a1-44ef-9dcf-3792a7faaff9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:11.573334 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42325a38-a2a1-44ef-9dcf-3792a7faaff9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1223 microversion: 2.1 time: 0.303391 Sep 18 01:11:11.575371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1224/2346] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:11 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1223 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:11.616120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:11.620458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:11.657504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:11.665301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:11.666615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:11.667397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:11.669397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:11.669899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:12.411846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:12.434374 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00ed7bd6-e709-4b92-b630-6ce7c0d5a1ad tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 0.856081 Sep 18 01:11:12.434970 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1225/2347] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:11 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:12.472725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1647832118"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:12.474507 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:12.501188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:12.506099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:12.511022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:12.514513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:12.515627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:12.516433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:12.646382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:11:12.646869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:11:12.647263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:11:12.647674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:11:12.648246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:11:12.671688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:12.672215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:12.672818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:12.673646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:12.674112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:12.674536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:12.750389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:11:12.766935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Getting quotas for user 253b3027efb74403a9bfaa4d2cbfd31e and project 3ee0890115d040d0b712a534b9c5a824. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:11:12.831690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:11:12.834501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:11:12.928414 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69ac517a-d682-4083-a834-6af22b1184f7 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278337 Sep 18 01:11:12.930879 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1123/2348] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:11:12.936351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:12.937245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:12.949146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:12.949872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:12.950501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:12.951381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:12.952050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:12.953078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:13.190107 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:13.205016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef09bf63-1e78-4a4c-8d4c-d0b02590eef0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1219 microversion: 2.1 time: 0.272822 Sep 18 01:11:13.216823 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1124/2349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:12 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1219 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:13.221888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Adding security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a to port 7338d34c-c072-42e2-81f8-1be7fca3bc0e Sep 18 01:11:13.243288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-735a8b1f-33a0-4bd3-a250-991d254437df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:13.253967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-735a8b1f-33a0-4bd3-a250-991d254437df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:13.608742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-735a8b1f-33a0-4bd3-a250-991d254437df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:13.623480 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-735a8b1f-33a0-4bd3-a250-991d254437df tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1214 microversion: 2.1 time: 0.403645 Sep 18 01:11:13.641959 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1125/2350] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:13 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1214 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:13.648880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:13.656049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:13.673793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:13.675110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:13.683217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:13.684212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:13.684834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:13.685407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:14.996188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:15.016709 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b466162e-b23a-4259-a271-c49b92acf5ee tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 1.372454 Sep 18 01:11:15.018370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1126/2351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:13 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:15.036704 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-92e0c36b-1dde-4a50-bb9a-ad8de7ad92ee req-dd960083-1332-4433-8c7e-85737b0547af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116b7b56-be0e-4e40-a523-58a7e112b8b9", "name": "network-vif-plugged", "status": "completed", "tag": "c68459d8-84d9-45c7-a559-5c49ef93e529"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:15.092798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-92e0c36b-1dde-4a50-bb9a-ad8de7ad92ee req-dd960083-1332-4433-8c7e-85737b0547af service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:15.093374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-92e0c36b-1dde-4a50-bb9a-ad8de7ad92ee req-dd960083-1332-4433-8c7e-85737b0547af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:15.099207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-92e0c36b-1dde-4a50-bb9a-ad8de7ad92ee req-dd960083-1332-4433-8c7e-85737b0547af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:15.155625 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-92e0c36b-1dde-4a50-bb9a-ad8de7ad92ee req-dd960083-1332-4433-8c7e-85737b0547af service nova] Creating event network-vif-plugged:c68459d8-84d9-45c7-a559-5c49ef93e529 for instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 on n-h2-master-1 Sep 18 01:11:15.177649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-92e0c36b-1dde-4a50-bb9a-ad8de7ad92ee req-dd960083-1332-4433-8c7e-85737b0547af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153903 Sep 18 01:11:15.178259 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1127/2352] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:15.192896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:15.193659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:15.232930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:15.234463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:15.235306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:15.237227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:15.238264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:15.238963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:15.708661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:15.723699 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20e81a02-4c69-45ed-8ced-c614e1b6348c tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1281 microversion: 2.1 time: 0.537567 Sep 18 01:11:15.745202 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1128/2353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:15 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1281 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:15.750361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:15.759003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:15.768580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:15.769509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:15.770141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:15.771055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:15.771677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:15.772263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:15.909884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b327517-c36a-4ea9-830d-37c4707b0151 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3/action" status: 202 len: 0 microversion: 2.1 time: 3.459461 Sep 18 01:11:15.911531 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1226/2354] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:11:12 2022] POST /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3/action => generated 0 bytes in 3463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:11:15.921330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d3b4617-e0ee-4301-b4f5-d0b3aedfc822 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70063d5280>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:16.197207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:16.211251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-70f49b0d-f700-4243-86a9-f092bff098e9 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1266 microversion: 2.1 time: 0.464549 Sep 18 01:11:16.215691 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1129/2355] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:15 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:16.233708 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0acc681b-720f-47d6-8e75-a7f24673ec48 req-e65f266a-de9f-4335-ae78-4b008048f85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a8d0f7-7fa4-4b35-9627-d1f591dec2c3", "tag": "7338d34c-c072-42e2-81f8-1be7fca3bc0e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:16.272714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0acc681b-720f-47d6-8e75-a7f24673ec48 req-e65f266a-de9f-4335-ae78-4b008048f85f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:16.280271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0acc681b-720f-47d6-8e75-a7f24673ec48 req-e65f266a-de9f-4335-ae78-4b008048f85f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:16.280972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0acc681b-720f-47d6-8e75-a7f24673ec48 req-e65f266a-de9f-4335-ae78-4b008048f85f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:16.316471 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0acc681b-720f-47d6-8e75-a7f24673ec48 req-e65f266a-de9f-4335-ae78-4b008048f85f service nova] Creating event network-changed:7338d34c-c072-42e2-81f8-1be7fca3bc0e for instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 on n-h2-master-1 Sep 18 01:11:16.339822 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0acc681b-720f-47d6-8e75-a7f24673ec48 req-e65f266a-de9f-4335-ae78-4b008048f85f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122453 Sep 18 01:11:16.340458 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1130/2356] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:16.368398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:16.370450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:16.387303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:16.387804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:16.388241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:16.388948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:16.391160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:16.391766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.061921 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-3d3b4617-e0ee-4301-b4f5-d0b3aedfc822 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use.", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:11:17.062612 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-3d3b4617-e0ee-4301-b4f5-d0b3aedfc822 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use. Sep 18 01:11:17.062612 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-ad817490-6fc1-4f12-b07d-b91c443325ea'] Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d3b4617-e0ee-4301-b4f5-d0b3aedfc822 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a HTTP/1.1 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: exception: Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use. Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-ad817490-6fc1-4f12-b07d-b91c443325ea'] Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '83ee90e7-d4f2-4a37-9b4c-5617873dc93a'} Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:11:17.064588 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use. Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad817490-6fc1-4f12-b07d-b91c443325ea'] Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use. Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad817490-6fc1-4f12-b07d-b91c443325ea'] Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use. Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad817490-6fc1-4f12-b07d-b91c443325ea'] Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use. Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad817490-6fc1-4f12-b07d-b91c443325ea'] Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d3b4617-e0ee-4301-b4f5-d0b3aedfc822 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 400 to user: Security Group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a in use. Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-ad817490-6fc1-4f12-b07d-b91c443325ea'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d3b4617-e0ee-4301-b4f5-d0b3aedfc822 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a" status: 400 len: 185 microversion: 2.1 time: 1.149846 Sep 18 01:11:17.068319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1227/2357] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:15 2022] DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a => generated 185 bytes in 1151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:11:17.075378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:17.076584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:17.096385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.096940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.097387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.098164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.098637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.099029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.139944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:17.168925 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40b7db4e-13e9-4d28-af57-1c849c355c96 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 0.818707 Sep 18 01:11:17.194134 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1131/2358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:16 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:17.214566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:17.215210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:17.231653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.232354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.242863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.243886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.244519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.245103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.313459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:17.379635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:17.402826 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a8e773cd-2a13-4b25-9f91-8ad50cab6106 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1281 microversion: 2.1 time: 0.334749 Sep 18 01:11:17.403431 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1228/2359] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:17 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1281 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:17.431358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:17.452626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:17.492254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.498095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.503345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.503563 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=13 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:17.505653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.509508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.514182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.555515 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2afb512-6908-43a8-9b0b-96907205bcca tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 204 len: 0 microversion: 2.1 time: 0.356165 Sep 18 01:11:17.557660 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1132/2360] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:17 2022] DELETE /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:17.574616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:17.575368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:17.602800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.603601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.604306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.605377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:17.606208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:17.606915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:17.806362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:17.822802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d2bb6d2-3c54-4099-a0e3-365ced166aa3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1272 microversion: 2.1 time: 0.401877 Sep 18 01:11:17.824053 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1229/2361] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:17 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:18.184947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:18.198756 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-85fb293b-7305-4191-8aa7-755c4b06e93a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1649 microversion: 2.1 time: 0.631212 Sep 18 01:11:18.199738 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1133/2362] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:17 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1649 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:18.221025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:18.221828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:18.232001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:18.234366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:18.236657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:18.237530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:18.239803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:18.240473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:18.444943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:18.448329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:18.465415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:18.468377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:18.469842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:18.471590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:18.472852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:18.474375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:18.513648 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:18.960431 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=7 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:19.127938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:19.137154 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-124511b7-2f56-4e27-a3f7-f0796d8141e6 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1281 microversion: 2.1 time: 0.712250 Sep 18 01:11:19.155040 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1134/2363] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:18 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1281 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:19.168011 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:19.172721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:19.189800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:19.194319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:19.194785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:19.195846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:19.196313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:19.215624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:19.410072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:19.448308 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1219de28-f16f-4ec1-a5f1-febcd5b0c85b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1272 microversion: 2.1 time: 0.288660 Sep 18 01:11:19.452516 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1135/2364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:19 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:19.472072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:19.472947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:19.481056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:19.481635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:19.482335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:19.483970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:19.483970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:19.484468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:19.512538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:19.525804 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac415310-2ea9-4ce9-a61a-4560d9ee7d5c tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1308 microversion: 2.1 time: 1.310377 Sep 18 01:11:19.528168 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1230/2365] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:18 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1308 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:19.927013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:19.942720 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cbac66d5-b0ba-4edb-b2e3-7fb08560525d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1649 microversion: 2.1 time: 0.485200 Sep 18 01:11:19.944019 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1136/2366] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:19 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1649 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:20.091535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84e5687b-6329-4275-a427-f008ffb9d603 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Action: 'create', calling method: .version_select at 0x7f7005e61940>, body: {"keypair": {"name": "tempest-keypair-310159639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkn1sufn+cwZPg0mVWHOFfAGdQp9dDomrCcR2e9OEaOpzmo7c3dR3Zm3viOUNxm0WOPsKNdFV4FtLIk0Cc6U5G9YFpHI/qKw6/a16gtv+W4p8dv//dWiwfznSb+irRVTw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:20.113283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-84e5687b-6329-4275-a427-f008ffb9d603 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Getting quotas for project 97543cfd30dd47fcb01cebef908f6fd7. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:11:20.128013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-84e5687b-6329-4275-a427-f008ffb9d603 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Getting quotas for user 15a63fcd25ee41c49edd383ee07a8821 and project 97543cfd30dd47fcb01cebef908f6fd7. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:11:20.173212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:20.174554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:20.186404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-84e5687b-6329-4275-a427-f008ffb9d603 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.656561 Sep 18 01:11:20.187029 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1231/2367] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:11:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:20.188760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:20.191260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:20.191732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:20.193701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:20.194190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:20.194632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:20.477368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:20.478024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:20.495423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:20.496321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:20.497218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:20.498370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:20.501919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:20.504180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:20.871168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:20.885848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac1493ff-9536-4891-9ae0-b45817fe9110 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 0.717998 Sep 18 01:11:20.887012 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1137/2368] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:20 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:20.896638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:20.897829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:20.911963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:20.912815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:20.915586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:20.917398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:20.919316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:20.922567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:21.212023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:21.223522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04d0bd4a-f041-4071-8c69-470d92a643b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 0.750600 Sep 18 01:11:21.224915 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1232/2369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:20 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:11:21.229788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:21.231622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:21.239965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:21.241456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:21.242127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:21.243200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:21.244073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:21.244809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:21.546843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:21.561693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e8fcd7a2-9680-4609-81fe-f70425b17301 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1487 microversion: 2.1 time: 0.672543 Sep 18 01:11:21.562758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1138/2370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:20 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1487 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:21.590841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1349984564"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:21.594864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:21.603502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:21.603950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:21.605762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:21.606555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:21.607022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:21.607524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:22.029997 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9adbb0bd-41e0-4d81-b0f5-91a3692a76c2 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "POST /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9/action" status: 202 len: 0 microversion: 2.1 time: 0.447098 Sep 18 01:11:22.031721 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1139/2371] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:11:21 2022] POST /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 18 01:11:22.037230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:22.038411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:22.046407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:22.047154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:22.047795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:22.048755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:22.049369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:22.050030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:22.425301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:22.437719 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-339cd710-388b-4694-a3f0-f774ac0cfff2 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1649 microversion: 2.1 time: 1.208203 Sep 18 01:11:22.437719 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1233/2372] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:21 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1649 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:22.452077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c518bcab-933f-4923-b3a1-41f2380fdcda tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f7006d11ca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:22.553324 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c518bcab-933f-4923-b3a1-41f2380fdcda tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2" status: 200 len: 1414 microversion: 2.1 time: 0.117286 Sep 18 01:11:22.555196 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1234/2373] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:11:22 2022] GET /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:22.568853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:22.569796 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:22.584495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:22.590730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:22.592153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:22.593959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:22.594763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:22.595481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:22.724538 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:23.609861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:23.622746 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=26 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:23.626464 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f76d258e-96a0-4ae2-a5c4-6b07e47cd792 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 1.593117 Sep 18 01:11:23.627368 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1140/2374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:22 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:23.658655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d9bf5395-5027-42a7-90c3-83a74b42a595 req-26487fda-6414-4c4e-a121-c3f64af783cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa3348f-42e7-4d3a-9100-17bb53be30ed", "tag": "493ca1c4-2721-4cf5-8c3d-e3c43332a05a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:23.673648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d9bf5395-5027-42a7-90c3-83a74b42a595 req-26487fda-6414-4c4e-a121-c3f64af783cc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:23.674821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d9bf5395-5027-42a7-90c3-83a74b42a595 req-26487fda-6414-4c4e-a121-c3f64af783cc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:23.675606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d9bf5395-5027-42a7-90c3-83a74b42a595 req-26487fda-6414-4c4e-a121-c3f64af783cc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:23.694693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d9bf5395-5027-42a7-90c3-83a74b42a595 req-26487fda-6414-4c4e-a121-c3f64af783cc service nova] Creating event network-changed:493ca1c4-2721-4cf5-8c3d-e3c43332a05a for instance ffa3348f-42e7-4d3a-9100-17bb53be30ed on n-h1-master-1 Sep 18 01:11:23.711715 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d9bf5395-5027-42a7-90c3-83a74b42a595 req-26487fda-6414-4c4e-a121-c3f64af783cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061461 Sep 18 01:11:23.713972 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1141/2375] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:23.730341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-73793812-ccd4-454c-af0b-d31a4a9fd73f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70061899d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:23.801122 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-73793812-ccd4-454c-af0b-d31a4a9fd73f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2" status: 200 len: 1414 microversion: 2.1 time: 0.085009 Sep 18 01:11:23.805842 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1142/2376] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:11:23 2022] GET /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:23.918149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:23.966976 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac3fd11b-e0f9-493c-a7cf-78eb35e292a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 1.405685 Sep 18 01:11:23.972246 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1235/2377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:22 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:24.004070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:24.006340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:24.044593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:24.046042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:24.048866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:24.050440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:24.056284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:24.057187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:24.203240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-911691953", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": "none"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:24.267641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:24.282264 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a741917f-3f85-4a7e-a88a-f394010c3be9 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 200 len: 1301 microversion: 2.1 time: 0.306969 Sep 18 01:11:24.292948 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1236/2378] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:23 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 1301 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:24.323578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:11:24.324557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:11:24.325337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:11:24.326228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:11:24.326896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:11:24.342299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:24.343990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:24.344907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:24.346069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:24.346821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:24.347633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:24.370160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-107ea0f1-9abc-4009-9f05-e4804a2c902c req-84659318-3ae8-4766-a358-d31be49ce30f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a824b75-7a83-4e85-b7b6-07173f93b720", "tag": "d529e4ce-e79a-4207-a342-816a2cdd824a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:24.397502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Getting quotas for project 768a8f982c2b47d6a6f4ab57424ac2a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:11:24.409307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Getting quotas for user f5474aa392484529b280cbab7436a24b and project 768a8f982c2b47d6a6f4ab57424ac2a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:11:24.419659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-107ea0f1-9abc-4009-9f05-e4804a2c902c req-84659318-3ae8-4766-a358-d31be49ce30f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:24.423367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-107ea0f1-9abc-4009-9f05-e4804a2c902c req-84659318-3ae8-4766-a358-d31be49ce30f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:24.424055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-107ea0f1-9abc-4009-9f05-e4804a2c902c req-84659318-3ae8-4766-a358-d31be49ce30f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:24.430795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:11:24.453358 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-107ea0f1-9abc-4009-9f05-e4804a2c902c req-84659318-3ae8-4766-a358-d31be49ce30f service nova] Creating event network-changed:d529e4ce-e79a-4207-a342-816a2cdd824a for instance 0a824b75-7a83-4e85-b7b6-07173f93b720 on n-h1-master-1 Sep 18 01:11:24.464377 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-107ea0f1-9abc-4009-9f05-e4804a2c902c req-84659318-3ae8-4766-a358-d31be49ce30f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167363 Sep 18 01:11:24.465744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:11:24.467460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1237/2379] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:24.480844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8d0aa71c-8e7b-4401-a1a4-5cc20121fd61 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70062f7040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:24.597980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb971e78-1323-4fa8-b18f-84b5d6253571 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.790050 Sep 18 01:11:24.605093 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1143/2380] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:11:24.613111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b86f8ccb-212a-4b55-9f92-25d9746d99a2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:24.613881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b86f8ccb-212a-4b55-9f92-25d9746d99a2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:24.825812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8d0aa71c-8e7b-4401-a1a4-5cc20121fd61 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2" status: 204 len: 0 microversion: 2.1 time: 0.356843 Sep 18 01:11:24.826693 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1238/2381] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:24 2022] DELETE /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:24.831921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:24.832669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:24.847236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:24.847820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:24.848287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:24.849398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:24.859486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b86f8ccb-212a-4b55-9f92-25d9746d99a2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:24.866064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:24.889706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b86f8ccb-212a-4b55-9f92-25d9746d99a2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:24.891176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b86f8ccb-212a-4b55-9f92-25d9746d99a2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:24.902339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:24.924770 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b86f8ccb-212a-4b55-9f92-25d9746d99a2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1452 microversion: 2.91 time: 0.317645 Sep 18 01:11:24.933934 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1144/2382] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:24 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1452 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:24.940393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8356a39e-07ec-408f-9236-d597b96fdc32 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f700615e0d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:24.975885 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:25.021532 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-8356a39e-07ec-408f-9236-d597b96fdc32 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Image not found. Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8356a39e-07ec-408f-9236-d597b96fdc32 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2 HTTP/1.1 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd764307b-ed92-407a-a027-324ce5a907d2'} Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d764307b-ed92-407a-a027-324ce5a907d2 Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:11:25.024631 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d764307b-ed92-407a-a027-324ce5a907d2 could not be found. Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:11:25.029490 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:25.037820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8356a39e-07ec-408f-9236-d597b96fdc32 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:25.037820 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8356a39e-07ec-408f-9236-d597b96fdc32 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2" status: 404 len: 62 microversion: 2.1 time: 0.101660 Sep 18 01:11:25.041844 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1145/2383] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:11:24 2022] GET /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:11:25.060614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:25.070985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:25.094100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:25.094825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:25.095695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:25.096586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:25.097696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:25.098540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:25.841016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:25.861745 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b67613db-1a83-4f31-b830-705e21f6f35e tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 1.031644 Sep 18 01:11:25.868348 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1239/2384] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:24 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:25.887357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:25.893373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:25.909345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:25.918642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:25.920487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:25.921793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:25.921793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:25.922371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:25.934070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:25.953911 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-955a01be-8d1b-4d80-8082-9fd4e9835614 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 0.908420 Sep 18 01:11:25.957334 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1146/2385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:25 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:25.974895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:25.977785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:25.996474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:25.998093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:25.998796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.002814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.003307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.003752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.036538 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 HTTP/1.1 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '96a8d0f7-7fa4-4b35-9627-d1f591dec2c3'} Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:26.039720 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-31680e1e-b6a4-4084-8a55-fed4a0ba032d tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 404 len: 111 microversion: 2.1 time: 0.081076 Sep 18 01:11:26.052192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1147/2386] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:25 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:26.055002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:26.055534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:26.062935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.063415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.063851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.064731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.065201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.065708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.350441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:26.363937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:26.366021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:26.376677 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee66a19d-d671-4dd4-b916-7f8dec98929c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1448 microversion: 2.91 time: 0.329174 Sep 18 01:11:26.387357 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1148/2387] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:26 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1448 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:26.387357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-968e0439-67ac-4581-b503-545babf2541b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7006201dc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:26.781776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:26.796221 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8222b97c-ff52-46c0-9974-f505143e9c6f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1505 microversion: 2.1 time: 0.924539 Sep 18 01:11:26.797624 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1240/2388] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:25 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1505 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:26.803987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1d8f1fbe-22f2-47b7-bcde-3549dfe5578d req-d1de7a62-ff01-414a-beee-ae1cfdfd3c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116b7b56-be0e-4e40-a523-58a7e112b8b9", "name": "network-vif-plugged", "status": "completed", "tag": "c68459d8-84d9-45c7-a559-5c49ef93e529"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:26.818098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d8f1fbe-22f2-47b7-bcde-3549dfe5578d req-d1de7a62-ff01-414a-beee-ae1cfdfd3c9a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.818960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d8f1fbe-22f2-47b7-bcde-3549dfe5578d req-d1de7a62-ff01-414a-beee-ae1cfdfd3c9a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.819652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d8f1fbe-22f2-47b7-bcde-3549dfe5578d req-d1de7a62-ff01-414a-beee-ae1cfdfd3c9a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.835424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1d8f1fbe-22f2-47b7-bcde-3549dfe5578d req-d1de7a62-ff01-414a-beee-ae1cfdfd3c9a service nova] Creating event network-vif-plugged:c68459d8-84d9-45c7-a559-5c49ef93e529 for instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 on n-h2-master-1 Sep 18 01:11:26.841759 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1d8f1fbe-22f2-47b7-bcde-3549dfe5578d req-d1de7a62-ff01-414a-beee-ae1cfdfd3c9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042113 Sep 18 01:11:26.843184 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1241/2389] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:26.853078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-2e518331-d9af-4db2-a0b8-6acc4ecac4a2 req-865f0930-c595-4fc5-8b84-60614d2a7f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e703c1-a546-4491-806c-5dc57a328851", "tag": "c13cc8a8-6d00-4504-9283-431a2325e41f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:26.869610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2e518331-d9af-4db2-a0b8-6acc4ecac4a2 req-865f0930-c595-4fc5-8b84-60614d2a7f9a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.870273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2e518331-d9af-4db2-a0b8-6acc4ecac4a2 req-865f0930-c595-4fc5-8b84-60614d2a7f9a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.870723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2e518331-d9af-4db2-a0b8-6acc4ecac4a2 req-865f0930-c595-4fc5-8b84-60614d2a7f9a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.885060 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-2e518331-d9af-4db2-a0b8-6acc4ecac4a2 req-865f0930-c595-4fc5-8b84-60614d2a7f9a service nova] Creating event network-changed:c13cc8a8-6d00-4504-9283-431a2325e41f for instance d0e703c1-a546-4491-806c-5dc57a328851 on n-h1-master-1 Sep 18 01:11:26.899809 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-2e518331-d9af-4db2-a0b8-6acc4ecac4a2 req-865f0930-c595-4fc5-8b84-60614d2a7f9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054880 Sep 18 01:11:26.900426 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1242/2390] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:26.905950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1911e7ca-a5ad-442e-b53a-9b8221c887fd req-8cb8d3c9-4e63-4493-a8a0-801807fc3452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a8d0f7-7fa4-4b35-9627-d1f591dec2c3", "name": "network-vif-deleted", "tag": "7338d34c-c072-42e2-81f8-1be7fca3bc0e"}, {"name": "network-changed", "server_uuid": "add4799b-2874-4d67-a3bc-59dafef3f6e0", "tag": "533d18a4-c60c-4fa9-a361-75d1dbd75346"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:26.918144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1911e7ca-a5ad-442e-b53a-9b8221c887fd req-8cb8d3c9-4e63-4493-a8a0-801807fc3452 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.918627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1911e7ca-a5ad-442e-b53a-9b8221c887fd req-8cb8d3c9-4e63-4493-a8a0-801807fc3452 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.919056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1911e7ca-a5ad-442e-b53a-9b8221c887fd req-8cb8d3c9-4e63-4493-a8a0-801807fc3452 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.934750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1911e7ca-a5ad-442e-b53a-9b8221c887fd req-8cb8d3c9-4e63-4493-a8a0-801807fc3452 service nova] Creating event network-vif-deleted:7338d34c-c072-42e2-81f8-1be7fca3bc0e for instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 on n-h2-master-1 Sep 18 01:11:26.935165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1911e7ca-a5ad-442e-b53a-9b8221c887fd req-8cb8d3c9-4e63-4493-a8a0-801807fc3452 service nova] Creating event network-changed:533d18a4-c60c-4fa9-a361-75d1dbd75346 for instance add4799b-2874-4d67-a3bc-59dafef3f6e0 on n-h2-master-1 Sep 18 01:11:26.942181 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1911e7ca-a5ad-442e-b53a-9b8221c887fd req-8cb8d3c9-4e63-4493-a8a0-801807fc3452 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040312 Sep 18 01:11:26.942807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1243/2391] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:26.949034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:26.949791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:26.956600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.957785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.958213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:26.959151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:26.959609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:26.960030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:27.317391 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-968e0439-67ac-4581-b503-545babf2541b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7" status: 202 len: 0 microversion: 2.1 time: 0.937210 Sep 18 01:11:27.319021 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1149/2392] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:26 2022] DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7 => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:11:27.333098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:27.333793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:27.352103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:27.352609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:27.355838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:27.356618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:27.357113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:27.358361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:27.358805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:27.367964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca01ddb2-0b4d-4a3d-aa1f-bcda0f313011 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 0.423584 Sep 18 01:11:27.381955 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1244/2393] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:26 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:27.387043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-207058160", "imageRef": "731df5e2-f67c-4ef5-9767-78d5373402bb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d9843eb6-bd00-48b6-9c74-163f2dc6b3f5"}], "security_groups": [{"name": "tempest-securitygroup--2032611930"}], "key_name": "tempest-keypair-310159639", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:27.690750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] validate_networks() for [('d9843eb6-bd00-48b6-9c74-163f2dc6b3f5', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:11:27.842355 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:27.855881 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ab2183f-6e52-47ba-8354-e00132234a7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 0.534555 Sep 18 01:11:27.858913 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1150/2394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:27 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:27.865086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64f3502b-911d-49bd-9ea2-94fd8f86d661 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7005e66430>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:28.339872 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64f3502b-911d-49bd-9ea2-94fd8f86d661 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a" status: 202 len: 0 microversion: 2.1 time: 0.478899 Sep 18 01:11:28.341979 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1151/2395] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:27 2022] DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:11:28.357311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:28.358046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:28.365853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.366459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.367874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:28.368631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.369328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.369865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:28.491102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:28.505022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:28.506539 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:28.514812 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-149a8555-b9c4-4cfe-a2f4-32112f84857c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1510 microversion: 2.91 time: 0.170812 Sep 18 01:11:28.515894 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1152/2396] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:28 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:28.521965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:28.523332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:28.532873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.537709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:11:28.539249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:11:28.539866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:11:28.540455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:11:28.541080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:11:28.549326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.551218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:28.552010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.552563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.552997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:28.562645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.563779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.564403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:28.565154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.565640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.566234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:28.596455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Getting quotas for project 97543cfd30dd47fcb01cebef908f6fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:11:28.608321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Getting quotas for user 15a63fcd25ee41c49edd383ee07a8821 and project 97543cfd30dd47fcb01cebef908f6fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:11:28.639477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:11:28.642594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='731df5e2-f67c-4ef5-9767-78d5373402bb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:11:28.659033 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:28.718782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:28.728564 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63fc0b45-a0fc-4625-81e6-51f68606320d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.345338 Sep 18 01:11:28.730085 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1245/2397] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:11:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:11:28.737129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63fc800b-a611-40a1-9022-436b086b8c25 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'create', calling method: .version_select at 0x7f70063d2a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-469489105", "description": "tempest-description-1170138427"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:28.746591 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00675fd4-9c9d-4aeb-9aa8-b281bdc4ab86 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1487 microversion: 2.1 time: 0.229477 Sep 18 01:11:28.750274 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1153/2398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:28 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1487 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:28.759515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:28.761110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:28.775204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.775954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.777143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:28.778133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:28.778751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:28.779343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.582626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:29.594549 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96e3f100-2344-4b7b-8188-01ba125252fd tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 0.840271 Sep 18 01:11:29.596972 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1154/2399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:28 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:29.609570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:29.611579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:29.636306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.636477 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63fc800b-a611-40a1-9022-436b086b8c25 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.904742 Sep 18 01:11:29.637170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.642566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.644108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.645190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.645630 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1246/2400] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:11:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:29.646658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.651181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:29.652120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:29.669299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.669831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.670257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.674807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.677504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.678147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.752810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:29.793220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:29.804898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-472b8689-06ad-4966-8320-1286e6b1e5bf tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1248 microversion: 2.1 time: 0.206111 Sep 18 01:11:29.805502 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1155/2401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:29 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1248 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:29.813459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:29.815077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:29.839346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.843944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.844404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.845150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.845638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.847243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.916103 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a7593d37-8a2b-4dc1-bef2-16ab88005c87 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 204 len: 0 microversion: 2.1 time: 0.269055 Sep 18 01:11:29.916708 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1247/2402] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:29 2022] DELETE /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:29.936739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:29.938433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:29.945924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.946703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.948125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:29.949171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:29.950023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:29.950672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.153293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:30.166872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:30.169416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:30.177014 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-488fc3e6-c27d-4749-a6d7-ea158c4bd8bf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1510 microversion: 2.91 time: 0.256474 Sep 18 01:11:30.177962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1248/2403] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:29 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:30.186032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3fe8adfe-2e25-4aa0-a9ce-35a02850089b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Action: 'update', calling method: .version_select at 0x7f7005e61700>, body: {"security_group": {"name": "tempest-sg-hth-1096434931", "description": "tempest-description-hth-1758586737"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:30.186982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:30.189383 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:30.197081 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ee207de-4c5f-4b4d-97d7-236b6cf1ae1e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 0.387483 Sep 18 01:11:30.206201 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1156/2404] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:29 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:30.216048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-787f7140-0f25-4fca-a0f3-0f6e402c6699 req-4db2c165-b8d5-4422-9f1a-a88459da0d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa3348f-42e7-4d3a-9100-17bb53be30ed", "name": "network-vif-plugged", "status": "completed", "tag": "493ca1c4-2721-4cf5-8c3d-e3c43332a05a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:30.247248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-787f7140-0f25-4fca-a0f3-0f6e402c6699 req-4db2c165-b8d5-4422-9f1a-a88459da0d47 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:30.248539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-787f7140-0f25-4fca-a0f3-0f6e402c6699 req-4db2c165-b8d5-4422-9f1a-a88459da0d47 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:30.249465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-787f7140-0f25-4fca-a0f3-0f6e402c6699 req-4db2c165-b8d5-4422-9f1a-a88459da0d47 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.265991 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-787f7140-0f25-4fca-a0f3-0f6e402c6699 req-4db2c165-b8d5-4422-9f1a-a88459da0d47 service nova] Creating event network-vif-plugged:493ca1c4-2721-4cf5-8c3d-e3c43332a05a for instance ffa3348f-42e7-4d3a-9100-17bb53be30ed on n-h1-master-1 Sep 18 01:11:30.272854 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-787f7140-0f25-4fca-a0f3-0f6e402c6699 req-4db2c165-b8d5-4422-9f1a-a88459da0d47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072178 Sep 18 01:11:30.274697 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1157/2405] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:30.281489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfb7c052-54a4-4f56-9fe8-fa8573f6bafb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70065d7d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:30.311813 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-dfb7c052-54a4-4f56-9fe8-fa8573f6bafb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Image not found. Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfb7c052-54a4-4f56-9fe8-fa8573f6bafb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2 HTTP/1.1 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd764307b-ed92-407a-a027-324ce5a907d2'} Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d764307b-ed92-407a-a027-324ce5a907d2 to delete Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d764307b-ed92-407a-a027-324ce5a907d2 could not be found. Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:30.315620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:11:30.320589 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:30.323605 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfb7c052-54a4-4f56-9fe8-fa8573f6bafb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:30.325396 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dfb7c052-54a4-4f56-9fe8-fa8573f6bafb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2" status: 404 len: 62 microversion: 2.1 time: 0.048444 Sep 18 01:11:30.326477 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1158/2406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:30 2022] DELETE /compute/v2.1/images/d764307b-ed92-407a-a027-324ce5a907d2 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:11:30.335783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:30.337457 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:30.347390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:30.348222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:30.348836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.349794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:30.350427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:30.351533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.394961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:30.488351 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Instance is already in deleting state, ignoring this request Sep 18 01:11:30.489817 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-479637f3-45c5-4006-af8d-5176e6f4a12b tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 204 len: 0 microversion: 2.1 time: 0.158886 Sep 18 01:11:30.491425 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1159/2407] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:30 2022] DELETE /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:30.501373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:30.502412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:30.511052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:30.511925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:30.512661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.513816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:30.514485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:30.514918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.523977 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3fe8adfe-2e25-4aa0-a9ce-35a02850089b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/91ff411d-f624-4361-aba0-6f8d02aaced8" status: 200 len: 218 microversion: 2.1 time: 0.342664 Sep 18 01:11:30.535237 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1249/2408] 10.222.0.25 () {60 vars in 1290 bytes} [Sun Sep 18 01:11:30 2022] PUT /compute/v2.1/os-security-groups/91ff411d-f624-4361-aba0-6f8d02aaced8 => generated 218 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:30.546272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07e27a1e-d0ab-4504-8327-4ad4f7c47959 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f700618ed30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:30.783459 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07e27a1e-d0ab-4504-8327-4ad4f7c47959 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/91ff411d-f624-4361-aba0-6f8d02aaced8" status: 200 len: 218 microversion: 2.1 time: 0.246632 Sep 18 01:11:30.786521 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1250/2409] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:11:30 2022] GET /compute/v2.1/os-security-groups/91ff411d-f624-4361-aba0-6f8d02aaced8 => generated 218 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:30.793422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:30.794299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:30.801917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:30.806090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:30.806795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:30.807422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.808134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:30.808761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:30.810269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:30.812356 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-414ff655-5bbd-496d-90e8-1d33d1431b6a tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1493 microversion: 2.1 time: 0.315005 Sep 18 01:11:30.813016 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1160/2410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:30 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1493 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:30.818117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4afa6d4f-0ca0-44c8-bb59-79a02a3f0f07 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70063fc0d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.028505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:31.043098 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2c1a820-9a6b-420b-bfcf-a6f7fa1200aa tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 0.254669 Sep 18 01:11:31.056635 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1251/2411] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:30 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:31.066521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.067392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:31.075724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.076894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.077709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.078792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.079370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.079925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.160236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:31.169710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-416636b9-feee-4258-981c-579e23aa64be tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1296 microversion: 2.1 time: 0.111371 Sep 18 01:11:31.170418 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1252/2412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:31 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:31.182724 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4afa6d4f-0ca0-44c8-bb59-79a02a3f0f07 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/91ff411d-f624-4361-aba0-6f8d02aaced8" status: 202 len: 0 microversion: 2.1 time: 0.368379 Sep 18 01:11:31.186723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1161/2413] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:30 2022] DELETE /compute/v2.1/os-security-groups/91ff411d-f624-4361-aba0-6f8d02aaced8 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:11:31.193409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.193956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:31.202157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.202157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.202157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.207815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.208497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:31.212825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.213769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.214620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.217601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.218105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.218553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.219259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.219772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.220215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.234137 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 HTTP/1.1 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '96a8d0f7-7fa4-4b35-9627-d1f591dec2c3'} Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:31.236671 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59f6e6ac-1239-4b91-bfb0-d115138bc07b tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 404 len: 111 microversion: 2.1 time: 0.050014 Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1253/2414] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:31 2022] DELETE /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.245271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:31.252430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.252928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.265125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.265394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.265882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.271168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.305807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:31.329746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:31.331545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:31.341654 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d28ba083-29cc-416b-a788-9bdf9aafd2c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1510 microversion: 2.91 time: 0.138129 Sep 18 01:11:31.359281 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1162/2415] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:31 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:11:31.371325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.372198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:31.379078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.379840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.380451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.381342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.381999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.382621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.405423 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 HTTP/1.1 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '96a8d0f7-7fa4-4b35-9627-d1f591dec2c3'} Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.410229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Instance 96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d61475a0-9d02-4f36-a22a-1c5aed74a51a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3" status: 404 len: 111 microversion: 2.1 time: 0.050851 Sep 18 01:11:31.416365 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1163/2416] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:31 2022] GET /compute/v2.1/servers/96a8d0f7-7fa4-4b35-9627-d1f591dec2c3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:31.427705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72c0ba09-84b1-4ec2-b8ab-c4af7aabe15f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7006136160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.513133 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-72c0ba09-84b1-4ec2-b8ab-c4af7aabe15f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:11:31.513780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-72c0ba09-84b1-4ec2-b8ab-c4af7aabe15f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a not found {{(pid=122373) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:11:31.514325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-72c0ba09-84b1-4ec2-b8ab-c4af7aabe15f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist Sep 18 01:11:31.514325 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-12adecb3-f4bb-4934-9c50-74a0cb82e1de'] Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72c0ba09-84b1-4ec2-b8ab-c4af7aabe15f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a HTTP/1.1 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: exception: Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-12adecb3-f4bb-4934-9c50-74a0cb82e1de'] Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '83ee90e7-d4f2-4a37-9b4c-5617873dc93a'} Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:11:31.516148 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12adecb3-f4bb-4934-9c50-74a0cb82e1de'] Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12adecb3-f4bb-4934-9c50-74a0cb82e1de'] Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12adecb3-f4bb-4934-9c50-74a0cb82e1de'] Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12adecb3-f4bb-4934-9c50-74a0cb82e1de'] Sep 18 01:11:31.520732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.524577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72c0ba09-84b1-4ec2-b8ab-c4af7aabe15f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group 83ee90e7-d4f2-4a37-9b4c-5617873dc93a does not exist Sep 18 01:11:31.524577 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-12adecb3-f4bb-4934-9c50-74a0cb82e1de'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:31.525432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72c0ba09-84b1-4ec2-b8ab-c4af7aabe15f tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a" status: 404 len: 194 microversion: 2.1 time: 0.101945 Sep 18 01:11:31.526028 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1164/2417] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:31 2022] DELETE /compute/v2.1/os-security-groups/83ee90e7-d4f2-4a37-9b4c-5617873dc93a => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:31.539690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7bd6eed1-12c7-49fb-a31f-bc2dc008e160 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70063b28b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.642992 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-7bd6eed1-12c7-49fb-a31f-bc2dc008e160 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:11:31.644268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-7bd6eed1-12c7-49fb-a31f-bc2dc008e160 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 not found {{(pid=122373) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:11:31.644850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-7bd6eed1-12c7-49fb-a31f-bc2dc008e160 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist Sep 18 01:11:31.644850 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-273c9104-8761-42dc-846e-772708874c50'] Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7bd6eed1-12c7-49fb-a31f-bc2dc008e160 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7 HTTP/1.1 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: exception: Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-273c9104-8761-42dc-846e-772708874c50'] Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4288ca71-3e99-4ce6-9413-cb8c869f5cb7'} Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:11:31.647647 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-273c9104-8761-42dc-846e-772708874c50'] Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-273c9104-8761-42dc-846e-772708874c50'] Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-273c9104-8761-42dc-846e-772708874c50'] Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-273c9104-8761-42dc-846e-772708874c50'] Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7bd6eed1-12c7-49fb-a31f-bc2dc008e160 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group 4288ca71-3e99-4ce6-9413-cb8c869f5cb7 does not exist Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-273c9104-8761-42dc-846e-772708874c50'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7bd6eed1-12c7-49fb-a31f-bc2dc008e160 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7" status: 404 len: 194 microversion: 2.1 time: 0.118715 Sep 18 01:11:31.656049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1165/2418] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:31 2022] DELETE /compute/v2.1/os-security-groups/4288ca71-3e99-4ce6-9413-cb8c869f5cb7 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:11:31.662676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:31.668067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f2864e1-8568-4993-b506-c9110470dcf6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7006189b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.678942 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8fc3394e-fc17-4d2f-bda0-ec98647202e3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 0.438508 Sep 18 01:11:31.679488 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1254/2419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:31 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:31.771129 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-9f2864e1-8568-4993-b506-c9110470dcf6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:11:31.772146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-9f2864e1-8568-4993-b506-c9110470dcf6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group d5482b97-39ea-4310-a024-d99e8eee29dc not found {{(pid=122373) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:11:31.775361 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9f2864e1-8568-4993-b506-c9110470dcf6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:11:31.775361 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-fcdd5de0-8eb5-45a2-8c33-2839e982d66d'] Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f2864e1-8568-4993-b506-c9110470dcf6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc HTTP/1.1 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: exception: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-fcdd5de0-8eb5-45a2-8c33-2839e982d66d'] Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd5482b97-39ea-4310-a024-d99e8eee29dc'} Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:11:31.782000 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcdd5de0-8eb5-45a2-8c33-2839e982d66d'] Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcdd5de0-8eb5-45a2-8c33-2839e982d66d'] Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcdd5de0-8eb5-45a2-8c33-2839e982d66d'] Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcdd5de0-8eb5-45a2-8c33-2839e982d66d'] Sep 18 01:11:31.786124 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.789244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f2864e1-8568-4993-b506-c9110470dcf6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group d5482b97-39ea-4310-a024-d99e8eee29dc does not exist Sep 18 01:11:31.789244 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-fcdd5de0-8eb5-45a2-8c33-2839e982d66d'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:31.791186 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f2864e1-8568-4993-b506-c9110470dcf6 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc" status: 404 len: 194 microversion: 2.1 time: 0.127181 Sep 18 01:11:31.794041 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1166/2420] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:31 2022] DELETE /compute/v2.1/os-security-groups/d5482b97-39ea-4310-a024-d99e8eee29dc => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:31.802213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-889d3461-632d-4fc1-949c-d9339526937a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7006444af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.844403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:31.848029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:31.858902 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-889d3461-632d-4fc1-949c-d9339526937a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:11:31.859721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-889d3461-632d-4fc1-949c-d9339526937a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group 0b13d626-befe-4b07-a025-82bbcda23111 not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:11:31.860440 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-889d3461-632d-4fc1-949c-d9339526937a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:11:31.860440 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-bb117713-feb0-4747-9ed7-f5069b150228'] Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-889d3461-632d-4fc1-949c-d9339526937a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111 HTTP/1.1 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: exception: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-bb117713-feb0-4747-9ed7-f5069b150228'] Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0b13d626-befe-4b07-a025-82bbcda23111'} Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:11:31.862600 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb117713-feb0-4747-9ed7-f5069b150228'] Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb117713-feb0-4747-9ed7-f5069b150228'] Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb117713-feb0-4747-9ed7-f5069b150228'] Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb117713-feb0-4747-9ed7-f5069b150228'] Sep 18 01:11:31.867181 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:31.871869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.871869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.872218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-889d3461-632d-4fc1-949c-d9339526937a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group 0b13d626-befe-4b07-a025-82bbcda23111 does not exist Sep 18 01:11:31.872218 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-bb117713-feb0-4747-9ed7-f5069b150228'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:31.872473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.873631 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-889d3461-632d-4fc1-949c-d9339526937a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111" status: 404 len: 194 microversion: 2.1 time: 0.076116 Sep 18 01:11:31.875176 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1255/2421] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:31 2022] DELETE /compute/v2.1/os-security-groups/0b13d626-befe-4b07-a025-82bbcda23111 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:31.878936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:31.879894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:31.881153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:31.890899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22e822d3-e282-4fff-84c7-55a32235a287 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7005e61dc0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.037148 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-22e822d3-e282-4fff-84c7-55a32235a287 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:11:32.038064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-22e822d3-e282-4fff-84c7-55a32235a287 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:11:32.039213 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-22e822d3-e282-4fff-84c7-55a32235a287 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:11:32.039213 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-b3a3e3ba-7218-43e0-ba5f-dfa87dd07365'] Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22e822d3-e282-4fff-84c7-55a32235a287 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a HTTP/1.1 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: exception: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-b3a3e3ba-7218-43e0-ba5f-dfa87dd07365'] Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '7b219fa0-bece-4790-9993-2cbe5bf7b19a'} Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:11:32.041580 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3a3e3ba-7218-43e0-ba5f-dfa87dd07365'] Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3a3e3ba-7218-43e0-ba5f-dfa87dd07365'] Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3a3e3ba-7218-43e0-ba5f-dfa87dd07365'] Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3a3e3ba-7218-43e0-ba5f-dfa87dd07365'] Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22e822d3-e282-4fff-84c7-55a32235a287 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group 7b219fa0-bece-4790-9993-2cbe5bf7b19a does not exist Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-b3a3e3ba-7218-43e0-ba5f-dfa87dd07365'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-22e822d3-e282-4fff-84c7-55a32235a287 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a" status: 404 len: 194 microversion: 2.1 time: 0.164368 Sep 18 01:11:32.050143 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1256/2422] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:31 2022] DELETE /compute/v2.1/os-security-groups/7b219fa0-bece-4790-9993-2cbe5bf7b19a => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:11:32.060015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d1cc8118-47c0-429c-b207-1a2966049e71 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f7006444c10>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.200878 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-d1cc8118-47c0-429c-b207-1a2966049e71 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:11:32.201484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-d1cc8118-47c0-429c-b207-1a2966049e71 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Neutron security group e2b6ff8b-70ee-4c01-b809-35b302da880e not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:11:32.202039 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d1cc8118-47c0-429c-b207-1a2966049e71 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:11:32.202039 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-7beeb872-d32b-489a-bbf8-243f377bbfbe'] Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d1cc8118-47c0-429c-b207-1a2966049e71 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e HTTP/1.1 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: exception: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-7beeb872-d32b-489a-bbf8-243f377bbfbe'] Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e2b6ff8b-70ee-4c01-b809-35b302da880e'} Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:11:32.203915 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7beeb872-d32b-489a-bbf8-243f377bbfbe'] Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7beeb872-d32b-489a-bbf8-243f377bbfbe'] Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7beeb872-d32b-489a-bbf8-243f377bbfbe'] Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7beeb872-d32b-489a-bbf8-243f377bbfbe'] Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d1cc8118-47c0-429c-b207-1a2966049e71 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Security group e2b6ff8b-70ee-4c01-b809-35b302da880e does not exist Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-7beeb872-d32b-489a-bbf8-243f377bbfbe'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d1cc8118-47c0-429c-b207-1a2966049e71 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e" status: 404 len: 194 microversion: 2.1 time: 0.152415 Sep 18 01:11:32.207446 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1257/2423] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:32 2022] DELETE /compute/v2.1/os-security-groups/e2b6ff8b-70ee-4c01-b809-35b302da880e => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:32.218368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.219138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:32.232590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.233148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.233644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.234333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.234795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.235226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.459727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:32.469769 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe71f568-2f81-4ac4-8bdd-a769bb524204 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1493 microversion: 2.1 time: 0.630971 Sep 18 01:11:32.477507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1167/2424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:31 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1493 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:32.482972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.483255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:32.497980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.498803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.499731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.500634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.501280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.501898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.577603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:32.595797 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a1c035ff-7594-4969-b38b-92b90a117de2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 0.388371 Sep 18 01:11:32.596657 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1258/2425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:32 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:32.604754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.606986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:32.619455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.620369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.620998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.621951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.622637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.623882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.648787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:32.661654 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb8e964d-e015-4c4a-9b68-131a0068cea5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1302 microversion: 2.1 time: 0.183147 Sep 18 01:11:32.662578 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1168/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:32 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1302 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:32.670035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.671709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:32.679928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.680785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.681518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.682541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.683245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.684037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.686711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:32.805536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:32.818517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:32.823713 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:32.833258 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4d8f490-a501-488a-82e6-c4537927049e tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 204 len: 0 microversion: 2.1 time: 0.235044 Sep 18 01:11:32.836783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1259/2427] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:32 2022] DELETE /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:32.838354 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-046b915f-3df4-43ba-b48c-c95fb8a2385a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1510 microversion: 2.91 time: 0.173806 Sep 18 01:11:32.840543 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1169/2428] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:32 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:32.848976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-534e27e7-6f70-42b3-ac42-9adf2916f636 req-74649f31-f7bd-47f8-b66b-e9065caa8717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116b7b56-be0e-4e40-a523-58a7e112b8b9", "name": "network-vif-unplugged", "status": "completed", "tag": "c68459d8-84d9-45c7-a559-5c49ef93e529"}, {"server_uuid": "0a824b75-7a83-4e85-b7b6-07173f93b720", "name": "network-vif-plugged", "status": "completed", "tag": "d529e4ce-e79a-4207-a342-816a2cdd824a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:32.858601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.860339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:32.878728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-534e27e7-6f70-42b3-ac42-9adf2916f636 req-74649f31-f7bd-47f8-b66b-e9065caa8717 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.880389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-534e27e7-6f70-42b3-ac42-9adf2916f636 req-74649f31-f7bd-47f8-b66b-e9065caa8717 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.880840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-534e27e7-6f70-42b3-ac42-9adf2916f636 req-74649f31-f7bd-47f8-b66b-e9065caa8717 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.890764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.891732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.892418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.893381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.894088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.894747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.906289 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-534e27e7-6f70-42b3-ac42-9adf2916f636 req-74649f31-f7bd-47f8-b66b-e9065caa8717 service nova] Creating event network-vif-unplugged:c68459d8-84d9-45c7-a559-5c49ef93e529 for instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 on n-h2-master-1 Sep 18 01:11:32.908987 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-534e27e7-6f70-42b3-ac42-9adf2916f636 req-74649f31-f7bd-47f8-b66b-e9065caa8717 service nova] Creating event network-vif-plugged:d529e4ce-e79a-4207-a342-816a2cdd824a for instance 0a824b75-7a83-4e85-b7b6-07173f93b720 on n-h1-master-1 Sep 18 01:11:32.924854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-534e27e7-6f70-42b3-ac42-9adf2916f636 req-74649f31-f7bd-47f8-b66b-e9065caa8717 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.084937 Sep 18 01:11:32.926162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1260/2429] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:32.934380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:32.935415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:32.943136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.943839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.944430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:32.945957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:32.946567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:32.947142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:33.893947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:33.912159 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-110463d8-5720-48ec-bd53-80cd3563cfaf tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1647 microversion: 2.1 time: 0.984073 Sep 18 01:11:33.917972 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1261/2430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:32 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1647 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:33.924198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:33.946666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:33.963824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:33.975272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:33.976384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:33.977300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:33.980969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:33.981538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:34.022507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:34.032154 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9657f7ac-3a75-428d-be99-1fe5afebe210 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 1.190269 Sep 18 01:11:34.035012 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1170/2431] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:32 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:34.040528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:34.042069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:34.063407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:34.064295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:34.064959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:34.065940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:34.066642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:34.067465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:34.362371 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:34.634499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:34.653626 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:34.674404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c07e759e-8b29-4694-9ce3-0c106f4a1449 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1493 microversion: 2.1 time: 0.753901 Sep 18 01:11:34.675284 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1262/2432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:33 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1493 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:34.686144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:34.687214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:34.718704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:34.719382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:34.720048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:34.721347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:34.722525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:34.723313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:34.784724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:34.805519 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dcd8f382-2557-45b9-b531-129f37aa667b tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 0.769076 Sep 18 01:11:34.810424 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1171/2433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:34 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:34.820287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:34.826863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:34.845993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:34.847687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:34.848918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:34.855102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:34.855983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:34.857479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:34.900404 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:35.135469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:35.150525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:35.162865 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d9196779-a343-4c60-a5b4-2a9878fb4bae tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1302 microversion: 2.1 time: 0.483763 Sep 18 01:11:35.163931 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1263/2434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:34 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1302 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:35.171626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:35.186469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:35.213480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:35.218533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:35.220719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:35.221870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:35.224389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:35.225125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:35.225941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:35.230234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:35.264299 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a78d7787-7f63-43c8-9629-e826c988f3d6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1510 microversion: 2.91 time: 0.452357 Sep 18 01:11:35.272632 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1172/2435] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:34 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:35.278212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:35.293163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:35.314070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:35.318012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:35.319994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:35.322336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:35.326744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:35.330668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:36.021668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:36.036006 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-203261da-4b76-468f-955f-c538453312fd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1314 microversion: 2.1 time: 0.761785 Sep 18 01:11:36.055551 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1173/2436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:35 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:36.061463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:36.061463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:36.078734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:36.079664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:36.080268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:36.081173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:36.081816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:36.082395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:36.938473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:36.969309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-995ac789-30b5-4b18-8777-f9932c509b40 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1647 microversion: 2.1 time: 1.801806 Sep 18 01:11:36.974059 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1264/2437] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:35 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1647 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:36.982559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:36.998229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:37.012954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:37.020608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:37.024413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:37.025510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:37.034549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:37.037294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:37.109960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:37.132811 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2cff790-cafd-46fc-b6cd-e0d2e3bf6042 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1493 microversion: 2.1 time: 1.075465 Sep 18 01:11:37.133666 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1174/2438] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:36 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1493 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:37.138764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:37.157764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:37.167682 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:37.183548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:37.184053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:37.184564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:37.185269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:37.209715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:37.210316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:38.580581 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:38.630660 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=26 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:38.756881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:38.773806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8673371a-026d-49ca-9215-41881803c6bc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 1.638331 Sep 18 01:11:38.777963 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1175/2439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:37 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:38.794775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:38.813518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:38.835997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:38.838098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:38.839086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:38.841231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:38.841899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:38.845143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:38.893474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:38.925576 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-074bc021-1d5e-44b7-ab6d-f33fc5fb545a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 1.949838 Sep 18 01:11:38.939725 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1265/2440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:36 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:38.969374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:38.973960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:38.980312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:38.981199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:38.982215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:38.983134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:38.984038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:38.984955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.197725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:39.226865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:39.228428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:39.254291 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56c6ca5b-c23d-4a69-bd70-966a199bddb2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1531 microversion: 2.91 time: 0.473444 Sep 18 01:11:39.254919 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1176/2441] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:38 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1531 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:39.279170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:39.291961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:39.306979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:39.308531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:39.309265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.312453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:39.315065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:39.315585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.411459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:39.411954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:39.412455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.412931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lazy-loading 'fault' on Instance uuid 8260bffc-93e7-4f80-97dd-ab880f38e22b {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:11:39.732994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8ef10d46d4f5390efdcd18d2e3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1e583f85c94264879e59720389d839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:39.746322 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c733ac0-992f-4223-b0cd-c573cb37672a tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 200 len: 1306 microversion: 2.1 time: 0.471361 Sep 18 01:11:39.747246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1177/2442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:39 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 1306 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:39.752104 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:39.752799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:39.780335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:39.781167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:39.781825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.783283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:39.786772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:39.796228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.796487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:39.802154 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:39.835681 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a31e7c3-c8c4-4125-b124-7b6932ac98a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1501 microversion: 2.1 time: 0.893971 Sep 18 01:11:39.842188 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1266/2443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:38 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1501 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:39.862051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-836eca71-4d99-4296-a345-62039e020e48 req-5e1159b0-42c2-43f6-aa16-b0efee2e01f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8260bffc-93e7-4f80-97dd-ab880f38e22b", "name": "network-vif-deleted", "tag": "f027a876-45e4-4a6f-ac37-d90685693687"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:39.890028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:39.895904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-836eca71-4d99-4296-a345-62039e020e48 req-5e1159b0-42c2-43f6-aa16-b0efee2e01f0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:39.896474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-836eca71-4d99-4296-a345-62039e020e48 req-5e1159b0-42c2-43f6-aa16-b0efee2e01f0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:39.897325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-836eca71-4d99-4296-a345-62039e020e48 req-5e1159b0-42c2-43f6-aa16-b0efee2e01f0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.901230 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5da8023-a896-4c7a-bba0-055cf2de6d16 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1293 microversion: 2.1 time: 0.151961 Sep 18 01:11:39.903118 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1178/2444] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:39 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1293 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:39.908530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ce588962-3ea8-44a0-984a-cb45b20da7fb req-d40c8fb0-1054-450e-a7c6-df47d2552cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add4799b-2874-4d67-a3bc-59dafef3f6e0", "name": "network-vif-plugged", "status": "completed", "tag": "533d18a4-c60c-4fa9-a361-75d1dbd75346"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:39.919494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ce588962-3ea8-44a0-984a-cb45b20da7fb req-d40c8fb0-1054-450e-a7c6-df47d2552cf1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:39.920341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ce588962-3ea8-44a0-984a-cb45b20da7fb req-d40c8fb0-1054-450e-a7c6-df47d2552cf1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:39.920819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ce588962-3ea8-44a0-984a-cb45b20da7fb req-d40c8fb0-1054-450e-a7c6-df47d2552cf1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:39.946123 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ce588962-3ea8-44a0-984a-cb45b20da7fb req-d40c8fb0-1054-450e-a7c6-df47d2552cf1 service nova] Creating event network-vif-plugged:533d18a4-c60c-4fa9-a361-75d1dbd75346 for instance add4799b-2874-4d67-a3bc-59dafef3f6e0 on n-h2-master-1 Sep 18 01:11:39.959393 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-836eca71-4d99-4296-a345-62039e020e48 req-5e1159b0-42c2-43f6-aa16-b0efee2e01f0 service nova] Creating event network-vif-deleted:f027a876-45e4-4a6f-ac37-d90685693687 for instance 8260bffc-93e7-4f80-97dd-ab880f38e22b on n-h2-master-1 Sep 18 01:11:39.964839 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ce588962-3ea8-44a0-984a-cb45b20da7fb req-d40c8fb0-1054-450e-a7c6-df47d2552cf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060081 Sep 18 01:11:39.966416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1179/2445] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:39.978509 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-836eca71-4d99-4296-a345-62039e020e48 req-5e1159b0-42c2-43f6-aa16-b0efee2e01f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134467 Sep 18 01:11:39.979504 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1267/2446] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:39.986735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-174372c7-4a23-4e17-b651-0a4d6ed21f3a req-86553ecf-219f-4c27-9a7d-1c958bdefaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116b7b56-be0e-4e40-a523-58a7e112b8b9", "name": "network-vif-deleted", "tag": "c68459d8-84d9-45c7-a559-5c49ef93e529"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:39.999284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-174372c7-4a23-4e17-b651-0a4d6ed21f3a req-86553ecf-219f-4c27-9a7d-1c958bdefaf6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.000132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-174372c7-4a23-4e17-b651-0a4d6ed21f3a req-86553ecf-219f-4c27-9a7d-1c958bdefaf6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.000775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-174372c7-4a23-4e17-b651-0a4d6ed21f3a req-86553ecf-219f-4c27-9a7d-1c958bdefaf6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.043769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-174372c7-4a23-4e17-b651-0a4d6ed21f3a req-86553ecf-219f-4c27-9a7d-1c958bdefaf6 service nova] Creating event network-vif-deleted:c68459d8-84d9-45c7-a559-5c49ef93e529 for instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 on n-h2-master-1 Sep 18 01:11:40.056679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-174372c7-4a23-4e17-b651-0a4d6ed21f3a req-86553ecf-219f-4c27-9a7d-1c958bdefaf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075313 Sep 18 01:11:40.071121 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1268/2447] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:40.078943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:40.079948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:40.087553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.088292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.088895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.089912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.090518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.091103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.545629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:40.546517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:40.573056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:40.583479 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b08c5f7-0782-4e84-8343-03a5682fc4c7 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.510489 Sep 18 01:11:40.584725 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1269/2448] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:40 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:40.590230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:40.600414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.601621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.605394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:40.606843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.607736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.609239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.612446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.639519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.645019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.654678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.655851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.658140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.659455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.737544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lazy-loading 'flavor' on Instance uuid 0a824b75-7a83-4e85-b7b6-07173f93b720 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:11:40.783555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lazy-loading 'services' on Instance uuid 630051a8-a626-45b4-bc41-aeb93e5e6617 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:11:40.838506 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65b1f30b-c922-48c2-a3e8-9259bfd2ed5c tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1936 microversion: 2.91 time: 0.867815 Sep 18 01:11:40.842116 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1180/2449] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:39 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1936 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:40.858973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:40.859848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:40.899429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.900184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.900814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.902161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.902589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.903055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.942144 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3bc5a3ea-7c5f-4664-b883-7e1886530a2c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "POST /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720/action" status: 202 len: 0 microversion: 2.1 time: 0.354309 Sep 18 01:11:40.942836 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1270/2450] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:11:40 2022] POST /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:11:40.967621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:40.970181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] [instance: 8260bffc-93e7-4f80-97dd-ab880f38e22b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:40.990323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.995250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.995994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:40.997704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:40.998793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:40.999399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.039651 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] HTTP exception thrown: Instance 8260bffc-93e7-4f80-97dd-ab880f38e22b could not be found. Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Request method failure captured: Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b HTTP/1.1 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm-wl63yXQSkRTqSlgtaF6_g7jVNX7u9tepAH-KbxnhAjEI7BhJLSk3ZHWwxXlb7jdzc24_NPz_3dj-TPuHOa96azvb7rIj3etqWcVMHJh2jTLxAxePy2D_wP5Pf1PAjq5dQApn2oqED7ohGv96HYMzs0s0DPGoacGHirnsXf6jeeqg Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1e583f85c94264879e59720389d839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1e583f85c94264879e59720389d839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1e583f85c94264879e59720389d839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1e583f85c94264879e59720389d839 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1676945629 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4dd8ef10d46d4f5390efdcd18d2e3059 Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsTestJSON-1676945629-project Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8260bffc-93e7-4f80-97dd-ab880f38e22b could not be found. Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8260bffc-93e7-4f80-97dd-ab880f38e22b'} Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8260bffc-93e7-4f80-97dd-ab880f38e22b could not be found. Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8260bffc-93e7-4f80-97dd-ab880f38e22b could not be found. Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:41.049960 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:41.054469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:41.054469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:41.054469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:41.054469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:41.054469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:41.054469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8260bffc-93e7-4f80-97dd-ab880f38e22b could not be found. Sep 18 01:11:41.054469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:41.056996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Returning 404 to user: Instance 8260bffc-93e7-4f80-97dd-ab880f38e22b could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:41.059844 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8e9b7cea-52ed-4888-8404-955e29d6c725 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b" status: 404 len: 111 microversion: 2.1 time: 0.115525 Sep 18 01:11:41.062903 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1271/2451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:40 2022] GET /compute/v2.1/servers/8260bffc-93e7-4f80-97dd-ab880f38e22b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:41.072319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:41.079969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:41.103180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.103686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.104124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.105148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.105636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.106067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.185794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:41.213045 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e61d1eb-482e-4155-8106-c7ad4fcb64c7 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1323 microversion: 2.1 time: 0.367121 Sep 18 01:11:41.216438 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1181/2452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:40 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:41.240529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:41.241905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:41.264999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.267067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.268175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.268981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.271574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.273729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.329413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lazy-loading 'services' on Instance uuid 630051a8-a626-45b4-bc41-aeb93e5e6617 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:11:41.351908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.352415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.352864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.353332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lazy-loading 'fault' on Instance uuid 116b7b56-be0e-4e40-a523-58a7e112b8b9 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:11:41.384479 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-51c9ef70-98dd-48da-9081-d4c3e59be387 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1936 microversion: 2.91 time: 0.318752 Sep 18 01:11:41.385761 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1272/2453] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:41 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1936 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:41.400176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:41.404199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:41.429215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.429885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.430354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.431116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.443379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.446684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b979a402b74d679ec79f0b39255155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da55a64967a14840a19106cc9a8a2c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:41.448773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.477372 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5416ce0-897d-459b-98a1-f58fdd761868 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 200 len: 1298 microversion: 2.1 time: 0.257865 Sep 18 01:11:41.484266 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1182/2454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:41 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 1298 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:41.502433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-190648ee-bc3c-4a2f-bc9e-15791390db26 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70063b2dc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:41.904902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:41.917100 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6467adb-6a92-4e3c-bf8b-df3cb14f5e7a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1509 microversion: 2.1 time: 0.526465 Sep 18 01:11:41.924885 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1273/2455] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:41 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:41.947998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:41.972203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.974569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.976352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:41.977382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:41.985818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:41.988809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:42.081044 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-178389ef-394b-4f28-a02c-7becd301b69b tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.150434 Sep 18 01:11:42.094002 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1274/2456] 10.222.0.25 () {60 vars in 1217 bytes} [Sun Sep 18 01:11:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:11:42.109573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:42.110580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:42.129398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:42.130631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:42.132960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:42.133782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:42.134256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:42.141764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:42.688583 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-190648ee-bc3c-4a2f-bc9e-15791390db26 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ce0da2ca-af4d-4b0c-974b-de600342f0d4" status: 202 len: 0 microversion: 2.1 time: 1.203610 Sep 18 01:11:42.689284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1183/2457] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:41 2022] DELETE /compute/v2.1/os-security-groups/ce0da2ca-af4d-4b0c-974b-de600342f0d4 => generated 0 bytes in 1206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:11:42.702620 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:42.703183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:42.726419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:42.730195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:42.730959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:42.731958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:42.732439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:42.732866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:42.777371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:42.791678 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca867e12-83fa-4406-9639-5dcd65787455 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.696115 Sep 18 01:11:42.794610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lazy-loading 'flavor' on Instance uuid 630051a8-a626-45b4-bc41-aeb93e5e6617 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:11:42.806695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1275/2458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:42 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:42.813892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d7681ff0-41c6-472c-9d40-47279529f078 req-3b36c521-97f2-4f21-9a52-4a447a2244bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e703c1-a546-4491-806c-5dc57a328851", "name": "network-vif-plugged", "status": "completed", "tag": "c13cc8a8-6d00-4504-9283-431a2325e41f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:42.828445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d7681ff0-41c6-472c-9d40-47279529f078 req-3b36c521-97f2-4f21-9a52-4a447a2244bf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:42.828445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d7681ff0-41c6-472c-9d40-47279529f078 req-3b36c521-97f2-4f21-9a52-4a447a2244bf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:42.828722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d7681ff0-41c6-472c-9d40-47279529f078 req-3b36c521-97f2-4f21-9a52-4a447a2244bf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:42.849038 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d7681ff0-41c6-472c-9d40-47279529f078 req-3b36c521-97f2-4f21-9a52-4a447a2244bf service nova] Creating event network-vif-plugged:c13cc8a8-6d00-4504-9283-431a2325e41f for instance d0e703c1-a546-4491-806c-5dc57a328851 on n-h1-master-1 Sep 18 01:11:42.857162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d7681ff0-41c6-472c-9d40-47279529f078 req-3b36c521-97f2-4f21-9a52-4a447a2244bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048912 Sep 18 01:11:42.859004 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1276/2459] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:42.865016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:42.865896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:42.894531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:42.895968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:42.896651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:42.899383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:42.900029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:42.900788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.138343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:43.148589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b96ab7e-4575-4486-a8a8-61b1b2cbb397 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1515 microversion: 2.1 time: 0.287470 Sep 18 01:11:43.165689 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1277/2460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:42 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:43.165689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-272f2a60-b61b-4e63-ac7a-262331723403 req-917d98d2-9efc-46cf-b030-28eb77eb7053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe0782b-0f74-4f86-abe4-58361c819a84", "tag": "4105b6b7-8f39-4412-b99c-e12a3b538e9e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:43.188980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-272f2a60-b61b-4e63-ac7a-262331723403 req-917d98d2-9efc-46cf-b030-28eb77eb7053 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.189641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-272f2a60-b61b-4e63-ac7a-262331723403 req-917d98d2-9efc-46cf-b030-28eb77eb7053 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.190082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-272f2a60-b61b-4e63-ac7a-262331723403 req-917d98d2-9efc-46cf-b030-28eb77eb7053 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.224038 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-272f2a60-b61b-4e63-ac7a-262331723403 req-917d98d2-9efc-46cf-b030-28eb77eb7053 service nova] Creating event network-changed:4105b6b7-8f39-4412-b99c-e12a3b538e9e for instance 3fe0782b-0f74-4f86-abe4-58361c819a84 on n-h1-master-1 Sep 18 01:11:43.228692 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ef17e11-1795-4982-943c-4a6ec24ce807 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action" status: 202 len: 0 microversion: 2.91 time: 0.536394 Sep 18 01:11:43.234515 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1184/2461] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:11:42 2022] POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:43.237956 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-272f2a60-b61b-4e63-ac7a-262331723403 req-917d98d2-9efc-46cf-b030-28eb77eb7053 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081922 Sep 18 01:11:43.238732 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1278/2462] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:43.245262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:43.246487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 116b7b56-be0e-4e40-a523-58a7e112b8b9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:43.254478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.255432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-112559ce-50cf-4370-b790-3e13f07fcbd1 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] Calling method '.version_select at 0x7f70061c4430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:43.256199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.258351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.260595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.261440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.263191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.295337 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 could not be found. Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 HTTP/1.1 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 could not be found. Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '116b7b56-be0e-4e40-a523-58a7e112b8b9'} Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 could not be found. Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 could not be found. Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:43.297394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:43.311367 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:43.311367 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:43.311367 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:43.311367 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:43.311367 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 could not be found. Sep 18 01:11:43.311367 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:43.313778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Instance 116b7b56-be0e-4e40-a523-58a7e112b8b9 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:43.315425 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c2945ce-43c7-4c53-8b75-64f94574937f tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9" status: 404 len: 111 microversion: 2.1 time: 0.077364 Sep 18 01:11:43.317344 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1185/2463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:43 2022] GET /compute/v2.1/servers/116b7b56-be0e-4e40-a523-58a7e112b8b9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:43.326657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:43.327659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:43.341596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.342730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.344244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.345255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.346528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.347192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.763095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:43.794122 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8bbd352-ca28-4af4-a8fb-6b73fc81d03b tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1492 microversion: 2.1 time: 0.474536 Sep 18 01:11:43.800162 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1186/2464] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:43 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1492 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:43.821515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:43.822881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:43.847181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.849038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.852271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.856395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.860311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.861046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.913974 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-112559ce-50cf-4370-b790-3e13f07fcbd1 tempest-SecurityGroupsTestJSON-1676945629 tempest-SecurityGroupsTestJSON-1676945629-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ed377af1-c520-4969-a1bc-71f9dad6d404" status: 202 len: 0 microversion: 2.1 time: 0.672553 Sep 18 01:11:43.919791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1279/2465] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:11:43 2022] DELETE /compute/v2.1/os-security-groups/ed377af1-c520-4969-a1bc-71f9dad6d404 => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:11:43.937244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:43.944988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:43.966930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.967559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.968000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:43.968717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:43.969210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:43.969610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.348524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:44.374947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:44.379824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:44.393048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce1d85b1-9ac4-41e2-9b93-bb9da686002d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.476243 Sep 18 01:11:44.395643 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1280/2466] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:43 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:44.447787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07417480-92d7-456e-a57e-b1a59322b6cb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70067c74c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:44.497151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:44.519485 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ea2ed9b-f0ff-4b2f-8b74-bc6865b7a22a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 200 len: 1323 microversion: 2.1 time: 0.717582 Sep 18 01:11:44.524746 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-07417480-92d7-456e-a57e-b1a59322b6cb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Image not found. Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07417480-92d7-456e-a57e-b1a59322b6cb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da HTTP/1.1 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: exception: Image not found. Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '05f94c4f-4d9d-4b71-84eb-028adf8b20da'} Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 05f94c4f-4d9d-4b71-84eb-028adf8b20da to delete Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 05f94c4f-4d9d-4b71-84eb-028adf8b20da could not be found. Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.528613 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:11:44.532542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.535552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07417480-92d7-456e-a57e-b1a59322b6cb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Image not found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:44.535552 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07417480-92d7-456e-a57e-b1a59322b6cb tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da" status: 404 len: 62 microversion: 2.1 time: 0.120276 Sep 18 01:11:44.535978 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1281/2467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:44 2022] DELETE /compute/v2.1/images/05f94c4f-4d9d-4b71-84eb-028adf8b20da => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:11:44.552176 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1187/2468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:43 2022] GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 1323 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:44.559093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:44.560202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:44.560385 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:44.562655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:44.584250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.586221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.587158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.588572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.589522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.590582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.605328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.607622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.608350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.618572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.619724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.623914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.639124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:44.810220 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52e6a5d0-62b2-4b04-bab1-971e39884f2a tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 204 len: 0 microversion: 2.1 time: 0.256247 Sep 18 01:11:44.816145 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1188/2469] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:44 2022] DELETE /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:44.839138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:44.849206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:44.872667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.873241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.874008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.883083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.883821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.885466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.922766 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a HTTP/1.1 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: exception: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'db8d0ab8-22db-4c08-b2db-be4f1b9b983a'} Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:44.925363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:44.929752 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:44.933985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:44.935111 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8298cbe6-5805-47c2-b142-8e1f8455c285 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 404 len: 111 microversion: 2.1 time: 0.117432 Sep 18 01:11:44.936915 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1189/2470] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:44 2022] DELETE /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:44.953750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:44.954674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:44.966586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.967514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.968011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:44.968907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:44.969582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:44.971852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:45.502212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:45.532192 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26d0395a-b67a-4dba-a926-6011282382fa tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.994081 Sep 18 01:11:45.533971 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1282/2471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:44 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:45.582493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:45.583457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: db8d0ab8-22db-4c08-b2db-be4f1b9b983a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:45.598804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:45.599641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:45.601206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:45.602207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:45.602859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:45.603475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:45.640569 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a HTTP/1.1 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: exception: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'db8d0ab8-22db-4c08-b2db-be4f1b9b983a'} Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.646642 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Instance db8d0ab8-22db-4c08-b2db-be4f1b9b983a could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1e51336d-0689-49e7-89ae-8b941d85aaf8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a" status: 404 len: 111 microversion: 2.1 time: 0.111236 Sep 18 01:11:45.655335 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1283/2472] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:45 2022] GET /compute/v2.1/servers/db8d0ab8-22db-4c08-b2db-be4f1b9b983a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:45.666678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:45.667357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:45.679816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:45.679956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:45.680179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:45.680805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:45.682084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:45.682706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:45.683319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:45.688398 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:45.691254 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9983b596-5db1-4a23-98cb-0b8417da05c8 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1498 microversion: 2.1 time: 0.751287 Sep 18 01:11:45.694690 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1190/2473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:44 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1498 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:45.702819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:45.703430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:45.720552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:45.722147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:45.727621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:45.728817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:45.729444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:45.730291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:45.877068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:45.896405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:45.898493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:45.911940 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b5b6c490-67c0-482a-be8d-fe4468787fa1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.261353 Sep 18 01:11:45.915349 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1284/2474] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:45 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:45.928319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26244ca7-dd0d-4133-a452-b489ef1c0d03 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70061c45e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:45.978719 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-26244ca7-dd0d-4133-a452-b489ef1c0d03 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Image not found. Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26244ca7-dd0d-4133-a452-b489ef1c0d03 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 HTTP/1.1 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: exception: Image not found. Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e580ac18-b8a7-4c46-8778-35ce79f165e4'} Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e580ac18-b8a7-4c46-8778-35ce79f165e4 to delete Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e580ac18-b8a7-4c46-8778-35ce79f165e4 could not be found. Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.984077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:11:45.988164 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:45.992147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26244ca7-dd0d-4133-a452-b489ef1c0d03 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Image not found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:45.993872 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26244ca7-dd0d-4133-a452-b489ef1c0d03 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4" status: 404 len: 62 microversion: 2.1 time: 0.077333 Sep 18 01:11:45.994795 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1285/2475] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:45 2022] DELETE /compute/v2.1/images/e580ac18-b8a7-4c46-8778-35ce79f165e4 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:11:46.008680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:46.009691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:46.018509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.019385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.020163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.023249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.023938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.024579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.047533 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d HTTP/1.1 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '30e17de0-e432-4be3-968d-1bd921fe322d'} Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:46.049995 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.053966 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.057019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:46.058271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6983a0b7-7b60-4977-8bea-128659fab524 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 404 len: 111 microversion: 2.1 time: 0.057826 Sep 18 01:11:46.059386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1286/2476] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:45 2022] DELETE /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:46.068064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:46.068692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 30e17de0-e432-4be3-968d-1bd921fe322d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:46.075754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.076258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.076886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.077813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.078439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.079032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.105674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d HTTP/1.1 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '30e17de0-e432-4be3-968d-1bd921fe322d'} Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.108096 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.112092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.112092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.112092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:46.112092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:46.112092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. Sep 18 01:11:46.112092 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.113955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Instance 30e17de0-e432-4be3-968d-1bd921fe322d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:46.115088 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d840aa66-0931-4220-a072-df6a8b304768 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d" status: 404 len: 111 microversion: 2.1 time: 0.050903 Sep 18 01:11:46.119443 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1287/2477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:46 2022] GET /compute/v2.1/servers/30e17de0-e432-4be3-968d-1bd921fe322d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:46.124941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e404a187-f2b2-442b-ae2e-0fdf0626a3a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '.version_select at 0x7f70061c4b80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:46.163417 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e404a187-f2b2-442b-ae2e-0fdf0626a3a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Image not found. Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e404a187-f2b2-442b-ae2e-0fdf0626a3a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc HTTP/1.1 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: exception: Image not found. Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc'} Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc to delete Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc could not be found. Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.164944 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e404a187-f2b2-442b-ae2e-0fdf0626a3a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Image not found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:46.168707 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e404a187-f2b2-442b-ae2e-0fdf0626a3a1 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc" status: 404 len: 62 microversion: 2.1 time: 0.046085 Sep 18 01:11:46.171509 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1288/2478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:46 2022] DELETE /compute/v2.1/images/76bf2dc4-9831-441a-b4ab-eec3b3c8b4fc => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:11:46.180807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:46.185029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:46.205424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.205965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.207001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.208064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.208771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.209546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.226636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:46.233312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 HTTP/1.1 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4a800f78-79ec-46a5-9d3e-25001ec3ef48'} Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:46.235657 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.239763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.242968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:46.244734 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-948eecc9-5da5-4fd7-9be5-1ac42aa44289 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 404 len: 111 microversion: 2.1 time: 0.072203 Sep 18 01:11:46.249383 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1289/2479] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:46 2022] DELETE /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:46.256305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:46.256948 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ab229bc-72a1-431b-b7ef-72d391fd2918 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 200 len: 1323 microversion: 2.1 time: 0.560665 Sep 18 01:11:46.257460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] [instance: 4a800f78-79ec-46a5-9d3e-25001ec3ef48] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:46.258027 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1191/2480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:45 2022] GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 1323 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:46.264246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.265053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.265731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.266780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.267448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.268076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.284261 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] HTTP exception thrown: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Request method failure captured: Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 HTTP/1.1 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm8u_9_4c_NbwyJTHW8tYmM6KUV1sB7a_uF7Qd6JFP4vcuGllBRCZlemRZqRiKLqB0qYR-Eve1UgndU3L_HuqzO596yCE_9C4sjPEGKWaaI96PgauS3dCDBbuEk9Z6oqI8zfb42sZzuhoazTNf09G_pRbwQAFQDxXPcV45HNq5WAnOc Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da55a64967a14840a19106cc9a8a2c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: da55a64967a14840a19106cc9a8a2c05 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesTestJSON-1125833444 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a7b979a402b74d679ec79f0b39255155 Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesTestJSON-1125833444-project Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4a800f78-79ec-46a5-9d3e-25001ec3ef48'} Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.286247 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:46.290460 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:46.290460 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:46.290460 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:46.290460 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:46.290460 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. Sep 18 01:11:46.290460 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:46.293013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] Returning 404 to user: Instance 4a800f78-79ec-46a5-9d3e-25001ec3ef48 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:46.294175 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e50e4ac-0a82-410b-9a08-8fc6e59249b8 tempest-ImagesTestJSON-1125833444 tempest-ImagesTestJSON-1125833444-project] 10.222.0.25 "GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48" status: 404 len: 111 microversion: 2.1 time: 0.043451 Sep 18 01:11:46.298412 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1290/2481] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:46 2022] GET /compute/v2.1/servers/4a800f78-79ec-46a5-9d3e-25001ec3ef48 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:46.573846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:46.574969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:46.587704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.588525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.589858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.590610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.591434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.592223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.719273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:46.721340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:46.737228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.738283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.738955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:46.739889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:46.740573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:46.741250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:47.073789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:47.084272 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-030f5054-6449-4f33-8a0d-eb198ab47e10 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.518160 Sep 18 01:11:47.085877 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1192/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:46 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:47.092211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:47.094004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:47.102400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:47.103241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:47.106527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:47.115276 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26f71ffc-2f6e-4c24-b5d8-8b68951c770e tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1498 microversion: 2.1 time: 0.403767 Sep 18 01:11:47.115720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:47.116813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:47.117405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:47.118647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:47.119977 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1291/2483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:46 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1498 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:47.144100 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:47.237379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:47.254573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:47.267036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:47.273948 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4722fab5-c856-4060-b83b-816c0fe49fd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.186479 Sep 18 01:11:47.274558 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1193/2484] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:47 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:47.286958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:47.288946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:47.297409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:47.299091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:47.299797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:47.301419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:47.302120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:47.303572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:47.784318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:47.824051 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2948d4c-1422-4d8e-9c09-2fe4c27985a4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 200 len: 1323 microversion: 2.1 time: 0.546664 Sep 18 01:11:47.831478 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1292/2485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:47 2022] GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:48.109881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:48.110643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:48.123038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.123716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.126874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.127819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.128415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.129082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.140470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:48.141516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:48.144771 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:48.156186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.157084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.161585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.163902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.166189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.166943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.798967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:48.806937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82d20d9a-4398-4b02-9998-700d36417173 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.701498 Sep 18 01:11:48.807531 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1194/2486] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:48 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:48.826825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:48.827680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:48.827984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:48.835829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.836599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.837243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.838145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.838783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.839374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.841818 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59a6b7de-4d4b-4fa3-ba48-ad0ec02bd812 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1498 microversion: 2.1 time: 0.705131 Sep 18 01:11:48.842739 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1293/2487] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:48 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1498 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:11:48.855058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:48.855939 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:48.869287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.869820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.870268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.870989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:48.871450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:48.871878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:48.967806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:48.986641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:48.997410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:49.009093 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-df9b4dfc-cdb6-400a-8250-3a1a6333f114 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.193668 Sep 18 01:11:49.010759 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1195/2488] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:48 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:49.261736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:49.276326 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-643ef2ee-1907-4eb0-9318-bd952474c8f0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 200 len: 1515 microversion: 2.1 time: 0.425053 Sep 18 01:11:49.277663 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1294/2489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:48 2022] GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:49.305227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:49.305899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:49.322883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:49.323641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:49.324451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:49.325460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:49.326710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:49.332724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:49.751537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:49.767542 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-83c9d13f-5c79-4911-b564-3aac975aef62 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed" status: 200 len: 1516 microversion: 2.1 time: 0.461763 Sep 18 01:11:49.768740 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1196/2490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:49 2022] GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed => generated 1516 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:49.793460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:49.794251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:49.807892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:49.808739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:49.809248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:49.810025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:49.810487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:49.814241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:49.831411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:49.832733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:49.846442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:49.850837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:49.851680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:49.853846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:49.854906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:49.856531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:49.908231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:50.161487 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3aaecc0f-de12-45fb-89c6-4baadb022c26 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed" status: 204 len: 0 microversion: 2.1 time: 0.371850 Sep 18 01:11:50.163392 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1295/2491] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:49 2022] DELETE /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:50.178264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:50.180460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:50.199074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:50.199883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:50.200680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:50.208099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:50.209130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:50.209790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:50.787772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:50.799247 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ab816eac-3a0d-4a24-9fc1-5de2296bfa62 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.971752 Sep 18 01:11:50.800386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1197/2492] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:49 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:50.806300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:50.813014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:50.833361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:50.834061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:50.835386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:50.836126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:50.836590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:50.839983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:50.916068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:50.924343 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-79c13779-b22c-4af9-9a78-221aca41dccd tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1498 microversion: 2.1 time: 0.757644 Sep 18 01:11:50.928462 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1296/2493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:50 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1498 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:50.944708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:50.945641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:50.972672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:50.973782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:50.974640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:50.976554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:50.977389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:50.979423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:51.099404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:51.122018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:51.131024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:51.166598 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2a42ceae-7b3e-4cba-8d2c-a75f756537aa tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.359327 Sep 18 01:11:51.172001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1198/2494] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:50 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:51.177487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9f6dab42-b706-409d-a709-4f4c6404a75a req-2b74024b-c505-46b1-a7ec-a5936dfd8aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a824b75-7a83-4e85-b7b6-07173f93b720", "name": "network-vif-deleted", "tag": "d529e4ce-e79a-4207-a342-816a2cdd824a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:51.195331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f6dab42-b706-409d-a709-4f4c6404a75a req-2b74024b-c505-46b1-a7ec-a5936dfd8aa4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:51.196673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f6dab42-b706-409d-a709-4f4c6404a75a req-2b74024b-c505-46b1-a7ec-a5936dfd8aa4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:51.197388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f6dab42-b706-409d-a709-4f4c6404a75a req-2b74024b-c505-46b1-a7ec-a5936dfd8aa4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:51.220057 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9f6dab42-b706-409d-a709-4f4c6404a75a req-2b74024b-c505-46b1-a7ec-a5936dfd8aa4 service nova] Creating event network-vif-deleted:d529e4ce-e79a-4207-a342-816a2cdd824a for instance 0a824b75-7a83-4e85-b7b6-07173f93b720 on n-h1-master-1 Sep 18 01:11:51.236370 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9f6dab42-b706-409d-a709-4f4c6404a75a req-2b74024b-c505-46b1-a7ec-a5936dfd8aa4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062082 Sep 18 01:11:51.237938 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1199/2495] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:51.873430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:51.904846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:51.910589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:51.919014 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2ed6887-3c0b-4f46-9ed5-e55f23e02362 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed" status: 200 len: 1522 microversion: 2.1 time: 0.990103 Sep 18 01:11:51.926100 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1297/2496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:50 2022] GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed => generated 1522 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:51.930380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:51.930880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:51.931320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:51.937645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:51.938320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:51.938779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:51.960732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:51.962994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:51.981023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:51.981869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:51.984828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:51.987159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:51.987866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:51.989303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:52.019987 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:52.043998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:52.046169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:52.046745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:52.048277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lazy-loading 'fault' on Instance uuid 0a824b75-7a83-4e85-b7b6-07173f93b720 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:11:52.769528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253b3027efb74403a9bfaa4d2cbfd31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee0890115d040d0b712a534b9c5a824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:52.785942 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1400df09-298f-42ad-b08d-c32f51a60aa0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 200 len: 1304 microversion: 2.1 time: 0.835840 Sep 18 01:11:52.787078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1298/2497] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:51 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 1304 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:52.794063 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:52.795223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:52.804213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:52.805219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:52.805903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:52.807007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:52.807861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:52.808638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:52.994776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:53.009211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:53.011118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:53.028965 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e53f88c-4cad-4a8b-b901-6a250c45fa47 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.237586 Sep 18 01:11:53.032161 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1299/2498] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:52 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:53.049092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:53.050131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:53.061444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:53.061983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:53.064507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:53.066136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:53.068826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:53.072183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:53.227114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:53.251086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-271d0d3a-8b1b-4eeb-a70d-8e5cd7bc6c7e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 1.409575 Sep 18 01:11:53.258096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:53.271913 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1200/2499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:51 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:53.274904 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2c1270c-0bdd-4535-9993-ad367d1f95d3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed" status: 200 len: 1480 microversion: 2.1 time: 0.238528 Sep 18 01:11:53.291244 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1300/2500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:53 2022] GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed => generated 1480 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:53.427523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-04e14a0b-7969-46df-8079-9eb742444f30 req-7fd4b843-5076-4b96-bdf2-32de976a888c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa3348f-42e7-4d3a-9100-17bb53be30ed", "name": "network-vif-deleted", "tag": "493ca1c4-2721-4cf5-8c3d-e3c43332a05a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:53.446184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-04e14a0b-7969-46df-8079-9eb742444f30 req-7fd4b843-5076-4b96-bdf2-32de976a888c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:53.446673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-04e14a0b-7969-46df-8079-9eb742444f30 req-7fd4b843-5076-4b96-bdf2-32de976a888c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:53.447112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-04e14a0b-7969-46df-8079-9eb742444f30 req-7fd4b843-5076-4b96-bdf2-32de976a888c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:53.511650 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-04e14a0b-7969-46df-8079-9eb742444f30 req-7fd4b843-5076-4b96-bdf2-32de976a888c service nova] Creating event network-vif-deleted:493ca1c4-2721-4cf5-8c3d-e3c43332a05a for instance ffa3348f-42e7-4d3a-9100-17bb53be30ed on n-h1-master-1 Sep 18 01:11:53.523794 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-04e14a0b-7969-46df-8079-9eb742444f30 req-7fd4b843-5076-4b96-bdf2-32de976a888c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099722 Sep 18 01:11:53.525275 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1201/2501] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:53.826910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:53.832702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:53.851633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:53.854769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:53.855434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:53.857195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:53.859623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:53.861015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:53.927138 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 HTTP/1.1 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0a824b75-7a83-4e85-b7b6-07173f93b720'} Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:53.932034 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:53.936392 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:53.936392 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:53.936392 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:53.936392 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:53.936392 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:53.936392 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:53.936392 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:53.939602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:53.941190 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9060edd8-6927-439a-89d9-9b484bdb3c54 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 404 len: 111 microversion: 2.1 time: 0.122336 Sep 18 01:11:53.943974 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1301/2502] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:53 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:53.955976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:53.956730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:53.966477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:53.967090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:53.967685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:53.968585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:53.969365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:53.969999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:53.998622 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 HTTP/1.1 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '0a824b75-7a83-4e85-b7b6-07173f93b720'} Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.002386 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.010447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.012027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d988958a-f247-47b1-b11d-081cd3197794 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 404 len: 111 microversion: 2.1 time: 0.057254 Sep 18 01:11:54.015557 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1202/2503] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:53 2022] DELETE /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.025215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.027622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 0a824b75-7a83-4e85-b7b6-07173f93b720] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.052897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.054846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.058035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.059018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.059741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.060357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.061660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.061797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.073878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.074806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.075614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.076798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.077635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.078652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.099479 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 HTTP/1.1 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0a824b75-7a83-4e85-b7b6-07173f93b720'} Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.101603 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 0a824b75-7a83-4e85-b7b6-07173f93b720 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.108242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf0ae96f-4b27-4849-82cf-2b65becac8a0 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720" status: 404 len: 111 microversion: 2.1 time: 0.085981 Sep 18 01:11:54.109912 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1302/2504] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers/0a824b75-7a83-4e85-b7b6-07173f93b720 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.126167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.128371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.146781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.148397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.148870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.152102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.152829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.154761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.187414 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 HTTP/1.1 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1bb3142d-5147-43e9-b2f4-653d52b7f265'} Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.194631 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.199989 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.202413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.210400 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-051cb00a-4b41-4bf6-9e70-032686c37621 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 404 len: 111 microversion: 2.1 time: 0.094070 Sep 18 01:11:54.216273 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1303/2505] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:54 2022] DELETE /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.226395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.227029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 1bb3142d-5147-43e9-b2f4-653d52b7f265] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.252882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.253686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:54.254884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.255746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.257339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.261226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.262318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.271532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:54.282276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:54.307979 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ecee99cd-e709-458f-a7d5-ae7ea364201c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.252104 Sep 18 01:11:54.311663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.323318 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1203/2506] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 HTTP/1.1 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1bb3142d-5147-43e9-b2f4-653d52b7f265'} Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.323885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.327521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.327521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.327521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.327521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.327521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.327521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. Sep 18 01:11:54.327521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.330308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 1bb3142d-5147-43e9-b2f4-653d52b7f265 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.332215 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd7197d1-fc6f-4966-9469-ad40e659a5c1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265" status: 404 len: 111 microversion: 2.1 time: 0.114280 Sep 18 01:11:54.333048 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1304/2507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers/1bb3142d-5147-43e9-b2f4-653d52b7f265 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.337254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.337910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.339001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.339854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.345792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.346295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.346739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.347465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.348358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.348358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.354418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.364386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.365253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.366849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.367568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.368231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.409768 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] HTTP exception thrown: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed HTTP/1.1 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'ffa3348f-42e7-4d3a-9100-17bb53be30ed'} Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.413430 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:54.420357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.423784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 404 to user: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.425670 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04c98f7d-8445-44dc-b0c3-b4980a3d400a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed" status: 404 len: 111 microversion: 2.1 time: 0.091062 Sep 18 01:11:54.437182 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1305/2508] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.446010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.447253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.460277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.461689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.462807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.464336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.465533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.466707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.498422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd HTTP/1.1 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '65a49915-3f71-4dd6-be9d-f338b8b4b9bd'} Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.500375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.503893 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.507117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.508376 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2cefb51-4661-4475-9b44-0d18b94078f3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 404 len: 111 microversion: 2.1 time: 0.069223 Sep 18 01:11:54.509508 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1306/2509] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:54 2022] DELETE /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.514898 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.520765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:54.522544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:54.528831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.529995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.530856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.531819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.532515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.533297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.638204 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d5d52c7-0254-44ff-b280-261ba626e3a3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.127251 Sep 18 01:11:54.648991 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1307/2510] 10.222.0.25 () {58 vars in 1230 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:11:54.655223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.656201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 65a49915-3f71-4dd6-be9d-f338b8b4b9bd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.664685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.665534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.666243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.667216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.667920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.668565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.675636 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:54.692008 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd HTTP/1.1 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '65a49915-3f71-4dd6-be9d-f338b8b4b9bd'} Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.697814 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.701627 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.701627 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.701627 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.701627 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.701627 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.701627 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. Sep 18 01:11:54.701627 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.704186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 65a49915-3f71-4dd6-be9d-f338b8b4b9bd could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.705648 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55695007-7d06-4bf0-8c5a-427b58a560b3 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd" status: 404 len: 111 microversion: 2.1 time: 0.054950 Sep 18 01:11:54.707142 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1308/2511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers/65a49915-3f71-4dd6-be9d-f338b8b4b9bd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.713733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5eacc95-bbc8-4480-9fc9-d913ee0ff4f1 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5eacc95-bbc8-4480-9fc9-d913ee0ff4f1 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 18 01:11:54.721165 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 18 01:11:54.728656 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.732774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5eacc95-bbc8-4480-9fc9-d913ee0ff4f1 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.733963 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b5eacc95-bbc8-4480-9fc9-d913ee0ff4f1 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025026 Sep 18 01:11:54.739202 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1309/2512] 10.222.0.25 () {58 vars in 1182 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:11:54.746612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.747250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.756644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.757230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.757922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.758877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.759559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.760218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.781841 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e HTTP/1.1 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '62040783-8dea-4d6d-bfe9-83be6ee37e7e'} Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:54.784565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:54.788736 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:54.791529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:54.794470 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d832b2c3-e231-4aa5-8784-9257c206fcb1 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 404 len: 111 microversion: 2.1 time: 0.053944 Sep 18 01:11:54.798261 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1310/2513] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:54 2022] DELETE /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:54.804029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-dad88170-a592-446c-96a3-0ad44d1ed902 req-2731c330-2aaf-454a-8dbd-5ab4540a5fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe0782b-0f74-4f86-abe4-58361c819a84", "name": "network-vif-plugged", "status": "completed", "tag": "4105b6b7-8f39-4412-b99c-e12a3b538e9e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:11:54.816675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-dad88170-a592-446c-96a3-0ad44d1ed902 req-2731c330-2aaf-454a-8dbd-5ab4540a5fb3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.817398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-dad88170-a592-446c-96a3-0ad44d1ed902 req-2731c330-2aaf-454a-8dbd-5ab4540a5fb3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.818163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-dad88170-a592-446c-96a3-0ad44d1ed902 req-2731c330-2aaf-454a-8dbd-5ab4540a5fb3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.838092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-dad88170-a592-446c-96a3-0ad44d1ed902 req-2731c330-2aaf-454a-8dbd-5ab4540a5fb3 service nova] Creating event network-vif-plugged:4105b6b7-8f39-4412-b99c-e12a3b538e9e for instance 3fe0782b-0f74-4f86-abe4-58361c819a84 on n-h1-master-1 Sep 18 01:11:54.844592 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-dad88170-a592-446c-96a3-0ad44d1ed902 req-2731c330-2aaf-454a-8dbd-5ab4540a5fb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044359 Sep 18 01:11:54.845518 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1311/2514] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:54.850822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.855913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:54.856664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:54.865162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.866082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.866555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.872595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.872595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.872595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:54.912632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:54.920810 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e3185dc-bb24-42ba-bb22-269378f5cc49 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.596228 Sep 18 01:11:54.921398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1204/2515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:54.924488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:11:54.963913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:54.969940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 62040783-8dea-4d6d-bfe9-83be6ee37e7e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:54.994778 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a2f27f1-1d65-4996-94d2-c98f01b93e9f tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.147968 Sep 18 01:11:54.997804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:54.998671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:54.998890 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1312/2516] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers => generated 683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:55.010604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.011690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.012584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.013228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.022697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.034044 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e HTTP/1.1 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '62040783-8dea-4d6d-bfe9-83be6ee37e7e'} Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.036506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.040313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.040313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.040313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.040313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:55.040313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:55.040313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. Sep 18 01:11:55.040313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.041437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.042492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.servers [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Removing options 'limit' from query {{(pid=122374) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 18 01:11:55.042970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 62040783-8dea-4d6d-bfe9-83be6ee37e7e could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:55.043167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:55.043943 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3beffa25-b372-46b6-b805-2bb64acb2aaf tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e" status: 404 len: 111 microversion: 2.1 time: 0.111011 Sep 18 01:11:55.044600 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1205/2517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:54 2022] GET /compute/v2.1/servers/62040783-8dea-4d6d-bfe9-83be6ee37e7e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:55.052346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.052840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.053298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.054089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.054533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.055632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.056141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:55.061837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.072614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.073373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.074080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.075436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.076165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.077003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.106469 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 HTTP/1.1 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: exception: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'fc3a2593-1d08-492c-b6dc-8bf8657aa9a2'} Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:55.108999 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.113886 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.116016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:55.117176 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-029c2c0e-6453-4bd2-b8b3-c8aefbf28536 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2" status: 404 len: 111 microversion: 2.1 time: 0.066181 Sep 18 01:11:55.118343 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1206/2518] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:55 2022] DELETE /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:55.119570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:11:55.136619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.137817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: fc3a2593-1d08-492c-b6dc-8bf8657aa9a2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:55.145826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.147894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.148733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.149986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.150845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.151773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.190011 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.190709 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-beffaf2e-ebcc-4587-865d-6818984883b2 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.178982 Sep 18 01:11:55.192060 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1313/2519] 10.222.0.25 () {58 vars in 1144 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 HTTP/1.1 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: exception: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'fc3a2593-1d08-492c-b6dc-8bf8657aa9a2'} Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.202312 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89452773-620e-4965-a0c2-dfde18aeb64c tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2" status: 404 len: 111 microversion: 2.1 time: 0.080860 Sep 18 01:11:55.210151 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1207/2520] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers/fc3a2593-1d08-492c-b6dc-8bf8657aa9a2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:55.210862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81de2f41-b59e-4b2f-8d23-78557bc4a271 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81de2f41-b59e-4b2f-8d23-78557bc4a271 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '-1' Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 18 01:11:55.216045 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81de2f41-b59e-4b2f-8d23-78557bc4a271 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:55.220125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-81de2f41-b59e-4b2f-8d23-78557bc4a271 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.014935 Sep 18 01:11:55.222393 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1314/2521] 10.222.0.25 () {58 vars in 1142 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:11:55.231878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e8c22b8c-50f0-4d3c-b38a-4df6b6074e3a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e8c22b8c-50f0-4d3c-b38a-4df6b6074e3a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: action_args: {} Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'testing' Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 18 01:11:55.246746 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:11:55.250743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e8c22b8c-50f0-4d3c-b38a-4df6b6074e3a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:55.253298 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e8c22b8c-50f0-4d3c-b38a-4df6b6074e3a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.022858 Sep 18 01:11:55.257570 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1208/2522] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:11:55.271598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-124fbc53-7cbf-43f7-8cf1-0c3dd4607954 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.282732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-124fbc53-7cbf-43f7-8cf1-0c3dd4607954 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.283802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-124fbc53-7cbf-43f7-8cf1-0c3dd4607954 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:55.299704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.servers [None req-124fbc53-7cbf-43f7-8cf1-0c3dd4607954 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Flavor 'non_existing_flavor' could not be found {{(pid=122374) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 18 01:11:55.302336 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-124fbc53-7cbf-43f7-8cf1-0c3dd4607954 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039785 Sep 18 01:11:55.315581 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1315/2523] 10.222.0.25 () {58 vars in 1178 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:11:55.337332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.345791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.348229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:55.350481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.351227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:55.356913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.357573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.358124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.359217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.359828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.361017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.375065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.386957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.387810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.388749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.389228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.389688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.496474 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dd909334-405d-4446-b072-ebbc38d7d86a tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.176946 Sep 18 01:11:55.498083 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1209/2524] 10.222.0.25 () {58 vars in 1174 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:11:55.516321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.523301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.524084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:55.531135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.531851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.532343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.533127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.533613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.534037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.707291 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c1fbe56-0eb2-4d1f-a5b3-2b377c68e7ec tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.194859 Sep 18 01:11:55.707892 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1210/2525] 10.222.0.25 () {58 vars in 1184 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:11:55.710263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.726312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.735168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.736827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:55.739807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.745657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.746207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.746834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.748117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.748663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.749096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.752212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.761685 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ded02d79-dc8f-4c5e-a879-ae316e575a02 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.423830 Sep 18 01:11:55.763939 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1316/2526] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:55.786668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:11:55.852336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:55.860340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.860825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.861270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.953324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:55.954074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:55.972875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.974539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.975399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:55.976150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:55.977194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:55.977896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.398322 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf06e347-ad68-44d8-a528-171eabb114b0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.677450 Sep 18 01:11:56.417993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1211/2527] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:56.428873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-97cae0b9-34e9-4341-9513-6ecc30e49d20 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:56.434523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-97cae0b9-34e9-4341-9513-6ecc30e49d20 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:56.435886 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-97cae0b9-34e9-4341-9513-6ecc30e49d20 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011093 Sep 18 01:11:56.448087 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1212/2528] 10.222.0.25 () {58 vars in 1178 bytes} [Sun Sep 18 01:11:56 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:11:56.448314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:56.464141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:56.469865 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2d5e80d2-25ac-40b3-9b78-0d93967fd90c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 0.519080 Sep 18 01:11:56.475677 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1317/2529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:55 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:11:56.485849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:56.490787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Searching by: {'deleted': False, 'project_id': '262b41491a1745808f4a16c0b447e245'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:11:56.511380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.512888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.513761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.515583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.520478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.520478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.579523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:11:56.624476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4aced472-08c3-4ead-b9ab-8fef8aef1861 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.174384 Sep 18 01:11:56.625333 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1213/2530] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:11:56 2022] GET /compute/v2.1/servers => generated 683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:11:56.645744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:56.646585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:56.655916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.656849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.658432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.660554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.661335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.662290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.688653 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] HTTP exception thrown: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed HTTP/1.1 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'ffa3348f-42e7-4d3a-9100-17bb53be30ed'} Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:56.693276 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:56.702757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:56.704530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 404 to user: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:56.713814 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dbc46611-1351-4f0a-8737-036353f06cee tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed" status: 404 len: 111 microversion: 2.1 time: 0.068628 Sep 18 01:11:56.713814 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1318/2531] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:56 2022] DELETE /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:56.722646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:56.723607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:56.734545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.743106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.743823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.744736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.745342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.746042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.795972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:56.796867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:56.821389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:56.821994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.822676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.825587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.830881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:56.833061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:56.834306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:56.936947 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:57.003201 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:11:57.011576 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67737508-6ab8-427d-a40b-19a32ee632b4 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 204 len: 0 microversion: 2.1 time: 0.296425 Sep 18 01:11:57.017981 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1214/2532] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:56 2022] DELETE /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:11:57.025842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:57.033139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:57.044473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.045102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.045655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:57.046394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.046854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.047352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:57.064562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:57.089759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:57.094248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:57.111164 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2b0d3fd-d569-433c-840f-2d2d2ed3898f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.319019 Sep 18 01:11:57.115741 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1319/2533] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:56 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:11:57.125050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:11:57.305327 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f46fb3d-c158-440f-a239-cbd1ef6519c3 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 204 len: 0 microversion: 2.1 time: 0.283569 Sep 18 01:11:57.309702 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1215/2534] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:11:57 2022] DELETE /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:11:57.315028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:57.316552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: ffa3348f-42e7-4d3a-9100-17bb53be30ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:57.341298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.344099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.344663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:57.347225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.348022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.349761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:57.397843 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] HTTP exception thrown: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed HTTP/1.1 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'ffa3348f-42e7-4d3a-9100-17bb53be30ed'} Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:57.399435 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:11:57.404887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 404 to user: Instance ffa3348f-42e7-4d3a-9100-17bb53be30ed could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:11:57.405611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6da8cf0a-b785-4b51-aa4b-e590c541f592 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed" status: 404 len: 111 microversion: 2.1 time: 0.094587 Sep 18 01:11:57.409870 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1320/2535] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:57 2022] GET /compute/v2.1/servers/ffa3348f-42e7-4d3a-9100-17bb53be30ed => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:11:57.422880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:57.423602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:57.448276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.448791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.449246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:57.450007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.450767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.450886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:57.496805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:57.497794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:57.543514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.544004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.549910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:57.555148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:57.555905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:57.557786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:58.769219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:58.783275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4214d9ef-5f74-4b9e-a51c-7bb3aa66b8d1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1370 microversion: 2.1 time: 1.292443 Sep 18 01:11:58.785897 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1321/2536] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:57 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1370 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:58.791419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:58.802536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:58.815743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:58.816790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:58.817778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:58.830008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:58.830703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:58.831333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:59.032038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:59.045043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:59.055337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:59.065869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:11:59.073086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3e9f97e-8d12-432a-8262-c07136f2f0e0 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 200 len: 1521 microversion: 2.1 time: 1.654616 Sep 18 01:11:59.074326 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1216/2537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:57 2022] GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 1521 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:11:59.082722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc596d28-6f13-40ec-a260-e49a6a9f2fa6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.295454 Sep 18 01:11:59.083933 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1322/2538] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:11:58 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:11:59.810589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:11:59.811666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:11:59.825757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:59.835776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:59.843980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:11:59.845020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:11:59.854522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:11:59.854863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:00.107926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:00.109189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:00.143240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:00.143931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:00.144692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:00.149455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:00.150103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:00.152927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:01.698931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:01.716339 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-abcd03eb-627b-453b-bbf2-e2506a461b4e tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1556 microversion: 2.1 time: 1.905384 Sep 18 01:12:01.717600 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1217/2539] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:11:59 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1556 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:01.752661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:01.758078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:01.770640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:01.771660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:01.773308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:01.775201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:01.777304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:01.779389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.516313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:02.528760 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9dab7782-7521-4f3c-aac7-40989a6eaa23 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 200 len: 1521 microversion: 2.1 time: 2.429298 Sep 18 01:12:02.536073 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1323/2540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:00 2022] GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 1521 bytes in 2437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:02.545631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d6bb1270-dfa0-4a8f-aa9a-5166752eab9c req-719c201a-733e-425c-a91d-6d99b89d48c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e703c1-a546-4491-806c-5dc57a328851", "name": "network-vif-deleted", "tag": "c13cc8a8-6d00-4504-9283-431a2325e41f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:02.583380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d6bb1270-dfa0-4a8f-aa9a-5166752eab9c req-719c201a-733e-425c-a91d-6d99b89d48c6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.584163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d6bb1270-dfa0-4a8f-aa9a-5166752eab9c req-719c201a-733e-425c-a91d-6d99b89d48c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.585877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d6bb1270-dfa0-4a8f-aa9a-5166752eab9c req-719c201a-733e-425c-a91d-6d99b89d48c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.590401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:02.600818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:02.607488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:02.618403 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-32ffe62d-cadc-4876-a19a-174a7f7a6cd1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.878973 Sep 18 01:12:02.619194 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1218/2541] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:01 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:02.626355 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:02.626764 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d6bb1270-dfa0-4a8f-aa9a-5166752eab9c req-719c201a-733e-425c-a91d-6d99b89d48c6 service nova] Creating event network-vif-deleted:c13cc8a8-6d00-4504-9283-431a2325e41f for instance d0e703c1-a546-4491-806c-5dc57a328851 on n-h1-master-1 Sep 18 01:12:02.627251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:02.637268 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d6bb1270-dfa0-4a8f-aa9a-5166752eab9c req-719c201a-733e-425c-a91d-6d99b89d48c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099495 Sep 18 01:12:02.639914 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1324/2542] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:02.645538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.646133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.646573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.647854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.648308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.648727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.652225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:02.656660 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:02.671177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.672039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.672725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.675705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.676480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.683336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.708842 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e HTTP/1.1 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '7c74bd5f-0704-461c-8500-d822d23e6a8e'} Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:12:02.717637 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.722214 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.727755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:12:02.729443 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f8888d9b-e613-4d6c-87c4-eb74ac9537a6 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 404 len: 111 microversion: 2.1 time: 0.087838 Sep 18 01:12:02.730343 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1325/2543] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:12:02 2022] DELETE /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:12:02.751194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:02.755409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 7c74bd5f-0704-461c-8500-d822d23e6a8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:02.771854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.772728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.773519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.774527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.775227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.775886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.815213 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e HTTP/1.1 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '7c74bd5f-0704-461c-8500-d822d23e6a8e'} Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:02.821310 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.826286 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.826286 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:02.826286 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:02.826286 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:12:02.826286 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:12:02.826286 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. Sep 18 01:12:02.826286 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.829916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 7c74bd5f-0704-461c-8500-d822d23e6a8e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:12:02.832898 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db349676-eca6-4f70-a140-b367434756c4 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e" status: 404 len: 111 microversion: 2.1 time: 0.092205 Sep 18 01:12:02.835959 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1326/2544] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:02 2022] GET /compute/v2.1/servers/7c74bd5f-0704-461c-8500-d822d23e6a8e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:12:02.853267 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:02.854225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:02.862750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.864814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.870560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.871723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.872465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:02.873155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:02.925496 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca HTTP/1.1 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca'} Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:12:02.937106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:02.940990 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:02.948475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:12:02.949781 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-84ac8ae3-92e1-4e9e-8d17-94e821a30f39 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 404 len: 111 microversion: 2.1 time: 0.111172 Sep 18 01:12:02.955348 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1327/2545] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:12:02 2022] DELETE /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:12:02.967200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:02.973768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] [instance: 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:02.996217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:02.999085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.000810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.001843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.002706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.004097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.043238 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] HTTP exception thrown: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Request method failure captured: Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca HTTP/1.1 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm7VFAZNMbQ5ZnRGy_xWyCxHOQBY4XpxSk933sOc195EhXHipRBw3H8NA71AXeoA2xiuWOYFSWtHed2pHhZJfIDocn6iKnyMOaHQjXWeq69rzox9Dp5FhXSQDkNxl1Z1O6Pr03q5pUi7bfHLlvq8HiNK8FATruhtE3oT1FyYRlLFHKk Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ee0890115d040d0b712a534b9c5a824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 3ee0890115d040d0b712a534b9c5a824 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1195183443 Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 253b3027efb74403a9bfaa4d2cbfd31e Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1195183443-project Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca'} Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:03.050147 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.054933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:03.054933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:03.054933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:03.054933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:12:03.054933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:12:03.054933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. Sep 18 01:12:03.054933 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.058891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] Returning 404 to user: Instance 5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:12:03.062587 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-087134fd-5329-4776-9129-96d1251035c5 tempest-DeleteServersTestJSON-1195183443 tempest-DeleteServersTestJSON-1195183443-project] 10.222.0.25 "GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca" status: 404 len: 111 microversion: 2.1 time: 0.103154 Sep 18 01:12:03.068092 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1328/2546] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:02 2022] GET /compute/v2.1/servers/5d7102ff-b2b1-495a-87ad-b3ec2d8ab5ca => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:12:03.435245 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee866ae7-78de-490b-8255-755da91c7d67 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.814745 Sep 18 01:12:03.437276 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1219/2547] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:12:02 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-interface => generated 284 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:03.563822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:03.565008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: d0e703c1-a546-4491-806c-5dc57a328851] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:03.602015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.620535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.621175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.622239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.623818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.625297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.656824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:03.659379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:03.680148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.681018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.685119 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] HTTP exception thrown: Instance d0e703c1-a546-4491-806c-5dc57a328851 could not be found. Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 HTTP/1.1 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: exception: Instance d0e703c1-a546-4491-806c-5dc57a328851 could not be found. Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'd0e703c1-a546-4491-806c-5dc57a328851'} Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e703c1-a546-4491-806c-5dc57a328851 could not be found. Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e703c1-a546-4491-806c-5dc57a328851 could not be found. Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.696536 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e703c1-a546-4491-806c-5dc57a328851 could not be found. Sep 18 01:12:03.701213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:03.702626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.702626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.702626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.702626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.707128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 404 to user: Instance d0e703c1-a546-4491-806c-5dc57a328851 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:12:03.711174 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65a07da7-e277-40b8-8e4b-763de4c17499 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851" status: 404 len: 111 microversion: 2.1 time: 0.153763 Sep 18 01:12:03.716250 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1329/2548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:03 2022] GET /compute/v2.1/servers/d0e703c1-a546-4491-806c-5dc57a328851 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:12:03.724405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-9d6efc09-229d-4f27-81e2-6ec3e9e7b412 req-5d851418-1d83-4077-8db0-565c3b6aeeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add4799b-2874-4d67-a3bc-59dafef3f6e0", "name": "network-vif-deleted", "tag": "533d18a4-c60c-4fa9-a361-75d1dbd75346"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:03.747856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9d6efc09-229d-4f27-81e2-6ec3e9e7b412 req-5d851418-1d83-4077-8db0-565c3b6aeeac service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.748925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9d6efc09-229d-4f27-81e2-6ec3e9e7b412 req-5d851418-1d83-4077-8db0-565c3b6aeeac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.749961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9d6efc09-229d-4f27-81e2-6ec3e9e7b412 req-5d851418-1d83-4077-8db0-565c3b6aeeac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.786951 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-9d6efc09-229d-4f27-81e2-6ec3e9e7b412 req-5d851418-1d83-4077-8db0-565c3b6aeeac service nova] Creating event network-vif-deleted:533d18a4-c60c-4fa9-a361-75d1dbd75346 for instance add4799b-2874-4d67-a3bc-59dafef3f6e0 on n-h2-master-1 Sep 18 01:12:03.799736 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-9d6efc09-229d-4f27-81e2-6ec3e9e7b412 req-5d851418-1d83-4077-8db0-565c3b6aeeac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080858 Sep 18 01:12:03.802105 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1330/2549] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:03.810987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:03.813075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:03.820802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.821830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.822445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:03.823329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:03.823945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:03.824724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:04.096019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:04.108350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:04.109477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9116b95ef91f4a8d9842f2d72d9718c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262b41491a1745808f4a16c0b447e245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:04.109903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:04.122843 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e84b7d50-02a2-4081-8f4d-603131ffacb9 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 200 len: 1479 microversion: 2.1 time: 0.319168 Sep 18 01:12:04.138336 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1331/2550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:03 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 1479 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:04.146135 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bc810cb4-8545-4256-a3db-d00c3258ee42 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.497731 Sep 18 01:12:04.148063 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1220/2551] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:03 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:05.152945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:05.158914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] [instance: add4799b-2874-4d67-a3bc-59dafef3f6e0] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:05.164523 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:05.181541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:05.182284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:05.182997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:05.183706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:05.184686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:05.187287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:05.188879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:05.189505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:05.191877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:05.195052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:05.202173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:05.203071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:05.204232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:05.204754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:05.222070 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] HTTP exception thrown: Instance add4799b-2874-4d67-a3bc-59dafef3f6e0 could not be found. Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Request method failure captured: Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 HTTP/1.1 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnApc_gQ7VUQwhOKATJ-FxY5jKIiYXLHk50M5c0RfT9lIJ7gDydCnKYrSfx3xug4J5V1hHusazv0wH_llURUwIXhIi2oPziTZNonv-lJj7EGgnloyYGEjlClJvkovPHR8mXXTeqTDhmuc2oTVKV8LGvjuHsx75IBzEYVXjo5cSWsdU8 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/262b41491a1745808f4a16c0b447e245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_262b41491a1745808f4a16c0b447e245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/262b41491a1745808f4a16c0b447e245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 262b41491a1745808f4a16c0b447e245 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1942466602 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9116b95ef91f4a8d9842f2d72d9718c9 Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListServersNegativeTestJSON-1942466602-project Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: exception: Instance add4799b-2874-4d67-a3bc-59dafef3f6e0 could not be found. Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'add4799b-2874-4d67-a3bc-59dafef3f6e0'} Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add4799b-2874-4d67-a3bc-59dafef3f6e0 could not be found. Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add4799b-2874-4d67-a3bc-59dafef3f6e0 could not be found. Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:05.224446 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add4799b-2874-4d67-a3bc-59dafef3f6e0 could not be found. Sep 18 01:12:05.230707 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:12:05.234459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] Returning 404 to user: Instance add4799b-2874-4d67-a3bc-59dafef3f6e0 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:12:05.236627 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e06b24e6-9a86-498d-b172-45356b60af18 tempest-ListServersNegativeTestJSON-1942466602 tempest-ListServersNegativeTestJSON-1942466602-project] 10.222.0.25 "GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0" status: 404 len: 111 microversion: 2.1 time: 0.087981 Sep 18 01:12:05.240915 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1332/2552] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:05 2022] GET /compute/v2.1/servers/add4799b-2874-4d67-a3bc-59dafef3f6e0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:12:05.344882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:05.353792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:05.355494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:05.361493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-045a89ad-7e91-4c29-8c59-161b8627690a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.183822 Sep 18 01:12:05.362636 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1221/2553] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:05 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:06.393101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:06.394364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:06.408352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:06.410200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:06.411426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:06.415120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:06.417015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:06.418645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:06.590721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:06.606914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:06.608392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:06.616259 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48ecfd69-7a3a-4038-825b-7ca0649f1150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.227467 Sep 18 01:12:06.616859 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1333/2554] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:06 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:07.647302 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:07.649946 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:07.655538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:07.656365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:07.678346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:07.679107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:07.679741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:07.680622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:07.681238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:07.681857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:07.807133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:07.816990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:07.824738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:07.838775 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd41c499-02df-4b8d-aa7c-f7f37f723de0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.192275 Sep 18 01:12:07.839599 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1222/2555] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:07 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:08.874864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:08.875662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:08.888479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:08.890836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:08.895507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:08.897545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:08.901159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:08.902155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:09.068078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:09.083762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:09.085985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:09.095693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5edbd407-0bfe-4d99-8195-0a97bb91ce2c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.224736 Sep 18 01:12:09.097504 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1334/2556] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:08 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:10.128844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:10.129491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:10.143830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:10.148752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:10.149461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:10.150414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:10.151044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:10.151941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:10.346033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:10.359860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:10.362392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:10.370348 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c75fb875-528a-4a08-a0ef-1f15ec30c053 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1558 microversion: 2.91 time: 0.245333 Sep 18 01:12:10.371742 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1223/2557] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:10 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1558 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:11.401534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:11.406054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:11.425909 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:11.429429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:11.431649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:11.432754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:11.435581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:11.445520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:11.446290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:11.806461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:11.809933 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:11.821584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:11.823412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:11.844422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b6c66966-070d-4855-a2d3-fdec985b7a19 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1558 microversion: 2.91 time: 0.447840 Sep 18 01:12:11.846565 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1335/2558] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:11 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1558 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:12.013770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f6f4e88e-d576-4fe6-8388-7395b7c46e72 req-c8f66b3f-ecf2-49bc-ae52-09605869089e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe0782b-0f74-4f86-abe4-58361c819a84", "tag": "4105b6b7-8f39-4412-b99c-e12a3b538e9e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:12.028234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f6f4e88e-d576-4fe6-8388-7395b7c46e72 req-c8f66b3f-ecf2-49bc-ae52-09605869089e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:12.028968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f6f4e88e-d576-4fe6-8388-7395b7c46e72 req-c8f66b3f-ecf2-49bc-ae52-09605869089e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:12.030120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f6f4e88e-d576-4fe6-8388-7395b7c46e72 req-c8f66b3f-ecf2-49bc-ae52-09605869089e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:12.049179 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f6f4e88e-d576-4fe6-8388-7395b7c46e72 req-c8f66b3f-ecf2-49bc-ae52-09605869089e service nova] Creating event network-changed:4105b6b7-8f39-4412-b99c-e12a3b538e9e for instance 3fe0782b-0f74-4f86-abe4-58361c819a84 on n-h1-master-1 Sep 18 01:12:12.058494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f6f4e88e-d576-4fe6-8388-7395b7c46e72 req-c8f66b3f-ecf2-49bc-ae52-09605869089e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049534 Sep 18 01:12:12.059674 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1224/2559] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:12.896117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:12.898286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:12.920841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:12.921391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:12.929316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:12.930468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:12.930967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:12.932408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:13.247991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:13.263546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:13.265004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:13.291964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cfb93074-7bf0-4169-b4e4-fd6fee65c720 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.415123 Sep 18 01:12:13.295574 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1336/2560] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:12 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:14.345528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:14.346994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:14.363802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:14.364551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:14.369607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:14.370872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:14.371527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:14.372109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:14.521790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:14.533543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:14.547583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:14.559476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-361bfe42-081d-4733-b99d-6cba6cab3fe7 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.236220 Sep 18 01:12:14.564576 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1225/2561] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:14 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:15.594187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:15.596224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:15.616798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:15.618401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:15.619685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:15.623115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:15.629766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:15.630772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:15.996331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:16.014533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:16.030773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:16.047798 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02f92def-c8f9-42a7-a9a7-80d604d7845a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.458102 Sep 18 01:12:16.052087 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1337/2562] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:15 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:17.085460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:17.087063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:17.098786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:17.104573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:17.105405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:17.106415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:17.107118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:17.107793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:17.243634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:17.260166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:17.266313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:17.278207 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ccb0740e-c08a-4951-b356-32560f8369ea tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.197509 Sep 18 01:12:17.283288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1226/2563] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:17 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:18.312087 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:18.312802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:18.332534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:18.333027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:18.333462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:18.334826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:18.335682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:18.335682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:18.483013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-44afd478-8251-4454-b4ab-f4ea1d0ed6c9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Action: 'create', calling method: .version_select at 0x7f700663f0d0>, body: {"keypair": {"name": "tempest-keypair-680090544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaVbfK763VNxmscii4cPXXljQ3xzwKCopvTlq3vRzmGJ/uQq7QU4MkbHLCXOlkgoLvYkuO+/WEXu982hUPgYtT+whrKCYLsJaVQtyWwZJsHQ/Ge3bh8yk6JctiNU6etWQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:18.528238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-44afd478-8251-4454-b4ab-f4ea1d0ed6c9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Getting quotas for project 622cbbf586594b449c1573f8d529aa5c. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:12:18.556308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-44afd478-8251-4454-b4ab-f4ea1d0ed6c9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Getting quotas for user de9bd3c0c4524c51b919a38238e79d0c and project 622cbbf586594b449c1573f8d529aa5c. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:12:18.600549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-44afd478-8251-4454-b4ab-f4ea1d0ed6c9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.516534 Sep 18 01:12:18.601170 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1338/2564] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:12:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:18.641798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:18.657344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:18.671394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:18.692266 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ce47d864-f585-48c0-b470-59d6bdc71239 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.384024 Sep 18 01:12:18.693892 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1227/2565] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:18 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:19.730298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:19.731008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:19.744130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:19.744877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:19.745636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:19.746867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:19.747493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:19.748085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:20.067282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:20.085476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:20.087193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:20.107741 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fc6480f-5699-491c-a7ca-559d56457889 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.386577 Sep 18 01:12:20.108381 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1339/2566] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:19 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:21.140923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:21.142316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:21.160603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:21.176032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:21.178574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:21.179597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:21.180575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:21.182665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:21.735725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:21.750223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:21.766406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:21.786443 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7dddd51d-657d-492b-a209-cb552418c6ff tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.650153 Sep 18 01:12:21.788813 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1228/2567] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:21 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:22.821033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:22.822468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:22.836382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:22.845353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:22.846078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:22.847782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:22.850744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:22.854244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:23.407430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:23.436399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:23.441085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:23.455736 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2673e0ff-69ef-4e5f-b190-b2ec92b996a1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.640258 Sep 18 01:12:23.471698 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1340/2568] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:22 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:12:24.503145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:24.504448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:24.519872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:24.520371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:24.520822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:24.523801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:24.525318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:24.526019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:24.718490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:24.726970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:24.731771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:24.751880 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a95fe08a-5d30-403a-885d-c95fcec026cf tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.250174 Sep 18 01:12:24.753264 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1229/2569] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:24 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:25.421964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-8616220", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b2e4e8aa-842e-4369-99d7-e6d0126f9b57"}], "security_groups": [{"name": "tempest-securitygroup--1987851198"}], "key_name": "tempest-keypair-680090544", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:25.784872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:25.785431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:25.796828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:25.797325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:25.800180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:25.800908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:25.801373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:25.801821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:26.122625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:26.125222 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:26.143142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:26.144895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:26.164487 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3049fab-f74e-4fde-845f-08496deb54b9 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.383310 Sep 18 01:12:26.172406 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1230/2570] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:25 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:12:26.407079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] validate_networks() for [('b2e4e8aa-842e-4369-99d7-e6d0126f9b57', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:12:27.205681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:27.206294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:27.223259 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:27.229028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:27.229523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:27.229997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:27.233595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:27.234122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:27.234564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:27.407188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:27.420077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:27.426385 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:27.432996 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-469ba4af-d57a-4926-90d8-fc877815a150 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.231464 Sep 18 01:12:27.434329 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1231/2571] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:27 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:12:28.407597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Getting quotas for project 622cbbf586594b449c1573f8d529aa5c. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:12:28.425302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Getting quotas for user de9bd3c0c4524c51b919a38238e79d0c and project 622cbbf586594b449c1573f8d529aa5c. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:12:28.456315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:12:28.459156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:12:28.459932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:12:28.460637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:12:28.466376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:12:28.471565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:28.472737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:28.480927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:28.487000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:28.487571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:28.488657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:28.488800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:28.490296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:28.493648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:28.494431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:28.494858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:28.495807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:28.496764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:28.498007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:28.536015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Getting quotas for project 622cbbf586594b449c1573f8d529aa5c. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:12:28.550983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Getting quotas for user de9bd3c0c4524c51b919a38238e79d0c and project 622cbbf586594b449c1573f8d529aa5c. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:12:28.571251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:12:28.574537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:12:28.636329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:28.655496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:28.660619 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a8fed53-3b9d-459a-8841-8e2667033d32 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.243071 Sep 18 01:12:28.661736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:28.661985 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1341/2572] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:12:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 3246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:12:28.672618 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a802ddf4-0526-4c86-af40-c8fdf285f396 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.211492 Sep 18 01:12:28.675182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22ced1c5-76cc-42ac-8203-e87c3eea5753 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:28.676121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-22ced1c5-76cc-42ac-8203-e87c3eea5753 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:28.679208 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1232/2573] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:28 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:28.846243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-22ced1c5-76cc-42ac-8203-e87c3eea5753 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:28.905824 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-22ced1c5-76cc-42ac-8203-e87c3eea5753 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1266 microversion: 2.1 time: 0.232850 Sep 18 01:12:28.908745 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1342/2574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:28 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:29.711562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:29.712166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:29.751297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:29.754375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:29.757492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:29.763122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:29.763873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:29.765074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:29.935501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:29.938303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:29.946773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:29.956804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:29.958765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:29.970049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:29.972083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:29.976598 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8f1030f-d223-42c3-8827-4cedc1640c7b tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.269041 Sep 18 01:12:29.977500 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1233/2575] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:29 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:29.984204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:29.986009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:29.988125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:29.990209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:30.373398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:30.383057 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53b91b3e-9c12-4038-82b4-2e909bfca6fa tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1318 microversion: 2.1 time: 0.455835 Sep 18 01:12:30.401964 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1343/2576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:29 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:31.011423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:31.012764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:31.026736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:31.029493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:31.030217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:31.031120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:31.033460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:31.034188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:31.420150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-196818653", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "7230947f-7ab1-4853-a4ff-de19a8b41471"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:31.570439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] validate_networks() for [('7230947f-7ab1-4853-a4ff-de19a8b41471', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:12:31.927831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:31.936352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:31.937876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:31.975923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c85906b-8d35-46f8-947f-2ac46e3ed023 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.968771 Sep 18 01:12:31.976531 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1234/2577] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:31 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:12:31.980990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:31.981619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:32.003661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:32.004157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:32.004596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:32.005340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:32.005817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:32.006245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:32.687830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:32.711494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d6f207bc-1fca-4755-9a53-0cd848da2738 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1324 microversion: 2.1 time: 0.733745 Sep 18 01:12:32.717049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1235/2578] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:31 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1324 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:33.004213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:33.005929 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:33.023055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:33.025102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:33.031793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:33.035574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:33.038463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:33.043519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:33.581942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:33.605059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:33.607003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:33.615107 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09ab9a47-da74-442f-8565-19737564dd5d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.616341 Sep 18 01:12:33.621154 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1236/2579] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:32 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:33.749596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:33.751155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:33.761111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:33.763149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:33.766434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:33.768348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:33.771327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:33.771955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:34.280027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:34.292144 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d57fce85-64da-4aa1-b5ad-cf6759a4e2b9 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1324 microversion: 2.1 time: 0.547287 Sep 18 01:12:34.293766 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1237/2580] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:33 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:12:34.476730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0941b5c8-4a8b-4e94-a07b-ebcfc5af3cb2"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:34.479426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:34.486328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:34.487191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:34.487798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:34.488683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:34.489870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:34.490449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:34.998643 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8c341cc-c0f0-43d7-a7f5-a43225cefaa4 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "POST /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526236 Sep 18 01:12:35.000763 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1238/2581] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:12:34 2022] POST /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:12:35.017237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:35.020364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:35.044001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:35.044495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:35.045173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:35.048033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:35.048699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:35.051352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:35.359462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:12:35.361034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:12:35.361816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:12:35.362385 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:12:35.362957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:12:35.384509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:35.387769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:35.389077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:35.391660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:35.402429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:35.404851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:35.450659 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Getting quotas for project f3d318640c324584849662c9c0c3f738. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:12:35.465622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Getting quotas for user e76c71bf09c14722b5d04ec4baa96eaf and project f3d318640c324584849662c9c0c3f738. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:12:35.499807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:12:35.505833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:12:35.546074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:35.560637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:35.579594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:35.601849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a9abf4c1-534f-4b34-a089-cd468506d715 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.597632 Sep 18 01:12:35.633091 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1239/2582] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:35 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:35.638393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:35.641716 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:35.660204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:35.661712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:35.663181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:35.671505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:35.672268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:35.674235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:35.679666 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-22475b40-429c-40d3-90be-2b1b870b5c38 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.489398 Sep 18 01:12:35.684036 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1344/2583] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:12:35.719450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c88786b-8a16-4921-80a3-ecb5fcde1689 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:35.722431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c88786b-8a16-4921-80a3-ecb5fcde1689 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:36.088968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c88786b-8a16-4921-80a3-ecb5fcde1689 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:36.102361 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c88786b-8a16-4921-80a3-ecb5fcde1689 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1215 microversion: 2.1 time: 0.398195 Sep 18 01:12:36.107692 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1345/2584] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:35 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1215 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:36.386723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:36.398393 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-21341452-423b-4e86-bea0-c6de32fe1a2f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.763210 Sep 18 01:12:36.404779 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1240/2585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:35 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:36.637653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:36.638845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:36.656896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:36.657769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:36.664273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:36.668482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:36.669197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:36.669897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:36.955648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:36.969802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:36.972259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:37.000177 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14cf7d56-c39d-4344-b765-fe2b25c7a664 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.352027 Sep 18 01:12:37.030719 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1346/2586] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:36 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:37.135374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:37.136181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:37.174366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:37.178119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:37.178973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:37.181233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:37.184168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:37.191113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:37.431208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:37.431889 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:37.448122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:37.451187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:37.452248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:37.455226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:37.458000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:37.458459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:37.859799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:37.886304 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d676eaf3-20ca-479f-b3f4-745d9c72e5a6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1219 microversion: 2.1 time: 0.756271 Sep 18 01:12:37.889741 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1241/2587] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:37 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1219 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:37.920807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:37.934663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68763cdf-349f-4161-b7cb-e11e98e729ea tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.503953 Sep 18 01:12:37.935623 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1347/2588] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:37 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:38.039115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:38.040146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:38.060094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:38.065965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:38.068549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:38.070994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:38.071745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:38.072428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:38.370324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:38.402377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:38.421621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:38.487224 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bc35854c-b42a-4280-8442-d5040462ea76 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.454731 Sep 18 01:12:38.499066 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1242/2589] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:38 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:38.914444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:38.915336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:38.940023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:38.945325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:38.953538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:38.967466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:38.970420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:38.978508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:38.981876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:38.984216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:38.986101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:38.998502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:39.000062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:39.000770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:39.008451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:39.008916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:40.585080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:40.606431 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-66e9899c-95e5-4218-ad1c-619aee5070d0 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1273 microversion: 2.1 time: 1.690364 Sep 18 01:12:40.607262 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1348/2590] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:38 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1273 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:40.613100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:40.620936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:40.643373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:40.644234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:40.650226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:40.651599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:40.655195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:40.655976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:41.063420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:41.073848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1fbdab83-882a-483e-9cca-0a60a2a9a91f tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 2.116129 Sep 18 01:12:41.088051 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1243/2591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:38 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:41.230812 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:41.241133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:41.254202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:41.275430 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-94618010-69f1-4787-95ef-0bb4b4858dca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.666687 Sep 18 01:12:41.281422 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1349/2592] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:40 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:41.631440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:41.632289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:41.650173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:41.661273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:41.661801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:41.662564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:41.663037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:41.663460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:42.108623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:42.109243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:42.111960 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:42.149743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:42.150310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:42.150772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:42.151927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:42.152394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:42.152826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:42.240301 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=59 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:42.256741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:42.278960 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5629a197-2748-4cb8-9679-d382d2fcbd9e tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1273 microversion: 2.1 time: 0.651893 Sep 18 01:12:42.301124 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1244/2593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:41 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1273 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:42.322870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:42.323975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:42.331239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:42.331955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:42.332555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:42.333470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:42.334098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:42.334676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:43.294750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:43.314760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:43.321349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:43.328235 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ece892c1-afb4-4310-aec2-5dc8178c6d6f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 1.009669 Sep 18 01:12:43.329342 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1245/2594] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:42 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:12:43.336478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:43.337396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:43.351863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:43.352376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:43.352823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:43.353566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:43.354032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:43.354460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:43.386988 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:43.653409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:43.668408 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42c165aa-b319-43d2-ad0b-738706a56fc4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 1.561709 Sep 18 01:12:43.671571 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1350/2595] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:42 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:12:44.157828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:44.177134 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05fcddec-e0af-47cb-8ba9-24eff32ab646 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.845548 Sep 18 01:12:44.177749 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1246/2596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:43 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:44.369290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:44.370606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:44.372885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5f72167d-b17d-417e-a360-14e3a076d1f0 req-d4cbb54f-a291-4343-91c1-8852ab048898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca1030d-871a-43de-af46-18b99b422d0f", "tag": "755104d6-aa9f-4ced-b539-e60876e51bd0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:44.402397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5f72167d-b17d-417e-a360-14e3a076d1f0 req-d4cbb54f-a291-4343-91c1-8852ab048898 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:44.403498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5f72167d-b17d-417e-a360-14e3a076d1f0 req-d4cbb54f-a291-4343-91c1-8852ab048898 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:44.404617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5f72167d-b17d-417e-a360-14e3a076d1f0 req-d4cbb54f-a291-4343-91c1-8852ab048898 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:44.414682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:44.442269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:44.442948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:44.443768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:44.444244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:44.450435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:44.463625 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5f72167d-b17d-417e-a360-14e3a076d1f0 req-d4cbb54f-a291-4343-91c1-8852ab048898 service nova] Creating event network-changed:755104d6-aa9f-4ced-b539-e60876e51bd0 for instance cca1030d-871a-43de-af46-18b99b422d0f on n-h1-master-1 Sep 18 01:12:44.484719 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5f72167d-b17d-417e-a360-14e3a076d1f0 req-d4cbb54f-a291-4343-91c1-8852ab048898 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116973 Sep 18 01:12:44.487021 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1247/2597] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:12:44.701300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:44.702130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:44.712384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:44.713145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:44.714593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:44.714789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:44.716442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:44.721084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:44.721812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:44.729739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:44.732049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:44.747292 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-477b1810-8971-48f1-aae7-cf05e2f21e30 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.390316 Sep 18 01:12:44.747910 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1351/2598] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:44 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:45.207751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:45.208568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:45.229383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:45.230359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:45.231172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:45.232096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:45.233040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:45.233696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:45.298117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:45.313281 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d27240bb-00d2-402e-8efa-b7e7f5e5b38a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.620948 Sep 18 01:12:45.326070 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1248/2599] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:44 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:12:45.431766 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:45.762678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:45.771879 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0c82575b-a544-44f9-b4c7-1a2c0c7c84a1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.573135 Sep 18 01:12:45.780472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:45.781706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:45.787851 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1352/2600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:45 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:45.791759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:45.798810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:45.799549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:45.800430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:45.801021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:45.801707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:46.012620 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:46.025521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:46.035493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:46.063610 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f6f4791c-658b-4e43-8cef-75cecc05802a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1535 microversion: 2.91 time: 0.287113 Sep 18 01:12:46.064490 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1249/2601] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:45 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1535 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:46.336276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:46.337208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:46.339110 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=24 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:46.355791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:46.356291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:46.357151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:46.357442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:46.357919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:46.358342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:46.695151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ace6d4d2-ef28-4545-bdec-f7caef2164b1 req-b0853b84-7e60-4849-8f02-bbe3e8616f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14419607-9e5b-4d97-a461-46537f47ca43", "tag": "13f2f058-d1a2-43f2-b9a8-6640aaa31249"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:46.723166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ace6d4d2-ef28-4545-bdec-f7caef2164b1 req-b0853b84-7e60-4849-8f02-bbe3e8616f1f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:46.729764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ace6d4d2-ef28-4545-bdec-f7caef2164b1 req-b0853b84-7e60-4849-8f02-bbe3e8616f1f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:46.733055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ace6d4d2-ef28-4545-bdec-f7caef2164b1 req-b0853b84-7e60-4849-8f02-bbe3e8616f1f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:46.763258 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ace6d4d2-ef28-4545-bdec-f7caef2164b1 req-b0853b84-7e60-4849-8f02-bbe3e8616f1f service nova] Creating event network-changed:13f2f058-d1a2-43f2-b9a8-6640aaa31249 for instance 14419607-9e5b-4d97-a461-46537f47ca43 on n-h2-master-1 Sep 18 01:12:46.767329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:46.776435 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ace6d4d2-ef28-4545-bdec-f7caef2164b1 req-b0853b84-7e60-4849-8f02-bbe3e8616f1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085161 Sep 18 01:12:46.780508 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1250/2602] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:12:46.790187 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0578b84b-2ea4-4cae-a8d4-e4db5efc41d0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.457874 Sep 18 01:12:46.790815 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1353/2603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:46 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:46.814069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:46.814069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:46.820901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:46.821670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:46.822293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:46.823156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:46.823771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:46.824351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:47.072688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-140685945", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "cc1cff88-5510-4ad1-92ea-097319862331"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:47.076187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:47.092462 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0410bfbc-8d56-45ba-b14d-91ffeeeb9e89 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.284712 Sep 18 01:12:47.093717 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1251/2604] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:46 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:47.102070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:47.103070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:47.110041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:47.111083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:47.111775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:47.112857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:47.113540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:47.114278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:47.181703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] validate_networks() for [('cc1cff88-5510-4ad1-92ea-097319862331', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:12:47.206133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:47.220057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:47.228418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:47.234997 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6b3b230d-41eb-44e4-8320-5d49c5dd8455 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1535 microversion: 2.91 time: 0.138253 Sep 18 01:12:47.238470 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1252/2605] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:47 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1535 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:47.774685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:12:47.778714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:12:47.779393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:12:47.779816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:12:47.797076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:12:47.814213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:47.814897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:47.833447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:47.835433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:47.836280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:47.836823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:47.837277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:47.838062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:47.838533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:47.839272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:47.840258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:47.841130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:47.844506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:47.845022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:47.958801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Getting quotas for project e4259c8d88db43eebf164b306b70eb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:12:47.969523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Getting quotas for user d3e40fd9dbb94f8fa23a5b7c8a16be83 and project e4259c8d88db43eebf164b306b70eb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:12:47.988331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Going to run 2 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:12:47.991445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:12:48.048391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=c7ea7ea2-c022-49dd-95f7-03d51d0d299b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:12:48.179335 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc97b699-74cc-4910-b8dc-56686f23df37 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226905 Sep 18 01:12:48.180122 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1354/2606] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:12:48.184856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:48.197390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:48.203975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:48.204833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:48.205510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:48.206502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:48.218378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:48.219253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:48.351250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:48.368403 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0abe5445-d75f-4928-b312-077172f1ec73 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.558690 Sep 18 01:12:48.383556 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1253/2607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:47 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:12:48.400757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:48.408661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:48.410048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Searching by: {'deleted': False, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:12:48.455199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:48.455816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:48.456477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:48.457186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:48.458356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:48.458782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:48.503886 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-02e2b44d-4408-45e2-91cf-1a7385b4e4e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.118884 Sep 18 01:12:48.504498 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1254/2608] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:12:48 2022] GET /compute/v2.1/servers => generated 675 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:48.524085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:48.524085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:48.537945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:48.538470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:48.538916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:48.544953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:48.545504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:48.546168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:48.699568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:48.715994 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21a50844-c0f4-4506-8bd7-56ac1f914f37 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.534530 Sep 18 01:12:48.729629 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1355/2609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:48 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:48.740279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-30ff5e71-7f97-47c3-8f2c-c064becfce60 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:48.740913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-30ff5e71-7f97-47c3-8f2c-c064becfce60 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:48.982283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:48.992153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:49.002856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:49.006246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30ff5e71-7f97-47c3-8f2c-c064becfce60 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:49.014041 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-30ff5e71-7f97-47c3-8f2c-c064becfce60 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1219 microversion: 2.1 time: 0.296008 Sep 18 01:12:49.017456 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a8869f1e-ac2c-481c-8dcd-50de9cec26e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1538 microversion: 2.91 time: 0.507932 Sep 18 01:12:49.018307 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1356/2610] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:48 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:49.055593 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1255/2611] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:48 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1538 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:49.075965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:49.078828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:49.101477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.105674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.111710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:49.112662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.115570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.116159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:49.236115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=122374) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 01:12:49.397277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:49.398208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:49.410525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.411643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.413751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:49.414769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.415398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.418991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:49.434491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68e9a73b-64a1-406e-bab9-ffaf6742c221 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action" status: 202 len: 0 microversion: 2.91 time: 0.362237 Sep 18 01:12:49.443522 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1357/2612] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:12:49 2022] POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:12:49.465022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:49.465747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:49.501077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.501587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.504644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:49.507238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.509683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.510167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:49.736633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:49.764306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:49.774546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:49.794241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db9a3d9e-1c90-45c8-89f1-1ec16a9ef642 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1486 microversion: 2.91 time: 0.345898 Sep 18 01:12:49.805593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1358/2613] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:49 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1486 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:49.810427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:49.812862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:49.859002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.862435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.865906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:49.881408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:49.885198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:49.888855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:50.324484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:50.364713 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0f1b83f-514c-42d5-b96b-042f9e2cb6cd tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.968413 Sep 18 01:12:50.366011 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1256/2614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:49 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:50.376158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:50.376772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:50.388660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:50.389380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:50.390013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:50.391167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:50.391796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:50.392636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:51.251308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:51.269229 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69e5a7af-0be5-4b17-bb2f-5e943d65bd5c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1215 microversion: 2.1 time: 0.900266 Sep 18 01:12:51.295551 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1257/2615] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:50 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1215 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:51.314532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:51.321313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:51.335464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:51.338114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:51.339317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:51.346895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:51.349153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:51.349894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:51.353916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:51.368466 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a99823c1-542a-4a1d-966c-14076044f6b6 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 1.565564 Sep 18 01:12:51.369342 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1359/2616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:49 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:51.388104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:51.390623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:51.412906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:51.416629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:51.418281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:51.419316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:51.419982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:51.420683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:51.518371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:51.546155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:51.557059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:51.581291 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-29767b20-041b-4e5d-be75-349b4aed8e22 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1486 microversion: 2.91 time: 0.281242 Sep 18 01:12:51.600217 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1258/2617] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:51 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1486 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:52.056060 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:52.066382 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ecd21dcb-0172-417d-a316-c38f7da00a77 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.682006 Sep 18 01:12:52.080796 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1360/2618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:51 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:52.307259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:52.308231 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:52.325885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:52.326399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:52.326847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:52.327500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:52.327986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:52.328425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:52.396951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:52.397746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:52.418965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:52.419719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:52.420385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:52.421459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:52.422329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:52.423028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:52.457302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:52.468500 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aae0844e-4d59-417e-9b52-e5133f16374f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1277 microversion: 2.1 time: 0.170419 Sep 18 01:12:52.469634 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1259/2619] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:52 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:52.621439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:52.626294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:52.648015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:52.649266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:52.649266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:52.651531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:52.652606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:52.654890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:52.775429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:52.790741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:52.791988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:52.809541 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5caee11-63a6-4ec9-ace1-3a7f2fe90863 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1488 microversion: 2.91 time: 0.195447 Sep 18 01:12:52.811651 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1260/2620] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:52 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1488 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:52.888039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:52.899921 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9f75a9b8-aae9-4a2e-b769-6a17d7f7a04d tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.506883 Sep 18 01:12:52.901222 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1361/2621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:52 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:12:53.095466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:53.096087 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:53.103854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.104708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.106152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.107431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.108573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.109445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.448801 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:53.463974 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-491d6dbc-8937-4e25-8501-2bc51e8df6ca tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.372270 Sep 18 01:12:53.484859 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1261/2622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:53 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:53.501483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:53.502677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:53.522783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.523842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.524473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.525430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.526376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.527008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.692877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:53.705119 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a358b9b6-17c5-46f6-bfb4-bed726e67380 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1277 microversion: 2.1 time: 0.208103 Sep 18 01:12:53.725396 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1362/2623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:53 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:53.823486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:53.826481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:53.834402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.835226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.835871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.836964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.838230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.838961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.842124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:53.842723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:53.862497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.863001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.863478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.864212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.864678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.865112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.879899 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e269812f-c588-4c7a-88ba-fc7de5174fab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060515 Sep 18 01:12:53.886473 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1262/2624] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:12:53 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:53.898032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:53.899742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:53.907686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.908545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.911158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:53.912644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:53.913921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:53.915098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.041966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lazy-loading 'services' on Instance uuid 3fe0782b-0f74-4f86-abe4-58361c819a84 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:12:54.055676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:54.065031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:54.067537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:54.074446 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae5823b2-2b8e-49cd-a015-4420e75941bd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.237522 Sep 18 01:12:54.086070 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1363/2625] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:53 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:54.103200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:54.104154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:54.110726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:54.111548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:54.112215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.113148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:54.113876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:54.114812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.167244 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-83471c5d-eb2a-4c45-bbc8-04b5f9b6a57c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments/0941b5c8-4a8b-4e94-a07b-ebcfc5af3cb2" status: 202 len: 0 microversion: 2.1 time: 0.278866 Sep 18 01:12:54.168180 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1263/2626] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:12:53 2022] DELETE /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments/0941b5c8-4a8b-4e94-a07b-ebcfc5af3cb2 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:12:54.180100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ae3c8e03-1dfa-400d-aca6-fdc453569ec2 req-c323d3e9-0905-4046-9121-ce6e436b8b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca1030d-871a-43de-af46-18b99b422d0f", "name": "network-vif-plugged", "status": "completed", "tag": "755104d6-aa9f-4ced-b539-e60876e51bd0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:54.211723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ae3c8e03-1dfa-400d-aca6-fdc453569ec2 req-c323d3e9-0905-4046-9121-ce6e436b8b42 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:54.214274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ae3c8e03-1dfa-400d-aca6-fdc453569ec2 req-c323d3e9-0905-4046-9121-ce6e436b8b42 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:54.214934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ae3c8e03-1dfa-400d-aca6-fdc453569ec2 req-c323d3e9-0905-4046-9121-ce6e436b8b42 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.224864 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:54.264758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ae3c8e03-1dfa-400d-aca6-fdc453569ec2 req-c323d3e9-0905-4046-9121-ce6e436b8b42 service nova] Creating event network-vif-plugged:755104d6-aa9f-4ced-b539-e60876e51bd0 for instance cca1030d-871a-43de-af46-18b99b422d0f on n-h1-master-1 Sep 18 01:12:54.281402 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ae3c8e03-1dfa-400d-aca6-fdc453569ec2 req-c323d3e9-0905-4046-9121-ce6e436b8b42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111581 Sep 18 01:12:54.289412 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1264/2627] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:12:54.376441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:54.388908 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c8ac7a8-c226-4e2d-ac63-2e4735616c29 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.298939 Sep 18 01:12:54.390125 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1364/2628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:54 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:54.496568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:54.498042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:54.508888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:54.509393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:54.515224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.516639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:54.517132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:54.517602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.734717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:54.736727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:54.747575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:54.748077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:54.748558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.750259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:54.751475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:54.751925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:54.856853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:54.870695 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d31242ec-73e2-42c2-896b-574a1e465939 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.377993 Sep 18 01:12:54.878425 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1265/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:54 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:55.017002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:55.030374 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b9b6eb2-b9ce-46aa-859f-2c43ec155ca7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.301736 Sep 18 01:12:55.031631 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1365/2630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:54 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:12:55.109013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:55.109749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:55.121648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:55.122430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:55.124305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:55.126090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:55.128612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:55.129663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:55.266381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1720106134", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "6c12358b-dae4-487f-9bd6-572f58cf6d15"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:55.278958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:55.289643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:55.298284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:55.307452 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-317d324d-3218-454a-aebd-1e3cd43b7f80 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.202955 Sep 18 01:12:55.313505 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1366/2631] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:55 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:12:55.408593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] validate_networks() for [('6c12358b-dae4-487f-9bd6-572f58cf6d15', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:12:55.414234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:55.415547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:55.429512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:55.430217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:55.435158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:55.436930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:55.440058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:55.440517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:55.469855 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:56.000375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:56.031760 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e177685-6d7a-4c11-81f1-5b3a9b3066ed tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.621636 Sep 18 01:12:56.044347 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1367/2632] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:55 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:56.554598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21fa71c1-e73c-441a-a475-41d65f2b76df tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] Calling method '.version_select at 0x7f7005e545e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:56.607948 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21fa71c1-e73c-441a-a475-41d65f2b76df tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.560197 Sep 18 01:12:56.616997 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1368/2633] 10.222.0.25 () {60 vars in 1226 bytes} [Sun Sep 18 01:12:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:12:56.642079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:56.647857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:56.681006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:12:56.682243 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:12:56.683753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:12:56.685018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:12:56.689541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:12:56.732827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:56.735439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:56.745097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:56.751261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:56.756906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:56.765690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:56.779176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:56.788739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:56.791960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:56.802355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:56.832123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:56.833479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:56.911301 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:56.941535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Getting quotas for project 6932b64a9ceb4c02a9c2b88f0e6bd6e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:12:56.954920 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Getting quotas for user a62a736f71924817917eef8956e1d1f7 and project 6932b64a9ceb4c02a9c2b88f0e6bd6e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:12:56.987597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:12:56.993036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:12:57.171347 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b2fb210c-7a61-4433-881b-b1ba8be1fd3f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.225541 Sep 18 01:12:57.172024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1266/2634] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:12:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:12:57.197821 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:57.198506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:57.236236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:57.238218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:57.242359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:57.244753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:57.248133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:57.248583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:57.256012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:57.278125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d30c4bb2-b9d4-48b9-8f9d-1cd5e37b309e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1392 microversion: 2.1 time: 0.655584 Sep 18 01:12:57.284816 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1369/2635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:56 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1392 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:57.305915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:57.307014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:57.324102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:57.331611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:57.333081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:57.334099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:57.336446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:57.342807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:57.705277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:57.716873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:57.729006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:57.766092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-045a4ae9-1007-4de2-a7ec-a2e8cd8e5938 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.479707 Sep 18 01:12:57.767121 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1370/2636] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:57 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:12:57.776956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:57.811346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-963e0f77-b7b0-4844-992d-82f6627e7fe6 tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] Action: 'update', calling method: .version_select at 0x7f7005e4f5e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:57.816359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f4b22db-3c1e-4db8-90db-2996f0542fec tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.640124 Sep 18 01:12:57.829070 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1267/2637] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:57 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:57.858523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:57.864682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:57.903161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:57.906951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:57.910063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:57.916197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:57.917854 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:57.919855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:57.925306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:58.168116 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-963e0f77-b7b0-4844-992d-82f6627e7fe6 tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.399152 Sep 18 01:12:58.169945 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1371/2638] 10.222.0.25 () {62 vars in 1247 bytes} [Sun Sep 18 01:12:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:12:58.179043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4822479-8c5e-4770-96c9-879384ecaedc tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:58.199871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a4822479-8c5e-4770-96c9-879384ecaedc tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:58.205440 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:12:58.470882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:58.493171 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-477658b6-28f4-416f-a69e-2180d58fbc06 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 0.658011 Sep 18 01:12:58.496922 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1268/2639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:57 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:58.497265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a4822479-8c5e-4770-96c9-879384ecaedc tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:58.507749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7000202-4a6a-4e10-92af-03d6d07c13a8 tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] Calling method '.version_select at 0x7f70055acdc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:58.524972 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a4822479-8c5e-4770-96c9-879384ecaedc tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1217 microversion: 2.1 time: 0.352912 Sep 18 01:12:58.547256 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1372/2640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:58 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1217 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:58.549948 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d7000202-4a6a-4e10-92af-03d6d07c13a8 tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.050583 Sep 18 01:12:58.558332 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1269/2641] 10.222.0.25 () {60 vars in 1226 bytes} [Sun Sep 18 01:12:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:12:58.574961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ce9b946e-338a-481d-b75c-e32f08f79f4a tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] Action: 'update', calling method: .version_select at 0x7f70055ace50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:12:58.586227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:58.592865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:58.624145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:58.624956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:58.625710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:58.627360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:58.627613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:58.628339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:58.721472 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ce9b946e-338a-481d-b75c-e32f08f79f4a tempest-QuotaClassesAdmin257Test-961873718 tempest-QuotaClassesAdmin257Test-961873718-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.159113 Sep 18 01:12:58.727452 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1270/2642] 10.222.0.25 () {62 vars in 1247 bytes} [Sun Sep 18 01:12:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:12:58.813132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:58.813838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:58.832129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:58.836915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:58.838939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:58.843146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:58.844767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:58.846225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:59.161195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:59.181163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:59.183710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:59.199171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:12:59.214260 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e782ef33-45e3-4b94-ba74-26f3fa7be071 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1574 microversion: 2.1 time: 0.664304 Sep 18 01:12:59.217732 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3895fdf0-7e55-4e81-9864-751cb9ba6353 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.407523 Sep 18 01:12:59.219310 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1373/2643] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:58 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1574 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:12:59.221479 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1271/2644] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:12:58 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:12:59.225536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:59.226420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:59.237433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:59.238948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:59.242214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:59.243107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:59.246227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:59.246862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:59.270040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:59.271255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:59.306090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:59.312164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:59.312609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:59.319514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:59.320010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:59.320518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:59.651464 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c7c5756-664d-41dc-abdb-a7c09dc0935a tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.385388 Sep 18 01:12:59.664795 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1272/2645] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:12:59 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f/os-interface => generated 285 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:12:59.673303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:12:59.679494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:12:59.704111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:59.705360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:59.707932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:12:59.710827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:12:59.711979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:12:59.714036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:00.718716 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:00.737768 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6adb6b96-8271-44ae-9e9c-3aa8cc3d1fdd tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 1.511664 Sep 18 01:13:00.757393 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1374/2646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:59 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:00.772401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:00.775391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:00.795391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:00.800382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:00.801951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:00.803337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:00.807949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:00.809448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:00.810222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:00.820380 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1e2ea9f-51d6-4148-a2ba-7f66258c91cd tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 1.153513 Sep 18 01:13:00.820965 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1273/2647] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:12:59 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:00.844809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-31fef738-9d39-43bf-add0-c72c65d4defb req-7cfd14c2-3810-4988-bab9-93f1618f40e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14419607-9e5b-4d97-a461-46537f47ca43", "name": "network-vif-plugged", "status": "completed", "tag": "13f2f058-d1a2-43f2-b9a8-6640aaa31249"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:00.901972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-31fef738-9d39-43bf-add0-c72c65d4defb req-7cfd14c2-3810-4988-bab9-93f1618f40e5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:00.904015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-31fef738-9d39-43bf-add0-c72c65d4defb req-7cfd14c2-3810-4988-bab9-93f1618f40e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:00.907184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-31fef738-9d39-43bf-add0-c72c65d4defb req-7cfd14c2-3810-4988-bab9-93f1618f40e5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:00.954984 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-31fef738-9d39-43bf-add0-c72c65d4defb req-7cfd14c2-3810-4988-bab9-93f1618f40e5 service nova] Creating event network-vif-plugged:13f2f058-d1a2-43f2-b9a8-6640aaa31249 for instance 14419607-9e5b-4d97-a461-46537f47ca43 on n-h2-master-1 Sep 18 01:13:00.970098 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-31fef738-9d39-43bf-add0-c72c65d4defb req-7cfd14c2-3810-4988-bab9-93f1618f40e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147815 Sep 18 01:13:00.995229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1274/2648] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:01.029897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:01.030872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:01.062959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:01.066510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:01.074311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:01.076167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:01.079311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:01.082384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:01.130101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:01.146001 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e9bd0a1-6a5e-407c-988b-653a6d3cc49b tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1275 microversion: 2.1 time: 0.380678 Sep 18 01:13:01.147013 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1375/2649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:00 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1275 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:01.334516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:01.344792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:01.351591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:01.362885 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c4b9c20-c9c4-44e6-9f1c-a98eb2a4eba5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.366312 Sep 18 01:13:01.366261 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1275/2650] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:00 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:01.769240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:01.771113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:01.783553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:01.783970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:01.784414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:01.814299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:01.814924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:01.815388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:01.844123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:01.844948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:01.855568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:01.858008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:01.858623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:01.859443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:01.859963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:01.860685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:03.417147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:03.426994 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c7a84ee-5612-462c-b435-6fa9bbdf0935 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1315 microversion: 2.1 time: 1.587021 Sep 18 01:13:03.438550 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1276/2651] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:01 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1315 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:03.444259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:03.461165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:03.487798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:03.488825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:03.489226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:03.489983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:03.490436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:03.491106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:03.599093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:03.613788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a25f803-47e3-4e01-a237-0384f2a1fc66 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 1.848032 Sep 18 01:13:03.629976 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1376/2652] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:01 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:03.638893 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:03.648722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:03.660279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:03.661209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:03.662662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:03.665020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:03.667773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:03.668429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:03.831707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:03.839830 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c8bcd38-ca77-4a71-8c3d-bebec090bbc6 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1275 microversion: 2.1 time: 0.399882 Sep 18 01:13:03.855133 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1277/2653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:03 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1275 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:03.860207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-829768c1-7a0f-4361-a811-a2bc9c244d73 req-283e1e39-f9f4-4c2e-b24a-daccdfa9991b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c57d28-5a88-409c-8c43-5ac674244394", "tag": "a01c2ac5-d5c2-457d-b180-e1a6ce4613c3"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:03.919925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-829768c1-7a0f-4361-a811-a2bc9c244d73 req-283e1e39-f9f4-4c2e-b24a-daccdfa9991b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:03.928273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:03.929595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-829768c1-7a0f-4361-a811-a2bc9c244d73 req-283e1e39-f9f4-4c2e-b24a-daccdfa9991b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:03.930058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-829768c1-7a0f-4361-a811-a2bc9c244d73 req-283e1e39-f9f4-4c2e-b24a-daccdfa9991b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:03.946704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:03.948724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:03.958363 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4489992-e475-436b-bf25-3ee9835d2c6c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.326494 Sep 18 01:13:03.959936 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1377/2654] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:03 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:03.968304 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-829768c1-7a0f-4361-a811-a2bc9c244d73 req-283e1e39-f9f4-4c2e-b24a-daccdfa9991b service nova] Creating event network-changed:a01c2ac5-d5c2-457d-b180-e1a6ce4613c3 for instance 58c57d28-5a88-409c-8c43-5ac674244394 on n-h1-master-1 Sep 18 01:13:03.982284 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-829768c1-7a0f-4361-a811-a2bc9c244d73 req-283e1e39-f9f4-4c2e-b24a-daccdfa9991b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125407 Sep 18 01:13:03.983119 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1278/2655] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:04.474480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:04.475797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:04.527711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:04.541457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:04.542538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:04.543866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:04.552436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:04.561528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:04.646657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:04.647922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:04.661748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:04.662479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:04.663137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:04.664079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:04.664717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:04.665346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:05.270331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:05.297060 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-377ccd3f-e9e2-49cc-b71b-5915ff48d6e5 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1502 microversion: 2.1 time: 0.835753 Sep 18 01:13:05.303313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1378/2656] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:04 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1502 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:05.330947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:05.333142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:05.355234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:05.360267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:05.361112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:05.361958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:05.371395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:05.372946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:05.374028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:05.399862 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1659b4d-c7ff-4b4f-933d-eaf40a57d8d6 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.758232 Sep 18 01:13:05.403052 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1279/2657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:04 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:05.417505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c5162527-3a2d-4b38-b84a-005b83b769f1 req-cd1f10f7-4bd6-44c0-950a-40300b2ba486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca1030d-871a-43de-af46-18b99b422d0f", "tag": "755104d6-aa9f-4ced-b539-e60876e51bd0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:05.474303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5162527-3a2d-4b38-b84a-005b83b769f1 req-cd1f10f7-4bd6-44c0-950a-40300b2ba486 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:05.475140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5162527-3a2d-4b38-b84a-005b83b769f1 req-cd1f10f7-4bd6-44c0-950a-40300b2ba486 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:05.476629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5162527-3a2d-4b38-b84a-005b83b769f1 req-cd1f10f7-4bd6-44c0-950a-40300b2ba486 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:05.522585 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c5162527-3a2d-4b38-b84a-005b83b769f1 req-cd1f10f7-4bd6-44c0-950a-40300b2ba486 service nova] Creating event network-changed:755104d6-aa9f-4ced-b539-e60876e51bd0 for instance cca1030d-871a-43de-af46-18b99b422d0f on n-h1-master-1 Sep 18 01:13:05.556577 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c5162527-3a2d-4b38-b84a-005b83b769f1 req-cd1f10f7-4bd6-44c0-950a-40300b2ba486 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151333 Sep 18 01:13:05.557856 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1280/2658] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:05.563942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:05.567200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:05.575964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:05.576773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:05.577600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:05.579599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:05.580427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:05.581189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:06.371584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:06.381820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f25719d9-1c5b-4a34-948d-340b6cbc3f85 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1574 microversion: 2.1 time: 1.076462 Sep 18 01:13:06.401956 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1379/2659] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:05 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1574 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:06.414669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:06.416292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:06.438766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:06.439778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:06.446342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:06.447447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:06.451985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:06.452726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:06.893815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:06.902084 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:06.913789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:06.915610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:06.935661 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-060d47d5-658d-401c-8988-436deeac295a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.532292 Sep 18 01:13:06.938280 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1380/2660] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:06 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:06.956318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:06.957785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:06.981840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:06.982950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:06.994912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:06.995889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:06.996455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.000014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:07.005265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:07.030637 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-200e1e63-5d21-4a34-8993-9eee69bf1148 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 1.471206 Sep 18 01:13:07.040458 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1281/2661] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:05 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:07.059334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:07.060815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:13:07.066707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:07.083911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:07.084822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.085489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:07.086460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:07.087126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.087621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:07.406019 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5775d4ac-6f33-4c71-8c6a-79f752dd6af3 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 204 len: 0 microversion: 2.1 time: 0.456136 Sep 18 01:13:07.408140 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1381/2662] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:06 2022] DELETE /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:13:07.436125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:07.437009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:07.467022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:07.467846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.468788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:07.471122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:07.471832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.474868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:07.570922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:07.595849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3a68a50-f59b-4e26-ad79-ae41d622c40e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.553145 Sep 18 01:13:07.595849 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1282/2663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:07 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:07.605603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-918a4b26-e838-4ef3-99f7-6831c550f934 req-43d8f4f4-8237-4d7b-8c44-54f479c9f76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ea7ea2-c022-49dd-95f7-03d51d0d299b", "tag": "f21ff885-5954-4d63-b965-53cb8314d910"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:07.627210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-918a4b26-e838-4ef3-99f7-6831c550f934 req-43d8f4f4-8237-4d7b-8c44-54f479c9f76e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:07.627694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-918a4b26-e838-4ef3-99f7-6831c550f934 req-43d8f4f4-8237-4d7b-8c44-54f479c9f76e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.628135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-918a4b26-e838-4ef3-99f7-6831c550f934 req-43d8f4f4-8237-4d7b-8c44-54f479c9f76e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:07.660439 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-918a4b26-e838-4ef3-99f7-6831c550f934 req-43d8f4f4-8237-4d7b-8c44-54f479c9f76e service nova] Creating event network-changed:f21ff885-5954-4d63-b965-53cb8314d910 for instance c7ea7ea2-c022-49dd-95f7-03d51d0d299b on n-h2-master-1 Sep 18 01:13:07.678478 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-918a4b26-e838-4ef3-99f7-6831c550f934 req-43d8f4f4-8237-4d7b-8c44-54f479c9f76e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079526 Sep 18 01:13:07.679557 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1283/2664] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:07.962093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:07.966609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:07.968134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:07.971567 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-968fd483-61fa-48a3-a999-1fc3d11ad931 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1508 microversion: 2.1 time: 0.552547 Sep 18 01:13:07.973205 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1382/2665] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:07 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1508 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:07.988911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:07.989421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.989903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:07.990637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:07.991161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:07.991596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.065392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:08.067856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:08.077765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.078910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.079566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.080464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.081089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.081869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.185963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:08.205867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:08.208785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:08.217747 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33846405-f8fd-4b62-a975-0def4a467b18 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.255108 Sep 18 01:13:08.219749 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1284/2666] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:07 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:13:08.435147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:08.449090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a9e9dec-b1e5-485c-9a8d-db6a535393f3 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 0.392293 Sep 18 01:13:08.450138 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1383/2667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:08 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:08.450468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:08.454312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:08.462156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.463851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.465128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.466304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.466937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.467612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.519679 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-934751f9-6b39-4c4c-965d-e004cfa5c56f tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074311 Sep 18 01:13:08.520597 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1285/2668] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:13:08 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:13:08.617890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:08.624805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:08.625426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:08.629233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:08.632441 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:08.640922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.641417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.641884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.642597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.643369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.643995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.646504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.647124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.647972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.649199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.649853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.650531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.717985 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:08.735048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d227eda-b458-4a58-9c1d-35f269b84780 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121856 Sep 18 01:13:08.744856 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1384/2669] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:13:08 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:13:08.825463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:08.827107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:08.834522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.835497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.836281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.837385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:08.838017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:08.838596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:08.875328 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:08.886792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:13:08.947658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:08.960126 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92c23018-fe46-483c-a44b-8beef4d4883c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.339833 Sep 18 01:13:08.965888 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1286/2670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:08 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:09.000648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:09.001461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:09.020630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.021566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.022293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.023434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.024334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.024557 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-72d99873-b527-4a2a-b414-3605e3dfa3b2 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 204 len: 0 microversion: 2.1 time: 0.203016 Sep 18 01:13:09.025106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.029147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1385/2671] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:08 2022] DELETE /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:13:09.030455 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:09.052601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:09.053239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:09.060098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.060604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.061041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.061802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.062257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.062685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.370732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:09.385486 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ea88b09-6205-49a5-a293-6e023c5e0fad tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1508 microversion: 2.1 time: 0.390155 Sep 18 01:13:09.406618 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1287/2672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:08 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:09.413019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:09.414207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:09.424351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.426488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.430346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.431474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.453911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.454911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.462534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:09.471533 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48438b54-dbf5-4f2f-bf89-b28b51dc73b5 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1681 microversion: 2.1 time: 0.440795 Sep 18 01:13:09.475745 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1386/2673] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:09 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1681 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:09.489232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:09.490522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:09.511280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.513527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.514649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.517629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:09.518259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:09.519677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:09.631730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:09.643875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:09.645973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:09.672950 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f6461c05-70b5-4b2b-9939-8d28622a8365 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.264663 Sep 18 01:13:09.673760 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1288/2674] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:09 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:09.936679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:09.953477 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-258d304f-488f-4018-abe1-3cddc01ddfe8 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 0.475493 Sep 18 01:13:09.954884 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1387/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:09 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:09.996129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:09.999184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:10.027697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:10.034051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:10.034766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:10.039840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:10.043722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:10.046028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:10.472003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5dc48f2-f98d-4e61-acbc-658b85fde50d tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] Action: 'create', calling method: .version_select at 0x7f700a807280>, body: {"security_group": {"name": "tempest-securitygroup-632933615", "description": "tempest-description-2050745363"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:10.654298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:10.671539 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1bfa6566-0628-4efa-8601-9c747b9a4962 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.686250 Sep 18 01:13:10.673662 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1388/2676] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:09 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:10.710245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-223f319f-a7d3-4a31-affb-b9cf75b4df65 req-1f05722b-f159-4f95-abc0-ef7cfd90afbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a43dd2c-8b3c-4787-aeb6-62046d789cb7", "tag": "4ed1bd26-c29d-43a7-b3e9-935a4ad7ea9a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:10.740788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-223f319f-a7d3-4a31-affb-b9cf75b4df65 req-1f05722b-f159-4f95-abc0-ef7cfd90afbf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:10.742079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-223f319f-a7d3-4a31-affb-b9cf75b4df65 req-1f05722b-f159-4f95-abc0-ef7cfd90afbf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:10.743092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-223f319f-a7d3-4a31-affb-b9cf75b4df65 req-1f05722b-f159-4f95-abc0-ef7cfd90afbf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:10.788520 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-223f319f-a7d3-4a31-affb-b9cf75b4df65 req-1f05722b-f159-4f95-abc0-ef7cfd90afbf service nova] Creating event network-changed:4ed1bd26-c29d-43a7-b3e9-935a4ad7ea9a for instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 on n-h1-master-1 Sep 18 01:13:10.815189 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-223f319f-a7d3-4a31-affb-b9cf75b4df65 req-1f05722b-f159-4f95-abc0-ef7cfd90afbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138872 Sep 18 01:13:10.817060 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1389/2677] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:10.827395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:10.828247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:10.835363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:10.835964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:10.837055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:10.837605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:10.838155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:10.838662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:11.320426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:11.330316 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-de0b4ecf-dc1e-4129-b9f3-0a707333465c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1508 microversion: 2.1 time: 0.507428 Sep 18 01:13:11.330929 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1390/2678] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:10 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1508 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:11.350416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:11.355762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:11.365070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:11.369234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:11.370177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:11.372193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:11.373440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:11.374098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.241166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:12.250704 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-018275ca-5a44-423a-a9dc-6af788fba611 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1681 microversion: 2.1 time: 0.917975 Sep 18 01:13:12.251553 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1391/2679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:11 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1681 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:12.276601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:12.277235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:12.283508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.284274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.284742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.285823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.286293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.286856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.379440 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5dc48f2-f98d-4e61-acbc-658b85fde50d tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.460985 Sep 18 01:13:12.380377 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1289/2680] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:13:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:13:12.389603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:12.390463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:12.398758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.399599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.400201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.401382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.402257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.403125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.453780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:12.466738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:12.469165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:12.482003 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d13f3d06-139b-47bb-b5ff-29a54e661e9f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.213926 Sep 18 01:13:12.483954 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1392/2681] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:12 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:12.499057 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:12.500209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:12.507483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.508338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.508932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.509793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.510494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.511140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.773614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:12.785652 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80a8a96d-95ae-4907-b92b-bfc91d5eb384 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 0.403569 Sep 18 01:13:12.802478 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1290/2682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:12 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:12.810402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d82c56d4-e885-468b-93cd-0b011e997c18 req-e2520660-3d72-4a7e-af4e-f9ce43411f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c57d28-5a88-409c-8c43-5ac674244394", "name": "network-vif-plugged", "status": "completed", "tag": "a01c2ac5-d5c2-457d-b180-e1a6ce4613c3"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:12.822203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d82c56d4-e885-468b-93cd-0b011e997c18 req-e2520660-3d72-4a7e-af4e-f9ce43411f65 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.823168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d82c56d4-e885-468b-93cd-0b011e997c18 req-e2520660-3d72-4a7e-af4e-f9ce43411f65 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.823787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d82c56d4-e885-468b-93cd-0b011e997c18 req-e2520660-3d72-4a7e-af4e-f9ce43411f65 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.839953 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d82c56d4-e885-468b-93cd-0b011e997c18 req-e2520660-3d72-4a7e-af4e-f9ce43411f65 service nova] Creating event network-vif-plugged:a01c2ac5-d5c2-457d-b180-e1a6ce4613c3 for instance 58c57d28-5a88-409c-8c43-5ac674244394 on n-h1-master-1 Sep 18 01:13:12.849018 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d82c56d4-e885-468b-93cd-0b011e997c18 req-e2520660-3d72-4a7e-af4e-f9ce43411f65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044124 Sep 18 01:13:12.854591 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1291/2683] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:12.862317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:12.864050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:12.874574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:12.887920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.888741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.889496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.891662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:12.893016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:12.893993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:12.915434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f9d10f7f-a36b-4164-bd40-9f9eaf200530 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.430094 Sep 18 01:13:12.919238 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1393/2684] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:12 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:12.928929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22abd01b-3d1b-4a9c-9af9-a48d3ca6da00 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] Action: 'create', calling method: .version_select at 0x7f7005eb7670>, body: {"security_group": {"name": "tempest-securitygroup-373349610", "description": "tempest-description-2113587178"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:13.402293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:13.415754 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54099fad-a0e7-420b-a720-ad3d8292e536 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1508 microversion: 2.1 time: 0.559427 Sep 18 01:13:13.416514 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1292/2685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:12 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1508 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:13.421332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:13.422308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:13.432282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.435503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.436180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:13.437093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.437769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.438351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:13.623640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:13.645571 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09c7171b-1199-4365-a88f-145043ccf6c1 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1613 microversion: 2.1 time: 0.227793 Sep 18 01:13:13.646466 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1293/2686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:13 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1613 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:13.653498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:13.654533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:13.664918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.672416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.673681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:13.674629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.676618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.677301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:13.853421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:13.866254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:13.868581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:13.874822 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0a1a9044-fd49-4930-8a30-a4240d5f6530 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.226592 Sep 18 01:13:13.875955 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1294/2687] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:13 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:13.889981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:13.891038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:13.903814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.904317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.904758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:13.905467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.905972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.906396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:13.954324 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-22abd01b-3d1b-4a9c-9af9-a48d3ca6da00 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.033468 Sep 18 01:13:13.955326 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1394/2688] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:13:12 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:13.966794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:13.967828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:13.977480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.978347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.978816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:13.980076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:13.980955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:13.981424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:14.570664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:14.583264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:14.584533 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b90fe78-ced3-46df-9423-648e423f2ac4 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1319 microversion: 2.1 time: 0.623843 Sep 18 01:13:14.597583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1395/2689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:13 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:14.598398 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a6effcc-d082-464c-a8ae-d85c61c83e2f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 0.715712 Sep 18 01:13:14.615748 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1295/2690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:13 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:14.625815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:14.629339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:14.656108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:14.658293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:14.660095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:14.662213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:14.662885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:14.664292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:14.673138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-439afb8e-c092-4d32-9c27-1d797d913659 tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] Action: 'create', calling method: .version_select at 0x7f7005ef9700>, body: {"security_group": {"name": "tempest-securitygroup-354108433", "description": "tempest-description-2081260950"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:15.773614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:15.782246 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f1621cd-17d6-4430-8e0f-2f1c01db64b1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1508 microversion: 2.1 time: 1.164837 Sep 18 01:13:15.787642 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1296/2691] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:14 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1508 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:15.809420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:15.810556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:15.818047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:15.818907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:15.819643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:15.821640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:15.822543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:15.823222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:15.889935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:15.890503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:15.890960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:15.891532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lazy-loading 'fault' on Instance uuid 3fe0782b-0f74-4f86-abe4-58361c819a84 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:13:15.997787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a63fcd25ee41c49edd383ee07a8821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97543cfd30dd47fcb01cebef908f6fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:16.009088 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e62d2b99-c4a1-45f1-8391-cf534dc38dab tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 200 len: 1330 microversion: 2.1 time: 0.205550 Sep 18 01:13:16.021960 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1297/2692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:15 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 1330 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:16.043478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8889accb-522a-425f-9099-7177b3d38992 req-63c4d2f6-c9ad-40b8-87ab-978c47649fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe0782b-0f74-4f86-abe4-58361c819a84", "name": "network-vif-deleted", "tag": "4105b6b7-8f39-4412-b99c-e12a3b538e9e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:16.075301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8889accb-522a-425f-9099-7177b3d38992 req-63c4d2f6-c9ad-40b8-87ab-978c47649fb1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.075785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8889accb-522a-425f-9099-7177b3d38992 req-63c4d2f6-c9ad-40b8-87ab-978c47649fb1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.078654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8889accb-522a-425f-9099-7177b3d38992 req-63c4d2f6-c9ad-40b8-87ab-978c47649fb1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.129207 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8889accb-522a-425f-9099-7177b3d38992 req-63c4d2f6-c9ad-40b8-87ab-978c47649fb1 service nova] Creating event network-vif-deleted:4105b6b7-8f39-4412-b99c-e12a3b538e9e for instance 3fe0782b-0f74-4f86-abe4-58361c819a84 on n-h1-master-1 Sep 18 01:13:16.134676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8889accb-522a-425f-9099-7177b3d38992 req-63c4d2f6-c9ad-40b8-87ab-978c47649fb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101990 Sep 18 01:13:16.139985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1298/2693] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:16.155505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2a97efdf-fe87-412d-a1bf-15924a00b07a req-8831e81d-c9ab-485b-a6c1-f9dad48611eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe0782b-0f74-4f86-abe4-58361c819a84", "name": "network-vif-unplugged", "status": "completed", "tag": "4105b6b7-8f39-4412-b99c-e12a3b538e9e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:16.170097 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:16.177105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2a97efdf-fe87-412d-a1bf-15924a00b07a req-8831e81d-c9ab-485b-a6c1-f9dad48611eb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.178755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2a97efdf-fe87-412d-a1bf-15924a00b07a req-8831e81d-c9ab-485b-a6c1-f9dad48611eb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.179465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2a97efdf-fe87-412d-a1bf-15924a00b07a req-8831e81d-c9ab-485b-a6c1-f9dad48611eb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.217806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2a97efdf-fe87-412d-a1bf-15924a00b07a req-8831e81d-c9ab-485b-a6c1-f9dad48611eb service nova] Creating event network-vif-unplugged:4105b6b7-8f39-4412-b99c-e12a3b538e9e for instance 3fe0782b-0f74-4f86-abe4-58361c819a84 on n-h1-master-1 Sep 18 01:13:16.223703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2a97efdf-fe87-412d-a1bf-15924a00b07a req-8831e81d-c9ab-485b-a6c1-f9dad48611eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080795 Sep 18 01:13:16.224398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1299/2694] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:16.230514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:16.231961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:16.245395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.245945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.246398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.247140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.247612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.248066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.412199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:16.423785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:16.426649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:16.433085 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f96ebf7-a65e-4d29-bdd0-53ee6e46d404 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1531 microversion: 2.91 time: 0.207263 Sep 18 01:13:16.434002 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1300/2695] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:16 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1531 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:16.438934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:16.442310 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:16.456581 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-439afb8e-c092-4d32-9c27-1d797d913659 tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.869569 Sep 18 01:13:16.465287 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1396/2696] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:13:14 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:16.476879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:16.477505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:16.492431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.493043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.494828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.495527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.499475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.500390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.503299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.504319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.505445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.506448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.507185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.507802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.788731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:16.799253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:16.806415 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bcf7b60a-88c0-4b0a-9f8c-0d2f2e5b5d7f tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 0.333468 Sep 18 01:13:16.815052 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56076516-e83c-437a-af19-035f32eaa974 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 200 len: 1508 microversion: 2.1 time: 0.379375 Sep 18 01:13:16.816167 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1301/2697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:16 2022] GET /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:16.829794 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1397/2698] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:16 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:16.833948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:16.835186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:16.844851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.845666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.846109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.846826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.847791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.848440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.848824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7a085ab-312c-463c-b9d1-0f56c1a1d21c tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] Action: 'create', calling method: .version_select at 0x7f7005e54940>, body: {"security_group": {"name": "tempest-securitygroup-1270735861", "description": "tempest-description-426050253"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:16.946118 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lazy-loading 'services' on Instance uuid 630051a8-a626-45b4-bc41-aeb93e5e6617 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:13:16.967790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c693ddb-7a3c-45e9-829f-b2fd51ba5dcb tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1936 microversion: 2.91 time: 0.150081 Sep 18 01:13:16.969041 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1302/2699] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:16 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1936 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:16.973914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:16.974515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:16.981741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.981927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.982256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:16.983224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:16.983749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:16.984394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.027077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.027579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.028019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.028735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lazy-loading 'fault' on Instance uuid 14419607-9e5b-4d97-a461-46537f47ca43 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:13:17.070780 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7a085ab-312c-463c-b9d1-0f56c1a1d21c tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.251143 Sep 18 01:13:17.071371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1398/2700] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:13:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:17.076817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:17.077681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:17.085217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.086478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.087274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.088273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.088876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.089304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.096222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76c71bf09c14722b5d04ec4baa96eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d318640c324584849662c9c0c3f738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:17.107949 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4fa396c-df25-4e5e-99cf-9b70efbb9b4b tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 200 len: 1305 microversion: 2.1 time: 0.137830 Sep 18 01:13:17.122006 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1303/2701] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:16 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:17.131422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:17.131855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:17.138552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.139267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.139879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.140790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.141410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.142092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.172212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lazy-loading 'flavor' on Instance uuid 630051a8-a626-45b4-bc41-aeb93e5e6617 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:13:17.214394 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:17.249336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:17.257747 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa01b6f0-5af2-42f6-914a-86b4d287a573 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 200 len: 1319 microversion: 2.1 time: 0.185072 Sep 18 01:13:17.258659 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1399/2702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:17 2022] GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:17.263459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:17.264226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:17.271613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.272104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.272728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.273987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.274851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.275491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.290855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] HTTP exception thrown: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Request method failure captured: Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 HTTP/1.1 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm_8QlH4j1FQXRay8ZwFGLTUJwHK-kG9lnGngAg9ZiLqbjxh7qCgBTYBH1NzDWVeMfUYqVoCb3c69W87K3WQLrbUX3yxV8dij9qzFwccnJQknVu98Eqm_bjKFaN3veRpX0zz9DULvTJDA-T27gc2NI4qK1OQHhLi0I5YtBaC4jQA9ko Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 97543cfd30dd47fcb01cebef908f6fd7 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 97543cfd30dd47fcb01cebef908f6fd7 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachSCSIVolumeTestJSON-1362301258-project Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 15a63fcd25ee41c49edd383ee07a8821 Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1362301258-project Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3fe0782b-0f74-4f86-abe4-58361c819a84'} Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:17.292856 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:17.297023 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:17.297023 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:17.297023 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:17.297023 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:17.297023 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:17.297023 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:17.297023 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:17.302178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Returning 404 to user: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:17.303052 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-832a3ea1-ede3-4c3a-9b83-632ac800e62d tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 404 len: 111 microversion: 2.1 time: 0.043455 Sep 18 01:13:17.303613 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1400/2703] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:17 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:17.308235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64112d0b-e8a3-4601-93fe-c0efe8d926df tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] Calling method '.version_select at 0x7f700a763e50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:17.403073 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f02da1fe-e29d-4ab5-adf2-3e1337981159 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action" status: 202 len: 0 microversion: 2.91 time: 0.279210 Sep 18 01:13:17.403696 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1304/2704] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:13:17 2022] POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:13:17.409527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47436bae-dec9-4bb4-9d5f-8931aa094d73 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '.version_select at 0x7f700556f700>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:17.431220 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47436bae-dec9-4bb4-9d5f-8931aa094d73 tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310159639" status: 202 len: 0 microversion: 2.1 time: 0.025500 Sep 18 01:13:17.432547 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1305/2705] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310159639 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:13:17.439167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:17.440208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:17.450113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.451092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.452041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.453650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.454073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.454508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.542018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:17.552070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:17.554173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:17.560230 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f305b604-03c0-48d7-9244-c02a77c3b69c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.126212 Sep 18 01:13:17.574798 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1306/2706] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:17 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:17.833658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:17.834777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:17.843584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.844301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.844744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:17.845483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:17.846001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:17.846421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.169035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:18.179017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7860d5d8-2238-4760-9322-b5cf8936eaaa tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 0.350144 Sep 18 01:13:18.179624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1307/2707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:17 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:18.184134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:18.184750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:18.228241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.229617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.231121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.231885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.232351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.232771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.265230 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] HTTP exception thrown: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Request method failure captured: Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 HTTP/1.1 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnB-QghtjnRDQ2tlkB0deZzVyZiAW0IwSpc_EgD1O1guDBzG8RagirwN3LmuArvhjBZf-lKMgFfKVKqEuWSY4IyEkXoOfnyUw6XkOi4z689Iw6E28M_1iKUSuuRjQlwXWbD3k7t8qLW9QopGVpInouPeQGrtklWehe3Zn8KDqH8w5dE Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3d318640c324584849662c9c0c3f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3d318640c324584849662c9c0c3f738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: e76c71bf09c14722b5d04ec4baa96eaf Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '14419607-9e5b-4d97-a461-46537f47ca43'} Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.266922 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.271884 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.271884 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.271884 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.271884 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:18.271884 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:18.271884 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.271884 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.273353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Returning 404 to user: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:18.274601 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-003b42c4-b064-42e4-9a06-9666c79f51d1 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 404 len: 111 microversion: 2.1 time: 0.094044 Sep 18 01:13:18.277707 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1308/2708] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:18 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:18.284083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5903c3db-b297-4dc1-8f0b-6bc1d011a57f req-19a921db-a7c2-4ca8-8606-2c6a06598ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14419607-9e5b-4d97-a461-46537f47ca43", "name": "network-vif-deleted", "tag": "13f2f058-d1a2-43f2-b9a8-6640aaa31249"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:18.294594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5903c3db-b297-4dc1-8f0b-6bc1d011a57f req-19a921db-a7c2-4ca8-8606-2c6a06598ff5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.295074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5903c3db-b297-4dc1-8f0b-6bc1d011a57f req-19a921db-a7c2-4ca8-8606-2c6a06598ff5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.295505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5903c3db-b297-4dc1-8f0b-6bc1d011a57f req-19a921db-a7c2-4ca8-8606-2c6a06598ff5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.308987 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5903c3db-b297-4dc1-8f0b-6bc1d011a57f req-19a921db-a7c2-4ca8-8606-2c6a06598ff5 service nova] Creating event network-vif-deleted:13f2f058-d1a2-43f2-b9a8-6640aaa31249 for instance 14419607-9e5b-4d97-a461-46537f47ca43 on n-h2-master-1 Sep 18 01:13:18.313901 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5903c3db-b297-4dc1-8f0b-6bc1d011a57f req-19a921db-a7c2-4ca8-8606-2c6a06598ff5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034792 Sep 18 01:13:18.314556 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1309/2709] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:18.320279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:18.320977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:18.330200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.330711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.331144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.331925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.332375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.332792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.584133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:18.592968 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15e83ba5-08a9-443a-8314-e3bd568db63f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 200 len: 1319 microversion: 2.1 time: 0.276952 Sep 18 01:13:18.593789 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1310/2710] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:18 2022] GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:18.599461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-574074253", "metadata": {"image_type": "test"}}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:18.602080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:18.608081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.608937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.609883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.610597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.618785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.619254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.637013 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] HTTP exception thrown: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Request method failure captured: Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43/action HTTP/1.1 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 111 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnB-QghtjnRDQ2tlkB0deZzVyZiAW0IwSpc_EgD1O1guDBzG8RagirwN3LmuArvhjBZf-lKMgFfKVKqEuWSY4IyEkXoOfnyUw6XkOi4z689Iw6E28M_1iKUSuuRjQlwXWbD3k7t8qLW9QopGVpInouPeQGrtklWehe3Zn8KDqH8w5dE Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3d318640c324584849662c9c0c3f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3d318640c324584849662c9c0c3f738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: e76c71bf09c14722b5d04ec4baa96eaf Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-574074253", "metadata": {"image_type": "test"}}} Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '14419607-9e5b-4d97-a461-46537f47ca43', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-574074253', 'metadata': {'image_type': 'test'}}}} Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 18 01:13:18.638712 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Returning 404 to user: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:18.644435 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9eb47177-def1-48d3-b290-deda5a294ffa tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "POST /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43/action" status: 404 len: 111 microversion: 2.1 time: 0.045416 Sep 18 01:13:18.650235 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1311/2711] 10.222.0.25 () {60 vars in 1279 bytes} [Sun Sep 18 01:13:18 2022] POST /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:18.655318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-620a2c56-897a-45d1-9ea1-fa562002776b req-8aeac101-041d-46ac-880c-d4aaef6487e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a43dd2c-8b3c-4787-aeb6-62046d789cb7", "name": "network-vif-plugged", "status": "completed", "tag": "4ed1bd26-c29d-43a7-b3e9-935a4ad7ea9a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:18.666022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-620a2c56-897a-45d1-9ea1-fa562002776b req-8aeac101-041d-46ac-880c-d4aaef6487e0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.666518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-620a2c56-897a-45d1-9ea1-fa562002776b req-8aeac101-041d-46ac-880c-d4aaef6487e0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.667071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-620a2c56-897a-45d1-9ea1-fa562002776b req-8aeac101-041d-46ac-880c-d4aaef6487e0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.678510 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-620a2c56-897a-45d1-9ea1-fa562002776b req-8aeac101-041d-46ac-880c-d4aaef6487e0 service nova] Creating event network-vif-plugged:4ed1bd26-c29d-43a7-b3e9-935a4ad7ea9a for instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 on n-h1-master-1 Sep 18 01:13:18.683908 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-620a2c56-897a-45d1-9ea1-fa562002776b req-8aeac101-041d-46ac-880c-d4aaef6487e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032123 Sep 18 01:13:18.684821 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1312/2712] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:18.693136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:18.694378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:18.701087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.701591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.702023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.702722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.703172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.703593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.833711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:18.846126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:18.847691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:18.867053 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8d5ab8b4-1f1d-453f-a757-660fb79db415 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.179812 Sep 18 01:13:18.873251 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1313/2713] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:18 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:18.887916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef4505f1-386f-4122-bfe8-491c1fdc2b00 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-698027462", "metadata": {"image_type": "test"}}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:18.890250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef4505f1-386f-4122-bfe8-491c1fdc2b00 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Failed to fetch instance by id tempest-invalid-777773263 {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 01:13:18.890771 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ef4505f1-386f-4122-bfe8-491c1fdc2b00 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] HTTP exception thrown: Instance tempest-invalid-777773263 could not be found. Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef4505f1-386f-4122-bfe8-491c1fdc2b00 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Request method failure captured: Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/tempest-invalid-777773263/action HTTP/1.1 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 111 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnB-QghtjnRDQ2tlkB0deZzVyZiAW0IwSpc_EgD1O1guDBzG8RagirwN3LmuArvhjBZf-lKMgFfKVKqEuWSY4IyEkXoOfnyUw6XkOi4z689Iw6E28M_1iKUSuuRjQlwXWbD3k7t8qLW9QopGVpInouPeQGrtklWehe3Zn8KDqH8w5dE Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3d318640c324584849662c9c0c3f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3d318640c324584849662c9c0c3f738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: e76c71bf09c14722b5d04ec4baa96eaf Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-698027462", "metadata": {"image_type": "test"}}} Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: exception: Instance tempest-invalid-777773263 could not be found. Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'tempest-invalid-777773263', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-698027462', 'metadata': {'image_type': 'test'}}}} Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-777773263 could not be found. Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:18.892406 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-777773263 could not be found. Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-777773263 could not be found. Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef4505f1-386f-4122-bfe8-491c1fdc2b00 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Returning 404 to user: Instance tempest-invalid-777773263 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef4505f1-386f-4122-bfe8-491c1fdc2b00 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-777773263/action" status: 404 len: 100 microversion: 2.1 time: 0.018220 Sep 18 01:13:18.896937 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1314/2714] 10.222.0.25 () {60 vars in 1246 bytes} [Sun Sep 18 01:13:18 2022] POST /compute/v2.1/servers/tempest-invalid-777773263/action => generated 100 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:18.906800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13cc1eac-d578-4fb6-b6e4-3eb1a274c9cc tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-295615411"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:18.909024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-13cc1eac-d578-4fb6-b6e4-3eb1a274c9cc tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 01:13:18.909740 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-13cc1eac-d578-4fb6-b6e4-3eb1a274c9cc tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13cc1eac-d578-4fb6-b6e4-3eb1a274c9cc tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Request method failure captured: Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 56 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnB-QghtjnRDQ2tlkB0deZzVyZiAW0IwSpc_EgD1O1guDBzG8RagirwN3LmuArvhjBZf-lKMgFfKVKqEuWSY4IyEkXoOfnyUw6XkOi4z689Iw6E28M_1iKUSuuRjQlwXWbD3k7t8qLW9QopGVpInouPeQGrtklWehe3Zn8KDqH8w5dE Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3d318640c324584849662c9c0c3f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3d318640c324584849662c9c0c3f738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: e76c71bf09c14722b5d04ec4baa96eaf Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: {"createImage": {"name": "tempest-test-snap-295615411"}} Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-295615411'}}} Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.911163 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13cc1eac-d578-4fb6-b6e4-3eb1a274c9cc tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:18.915152 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13cc1eac-d578-4fb6-b6e4-3eb1a274c9cc tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009861 Sep 18 01:13:18.919121 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1315/2715] 10.222.0.25 () {60 vars in 1275 bytes} [Sun Sep 18 01:13:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:18.926304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d744b305-9a8c-4dcd-a846-aa7e99441576 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-231162218"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:18.928617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d744b305-9a8c-4dcd-a846-aa7e99441576 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 01:13:18.929999 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d744b305-9a8c-4dcd-a846-aa7e99441576 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d744b305-9a8c-4dcd-a846-aa7e99441576 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Request method failure captured: Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 56 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnB-QghtjnRDQ2tlkB0deZzVyZiAW0IwSpc_EgD1O1guDBzG8RagirwN3LmuArvhjBZf-lKMgFfKVKqEuWSY4IyEkXoOfnyUw6XkOi4z689Iw6E28M_1iKUSuuRjQlwXWbD3k7t8qLW9QopGVpInouPeQGrtklWehe3Zn8KDqH8w5dE Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3d318640c324584849662c9c0c3f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3d318640c324584849662c9c0c3f738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: e76c71bf09c14722b5d04ec4baa96eaf Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: {"createImage": {"name": "tempest-test-snap-231162218"}} Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-231162218'}}} Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.931762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 18 01:13:18.935678 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.937813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d744b305-9a8c-4dcd-a846-aa7e99441576 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:18.939078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d744b305-9a8c-4dcd-a846-aa7e99441576 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018629 Sep 18 01:13:18.940508 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1316/2716] 10.222.0.25 () {60 vars in 1281 bytes} [Sun Sep 18 01:13:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:18.952097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:18.952816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:18.965249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.966145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.966734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.967606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:18.968211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:18.968782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:18.986688 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] HTTP exception thrown: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Request method failure captured: Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 HTTP/1.1 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnB-QghtjnRDQ2tlkB0deZzVyZiAW0IwSpc_EgD1O1guDBzG8RagirwN3LmuArvhjBZf-lKMgFfKVKqEuWSY4IyEkXoOfnyUw6XkOi4z689Iw6E28M_1iKUSuuRjQlwXWbD3k7t8qLW9QopGVpInouPeQGrtklWehe3Zn8KDqH8w5dE Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3d318640c324584849662c9c0c3f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3d318640c324584849662c9c0c3f738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: e76c71bf09c14722b5d04ec4baa96eaf Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '14419607-9e5b-4d97-a461-46537f47ca43'} Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:18.988479 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Returning 404 to user: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-623c9f4b-8bb7-4cfa-8c17-e902e6d12c63 tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 404 len: 111 microversion: 2.1 time: 0.043343 Sep 18 01:13:18.993676 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1317/2717] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:18 2022] DELETE /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:18.998731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:18.999479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] [instance: 14419607-9e5b-4d97-a461-46537f47ca43] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:19.006498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:19.009649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:19.010219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:19.011151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:19.011828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:19.012307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:19.030900 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] HTTP exception thrown: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Request method failure captured: Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 HTTP/1.1 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnB-QghtjnRDQ2tlkB0deZzVyZiAW0IwSpc_EgD1O1guDBzG8RagirwN3LmuArvhjBZf-lKMgFfKVKqEuWSY4IyEkXoOfnyUw6XkOi4z689Iw6E28M_1iKUSuuRjQlwXWbD3k7t8qLW9QopGVpInouPeQGrtklWehe3Zn8KDqH8w5dE Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3d318640c324584849662c9c0c3f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3d318640c324584849662c9c0c3f738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3d318640c324584849662c9c0c3f738"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f3d318640c324584849662c9c0c3f738 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1939092911 Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: e76c71bf09c14722b5d04ec4baa96eaf Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesNegativeTestJSON-1939092911-project Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '14419607-9e5b-4d97-a461-46537f47ca43'} Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:19.033089 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] Returning 404 to user: Instance 14419607-9e5b-4d97-a461-46537f47ca43 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94e5f12c-2601-47c1-b8b6-0063531e461c tempest-ImagesNegativeTestJSON-1939092911 tempest-ImagesNegativeTestJSON-1939092911-project] 10.222.0.25 "GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43" status: 404 len: 111 microversion: 2.1 time: 0.041010 Sep 18 01:13:19.039170 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1318/2718] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:18 2022] GET /compute/v2.1/servers/14419607-9e5b-4d97-a461-46537f47ca43 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:19.205774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:19.207365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:19.215072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:19.215836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:19.216530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:19.217540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:19.218204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:19.218866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:19.466097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:19.478377 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57fa74c1-dda8-4ed0-8e18-40d2efef74a1 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1317 microversion: 2.1 time: 0.280034 Sep 18 01:13:19.496570 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1319/2719] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:19 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:19.620275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:19.621100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:19.632446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:19.634821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:19.635591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:19.637085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:19.638529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:19.640822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:19.988137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:20.009240 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bad4002a-2cd0-44a9-9a5c-ed541e2c7990 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 200 len: 1319 microversion: 2.1 time: 0.396410 Sep 18 01:13:20.021758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1320/2720] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:19 2022] GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:20.031407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:20.033480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:20.061709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:20.062213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:20.062657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:20.063368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:20.063835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:20.064258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:20.195476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:20.246019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:20.249859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:20.257909 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-093c13aa-6006-4b90-affb-50896eab19f4 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.234010 Sep 18 01:13:20.259230 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1321/2721] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:20 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:20.441835 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64112d0b-e8a3-4601-93fe-c0efe8d926df tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10305 microversion: 2.1 time: 3.136942 Sep 18 01:13:20.457634 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1401/2722] 10.222.0.25 () {58 vars in 1191 bytes} [Sun Sep 18 01:13:17 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10305 bytes in 3145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:13:20.468892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fbf07dd9-5128-423b-be08-9e1eaf872460 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] Calling method '.version_select at 0x7f70055bee50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:20.505495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:20.506419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:20.520095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:20.523352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:20.523965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:20.525524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:20.526708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:20.527680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:20.863661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:20.879245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a64075c6-771c-45ab-a23f-c4bf755f0c69 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1506 microversion: 2.1 time: 0.378161 Sep 18 01:13:20.902778 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1402/2723] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:20 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:20.908940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:20.909942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:20.919646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:20.920463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:20.921124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:20.922432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:20.923692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:20.927186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.009302 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fbf07dd9-5128-423b-be08-9e1eaf872460 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.545184 Sep 18 01:13:21.010521 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1322/2724] 10.222.0.25 () {58 vars in 1191 bytes} [Sun Sep 18 01:13:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:21.013407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba38457c-1cb5-44e8-a4e8-53224107c32d tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7/ips" status: 200 len: 109 microversion: 2.1 time: 0.109166 Sep 18 01:13:21.014028 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1403/2725] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:13:20 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7/ips => generated 109 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:21.027709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.028215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:21.038014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14128533-d0f6-4934-9e8f-24e3433b02d7 tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] Calling method '.version_select at 0x7f70061c3a60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.045613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.046113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.046555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.047269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.047726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.048150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.082232 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5d7ca31d-157d-442f-99e0-d6861e9521f2 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7/ips" status: 200 len: 109 microversion: 2.1 time: 0.059251 Sep 18 01:13:21.083523 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1323/2726] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:13:21 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7/ips => generated 109 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:21.088757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.089883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:21.097338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.098300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.099004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.099966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.100653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.101294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.366486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:21.374209 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0edaad67-424b-4177-9c26-abd0ec680100 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 200 len: 1319 microversion: 2.1 time: 0.289299 Sep 18 01:13:21.385068 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1324/2727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:21 2022] GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:21.396439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.397311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:21.404121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.404913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.405610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.406635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.407327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.408062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.435221 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a8a96ff-a9b1-4456-a83e-3861dffddd59 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7/ips/tempest-ServerAddressesTestJSON-1961257789-network" status: 200 len: 94 microversion: 2.1 time: 0.048385 Sep 18 01:13:21.443721 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1325/2728] 10.222.0.25 () {58 vars in 1401 bytes} [Sun Sep 18 01:13:21 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7/ips/tempest-ServerAddressesTestJSON-1961257789-network => generated 94 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:13:21.450875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.451840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:21.467051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.468422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.469060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.470269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.471186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.473119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.486961 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14128533-d0f6-4934-9e8f-24e3433b02d7 tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/609d2e35-5ca6-4c6d-82a5-f7cf402ee9a9" status: 202 len: 0 microversion: 2.1 time: 0.453958 Sep 18 01:13:21.487604 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1404/2729] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:13:21 2022] DELETE /compute/v2.1/os-security-groups/609d2e35-5ca6-4c6d-82a5-f7cf402ee9a9 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:13:21.497127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.498001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:21.506441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.508260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.508964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.509973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.510675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.514177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.584347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:21.596004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:13:21.596281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:21.598639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:21.605590 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef3d0d6a-d9b1-4056-bd33-9648b63f363d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.159035 Sep 18 01:13:21.615113 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1326/2730] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:21 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:21.636791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc3f783c-2a7d-47f4-a20b-0680230809f8 tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] Calling method '.version_select at 0x7f70055459d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.671331 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:21.771762 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ecf1d130-59b8-41b1-a112-d40f69900d21 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 204 len: 0 microversion: 2.1 time: 0.279503 Sep 18 01:13:21.777937 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1405/2731] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:21 2022] DELETE /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:13:21.794070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:21.795242 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:21.805097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.805630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.806079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:21.806857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:21.807413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:21.807846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:22.240128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:22.252715 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1e0650e5-1383-480c-a1ec-8453f8d48f8e tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1512 microversion: 2.1 time: 0.473016 Sep 18 01:13:22.253895 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1406/2732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:21 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:22.262357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3734ea01-d03e-4bb4-96e8-3a29a750afcb req-d6acbca8-beea-436a-aa05-5da26d89032a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ea7ea2-c022-49dd-95f7-03d51d0d299b", "name": "network-vif-plugged", "status": "completed", "tag": "f21ff885-5954-4d63-b965-53cb8314d910"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:22.287652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3734ea01-d03e-4bb4-96e8-3a29a750afcb req-d6acbca8-beea-436a-aa05-5da26d89032a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:22.288204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3734ea01-d03e-4bb4-96e8-3a29a750afcb req-d6acbca8-beea-436a-aa05-5da26d89032a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:22.288639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3734ea01-d03e-4bb4-96e8-3a29a750afcb req-d6acbca8-beea-436a-aa05-5da26d89032a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:22.320654 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3734ea01-d03e-4bb4-96e8-3a29a750afcb req-d6acbca8-beea-436a-aa05-5da26d89032a service nova] Creating event network-vif-plugged:f21ff885-5954-4d63-b965-53cb8314d910 for instance c7ea7ea2-c022-49dd-95f7-03d51d0d299b on n-h2-master-1 Sep 18 01:13:22.332057 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3734ea01-d03e-4bb4-96e8-3a29a750afcb req-d6acbca8-beea-436a-aa05-5da26d89032a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073066 Sep 18 01:13:22.334004 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1407/2733] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:22.368763 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc3f783c-2a7d-47f4-a20b-0680230809f8 tempest-SecurityGroupsTestAdminJSON-1607665811 tempest-SecurityGroupsTestAdminJSON-1607665811-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3abf5ec4-6517-4b47-87d5-b4e6de5fb857" status: 202 len: 0 microversion: 2.1 time: 0.752132 Sep 18 01:13:22.370053 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1327/2734] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:13:21 2022] DELETE /compute/v2.1/os-security-groups/3abf5ec4-6517-4b47-87d5-b4e6de5fb857 => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:13:22.380920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eaec93d2-f52d-4709-b84b-33a34a3cbfd7 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] Calling method '.version_select at 0x7f700678be50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:22.427927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:22.428719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:22.453998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:22.460876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:22.463919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:22.464875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:22.465376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:22.474174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:22.831215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:22.841049 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-178f2732-700c-4e1c-a285-8c18d6d80541 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 200 len: 1319 microversion: 2.1 time: 0.442717 Sep 18 01:13:22.854000 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1328/2735] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:22 2022] GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:22.862999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:22.864289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:22.872459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:22.872459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:22.872459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:22.872877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:22.873190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:22.873896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:23.015794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:23.038641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:23.043752 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:23.051944 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-08222a99-a8dd-40d9-8598-644294cc585f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.194970 Sep 18 01:13:23.053098 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1329/2736] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:22 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:23.192870 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eaec93d2-f52d-4709-b84b-33a34a3cbfd7 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3c5a5ed4-126b-4aa1-95e1-ce0c834d1995" status: 202 len: 0 microversion: 2.1 time: 0.817375 Sep 18 01:13:23.194124 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1408/2737] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:13:22 2022] DELETE /compute/v2.1/os-security-groups/3c5a5ed4-126b-4aa1-95e1-ce0c834d1995 => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:13:23.204498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1ee157d-789b-482f-86d5-c41349cd9414 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] Calling method '.version_select at 0x7f70055be4c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:23.281645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:23.285472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:23.296508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:23.297800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:23.298402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:23.299286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:23.299966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:23.300691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:24.202446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:24.217797 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0519e43f-c581-4b65-9b3b-b6c1d22b3004 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1512 microversion: 2.1 time: 0.945081 Sep 18 01:13:24.231889 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1409/2738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:23 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1512 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:24.243403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:24.244410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:24.251253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:24.253381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:24.254157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:24.255158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:24.255855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:24.256513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:24.755409 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1ee157d-789b-482f-86d5-c41349cd9414 tempest-SecurityGroupsTestAdminJSON-1207280694 tempest-SecurityGroupsTestAdminJSON-1207280694-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/bc01c8b6-42ba-4f46-af5d-e0cb3117a49e" status: 202 len: 0 microversion: 2.1 time: 1.556263 Sep 18 01:13:24.757029 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1330/2739] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:13:23 2022] DELETE /compute/v2.1/os-security-groups/bc01c8b6-42ba-4f46-af5d-e0cb3117a49e => generated 0 bytes in 1559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:13:24.771089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:24.771936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:24.789176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:24.805013 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5cd8208-916f-47f1-83d9-c160a29d8f17 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 200 len: 1319 microversion: 2.1 time: 0.565499 Sep 18 01:13:24.826288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:24.827471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:24.829211 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1410/2740] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:24 2022] GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:24.832086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:24.837478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:24.840305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:24.840493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:24.840987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:24.850647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:24.874946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:24.875772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:24.880622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:24.881627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:24.883706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:24.884899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:25.078797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:25.094131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:25.099070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:25.114203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dfc35a38-b09a-4f77-aa4d-b72e95036793 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.283073 Sep 18 01:13:25.115840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1411/2741] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:24 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:25.182263 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] HTTP exception thrown: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Request method failure captured: Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 HTTP/1.1 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJm_8QlH4j1FQXRay8ZwFGLTUJwHK-kG9lnGngAg9ZiLqbjxh7qCgBTYBH1NzDWVeMfUYqVoCb3c69W87K3WQLrbUX3yxV8dij9qzFwccnJQknVu98Eqm_bjKFaN3veRpX0zz9DULvTJDA-T27gc2NI4qK1OQHhLi0I5YtBaC4jQA9ko Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 97543cfd30dd47fcb01cebef908f6fd7 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 97543cfd30dd47fcb01cebef908f6fd7 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachSCSIVolumeTestJSON-1362301258-project Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 15a63fcd25ee41c49edd383ee07a8821 Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1362301258-project Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3fe0782b-0f74-4f86-abe4-58361c819a84'} Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:25.183971 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Returning 404 to user: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9a0279c-b46a-4d1c-a1bb-22441aa3906c tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 404 len: 111 microversion: 2.1 time: 0.421616 Sep 18 01:13:25.190202 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1331/2742] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:24 2022] DELETE /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 111 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:25.203034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:25.203655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] [instance: 3fe0782b-0f74-4f86-abe4-58361c819a84] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:25.209852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:25.210346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:25.210788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:25.211493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:25.211948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:25.212369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:25.226721 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] HTTP exception thrown: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Request method failure captured: Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 HTTP/1.1 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJm_8QlH4j1FQXRay8ZwFGLTUJwHK-kG9lnGngAg9ZiLqbjxh7qCgBTYBH1NzDWVeMfUYqVoCb3c69W87K3WQLrbUX3yxV8dij9qzFwccnJQknVu98Eqm_bjKFaN3veRpX0zz9DULvTJDA-T27gc2NI4qK1OQHhLi0I5YtBaC4jQA9ko Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 97543cfd30dd47fcb01cebef908f6fd7 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97543cfd30dd47fcb01cebef908f6fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 97543cfd30dd47fcb01cebef908f6fd7 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1362301258 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachSCSIVolumeTestJSON-1362301258-project Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 15a63fcd25ee41c49edd383ee07a8821 Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1362301258-project Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3fe0782b-0f74-4f86-abe4-58361c819a84'} Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:25.228372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] Returning 404 to user: Instance 3fe0782b-0f74-4f86-abe4-58361c819a84 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-383150ab-b146-4999-b7f8-c2fd3bf28efc tempest-AttachSCSIVolumeTestJSON-1362301258 tempest-AttachSCSIVolumeTestJSON-1362301258-project] 10.222.0.25 "GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84" status: 404 len: 111 microversion: 2.1 time: 0.039213 Sep 18 01:13:25.232406 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1412/2743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:25 2022] GET /compute/v2.1/servers/3fe0782b-0f74-4f86-abe4-58361c819a84 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:13:25.247143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:25.248516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:25.262032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:25.262791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:25.263455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:25.269090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:25.269837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:25.270278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:25.467358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62a736f71924817917eef8956e1d1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6932b64a9ceb4c02a9c2b88f0e6bd6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:25.471143 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:25.496890 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c863b2e1-4752-4bdd-8d34-426f72320379 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 200 len: 1470 microversion: 2.1 time: 0.253736 Sep 18 01:13:25.498933 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1332/2744] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:25 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 1470 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:25.557869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a1977409-c154-4074-adcd-f18a40147aef req-2db830f9-5132-4b9b-a0ab-f245c5ef10d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a43dd2c-8b3c-4787-aeb6-62046d789cb7", "name": "network-vif-deleted", "tag": "4ed1bd26-c29d-43a7-b3e9-935a4ad7ea9a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:25.580999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a1977409-c154-4074-adcd-f18a40147aef req-2db830f9-5132-4b9b-a0ab-f245c5ef10d1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:25.585743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a1977409-c154-4074-adcd-f18a40147aef req-2db830f9-5132-4b9b-a0ab-f245c5ef10d1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:25.586329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a1977409-c154-4074-adcd-f18a40147aef req-2db830f9-5132-4b9b-a0ab-f245c5ef10d1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:25.619835 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a1977409-c154-4074-adcd-f18a40147aef req-2db830f9-5132-4b9b-a0ab-f245c5ef10d1 service nova] Creating event network-vif-deleted:4ed1bd26-c29d-43a7-b3e9-935a4ad7ea9a for instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 on n-h1-master-1 Sep 18 01:13:25.625014 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a1977409-c154-4074-adcd-f18a40147aef req-2db830f9-5132-4b9b-a0ab-f245c5ef10d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072517 Sep 18 01:13:25.626250 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1413/2745] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:13:25.853346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:25.853985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:25.879098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:25.879604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:25.880878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:25.881633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:25.883778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:25.884584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.150523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:26.151515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:26.154546 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:26.158808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.159326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.159980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.161024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.161475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.161916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.262561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:26.277161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:26.278648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:26.289030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:26.294080 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-607b3682-2cc8-409c-abcf-9707769d3449 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.150029 Sep 18 01:13:26.294870 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1414/2746] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:26 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:13:26.333799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ce588442-e495-4cc8-9f60-499a3dfae904 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 200 len: 1507 microversion: 2.1 time: 0.481917 Sep 18 01:13:26.338071 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1333/2747] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:25 2022] GET /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:26.368595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:26.369499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:26.380615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.381255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.381868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.383200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.384401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.385262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.435317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: c7ea7ea2-c022-49dd-95f7-03d51d0d299b] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:13:26.530737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:26.532867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] [instance: 4a43dd2c-8b3c-4787-aeb6-62046d789cb7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:26.570804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.574239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.577635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.580880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.582635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.583336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.597855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ead36445-97ee-447f-bea8-947a2de0a7e5 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b" status: 204 len: 0 microversion: 2.1 time: 0.236939 Sep 18 01:13:26.601065 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1415/2748] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:26 2022] DELETE /compute/v2.1/servers/c7ea7ea2-c022-49dd-95f7-03d51d0d299b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:13:26.606891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] HTTP exception thrown: Instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 could not be found. Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Request method failure captured: Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 HTTP/1.1 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnCWZ0y68LPM4L4uL9QIwr1SXfOtj5-8pt3g1XmSmFMG4PCdlX12LixYa8M8WaEdkbs_45rP0EZymKGfoi_u1amFSUBdwmhdrjZhSL6YvEx0xtft5l4_VvfgTZ-4NeLrzwH3hb2npZK0ThRPlAf2lXnwJ40vzT0EPotPjtHFi5_CADk Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 6932b64a9ceb4c02a9c2b88f0e6bd6e0 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerAddressesTestJSON-1526107565 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6932b64a9ceb4c02a9c2b88f0e6bd6e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6932b64a9ceb4c02a9c2b88f0e6bd6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6932b64a9ceb4c02a9c2b88f0e6bd6e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6932b64a9ceb4c02a9c2b88f0e6bd6e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerAddressesTestJSON-1526107565 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 6932b64a9ceb4c02a9c2b88f0e6bd6e0 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1526107565 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerAddressesTestJSON-1526107565-project Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a62a736f71924817917eef8956e1d1f7 Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerAddressesTestJSON-1526107565-project Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 could not be found. Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4a43dd2c-8b3c-4787-aeb6-62046d789cb7'} Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 could not be found. Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 could not be found. Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:26.609964 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:26.614115 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:26.614115 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:26.614115 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:26.614115 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:26.614115 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:26.614115 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 could not be found. Sep 18 01:13:26.614115 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:26.617089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] Returning 404 to user: Instance 4a43dd2c-8b3c-4787-aeb6-62046d789cb7 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:26.617260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:26.618442 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50b8dd77-59f0-4a1d-bc5f-bb81eb0d5442 tempest-ServerAddressesTestJSON-1526107565 tempest-ServerAddressesTestJSON-1526107565-project] 10.222.0.25 "GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7" status: 404 len: 111 microversion: 2.1 time: 0.099621 Sep 18 01:13:26.619195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:26.619996 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1334/2749] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:26 2022] GET /compute/v2.1/servers/4a43dd2c-8b3c-4787-aeb6-62046d789cb7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:26.638575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.639277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.640306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.642315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:26.643303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:26.644836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:26.681473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 58c57d28-5a88-409c-8c43-5ac674244394] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:13:26.824160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c1f7a752-e5e8-4841-8420-9199c55e5345 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394" status: 204 len: 0 microversion: 2.1 time: 0.216492 Sep 18 01:13:26.825348 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1416/2750] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:26 2022] DELETE /compute/v2.1/servers/58c57d28-5a88-409c-8c43-5ac674244394 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:13:27.018341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1026269166", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "cc1cff88-5510-4ad1-92ea-097319862331"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:27.111606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] validate_networks() for [('cc1cff88-5510-4ad1-92ea-097319862331', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:13:27.326380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:27.327085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:27.344879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:27.345378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:27.345847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:27.347083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:27.347549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:27.348153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:27.463549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:27.476584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:27.479067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:27.492784 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a851ff9-e6ab-4382-8b90-7818db69a8ba tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.169693 Sep 18 01:13:27.507802 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1417/2751] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:27 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:28.533755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:28.536053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:28.545154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:28.545942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:28.546626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:28.547803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:28.548469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:28.549107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:28.787791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:28.805671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:28.807810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:28.819719 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-442dca8a-ea59-4edd-a01c-a4f24fd9531a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.296351 Sep 18 01:13:28.843989 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1418/2752] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:28 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:29.183745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:13:29.186720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:13:29.186720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:13:29.186720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:13:29.186720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:13:29.201134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:29.201681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:29.202130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:29.202883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:29.203342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:29.203759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:29.256441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Getting quotas for project e4259c8d88db43eebf164b306b70eb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:13:29.277039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Getting quotas for user d3e40fd9dbb94f8fa23a5b7c8a16be83 and project e4259c8d88db43eebf164b306b70eb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:13:29.309408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Going to run 2 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:13:29.312963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:13:29.407011 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=579347bb-656a-4e42-8726-832cc1586181,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:13:29.541020 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26bbd50f-33b9-4774-b80b-bcef9a74bdaf tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.530397 Sep 18 01:13:29.544323 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1335/2753] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:13:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 2535 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 18 01:13:29.552349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:29.561152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:29.562518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Searching by: {'deleted': False, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:13:29.600955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:29.603983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:29.610048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:29.635098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:29.637687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:29.638224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:29.678972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:13:29.729292 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-54adf59b-212a-41d9-82a3-9af6c7018386 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.179792 Sep 18 01:13:29.729292 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1419/2754] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:13:29 2022] GET /compute/v2.1/servers => generated 1335 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:29.741974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-24a0b3fe-4e66-4ed1-824e-1dc09f02c3fb tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:29.743034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-24a0b3fe-4e66-4ed1-824e-1dc09f02c3fb tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:29.771354 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:29.851985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:29.852754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:29.862667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:29.865143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:29.880895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:29.884475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:29.886347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:29.888999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:30.076454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-24a0b3fe-4e66-4ed1-824e-1dc09f02c3fb tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:30.085817 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-24a0b3fe-4e66-4ed1-824e-1dc09f02c3fb tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1218 microversion: 2.1 time: 0.348800 Sep 18 01:13:30.086403 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1336/2755] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:29 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:30.207377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:30.215778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:30.217230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:30.231552 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68ad1b35-9167-4851-bf82-96a959c7afca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.385127 Sep 18 01:13:30.232152 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1420/2756] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:29 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:13:30.623869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1460986719", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:30.715217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:13:31.110510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:31.111132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:31.127043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:31.130158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:31.132342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:31.134475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:31.141067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:31.143015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:31.172519 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:31.362555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:31.386677 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dfea0a0a-5f6c-4ae1-bcc2-1218fb5a3ae9 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1222 microversion: 2.1 time: 0.280681 Sep 18 01:13:31.387621 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1421/2757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:31 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:31.421693 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-77b663ec-9856-4d2e-aef5-d14bec91cf50 req-a1b52a3f-727e-4308-a705-6487203ced29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c57d28-5a88-409c-8c43-5ac674244394", "name": "network-vif-deleted", "tag": "a01c2ac5-d5c2-457d-b180-e1a6ce4613c3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:31.453931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-77b663ec-9856-4d2e-aef5-d14bec91cf50 req-a1b52a3f-727e-4308-a705-6487203ced29 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:31.455130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-77b663ec-9856-4d2e-aef5-d14bec91cf50 req-a1b52a3f-727e-4308-a705-6487203ced29 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:31.460784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-77b663ec-9856-4d2e-aef5-d14bec91cf50 req-a1b52a3f-727e-4308-a705-6487203ced29 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:31.513848 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-77b663ec-9856-4d2e-aef5-d14bec91cf50 req-a1b52a3f-727e-4308-a705-6487203ced29 service nova] Creating event network-vif-deleted:a01c2ac5-d5c2-457d-b180-e1a6ce4613c3 for instance 58c57d28-5a88-409c-8c43-5ac674244394 on n-h1-master-1 Sep 18 01:13:31.530980 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-77b663ec-9856-4d2e-aef5-d14bec91cf50 req-a1b52a3f-727e-4308-a705-6487203ced29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128963 Sep 18 01:13:31.538143 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1422/2758] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:31.544941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:31.546294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:31.555862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:31.558310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:31.558967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:31.564485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:31.567341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:31.568706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:31.647964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:13:31.648517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:13:31.649214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:13:31.649840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:13:31.650523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:13:31.682754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:31.689743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:31.691123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:31.692045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:31.695183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:31.696723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:31.739617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Getting quotas for project cab15a2304c04037b46d23ac68d2c75d. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:13:31.746910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Getting quotas for user 56325b0791c442ada71d064a826b4a6e and project cab15a2304c04037b46d23ac68d2c75d. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:13:31.767964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:13:31.773028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:13:31.840113 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-29c3db96-f418-4094-bef2-31fa2f02c292 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534501 Sep 18 01:13:31.849977 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1337/2759] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:13:31.902415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:31.923706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:31.928704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:31.938401 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-679fea56-7300-42cc-8cfc-f63486807c51 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.398559 Sep 18 01:13:31.939201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1423/2760] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:31 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:31.973788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-989f6178-4a70-4bc1-8ab2-b46600ed3dd0 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:31.974614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-989f6178-4a70-4bc1-8ab2-b46600ed3dd0 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:32.236079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b61c5de0-12b9-48d9-bc64-11dc7a5af631 tempest-ListImageFiltersNegativeTestJSON-1121713459 tempest-ListImageFiltersNegativeTestJSON-1121713459-project] Calling method '.version_select at 0x7f70063b2dc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:32.265525 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b61c5de0-12b9-48d9-bc64-11dc7a5af631 tempest-ListImageFiltersNegativeTestJSON-1121713459 tempest-ListImageFiltersNegativeTestJSON-1121713459-project] HTTP exception thrown: Image not found. Sep 18 01:13:32.267507 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-989f6178-4a70-4bc1-8ab2-b46600ed3dd0 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b61c5de0-12b9-48d9-bc64-11dc7a5af631 tempest-ListImageFiltersNegativeTestJSON-1121713459 tempest-ListImageFiltersNegativeTestJSON-1121713459-project] Request method failure captured: Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/images/a385a953-2c26-40a6-ae8c-00f6eacebd43 HTTP/1.1 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnC74vtfTXPHRYZJV2kkGs4YU4eAtMa-WOMquAU8-s4liiwai4GNpkaGQ728wuxKT8rO3TLdMtWCj_1RyMIyr2X8I0tTD82-Ja3GPjs9wcFzLlnpBFkpSNecX61HeKWwT_VeXrGzIy-aWvHjBoofWGLBDkvFMyUmwuABG7L4gT4GI6o Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 05148d3772334d41aa95cabf5c1cf273 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1121713459 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05148d3772334d41aa95cabf5c1cf273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05148d3772334d41aa95cabf5c1cf273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05148d3772334d41aa95cabf5c1cf273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05148d3772334d41aa95cabf5c1cf273"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1121713459 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 05148d3772334d41aa95cabf5c1cf273 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1121713459 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ListImageFiltersNegativeTestJSON-1121713459-project Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 7527b40a12aa44ac8f0332cc92838282 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1121713459-project Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'a385a953-2c26-40a6-ae8c-00f6eacebd43'} Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a385a953-2c26-40a6-ae8c-00f6eacebd43 Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:13:32.269534 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a385a953-2c26-40a6-ae8c-00f6eacebd43 could not be found. Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:13:32.274716 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:32.282986 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-989f6178-4a70-4bc1-8ab2-b46600ed3dd0 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1223 microversion: 2.1 time: 0.322051 Sep 18 01:13:32.284559 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b61c5de0-12b9-48d9-bc64-11dc7a5af631 tempest-ListImageFiltersNegativeTestJSON-1121713459 tempest-ListImageFiltersNegativeTestJSON-1121713459-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:32.285809 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b61c5de0-12b9-48d9-bc64-11dc7a5af631 tempest-ListImageFiltersNegativeTestJSON-1121713459 tempest-ListImageFiltersNegativeTestJSON-1121713459-project] 10.222.0.25 "GET /compute/v2.1/images/a385a953-2c26-40a6-ae8c-00f6eacebd43" status: 404 len: 62 microversion: 2.1 time: 0.433151 Sep 18 01:13:32.286868 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1338/2761] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:13:31 2022] GET /compute/v2.1/images/a385a953-2c26-40a6-ae8c-00f6eacebd43 => generated 62 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:13:32.299668 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1424/2762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:31 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1223 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:32.423750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:32.425399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:32.439754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:32.443972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:32.444893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:32.450694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:32.451380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:32.451693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:32.637927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:32.668583 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe7d877c-39a6-47cc-abb6-f88f8d456636 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1214 microversion: 2.1 time: 0.259133 Sep 18 01:13:32.673476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1339/2763] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:32 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:32.978281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:32.979371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:33.013173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:33.019458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:33.020017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:33.024353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:33.028351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:33.032740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:33.315745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:33.316908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:33.332260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:33.333173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:33.333867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:33.334822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:33.346903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:33.347797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:33.903841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:33.913968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:33.915445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:33.922423 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b463de12-5144-4f57-ba08-fc5dc4333a93 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.955885 Sep 18 01:13:33.923287 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1425/2764] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:32 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:33.928155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:33.928778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:33.945885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:33.946394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:33.946840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:33.947617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:33.948325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:33.948717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.106072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:34.116699 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1634b732-204b-4c8c-abb9-74b6a8c8f977 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1219 microversion: 2.1 time: 0.804899 Sep 18 01:13:34.129578 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1340/2765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:33 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1219 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:34.137367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8f083880-2c6e-4c90-848b-f2659292fde2 req-87172aa1-664b-4f8a-b988-4c86006d7b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ea7ea2-c022-49dd-95f7-03d51d0d299b", "name": "network-vif-deleted", "tag": "f21ff885-5954-4d63-b965-53cb8314d910"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:34.152008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8f083880-2c6e-4c90-848b-f2659292fde2 req-87172aa1-664b-4f8a-b988-4c86006d7b17 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.152579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8f083880-2c6e-4c90-848b-f2659292fde2 req-87172aa1-664b-4f8a-b988-4c86006d7b17 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.152924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8f083880-2c6e-4c90-848b-f2659292fde2 req-87172aa1-664b-4f8a-b988-4c86006d7b17 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.173434 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8f083880-2c6e-4c90-848b-f2659292fde2 req-87172aa1-664b-4f8a-b988-4c86006d7b17 service nova] Creating event network-vif-deleted:f21ff885-5954-4d63-b965-53cb8314d910 for instance c7ea7ea2-c022-49dd-95f7-03d51d0d299b on n-h2-master-1 Sep 18 01:13:34.176682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:34.181962 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8f083880-2c6e-4c90-848b-f2659292fde2 req-87172aa1-664b-4f8a-b988-4c86006d7b17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061665 Sep 18 01:13:34.182620 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1341/2766] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:34.191175 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b209aee-0bb9-464f-8002-5c315e054b31 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1288 microversion: 2.1 time: 0.265994 Sep 18 01:13:34.191945 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1426/2767] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:33 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1288 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:34.193159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:34.199411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:34.200996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Searching by: {'deleted': False, 'project_id': '622cbbf586594b449c1573f8d529aa5c'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:13:34.214128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.216730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.217492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.221106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.221646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.222273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.256541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:13:34.292015 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6aea07e5-36c6-4218-abdd-0a6a66c371b0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 331 microversion: 2.1 time: 0.107782 Sep 18 01:13:34.292900 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1342/2768] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:13:34 2022] GET /compute/v2.1/servers => generated 331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:34.307917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:34.314006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:34.315723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Searching by: {'deleted': False, 'project_id': '622cbbf586594b449c1573f8d529aa5c'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:13:34.323191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.323869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.324471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.325386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.326036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.326654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.371710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:13:34.422036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:34.432589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.434168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.434168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.751463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3529b022-1725-46f3-9fee-f72f60e7ac29 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.446876 Sep 18 01:13:34.766385 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1427/2769] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:13:34 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:34.781024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f15f76d-52ed-44b2-998c-f281e02e9b5e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:34.791835 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f15f76d-52ed-44b2-998c-f281e02e9b5e tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016283 Sep 18 01:13:34.803908 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1343/2770] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:13:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:34.955354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:34.957429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:34.965570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.966454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.967156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:34.968245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:34.969422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:34.970165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.104530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:35.116872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:35.119379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:35.126245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88159c89-cbff-4df8-a22e-437abc8feabd tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.177054 Sep 18 01:13:35.127459 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1428/2771] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:34 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:35.153785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:35.154728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:35.160159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:35.161275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:35.169046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.170546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.171177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.171333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.171920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.172718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.173651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.173924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.174654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.177893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.178412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.178785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.278355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:13:35.294112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:35.317127 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4ab015e-9e8b-44de-8676-53226cf9bf7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1281 microversion: 2.1 time: 0.178027 Sep 18 01:13:35.335516 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1344/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:35 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:35.345069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:35.354063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:35.370407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.371311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.372300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.373200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.374042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.374639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.520773 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3647abdd-2ec8-4c83-8906-f2dc98931190 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 204 len: 0 microversion: 2.1 time: 0.364933 Sep 18 01:13:35.525407 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1429/2773] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:13:35 2022] DELETE /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:13:35.544788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:35.547648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:35.578566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.579674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.580137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.582091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:35.584076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:35.585436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:35.818241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:35.831476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-241bafdd-0d4c-4e7f-830c-1c2cde6ca304 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1276 microversion: 2.1 time: 0.493847 Sep 18 01:13:35.833006 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1345/2774] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:35 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1276 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:36.055429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:36.070089 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe8232a1-5423-47f0-aafc-00b4847a64ed tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1698 microversion: 2.1 time: 0.538563 Sep 18 01:13:36.071001 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1430/2775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:35 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1698 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:36.162992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:36.164241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:36.175695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:36.177439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:36.178934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:36.181313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:36.184610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:36.188232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:36.360738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:36.361251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:36.374081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:36.374600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:36.375046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:36.375778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:36.376237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:36.376667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:36.463691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:36.476379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:36.479576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:36.508516 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72cdd05f-39ed-420c-acec-e099adfef810 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.338872 Sep 18 01:13:36.510388 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1346/2776] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:36 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:36.527677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:36.544778 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d5c0f77-c9bb-467a-bee2-ae71f6ec3b87 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1281 microversion: 2.1 time: 0.187791 Sep 18 01:13:36.544778 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1431/2777] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:36 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:36.857502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:36.858363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:36.865894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:36.867250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:36.868230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:36.869443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:36.870138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:36.870777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:37.095059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:37.095669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:37.102864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:37.103942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:37.104567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:37.105352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:37.106042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:37.106497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:37.231456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:37.243502 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9272a6c1-632c-4007-8eb9-b04b7ad62474 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.391607 Sep 18 01:13:37.250533 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1347/2778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:36 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:37.542808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:37.544238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:37.554858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:37.556904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:37.557462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:37.557842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:37.558738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:37.559381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:37.559970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:37.569915 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19bed330-ff92-4d74-8d5c-0de249c1fb18 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1698 microversion: 2.1 time: 0.478801 Sep 18 01:13:37.570711 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1432/2779] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:37 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1698 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:37.579516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:37.580368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:37.604759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:37.606217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:37.607484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:37.608530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:37.609194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:37.609858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:37.816555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:37.826202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:37.828242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:37.835273 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65b3a955-2113-4080-855d-ba2eb2122aee tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.296591 Sep 18 01:13:37.836615 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1348/2780] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:37 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:37.872131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:37.886370 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f58bb7f6-7e32-42a6-96e4-d12f8d5a8231 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1281 microversion: 2.1 time: 0.313570 Sep 18 01:13:37.898061 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1433/2781] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:37 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1281 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:38.269736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:38.270292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:38.282470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:38.286898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:38.287719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:38.296180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:38.297064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:38.297997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:38.598353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:38.600108 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:38.607297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:38.608164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:38.608758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:38.609872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:38.610522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:38.611104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:39.023959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:39.036048 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc329dcf-b217-483a-91b4-603107b54142 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.770444 Sep 18 01:13:39.037728 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1349/2782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:38 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:39.045384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:39.046363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:39.054089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:39.055187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:39.055818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:39.056717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:39.057800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:39.058388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:39.247867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:39.261254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:39.263196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:39.270584 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a916fde6-516d-49c5-b6b3-33e8114223fc tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.231555 Sep 18 01:13:39.272599 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1350/2783] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:39 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:39.278471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:39.279714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:39.288336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:39.289096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:39.290005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:39.290937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:39.291555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:39.292333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:39.340303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:39.353788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa80bee7-e7a4-401e-a813-939bf0467395 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1698 microversion: 2.1 time: 0.759391 Sep 18 01:13:39.366368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1434/2784] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:38 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1698 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:39.920154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-016dfbc6-26c0-47af-8d8b-d7abc57c4f23 req-8d15b612-c2ec-41ee-aa94-b2bca2b51f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579347bb-656a-4e42-8726-832cc1586181", "tag": "9965b575-7ed3-47cf-a489-3c4269655ddb"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:39.943644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-016dfbc6-26c0-47af-8d8b-d7abc57c4f23 req-8d15b612-c2ec-41ee-aa94-b2bca2b51f7a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:39.945082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-016dfbc6-26c0-47af-8d8b-d7abc57c4f23 req-8d15b612-c2ec-41ee-aa94-b2bca2b51f7a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:39.946154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-016dfbc6-26c0-47af-8d8b-d7abc57c4f23 req-8d15b612-c2ec-41ee-aa94-b2bca2b51f7a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:39.968604 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-016dfbc6-26c0-47af-8d8b-d7abc57c4f23 req-8d15b612-c2ec-41ee-aa94-b2bca2b51f7a service nova] Creating event network-changed:9965b575-7ed3-47cf-a489-3c4269655ddb for instance 579347bb-656a-4e42-8726-832cc1586181 on n-h2-master-1 Sep 18 01:13:39.974340 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-016dfbc6-26c0-47af-8d8b-d7abc57c4f23 req-8d15b612-c2ec-41ee-aa94-b2bca2b51f7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063460 Sep 18 01:13:39.975491 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1435/2785] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:13:40.063546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:40.065722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:40.074349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:40.075138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:40.076033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:40.077689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:40.078330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:40.079788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:40.212959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:40.230102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7d34e7d-3a74-4525-b9d8-a532f237bec7 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 0.955977 Sep 18 01:13:40.248899 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1351/2786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:39 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:40.305493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:40.307923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:40.329362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:40.330608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:40.331182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:40.336363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:40.337738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:40.339727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:40.534658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:40.563261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:40.572466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:40.597015 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9b845782-3124-407a-b2b2-6e905ba030c2 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.296059 Sep 18 01:13:40.597911 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1352/2787] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:40 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:40.615581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:40.616411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:40.633140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:40.633836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:40.635345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:40.636973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:40.637855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:40.638589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:40.817452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:40.837820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-57c7025f-bbec-44a6-b4da-65a860378724 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.778723 Sep 18 01:13:40.860075 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1436/2788] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:40 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:40.888239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8f0154a6-b0f6-434d-ae19-aa6aa2f76006 req-996a2d78-ab05-4d33-8f1c-2c56d957c67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca1030d-871a-43de-af46-18b99b422d0f", "name": "network-vif-deleted", "tag": "755104d6-aa9f-4ced-b539-e60876e51bd0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:40.920023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8f0154a6-b0f6-434d-ae19-aa6aa2f76006 req-996a2d78-ab05-4d33-8f1c-2c56d957c67c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:40.921717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9bd3c0c4524c51b919a38238e79d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622cbbf586594b449c1573f8d529aa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:40.922534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8f0154a6-b0f6-434d-ae19-aa6aa2f76006 req-996a2d78-ab05-4d33-8f1c-2c56d957c67c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:40.923159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8f0154a6-b0f6-434d-ae19-aa6aa2f76006 req-996a2d78-ab05-4d33-8f1c-2c56d957c67c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:40.946098 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50761729-e51e-43a0-bca4-22361406aee4 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 200 len: 1630 microversion: 2.1 time: 0.346006 Sep 18 01:13:40.948667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1353/2789] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:40 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 1630 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:40.979553 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8f0154a6-b0f6-434d-ae19-aa6aa2f76006 req-996a2d78-ab05-4d33-8f1c-2c56d957c67c service nova] Creating event network-vif-deleted:755104d6-aa9f-4ced-b539-e60876e51bd0 for instance cca1030d-871a-43de-af46-18b99b422d0f on n-h1-master-1 Sep 18 01:13:40.988433 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8f0154a6-b0f6-434d-ae19-aa6aa2f76006 req-996a2d78-ab05-4d33-8f1c-2c56d957c67c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120396 Sep 18 01:13:40.990184 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1437/2790] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:41.260041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:41.260954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:41.271398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:41.271808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:41.273657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:41.274561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:41.278175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:41.278850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:41.627808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:41.628924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:41.651711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:41.653995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:41.656399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:41.657380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:41.658120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:41.659360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:41.727493 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:41.761598 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=14 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:41.790706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:41.793716 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:41.801481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6fb53821-201d-468e-aa88-ad2363d67f4f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 0.545677 Sep 18 01:13:41.818067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1354/2791] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:41 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:41.867715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:41.869796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:41.886512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:41.891346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:41.892127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:41.896563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:41.897276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:41.897961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:41.952379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:41.967390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:41.969362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:41.980635 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c002ac5-ef94-43e4-9d4c-6db88e559b7a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.359651 Sep 18 01:13:41.993594 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1438/2792] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:41 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:41.993594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:41.993594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] [instance: cca1030d-871a-43de-af46-18b99b422d0f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:42.007258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:42.012563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:42.013209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:42.014182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:42.014804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:42.016182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:42.051907 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] HTTP exception thrown: Instance cca1030d-871a-43de-af46-18b99b422d0f could not be found. Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Request method failure captured: Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f HTTP/1.1 Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnBxwe49VrT95SldzB38ZGPVDJP5XI_v16fOOz25CO8uQanDPob1RastafL2t7_86kDnRLAhOM6GXZrYFkgsymoXj3LqCwFaBiAnt1NpmbdO7y0GWljVFJaZgtJ-ugC9A4hkesEo0BWLiHpf8Ng-eXZUIeDuBOf_shyT6EPmjwt8uog Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 622cbbf586594b449c1573f8d529aa5c Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1137083337 Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/622cbbf586594b449c1573f8d529aa5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/622cbbf586594b449c1573f8d529aa5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_622cbbf586594b449c1573f8d529aa5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/622cbbf586594b449c1573f8d529aa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1137083337 Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 622cbbf586594b449c1573f8d529aa5c Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1137083337 Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1137083337-project Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: de9bd3c0c4524c51b919a38238e79d0c Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1137083337-project Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: exception: Instance cca1030d-871a-43de-af46-18b99b422d0f could not be found. Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'cca1030d-871a-43de-af46-18b99b422d0f'} Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca1030d-871a-43de-af46-18b99b422d0f could not be found. Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca1030d-871a-43de-af46-18b99b422d0f could not be found. Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:42.053936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:42.058797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:42.058797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:42.058797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:42.058797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:13:42.058797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:13:42.058797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca1030d-871a-43de-af46-18b99b422d0f could not be found. Sep 18 01:13:42.058797 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:13:42.060410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Returning 404 to user: Instance cca1030d-871a-43de-af46-18b99b422d0f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:42.061526 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6781e981-dcba-446e-9b77-7b33d56d04f0 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f" status: 404 len: 111 microversion: 2.1 time: 0.078926 Sep 18 01:13:42.066748 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1439/2793] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:41 2022] GET /compute/v2.1/servers/cca1030d-871a-43de-af46-18b99b422d0f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:42.074758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a2a238e-ac8b-43f9-98c9-7b0e065e7183 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] Calling method '.version_select at 0x7f7005f540d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:42.125206 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a2a238e-ac8b-43f9-98c9-7b0e065e7183 tempest-ServersTestJSON-1137083337 tempest-ServersTestJSON-1137083337-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-680090544" status: 202 len: 0 microversion: 2.1 time: 0.054241 Sep 18 01:13:42.126134 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1440/2794] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:13:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-680090544 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:13:42.135846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ef3b968e-edaf-42b9-af3f-55ae27460e98 req-08ade3db-5440-4404-b588-122b1f43b459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3354a169-ba19-43f4-bf09-5ac35a27f761", "tag": "5cafbf44-96bd-4836-96ee-155e4d1008e4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:42.156370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ef3b968e-edaf-42b9-af3f-55ae27460e98 req-08ade3db-5440-4404-b588-122b1f43b459 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:42.156857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ef3b968e-edaf-42b9-af3f-55ae27460e98 req-08ade3db-5440-4404-b588-122b1f43b459 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:42.157490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ef3b968e-edaf-42b9-af3f-55ae27460e98 req-08ade3db-5440-4404-b588-122b1f43b459 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:42.172962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ef3b968e-edaf-42b9-af3f-55ae27460e98 req-08ade3db-5440-4404-b588-122b1f43b459 service nova] Creating event network-changed:5cafbf44-96bd-4836-96ee-155e4d1008e4 for instance 3354a169-ba19-43f4-bf09-5ac35a27f761 on n-h1-master-1 Sep 18 01:13:42.184512 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ef3b968e-edaf-42b9-af3f-55ae27460e98 req-08ade3db-5440-4404-b588-122b1f43b459 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056995 Sep 18 01:13:42.190014 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1441/2795] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:42.481437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:42.511383 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6aae1e2-664f-407e-a9dd-88e6459f4307 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.646971 Sep 18 01:13:42.526301 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1355/2796] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:41 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:42.834856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:42.836439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:42.850438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:42.851045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:42.851391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:42.852131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:42.852571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:42.855653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:43.031630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:43.033053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:43.054544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:43.055063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:43.055517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:43.056551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:43.057169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:43.058294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:43.701855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:43.746628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:43.749428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:43.802494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-915a1d2c-cd76-4e57-a463-612cfe6ac244 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.774362 Sep 18 01:13:43.848216 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1356/2797] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:43 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:13:43.853981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1d65523a-8c36-411a-97a0-fce50bdba92f req-f27776a8-6982-44d3-bd41-06a7e91fa5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5092471-f83a-4486-bbb8-7e6a6dcfb305", "tag": "6cb15bf7-5ea8-4dc6-b819-1845a643fd55"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:43.867617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1d65523a-8c36-411a-97a0-fce50bdba92f req-f27776a8-6982-44d3-bd41-06a7e91fa5f1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:43.869657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1d65523a-8c36-411a-97a0-fce50bdba92f req-f27776a8-6982-44d3-bd41-06a7e91fa5f1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:43.870444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1d65523a-8c36-411a-97a0-fce50bdba92f req-f27776a8-6982-44d3-bd41-06a7e91fa5f1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:43.886566 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1d65523a-8c36-411a-97a0-fce50bdba92f req-f27776a8-6982-44d3-bd41-06a7e91fa5f1 service nova] Creating event network-changed:6cb15bf7-5ea8-4dc6-b819-1845a643fd55 for instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 on n-h1-master-1 Sep 18 01:13:43.894381 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1d65523a-8c36-411a-97a0-fce50bdba92f req-f27776a8-6982-44d3-bd41-06a7e91fa5f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044664 Sep 18 01:13:43.895999 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1357/2798] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:43.903764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:43.904860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:43.923045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:43.924028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:43.924809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:43.925798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:43.926497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:43.927165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:44.181510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:44.228840 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-470100a5-1d21-4ce9-9d02-722d3cde9068 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 1.399778 Sep 18 01:13:44.229951 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1442/2799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:42 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:44.243581 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:44.608227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:44.620989 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c9572de3-eec1-40bc-b6d7-153b3c5ac9a7 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.723121 Sep 18 01:13:44.625970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1358/2800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:43 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:44.855970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:44.856763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:44.862922 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:44.864265 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:44.903221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:44.904952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:44.905505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:44.910632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:44.912544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:44.913075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:45.135444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:45.146468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:45.148334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:45.152000 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:45.160465 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a2d0b49-3533-4504-a963-2ae6ba124838 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1558 microversion: 2.91 time: 0.309286 Sep 18 01:13:45.183360 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1443/2801] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:44 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1558 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:45.273486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:45.274141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:45.282872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:45.284145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:45.285045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:45.286929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:45.288658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:45.289721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:45.649453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:45.650416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:45.662523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:45.664012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:45.665107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:45.666360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:45.667942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:45.669170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:46.040364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:46.046685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:46.054852 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ece9eab0-7fed-463f-8fcf-a316f49c5fe2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.409622 Sep 18 01:13:46.055450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1444/2802] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:45 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:46.077263 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e66f1c84-eb0f-4dc1-9011-96c26a903bfa tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 0.812599 Sep 18 01:13:46.078269 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1359/2803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:45 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:46.192708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:46.193335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:46.206443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:46.206849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:46.207297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:46.207979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:46.208428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:46.208847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:46.393717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:46.415484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:46.418828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:46.430602 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6aab6c2d-c088-4bfd-b5e1-95d872af4d62 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.241756 Sep 18 01:13:46.434777 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1445/2804] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:46 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:47.082967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:47.083599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:47.106280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:47.107035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:47.111020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:47.116816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:47.118198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:47.121380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:47.123820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:47.125236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:47.125972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:47.127124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:47.130645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:47.130932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:47.132030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:47.132296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:48.049316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:48.058974 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94e62654-f708-4061-9688-fcdaf9d1e1ac tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.983208 Sep 18 01:13:48.059579 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1360/2805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:47 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:48.118237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:48.123610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:48.170996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:48.171510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:48.173397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:48.177372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:48.178024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:48.178476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:48.213565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:48.294424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52fe4b5d-4af4-485f-93e0-b3a1b16e9345 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 1.191879 Sep 18 01:13:48.297605 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1446/2806] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:47 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:48.397749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:48.421642 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:48.431481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:48.453648 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d2b50ce9-13fc-459f-aa1e-89183dbef100 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.375195 Sep 18 01:13:48.455452 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1361/2807] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:48 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:49.084347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:49.084977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:49.094827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:49.095324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:49.096325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:49.097051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:49.097529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:49.101144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:49.320466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:49.321738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:49.337859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:49.342273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:49.346580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:49.352337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:49.358585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:49.360363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:49.362728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-95a98eb7-8ef8-42c4-aa89-3f18687a8ad2 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 0.279760 Sep 18 01:13:49.364005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:49.366182 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1447/2808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:49 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:49.483961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:49.484566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:49.491259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:49.491749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:49.492391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:49.493093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:49.493543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:49.493996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:49.599899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:49.612920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:49.617419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:49.621524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:49.630077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa03d56c-0b05-4247-913a-703e92261732 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.150489 Sep 18 01:13:49.632594 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1448/2809] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:49 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:49.634363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-deb18afb-8ca7-4bd4-b951-95cce9def4ba tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 0.317790 Sep 18 01:13:49.636122 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1362/2810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:49 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:50.393849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:50.394847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:50.411529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:50.412043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:50.412506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:50.420203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:50.420710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:50.422722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:50.661474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:50.662762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:50.691534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:50.695694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:50.704330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:50.713675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:50.717444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:50.722367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:51.601608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:51.613052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:51.613973 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3108c6a-d1e6-40f4-bb51-15169c212a98 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 1.222161 Sep 18 01:13:51.615932 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1449/2811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:50 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:51.620852 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aafef5e9-4053-4556-882c-d7fabce6c250 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 0.965780 Sep 18 01:13:51.628093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:51.628729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:51.645128 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1363/2812] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:50 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:51.647137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:51.650166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:51.650906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:51.651673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:51.652322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:51.653157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-72a36b1f-0ae9-4c8f-b43b-06780e14ef4c req-20908564-20dd-4fea-a17f-62501a3df12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579347bb-656a-4e42-8726-832cc1586181", "name": "network-vif-plugged", "status": "completed", "tag": "9965b575-7ed3-47cf-a489-3c4269655ddb"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:51.654300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:51.673220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-72a36b1f-0ae9-4c8f-b43b-06780e14ef4c req-20908564-20dd-4fea-a17f-62501a3df12d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:51.686343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-72a36b1f-0ae9-4c8f-b43b-06780e14ef4c req-20908564-20dd-4fea-a17f-62501a3df12d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:51.687136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-72a36b1f-0ae9-4c8f-b43b-06780e14ef4c req-20908564-20dd-4fea-a17f-62501a3df12d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:51.714046 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-72a36b1f-0ae9-4c8f-b43b-06780e14ef4c req-20908564-20dd-4fea-a17f-62501a3df12d service nova] Creating event network-vif-plugged:9965b575-7ed3-47cf-a489-3c4269655ddb for instance 579347bb-656a-4e42-8726-832cc1586181 on n-h2-master-1 Sep 18 01:13:51.719449 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-72a36b1f-0ae9-4c8f-b43b-06780e14ef4c req-20908564-20dd-4fea-a17f-62501a3df12d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072542 Sep 18 01:13:51.720426 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1364/2813] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:51.819752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:51.853935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:51.874740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:51.895332 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3f35971-9508-4b72-9735-6c06849eb422 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.271990 Sep 18 01:13:51.896314 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1450/2814] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:51 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:52.650895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:52.651437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:52.652760 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:52.653889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:52.667841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:52.676136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:52.678326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:52.679904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:52.684407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:52.685668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:52.687887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:52.690224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:52.691294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:52.692343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:52.695621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:52.696530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:54.175065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:54.224354 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1643ba31-863b-488b-8df2-82aecb25d495 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 1.568295 Sep 18 01:13:54.225485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1365/2815] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:52 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:54.246446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:54.274603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:54.302935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:54.325428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:54.337759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:54.342261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:54.343178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:54.345400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:54.487145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:54.510111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:54.511906 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:54.517750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4cbbce5a-66bc-4993-b2e8-42470a4de84e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.286242 Sep 18 01:13:54.534279 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1366/2816] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:54 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:54.547151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0bced4aa-3ee1-4963-b56c-85263eb08a3d req-51d82014-3f21-4161-90e2-df0ca8bfc8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3354a169-ba19-43f4-bf09-5ac35a27f761", "name": "network-vif-plugged", "status": "completed", "tag": "5cafbf44-96bd-4836-96ee-155e4d1008e4"}, {"server_uuid": "e5092471-f83a-4486-bbb8-7e6a6dcfb305", "name": "network-vif-plugged", "status": "completed", "tag": "6cb15bf7-5ea8-4dc6-b819-1845a643fd55"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:54.584614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0bced4aa-3ee1-4963-b56c-85263eb08a3d req-51d82014-3f21-4161-90e2-df0ca8bfc8dd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:54.593624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0bced4aa-3ee1-4963-b56c-85263eb08a3d req-51d82014-3f21-4161-90e2-df0ca8bfc8dd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:54.593624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0bced4aa-3ee1-4963-b56c-85263eb08a3d req-51d82014-3f21-4161-90e2-df0ca8bfc8dd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:54.632107 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0bced4aa-3ee1-4963-b56c-85263eb08a3d req-51d82014-3f21-4161-90e2-df0ca8bfc8dd service nova] Creating event network-vif-plugged:5cafbf44-96bd-4836-96ee-155e4d1008e4 for instance 3354a169-ba19-43f4-bf09-5ac35a27f761 on n-h1-master-1 Sep 18 01:13:54.632716 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0bced4aa-3ee1-4963-b56c-85263eb08a3d req-51d82014-3f21-4161-90e2-df0ca8bfc8dd service nova] Creating event network-vif-plugged:6cb15bf7-5ea8-4dc6-b819-1845a643fd55 for instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 on n-h1-master-1 Sep 18 01:13:54.647528 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0bced4aa-3ee1-4963-b56c-85263eb08a3d req-51d82014-3f21-4161-90e2-df0ca8bfc8dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.111758 Sep 18 01:13:54.648265 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1367/2817] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:54.823404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:54.834855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8eeb4002-6ff9-4d42-b7ed-d5ac43a6b45a tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 2.194571 Sep 18 01:13:54.847856 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1451/2818] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:52 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:55.251053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:55.252009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:55.269384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:55.281908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:55.286629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:55.287918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:55.288627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:55.289298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:55.548740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:55.553601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:55.565002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:55.572206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:55.573956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:55.576613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:55.580264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:55.581255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:55.757991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:55.788579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:55.794786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:55.814123 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78553c84-fe2b-44ef-b25c-4778e79f9c26 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.267208 Sep 18 01:13:55.815363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1452/2819] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:55 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:13:55.875320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:55.877008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:55.896994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:55.897501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:55.898074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:55.898681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:55.899137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:55.903428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:56.398528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:56.422883 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9cca5831-267b-4e33-b10d-425f3ab30433 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1318 microversion: 2.1 time: 1.178050 Sep 18 01:13:56.430819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1368/2820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:55 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1318 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:56.444789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:56.458289 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14309c03-2cbc-4ae3-b52d-c7381f28b475 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1323 microversion: 2.1 time: 0.588510 Sep 18 01:13:56.459490 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1453/2821] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:55 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:13:56.850053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:56.851149 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:56.860925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:56.866201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:56.866884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:56.873524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:56.875867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:56.876318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:57.091991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:57.118670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:57.126350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:57.140409 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-604fa066-04e1-4f70-b912-62c85875ebc3 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.295677 Sep 18 01:13:57.141692 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1369/2822] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:56 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:57.291400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b7b37c9-e1b5-4eb4-bde7-9ab7d41529a5 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:57.310323 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b7b37c9-e1b5-4eb4-bde7-9ab7d41529a5 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.386973 Sep 18 01:13:57.311371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1454/2823] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:13:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:13:57.456761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:57.458637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:57.488108 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:57.491467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:57.530660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:57.534315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:57.542421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:57.542892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:57.543770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:57.544803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:57.546570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:57.547317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:57.548091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:57.550397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:57.552656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:57.553823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:58.472326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:58.484177 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d750c32-8be5-48f0-930d-b9f95a6f4a41 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1472 microversion: 2.1 time: 1.001587 Sep 18 01:13:58.518679 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1455/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:57 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1472 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:58.533881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:58.535379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:58.555916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:58.561931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:58.565362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:58.566850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:58.571569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:58.575073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:58.595029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:58.612199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b13f9b2-9f7f-4330-b1cc-66486014008a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1506 microversion: 2.1 time: 1.153885 Sep 18 01:13:58.620750 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1370/2825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:57 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1506 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:13:58.637333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:58.654481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:58.677998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:58.685886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:58.686802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:58.687756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:58.690350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:58.704151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:58.813895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Request method failure captured: Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305/diagnostics HTTP/1.1 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnC4Z9cc65zzIlkNzl3oyUeHERWtO2PGBgu23rnxB9clQaYR_A0DoysFOIiz8KwKk0roXFYfkiXjXjc55y2Fr-eVHXMWKlHVZqa49vlud_En0seBFPkMf7say57s-MJEf5BD1Of_7hxm1HQXdsHdfGEB0RRoC5OO9xYNJZIeTpKojd0 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: cab15a2304c04037b46d23ac68d2c75d Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1586902252 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1586902252 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: cab15a2304c04037b46d23ac68d2c75d Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1586902252 Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerDiagnosticsNegativeTest-1586902252-project Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 56325b0791c442ada71d064a826b4a6e Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1586902252-project Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': 'e5092471-f83a-4486-bbb8-7e6a6dcfb305'} Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:58.824878 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:13:58.829913 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:13:58.829913 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:13:58.829913 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:13:58.829913 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:13:58.829913 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 18 01:13:58.829913 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:13:58.831663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:13:58.832858 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ecebbfc-2a14-4932-b9bb-60400706561f tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.202745 Sep 18 01:13:58.845236 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1371/2826] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:13:58 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305/diagnostics => generated 117 bytes in 224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:13:58.866656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:13:58.867894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:13:58.870374 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:13:58.902493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:58.903001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:58.903446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:58.904164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:13:58.904621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:13:58.905046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:13:58.962733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:58.987155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:58.989384 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:13:59.010158 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac0419e7-1bc7-40e5-a3fa-949389ec6d60 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.481508 Sep 18 01:13:59.013395 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1456/2827] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:13:58 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:13:59.029771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a9d1204-dc3e-4b9a-8086-e0f119e5df84 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-710138965", "imageRef": "ffb67f99-16cf-4ba4-86ae-afb89e49759a", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:13:59.161933 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-9a9d1204-dc3e-4b9a-8086-e0f119e5df84 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:00.876375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:00.915941 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69515d61-18ae-4f0a-8c23-c4555c40a59a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181" status: 200 len: 1506 microversion: 2.1 time: 2.069210 Sep 18 01:14:00.916673 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1372/2828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:13:58 2022] GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181 => generated 1506 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:00.926577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:00.932355 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:00.948185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:00.949967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:00.950714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:00.953188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:00.956478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:00.957141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:01.039651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:14:01.080785 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:01.191894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9a9d1204-dc3e-4b9a-8086-e0f119e5df84 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a9d1204-dc3e-4b9a-8086-e0f119e5df84 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] Request method failure captured: Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 142 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDU63rA623md9zKGpGrQUVnstyuXeaxd2AD8ki8GoyQKHY9RFV-msAq_s3mFJz4AmfRUAigaL6xg9TZKi2BYVKRFpjDts5XXwZRxbFFxxiQhFihftk__2qLy4E-fiiRIrZz7UFxexu3nN_S7sOX0Z6dfit2Q_JZ_62bY9kKwFV_o5I Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 730c57bc3ffc40928382319271c0c171 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-FlavorsV2NegativeTest-1960743391 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/730c57bc3ffc40928382319271c0c171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/730c57bc3ffc40928382319271c0c171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_730c57bc3ffc40928382319271c0c171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/730c57bc3ffc40928382319271c0c171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-FlavorsV2NegativeTest-1960743391 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 730c57bc3ffc40928382319271c0c171 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1960743391 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-FlavorsV2NegativeTest-1960743391-project Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 062411475afe49d6b850a33585a17cf7 Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-FlavorsV2NegativeTest-1960743391-project Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-710138965", "imageRef": "ffb67f99-16cf-4ba4-86ae-afb89e49759a", "flavorRef": "452"}} Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: exception: Flavor's memory is too small for requested image. Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-710138965', 'imageRef': 'ffb67f99-16cf-4ba4-86ae-afb89e49759a', 'flavorRef': '452'}}} Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:01.194323 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 18 01:14:01.199243 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:01.202447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a9d1204-dc3e-4b9a-8086-e0f119e5df84 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:01.203598 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a9d1204-dc3e-4b9a-8086-e0f119e5df84 tempest-FlavorsV2NegativeTest-1960743391 tempest-FlavorsV2NegativeTest-1960743391-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 2.189118 Sep 18 01:14:01.204425 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1457/2829] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:13:59 2022] POST /compute/v2.1/servers => generated 93 bytes in 2190 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:14:01.239657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:01.243463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:01.256040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:01.260428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:01.263875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:01.268113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:01.268961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:01.269672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:01.345635 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5774f680-c06c-4e37-8f6a-aff7f9d8d92e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 204 len: 0 microversion: 2.1 time: 0.424914 Sep 18 01:14:01.356054 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1373/2830] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:14:00 2022] DELETE /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:14:01.387472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:01.388069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:01.409743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:01.413942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:01.414619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:01.415544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:01.416165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:01.418571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:01.556829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:14:01.584583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:01.599665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:01.601605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:01.617367 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a45c3a5-549d-4538-a7e8-c4b70d66a4d5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.411594 Sep 18 01:14:01.619167 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1458/2831] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:01 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:01.808388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb75c7e1-35d3-4c62-a61d-0e067290328d tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Action: 'create', calling method: .version_select at 0x7f70064dbf70>, body: {"keypair": {"name": "tempest-keypair-29610687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjvllSsetOYDMFnKMw8OG9bclg/KvRV/MnB7fiWM/NjCJ9LDv8nKg/v5r6adwwUWJilOYIGkxg8VVV1JPI/tmXuHbZI7ek6dkdr/uCYc7xI7QWVKp9e87qQTPNmOq+szQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:01.840777 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0603de13-dca7-4e83-baa4-9ebfbfc8be07 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "DELETE /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181" status: 204 len: 0 microversion: 2.1 time: 0.478699 Sep 18 01:14:01.845628 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1374/2832] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:14:01 2022] DELETE /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:14:01.850369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:01.855323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:01.862670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-bb75c7e1-35d3-4c62-a61d-0e067290328d tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Getting quotas for project 70699b2280334f19ad596b183f3718fe. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:01.886124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:01.886684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:01.887305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:01.888223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:01.890216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:01.891448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:01.931582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-bb75c7e1-35d3-4c62-a61d-0e067290328d tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Getting quotas for user 3b51519d90f44a04b65fa5730e644760 and project 70699b2280334f19ad596b183f3718fe. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:02.063088 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb75c7e1-35d3-4c62-a61d-0e067290328d tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.440010 Sep 18 01:14:02.064740 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1459/2833] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:02.075510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:02.080401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:02.095645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:02.102363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:02.102850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:02.106158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:02.107295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:02.109520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:02.169484 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:02.188258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:14:02.428120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82f1f8f1-8b9a-46b7-8b3f-c9cf18e1820a tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 204 len: 0 microversion: 2.1 time: 0.361864 Sep 18 01:14:02.429224 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1460/2834] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:14:02 2022] DELETE /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:14:02.442634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:02.445298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:02.462202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:02.465639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:02.466734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:02.468533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:02.470830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:02.471750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:02.813027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:02.842544 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05434b31-bcb0-454b-8d29-8d1146fe39d6 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1478 microversion: 2.1 time: 0.999105 Sep 18 01:14:02.867288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1375/2835] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:01 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1478 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:02.904581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:02.906209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:02.929332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:02.931764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:02.932729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:02.935575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:02.938370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:02.938917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:03.061135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:03.108325 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a74856b-586c-4f49-a170-3d8b62a15d7c tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181" status: 200 len: 1512 microversion: 2.1 time: 0.673526 Sep 18 01:14:03.108936 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1461/2836] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:02 2022] GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181 => generated 1512 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:03.156815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:03.173094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:03.181239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:03.191632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e95de955-6641-426c-b103-388979b9b047 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.322557 Sep 18 01:14:03.193026 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1376/2837] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:02 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:03.885180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:03.885832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:03.892788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:03.903031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:03.903492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:03.904239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:03.904693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:03.905116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:04.138192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:04.139479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:04.154238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:04.160167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:04.166341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:04.167499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:04.171188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:04.179133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:05.044113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:05.055282 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3aa63a66-9c1b-4ed7-b147-303bfd14c13e tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1478 microversion: 2.1 time: 1.174549 Sep 18 01:14:05.072477 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1462/2838] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:03 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1478 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:05.072477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:05.072477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:05.079882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:05.080520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:05.081523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:05.082609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:05.083205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:05.083745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:05.334051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:05.375315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:05.380597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:05.392046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:05.411704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bab680ca-4b4b-44a2-88ab-d13d8dfa37bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181" status: 200 len: 1512 microversion: 2.1 time: 1.275192 Sep 18 01:14:05.412892 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9dd6002a-e32b-4fc1-9ea2-42da7060f6e8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.351513 Sep 18 01:14:05.438306 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1377/2839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:04 2022] GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181 => generated 1512 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:05.439695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1463/2840] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:05 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:06.055836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-49bb626c-7c79-42f1-b599-3f410b5f5fa1 req-b4d79b71-f909-4252-b6c3-c9594f86c198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5092471-f83a-4486-bbb8-7e6a6dcfb305", "name": "network-vif-deleted", "tag": "6cb15bf7-5ea8-4dc6-b819-1845a643fd55"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:06.083227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49bb626c-7c79-42f1-b599-3f410b5f5fa1 req-b4d79b71-f909-4252-b6c3-c9594f86c198 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:06.083749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49bb626c-7c79-42f1-b599-3f410b5f5fa1 req-b4d79b71-f909-4252-b6c3-c9594f86c198 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:06.084503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:06.089998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49bb626c-7c79-42f1-b599-3f410b5f5fa1 req-b4d79b71-f909-4252-b6c3-c9594f86c198 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:06.090928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:06.116669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:06.119568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:06.120316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:06.122800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:06.126229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:06.127038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:06.155305 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-49bb626c-7c79-42f1-b599-3f410b5f5fa1 req-b4d79b71-f909-4252-b6c3-c9594f86c198 service nova] Creating event network-vif-deleted:6cb15bf7-5ea8-4dc6-b819-1845a643fd55 for instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 on n-h1-master-1 Sep 18 01:14:06.192576 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-49bb626c-7c79-42f1-b599-3f410b5f5fa1 req-b4d79b71-f909-4252-b6c3-c9594f86c198 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113756 Sep 18 01:14:06.196723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1378/2841] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:06.448190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:06.449699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:06.483629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:06.484136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:06.487886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:06.488659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:06.491960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:06.494157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:07.378579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:07.379484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56325b0791c442ada71d064a826b4a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab15a2304c04037b46d23ac68d2c75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:07.389893 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3dc2f815-75e6-4b66-8813-d7816488f7b3 tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 200 len: 1308 microversion: 2.1 time: 1.313125 Sep 18 01:14:07.390505 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1464/2842] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:06 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 1308 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:07.402325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9407e1cb-3d53-4dd5-904a-1a28f524b43e tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181" status: 200 len: 1470 microversion: 2.1 time: 0.959533 Sep 18 01:14:07.403608 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1379/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:06 2022] GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181 => generated 1470 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:07.436392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:07.440118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:07.485180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:07.489531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:07.490329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:07.492404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:07.493929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:07.504929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:07.737837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-7c88b18c-4867-4336-83d5-3ee14a3d6b37 req-c22ecec1-6ca6-4283-9217-9f70651f458a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579347bb-656a-4e42-8726-832cc1586181", "name": "network-vif-deleted", "tag": "9965b575-7ed3-47cf-a489-3c4269655ddb"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:07.786250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7c88b18c-4867-4336-83d5-3ee14a3d6b37 req-c22ecec1-6ca6-4283-9217-9f70651f458a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:07.787860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7c88b18c-4867-4336-83d5-3ee14a3d6b37 req-c22ecec1-6ca6-4283-9217-9f70651f458a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:07.788851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7c88b18c-4867-4336-83d5-3ee14a3d6b37 req-c22ecec1-6ca6-4283-9217-9f70651f458a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:07.821080 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-7c88b18c-4867-4336-83d5-3ee14a3d6b37 req-c22ecec1-6ca6-4283-9217-9f70651f458a service nova] Creating event network-vif-deleted:9965b575-7ed3-47cf-a489-3c4269655ddb for instance 579347bb-656a-4e42-8726-832cc1586181 on n-h2-master-1 Sep 18 01:14:07.827163 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-7c88b18c-4867-4336-83d5-3ee14a3d6b37 req-c22ecec1-6ca6-4283-9217-9f70651f458a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101464 Sep 18 01:14:07.828394 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1380/2844] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 18 01:14:08.426650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:08.427416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] [instance: e5092471-f83a-4486-bbb8-7e6a6dcfb305] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:08.462339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:08.470445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:08.471263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:08.474157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:08.478543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:08.480903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:08.483904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:08.492053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:08.511029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:08.544028 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] HTTP exception thrown: Instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 could not be found. Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Request method failure captured: Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 HTTP/1.1 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnC4Z9cc65zzIlkNzl3oyUeHERWtO2PGBgu23rnxB9clQaYR_A0DoysFOIiz8KwKk0roXFYfkiXjXjc55y2Fr-eVHXMWKlHVZqa49vlud_En0seBFPkMf7say57s-MJEf5BD1Of_7hxm1HQXdsHdfGEB0RRoC5OO9xYNJZIeTpKojd0 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: cab15a2304c04037b46d23ac68d2c75d Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1586902252 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cab15a2304c04037b46d23ac68d2c75d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1586902252 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: cab15a2304c04037b46d23ac68d2c75d Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1586902252 Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerDiagnosticsNegativeTest-1586902252-project Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 56325b0791c442ada71d064a826b4a6e Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1586902252-project Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: exception: Instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 could not be found. Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e5092471-f83a-4486-bbb8-7e6a6dcfb305'} Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 could not be found. Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 could not be found. Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.550183 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 could not be found. Sep 18 01:14:08.555885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.562231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7947b5f2-6c0d-49dd-95ce-8b2b57a6ed40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 1.162208 Sep 18 01:14:08.562850 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1465/2845] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:07 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:08.578891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] Returning 404 to user: Instance e5092471-f83a-4486-bbb8-7e6a6dcfb305 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:08.580489 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e642abde-26ac-4609-b12b-9717501d2f7d tempest-ServerDiagnosticsNegativeTest-1586902252 tempest-ServerDiagnosticsNegativeTest-1586902252-project] 10.222.0.25 "GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305" status: 404 len: 111 microversion: 2.1 time: 0.163788 Sep 18 01:14:08.590351 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1381/2846] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:08 2022] GET /compute/v2.1/servers/e5092471-f83a-4486-bbb8-7e6a6dcfb305 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:14:08.604754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:08.607612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 579347bb-656a-4e42-8726-832cc1586181] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:08.643857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:08.646938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:08.652994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:08.660866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:08.669451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:08.672640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:08.752126 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] HTTP exception thrown: Instance 579347bb-656a-4e42-8726-832cc1586181 could not be found. Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Request method failure captured: Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181 HTTP/1.1 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnCOq0OGuN3itfdVXflavnRRXmsHRQHKyRUeP3JrpKq5ErkZedlvna1jB2uZZDYPyoTKskFbHtxrrPzPi52lBs9Yviwu-Cp4nzWrO9E2HofDFHQnCnt_fSILzIzMYoDjtywS9uaSV2S8mfWFmRuI91UCIGk6A2UPFxgPOXtYGYrY_vs Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e4259c8d88db43eebf164b306b70eb4b Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MultipleCreateTestJSON-659967227 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MultipleCreateTestJSON-659967227 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e4259c8d88db43eebf164b306b70eb4b Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MultipleCreateTestJSON-659967227 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MultipleCreateTestJSON-659967227-project Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d3e40fd9dbb94f8fa23a5b7c8a16be83 Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MultipleCreateTestJSON-659967227-project Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 579347bb-656a-4e42-8726-832cc1586181 could not be found. Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '579347bb-656a-4e42-8726-832cc1586181'} Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579347bb-656a-4e42-8726-832cc1586181 could not be found. Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579347bb-656a-4e42-8726-832cc1586181 could not be found. Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:08.755745 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.760549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:08.760549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:08.760549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:08.760549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:08.760549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:08.760549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579347bb-656a-4e42-8726-832cc1586181 could not be found. Sep 18 01:14:08.760549 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:08.774228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Returning 404 to user: Instance 579347bb-656a-4e42-8726-832cc1586181 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:08.790901 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ff520055-31ca-4c06-933e-daf319c1f456 tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181" status: 404 len: 111 microversion: 2.1 time: 0.220851 Sep 18 01:14:08.802783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1466/2847] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:08 2022] GET /compute/v2.1/servers/579347bb-656a-4e42-8726-832cc1586181 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:14:08.836364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:08.837306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:08.859720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:08.862416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:08.864295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:08.888729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:08.907371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:08.910672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:09.018049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:09.018636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:09.019103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:09.019587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lazy-loading 'fault' on Instance uuid 3354a169-ba19-43f4-bf09-5ac35a27f761 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:14:09.223203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e40fd9dbb94f8fa23a5b7c8a16be83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4259c8d88db43eebf164b306b70eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:09.239622 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96c76033-2ad5-4006-9498-522c75bc182f tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 200 len: 1308 microversion: 2.1 time: 0.426886 Sep 18 01:14:09.258923 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1467/2848] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:08 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:09.331876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1102495872", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:09.498119 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] validate_networks() for [('28a4f8d7-540d-4650-8fc6-4ab30db92cdd', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:09.634634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f7638a5-a4c7-464d-88a4-fab583c443de tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1616393449", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:09.642784 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-0f7638a5-a4c7-464d-88a4-fab583c443de tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] HTTP exception thrown: min_count must be <= max_count Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f7638a5-a4c7-464d-88a4-fab583c443de tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Request method failure captured: Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 184 Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDg9U4i936dpOo4Wz691ZIiPAkoQAMxkvUj5AeEAUDRpT_VVPtl9AzcVW1Iq1DutCfL68hOs2b6zxNXwVhsXywuu5-aOrTBPjaTBcs14LuZLmnuiSB86MUPxp-2tYu3vr4_agB95exRQobQAqNTXjlNwxCOT3T6z3TKW6jlAvONxdg Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e38599990c2144d39f9774c264ea004c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e38599990c2144d39f9774c264ea004c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 531c4c09a71a4387b093585463655c4c Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1616393449", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: exception: min_count must be <= max_count Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1616393449', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 18 01:14:09.646962 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:09.655700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f7638a5-a4c7-464d-88a4-fab583c443de tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Returning 400 to user: min_count must be <= max_count {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:09.655700 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0f7638a5-a4c7-464d-88a4-fab583c443de tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.392506 Sep 18 01:14:09.656177 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1468/2849] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:09 2022] POST /compute/v2.1/servers => generated 74 bytes in 396 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:14:09.665607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:09.666234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:09.694013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:09.694539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:09.695889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:09.696628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:09.699874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:09.702824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:09.977126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:09.989192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:10.004570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:10.033041 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-17623d6c-9a24-4ba9-9bc2-d35656a7c5a8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.375046 Sep 18 01:14:10.054464 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1469/2850] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:09 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:10.067225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1a94d48b-65e0-41d6-90d2-fc0790125874 req-6e6997fb-aff8-4237-942f-a4a65b28f779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3354a169-ba19-43f4-bf09-5ac35a27f761", "name": "network-vif-deleted", "tag": "5cafbf44-96bd-4836-96ee-155e4d1008e4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:10.091796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a94d48b-65e0-41d6-90d2-fc0790125874 req-6e6997fb-aff8-4237-942f-a4a65b28f779 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:10.092291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a94d48b-65e0-41d6-90d2-fc0790125874 req-6e6997fb-aff8-4237-942f-a4a65b28f779 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:10.092699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a94d48b-65e0-41d6-90d2-fc0790125874 req-6e6997fb-aff8-4237-942f-a4a65b28f779 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:10.132382 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1a94d48b-65e0-41d6-90d2-fc0790125874 req-6e6997fb-aff8-4237-942f-a4a65b28f779 service nova] Creating event network-vif-deleted:5cafbf44-96bd-4836-96ee-155e4d1008e4 for instance 3354a169-ba19-43f4-bf09-5ac35a27f761 on n-h1-master-1 Sep 18 01:14:10.148519 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1a94d48b-65e0-41d6-90d2-fc0790125874 req-6e6997fb-aff8-4237-942f-a4a65b28f779 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090257 Sep 18 01:14:10.149874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1470/2851] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:10.167943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-860232a2-1191-42be-94c5-31d16de6e831 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-512605606", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "max_count": 0}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-860232a2-1191-42be-94c5-31d16de6e831 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Request method failure captured: Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 167 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDg9U4i936dpOo4Wz691ZIiPAkoQAMxkvUj5AeEAUDRpT_VVPtl9AzcVW1Iq1DutCfL68hOs2b6zxNXwVhsXywuu5-aOrTBPjaTBcs14LuZLmnuiSB86MUPxp-2tYu3vr4_agB95exRQobQAqNTXjlNwxCOT3T6z3TKW6jlAvONxdg Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e38599990c2144d39f9774c264ea004c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e38599990c2144d39f9774c264ea004c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 531c4c09a71a4387b093585463655c4c Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-512605606", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "max_count": 0}} Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-512605606', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'max_count': 0}}} Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 0 Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:14:10.174176 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-860232a2-1191-42be-94c5-31d16de6e831 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-860232a2-1191-42be-94c5-31d16de6e831 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021350 Sep 18 01:14:10.178779 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1471/2852] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:10 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:10.270494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:10.272330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] [instance: 3354a169-ba19-43f4-bf09-5ac35a27f761] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:10.302997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:10.303848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:10.305152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:10.308089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:10.309084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:10.311238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:10.350514 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] HTTP exception thrown: Instance 3354a169-ba19-43f4-bf09-5ac35a27f761 could not be found. Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Request method failure captured: Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 HTTP/1.1 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnCOq0OGuN3itfdVXflavnRRXmsHRQHKyRUeP3JrpKq5ErkZedlvna1jB2uZZDYPyoTKskFbHtxrrPzPi52lBs9Yviwu-Cp4nzWrO9E2HofDFHQnCnt_fSILzIzMYoDjtywS9uaSV2S8mfWFmRuI91UCIGk6A2UPFxgPOXtYGYrY_vs Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e4259c8d88db43eebf164b306b70eb4b Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MultipleCreateTestJSON-659967227 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4259c8d88db43eebf164b306b70eb4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MultipleCreateTestJSON-659967227 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e4259c8d88db43eebf164b306b70eb4b Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MultipleCreateTestJSON-659967227 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MultipleCreateTestJSON-659967227-project Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d3e40fd9dbb94f8fa23a5b7c8a16be83 Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MultipleCreateTestJSON-659967227-project Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3354a169-ba19-43f4-bf09-5ac35a27f761 could not be found. Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3354a169-ba19-43f4-bf09-5ac35a27f761'} Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3354a169-ba19-43f4-bf09-5ac35a27f761 could not be found. Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3354a169-ba19-43f4-bf09-5ac35a27f761 could not be found. Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:10.363662 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3354a169-ba19-43f4-bf09-5ac35a27f761 could not be found. Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] Returning 404 to user: Instance 3354a169-ba19-43f4-bf09-5ac35a27f761 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:10.368482 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c43866ef-bb3d-4f36-9098-4ecfd13de1bc tempest-MultipleCreateTestJSON-659967227 tempest-MultipleCreateTestJSON-659967227-project] 10.222.0.25 "GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761" status: 404 len: 111 microversion: 2.1 time: 0.101820 Sep 18 01:14:10.373899 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1472/2853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:10 2022] GET /compute/v2.1/servers/3354a169-ba19-43f4-bf09-5ac35a27f761 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:14:10.390677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dcec5fc-a7c1-4d65-98b7-44dea9cfe9f1 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1733337328", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "max_count": 2.5}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dcec5fc-a7c1-4d65-98b7-44dea9cfe9f1 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Request method failure captured: Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 170 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDg9U4i936dpOo4Wz691ZIiPAkoQAMxkvUj5AeEAUDRpT_VVPtl9AzcVW1Iq1DutCfL68hOs2b6zxNXwVhsXywuu5-aOrTBPjaTBcs14LuZLmnuiSB86MUPxp-2tYu3vr4_agB95exRQobQAqNTXjlNwxCOT3T6z3TKW6jlAvONxdg Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e38599990c2144d39f9774c264ea004c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e38599990c2144d39f9774c264ea004c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 531c4c09a71a4387b093585463655c4c Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1733337328", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "max_count": 2.5}} Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1733337328', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'max_count': 2.5}}} Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 2.5 Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:14:10.394115 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 18 01:14:10.398357 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:10.402899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dcec5fc-a7c1-4d65-98b7-44dea9cfe9f1 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:10.404252 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9dcec5fc-a7c1-4d65-98b7-44dea9cfe9f1 tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029199 Sep 18 01:14:10.409741 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1473/2854] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:11.284066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a7d3db0-1b9b-43eb-8175-4e67be0d035b tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Action: 'create', calling method: .version_select at 0x7f700a763ee0>, body: {"keypair": {"name": "tempest-keypair-1573756270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvTPOoPTKP3nO1rlsn0RCtCdSrLxHZUGX9qhCQCW5+tZ4PMluKD+guYxK7Nn+lY2sidxXaCzq8o8vSaTxJwZVpDKWK+yT7CMHYufBG3336grtEu8YA3/JTk6ikUuDsjoA=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:11.352004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5a7d3db0-1b9b-43eb-8175-4e67be0d035b tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:11.371116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5a7d3db0-1b9b-43eb-8175-4e67be0d035b tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for user 36fee37736ae4ce492db8c383eaed401 and project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:11.472472 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:11.522469 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a7d3db0-1b9b-43eb-8175-4e67be0d035b tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.858124 Sep 18 01:14:11.535045 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1474/2855] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:14:11.547372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5bc54bc-e015-49ad-a535-ff31986c411b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1597185122", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 0}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5bc54bc-e015-49ad-a535-ff31986c411b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Request method failure captured: Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 168 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDg9U4i936dpOo4Wz691ZIiPAkoQAMxkvUj5AeEAUDRpT_VVPtl9AzcVW1Iq1DutCfL68hOs2b6zxNXwVhsXywuu5-aOrTBPjaTBcs14LuZLmnuiSB86MUPxp-2tYu3vr4_agB95exRQobQAqNTXjlNwxCOT3T6z3TKW6jlAvONxdg Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e38599990c2144d39f9774c264ea004c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e38599990c2144d39f9774c264ea004c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 531c4c09a71a4387b093585463655c4c Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1597185122", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 0}} Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1597185122', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'min_count': 0}}} Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 0 Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:14:11.557227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5bc54bc-e015-49ad-a535-ff31986c411b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5bc54bc-e015-49ad-a535-ff31986c411b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.029216 Sep 18 01:14:11.562383 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1475/2856] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:11.578503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:11.581601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:11.603940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:11.604531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:11.605333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:11.608187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:11.613394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:11.613800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:11.685949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:14:11.686458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:14:11.687138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:14:11.687712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:14:11.688447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:14:11.715376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:11.716269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:11.716882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:11.717843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:11.718473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:11.719057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:11.743297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for project 941f245a91fa4b078afc8047e827227e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:11.752733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for user 4a53e55c3a684703a1ed5878f240f6c4 and project 941f245a91fa4b078afc8047e827227e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:11.791968 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:14:11.810686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:14:11.817428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:11.834912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:11.839319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:11.864995 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8074971c-0690-4c71-878c-d20ef6b88ace tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.296204 Sep 18 01:14:11.867128 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1476/2857] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:11 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:11.888745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5feb98a0-cad4-445c-9fcd-209b79716e65 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f70064dbee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:11.900992 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5feb98a0-cad4-445c-9fcd-209b79716e65 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1573756270" status: 200 len: 498 microversion: 2.1 time: 0.031694 Sep 18 01:14:11.902053 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1477/2858] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:14:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1573756270 => generated 498 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:11.907399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a183a20a-2a86-4f31-b23b-5b46ad385a4b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-671431461", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 2.5}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a183a20a-2a86-4f31-b23b-5b46ad385a4b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Request method failure captured: Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 169 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDg9U4i936dpOo4Wz691ZIiPAkoQAMxkvUj5AeEAUDRpT_VVPtl9AzcVW1Iq1DutCfL68hOs2b6zxNXwVhsXywuu5-aOrTBPjaTBcs14LuZLmnuiSB86MUPxp-2tYu3vr4_agB95exRQobQAqNTXjlNwxCOT3T6z3TKW6jlAvONxdg Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e38599990c2144d39f9774c264ea004c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e38599990c2144d39f9774c264ea004c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e38599990c2144d39f9774c264ea004c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e38599990c2144d39f9774c264ea004c Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1282062344 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 531c4c09a71a4387b093585463655c4c Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1282062344-project Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-671431461", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "min_count": 2.5}} Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-671431461', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'min_count': 2.5}}} Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 2.5 Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:14:11.912009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 18 01:14:11.916211 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:11.920524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a183a20a-2a86-4f31-b23b-5b46ad385a4b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:11.922895 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a183a20a-2a86-4f31-b23b-5b46ad385a4b tempest-MultipleCreateNegativeTestJSON-1282062344 tempest-MultipleCreateNegativeTestJSON-1282062344-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019224 Sep 18 01:14:11.932586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1478/2859] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:11.940611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd3b470c-d48c-4c9c-b642-40aa7757027d tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f70054325e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:11.970049 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dd3b470c-d48c-4c9c-b642-40aa7757027d tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573756270" status: 202 len: 0 microversion: 2.1 time: 0.034755 Sep 18 01:14:11.971369 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1479/2860] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:14:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573756270 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:14:11.980882 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b53663e9-fe03-4622-af9e-90016e49bc3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.184275 Sep 18 01:14:11.988441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-657b7c06-7c2a-4422-92a5-76a2620b5111 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Action: 'create', calling method: .version_select at 0x7f700a825d30>, body: {"keypair": {"name": "tempest-keypair-1528233568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrJdimaOlgmlZjyRfROlhdhiOALG29Z2k0FLvplpNpvxS26M3abg/fWlz9Vqxx+AC8pYZc166TlYSvJ7LC+GaD6Tdh/Ps73RFqPCiz8C9N/7QMHdiourN9/bXZlYofK5w=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:11.991081 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1382/2861] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:14:11.996100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-421757c9-cb4a-410b-9d44-ff938c381bab tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:12.002358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-421757c9-cb4a-410b-9d44-ff938c381bab tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:12.012311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-657b7c06-7c2a-4422-92a5-76a2620b5111 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:12.055544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-657b7c06-7c2a-4422-92a5-76a2620b5111 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for user 36fee37736ae4ce492db8c383eaed401 and project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:12.097681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-421757c9-cb4a-410b-9d44-ff938c381bab tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:12.105143 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-421757c9-cb4a-410b-9d44-ff938c381bab tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1222 microversion: 2.1 time: 0.112863 Sep 18 01:14:12.122305 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1383/2862] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:11 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:12.157195 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-657b7c06-7c2a-4422-92a5-76a2620b5111 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174990 Sep 18 01:14:12.165600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1480/2863] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:12.171246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-55255310-efb0-4edb-ab7f-ea140b6221bf tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f70068aaaf0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:12.225023 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-55255310-efb0-4edb-ab7f-ea140b6221bf tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528233568" status: 202 len: 0 microversion: 2.1 time: 0.057622 Sep 18 01:14:12.228286 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1384/2864] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:14:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528233568 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:14:12.238522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb13538e-2a05-42b2-96e4-d0551043ff7c tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Action: 'create', calling method: .version_select at 0x7f70054321f0>, body: {"keypair": {"name": "tempest-keypair-474129419", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:12.274617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-fb13538e-2a05-42b2-96e4-d0551043ff7c tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:12.298950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-fb13538e-2a05-42b2-96e4-d0551043ff7c tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for user 36fee37736ae4ce492db8c383eaed401 and project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:12.367627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1945212295", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:12.427180 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb13538e-2a05-42b2-96e4-d0551043ff7c tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.193557 Sep 18 01:14:12.434115 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1481/2865] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:12 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:12.447803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc58e9c4-2477-484e-b756-0084a31bfd71 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f70054a1310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:12.475377 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc58e9c4-2477-484e-b756-0084a31bfd71 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474129419" status: 202 len: 0 microversion: 2.1 time: 0.040653 Sep 18 01:14:12.476324 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1482/2866] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:14:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474129419 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:14:12.534263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] validate_networks() for [('28a4f8d7-540d-4650-8fc6-4ab30db92cdd', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:12.557279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-89bcb24d-5519-48af-b289-bde1456168c2 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Action: 'create', calling method: .version_select at 0x7f700678b820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1781336950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPYblAYv55e6jjlA/nZ/gAZXSgmc67GlPqjgMmc7WwhF8oYsD+FCRGbhobOUHfJyfBSHDuO1hzkMTQHpBzQN5+Thf3+O+mi4zMl1zvS0bPs6yJs1Qf1Bn0F9gYR2MFQMw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:12.600777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-89bcb24d-5519-48af-b289-bde1456168c2 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:12.616392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-89bcb24d-5519-48af-b289-bde1456168c2 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for user 36fee37736ae4ce492db8c383eaed401 and project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:12.699399 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-89bcb24d-5519-48af-b289-bde1456168c2 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.162181 Sep 18 01:14:12.700152 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1483/2867] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:12.714329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e7244a5-5ecd-4870-b9ae-7775e1c8b9a9 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Action: 'create', calling method: .version_select at 0x7f7006afb9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1107449105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK79j6CMF3O75I8+nCICGu1u2UZM8tSQhRhbZH+Gdd2zpAhplUvXaY+WGlcYxZpHqV6vB+IPRvJXJzHveHYL5GW74CW6Nxj8iyRuvwj3ol29qZ0V5FSdVpdqdhNXyoP9AQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:12.732556 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2e7244a5-5ecd-4870-b9ae-7775e1c8b9a9 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:12.743275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2e7244a5-5ecd-4870-b9ae-7775e1c8b9a9 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for user 36fee37736ae4ce492db8c383eaed401 and project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:12.785452 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e7244a5-5ecd-4870-b9ae-7775e1c8b9a9 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.074879 Sep 18 01:14:12.794700 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1484/2868] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:12.801003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5785f6fb-ac26-4f28-9739-141034fb5073 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Action: 'create', calling method: .version_select at 0x7f7005432e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-977026356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9fVi4SrMur6QPcJUyZBmci1wlanw9GWiRVJGYF2Ct/N0v6gcIa8Zs/o95zEVbKwmrR67ZXgobJZtzvEkC7PwXVjP02TCmJqK4JA/eq88+CbUULSlb+dIAn46K4g9spQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:12.827416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5785f6fb-ac26-4f28-9739-141034fb5073 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:12.837209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5785f6fb-ac26-4f28-9739-141034fb5073 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Getting quotas for user 36fee37736ae4ce492db8c383eaed401 and project edcfbdf5f8c544a1acc9eda09de33941. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:12.897488 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5785f6fb-ac26-4f28-9739-141034fb5073 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.100083 Sep 18 01:14:12.905163 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1485/2869] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:12.914499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "73af8d7b-b63a-413a-a55e-8b35433165ac"}], "security_groups": [{"name": "tempest-securitygroup--1531814377"}], "key_name": "tempest-keypair-29610687", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:14.071622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] validate_networks() for [('73af8d7b-b63a-413a-a55e-8b35433165ac', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:15.750811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:14:15.752318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:14:15.757865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:14:15.758458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:14:15.759174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:14:15.759697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:14:15.759938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:14:15.760672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:14:15.761901 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:14:15.763456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:14:15.807635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:15.808166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:15.809507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:15.811071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:15.814952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:15.816036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:15.816548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:15.817584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:15.818465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:15.819876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:15.822947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:15.824738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:15.873289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for project 941f245a91fa4b078afc8047e827227e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:15.885492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Getting quotas for project 70699b2280334f19ad596b183f3718fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:15.890822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for user 4a53e55c3a684703a1ed5878f240f6c4 and project 941f245a91fa4b078afc8047e827227e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:15.898966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Getting quotas for user 3b51519d90f44a04b65fa5730e644760 and project 70699b2280334f19ad596b183f3718fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:15.928636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:14:15.936311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:14:15.943442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:14:15.949987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:14:16.091994 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e1cb91f-cc31-4989-8765-9fbbc4e97b6d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.729679 Sep 18 01:14:16.095987 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce44afc7-0afe-4614-9bd2-132c106f5799 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.188440 Sep 18 01:14:16.103650 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1385/2870] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:14:16.104687 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1486/2871] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 3199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:14:16.117581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e40a8128-dec6-4ea3-8206-6c299772aee1 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f700635c430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:16.129865 n-d-master-1 devstack@n-api.service[122374]: WARNING oslo_db.sqlalchemy.utils [None req-e40a8128-dec6-4ea3-8206-6c299772aee1 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 18 01:14:16.140928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:16.141596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:16.146614 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e40a8128-dec6-4ea3-8206-6c299772aee1 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.040445 Sep 18 01:14:16.147713 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1487/2872] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:14:16 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:16.153861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-10bc6ebd-8095-4b9d-a98f-f01f7c892b96 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:16.154896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-10bc6ebd-8095-4b9d-a98f-f01f7c892b96 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:16.178790 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:16.182252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:16.182931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:16.184964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:16.186216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:16.186876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:16.188908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:16.361975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-10bc6ebd-8095-4b9d-a98f-f01f7c892b96 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:16.372837 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-10bc6ebd-8095-4b9d-a98f-f01f7c892b96 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1224 microversion: 2.1 time: 0.223702 Sep 18 01:14:16.379291 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1488/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:16 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1224 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:16.402580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-290702e9-ce92-497a-911d-d25b3d740a13 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:16.403206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-290702e9-ce92-497a-911d-d25b3d740a13 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:16.525946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:16.537200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:16.538881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:16.546249 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ed11a0f-7fc6-43b6-9ef6-79abd4f157e5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1553 microversion: 2.91 time: 0.443494 Sep 18 01:14:16.569090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1386/2874] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:16 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1553 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:16.583181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d6b2ecbc-5af9-4f44-bb52-66e0d1973a0f tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f7005e75a60>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:16.609236 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d6b2ecbc-5af9-4f44-bb52-66e0d1973a0f tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-977026356" status: 202 len: 0 microversion: 2.1 time: 0.036864 Sep 18 01:14:16.610595 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1387/2875] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-977026356 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:14:16.623350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-783a8f58-2b6d-4007-bc9b-215900330c4a tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f700652c550>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:16.657716 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-783a8f58-2b6d-4007-bc9b-215900330c4a tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1107449105" status: 202 len: 0 microversion: 2.1 time: 0.039741 Sep 18 01:14:16.659154 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1388/2876] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 01:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1107449105 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:14:16.669658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3b095e9-49f4-4954-a7b7-3a3ef0472c12 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] Calling method '.version_select at 0x7f7005fdce50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:16.677921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-290702e9-ce92-497a-911d-d25b3d740a13 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:16.698723 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-290702e9-ce92-497a-911d-d25b3d740a13 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1222 microversion: 2.1 time: 0.300290 Sep 18 01:14:16.700908 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1489/2877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:16 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1222 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:16.727001 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3b095e9-49f4-4954-a7b7-3a3ef0472c12 tempest-KeyPairsV2TestJSON-1507173962 tempest-KeyPairsV2TestJSON-1507173962-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1781336950" status: 202 len: 0 microversion: 2.1 time: 0.062746 Sep 18 01:14:16.728092 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1389/2878] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 01:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1781336950 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:14:17.407881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:17.409156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:17.423239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:17.424075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:17.430068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:17.431050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:17.431945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:17.432780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:17.586353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:17.587557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:17.628581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:17.629199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:17.632580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:17.634272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:17.635572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:17.638007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:17.738309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:17.761530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e0fbc32-8aae-4652-8516-d036dc4de6e6 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1228 microversion: 2.1 time: 0.355952 Sep 18 01:14:17.780339 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1490/2879] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:17 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1228 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:17.791624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:17.794343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:17.827109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:17.827631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:17.828084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:17.830400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:17.831296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:17.831736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:17.831885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:17.843683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:17.845241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:17.859246 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0c2f014-5c3e-4fcd-b8b2-8cb89f74fa63 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1535 microversion: 2.91 time: 0.282786 Sep 18 01:14:17.861367 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1390/2880] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:17 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1535 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:18.318205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:18.327541 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5295b585-000a-4e38-b0e3-13f1d843cf0a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1218 microversion: 2.1 time: 0.545743 Sep 18 01:14:18.328727 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1491/2881] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:17 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1218 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:18.349108 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-788504768", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:18.480165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:18.788068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:18.788677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:18.799322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:18.802374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:18.804768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:18.805764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:18.808621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:18.809063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:19.078256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:19.088881 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6436b7e9-3a1b-41d2-8bce-fea737e6d78a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1282 microversion: 2.1 time: 0.305365 Sep 18 01:14:19.090920 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1492/2882] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:18 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1282 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:19.096459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:19.096742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:19.105204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:19.106022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:19.106770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:19.110682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:19.111991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:19.112444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:19.476516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:19.491099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:19.495822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:19.503669 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a062777-da08-4771-aaf2-0e8a1c6f24e6 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1535 microversion: 2.91 time: 0.412792 Sep 18 01:14:19.505448 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1493/2883] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:19 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1535 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:19.536352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:19.537315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:19.546406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:19.547376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:19.548829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:19.550377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:19.550851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:19.551283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:19.735035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:19.748482 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:19.753667 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d952ee85-cc04-4cd8-b372-ebf52915488d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1292 microversion: 2.1 time: 0.246918 Sep 18 01:14:19.754805 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1494/2884] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:19 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1292 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:19.798952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:14:19.799471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:14:19.804867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:14:19.806649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:14:19.807088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:14:19.824392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:19.825751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:19.826941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:19.828333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:19.828965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:19.829301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:19.885690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Getting quotas for project c68b241d9f2e4caba8024093c0bdf903. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:19.892166 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:19.893002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Getting quotas for user a16a5f20794549518f8c3ab8d40492d6 and project c68b241d9f2e4caba8024093c0bdf903. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:19.919172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:14:19.925534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:14:20.030018 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc01153a-5e4e-49c7-b3d6-b9a2706fe9dd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.157103 Sep 18 01:14:20.030940 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1391/2885] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:14:20.136161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:20.138263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:20.152345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:20.153295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:20.154891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:20.156271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:20.157230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:20.158495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:20.259404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1560573732", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:20.340112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:20.851813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:20.862642 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-094f06da-c760-43b3-a71f-d201854cfac9 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 0.750610 Sep 18 01:14:20.865311 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1495/2886] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:20 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:20.887182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:20.887894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:20.896552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:20.897056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:20.897492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:20.898504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:20.899124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:20.899712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:21.518251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:21.534940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:21.536843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:21.543880 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93234cda-4ade-4391-88ce-96e77fb05050 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1535 microversion: 2.91 time: 0.677259 Sep 18 01:14:21.546122 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1496/2887] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:20 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1535 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:21.561931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:21.562975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:21.576470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:21.577625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:21.578305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:21.579448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:21.580352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:21.581080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:21.754852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:21.773483 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac4dcd79-e2cc-4f0e-ba2c-ecd1bd11e002 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1280 microversion: 2.1 time: 0.225494 Sep 18 01:14:21.789426 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1497/2888] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:21 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:21.870248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:14:21.873926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:14:21.875709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:14:21.877878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:14:21.878541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:14:21.886749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:21.887930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:21.906461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:21.908303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:21.910650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:21.912177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:21.913186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:21.915930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:21.916487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:21.917289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:21.920920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:21.921748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:21.922222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:21.925325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:21.977723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Getting quotas for project c68b241d9f2e4caba8024093c0bdf903. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:21.994541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Getting quotas for user a16a5f20794549518f8c3ab8d40492d6 and project c68b241d9f2e4caba8024093c0bdf903. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:22.018461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:14:22.021357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:14:22.079725 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc782045-04f6-4b1e-b297-112bd5944441 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.825502 Sep 18 01:14:22.081025 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1392/2889] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:14:22.086031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-600c8f14-f681-447c-9274-d686cf31f22b req-b0b81566-015f-4791-be7e-c97a24272802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07", "tag": "d6772adf-629a-4a86-8862-d5884609244c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:22.098660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-600c8f14-f681-447c-9274-d686cf31f22b req-b0b81566-015f-4791-be7e-c97a24272802 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:22.099431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-600c8f14-f681-447c-9274-d686cf31f22b req-b0b81566-015f-4791-be7e-c97a24272802 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:22.100016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-600c8f14-f681-447c-9274-d686cf31f22b req-b0b81566-015f-4791-be7e-c97a24272802 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:22.113007 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-600c8f14-f681-447c-9274-d686cf31f22b req-b0b81566-015f-4791-be7e-c97a24272802 service nova] Creating event network-changed:d6772adf-629a-4a86-8862-d5884609244c for instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 on n-h1-master-1 Sep 18 01:14:22.118517 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-600c8f14-f681-447c-9274-d686cf31f22b req-b0b81566-015f-4791-be7e-c97a24272802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036140 Sep 18 01:14:22.119689 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1393/2890] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:22.126425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64e8611c-7d4f-4d2f-bc8b-077700e1be18 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:22.128287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64e8611c-7d4f-4d2f-bc8b-077700e1be18 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:22.251970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64e8611c-7d4f-4d2f-bc8b-077700e1be18 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:22.262646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64e8611c-7d4f-4d2f-bc8b-077700e1be18 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1214 microversion: 2.1 time: 0.139660 Sep 18 01:14:22.263296 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1394/2891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:22 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:22.607496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:22.616224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:22.618035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:22.631905 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36121b98-d642-4ed2-a174-6c97846a8460 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 0.748521 Sep 18 01:14:22.632308 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1498/2892] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:21 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:22.666140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:22.669242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:22.670422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:22.672258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:22.673482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:22.673598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:22.816904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:22.818772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:22.828251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:22.830252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:22.831084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:22.832097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:22.832762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:22.833428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:22.963833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:22.996530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:23.004870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:23.013029 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c15e624-178a-43e2-8c20-41bcf7a8c60c tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1478 microversion: 2.91 time: 0.435575 Sep 18 01:14:23.014652 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1395/2893] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:22 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1478 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:23.048516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:23.050986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:23.063082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.064503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.066094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:23.067031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.074840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.075294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:23.136518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:23.167028 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-380066b0-7c87-4dd2-b951-4a71400988b1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1280 microversion: 2.1 time: 0.351332 Sep 18 01:14:23.170020 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1499/2894] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:22 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1280 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:23.227379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=122373) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 01:14:23.289977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:23.290785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:23.306501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.307750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.309985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:23.314541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.315280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.315916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:23.362048 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d3fa3ad-ffa7-49ed-804f-0be7867cd099 tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action" status: 202 len: 0 microversion: 2.91 time: 0.316200 Sep 18 01:14:23.367458 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1396/2895] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:14:23 2022] POST /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:14:23.408602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:23.412330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:23.451992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.453039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.453520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:23.454897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.455373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.455803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:23.476961 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:23.743316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:23.755782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:23.756016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:23.758307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:23.772582 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-654e86a5-f5ff-46d1-8e38-4e0599cc8dc1 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1486 microversion: 2.91 time: 0.401956 Sep 18 01:14:23.773931 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1397/2896] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:23 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1486 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:14:23.782624 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8ebc0f9-d43b-4374-b3d7-694c3f1080e7 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1210 microversion: 2.1 time: 0.494148 Sep 18 01:14:23.784424 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1500/2897] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:23 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1210 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:23.787122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:23.788096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:23.797140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.798476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.799799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:23.800743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:23.801407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:23.802079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:24.194055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:24.196138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:24.206979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:24.207931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:24.208919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:24.209966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:24.210818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:24.211514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:24.766025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:24.775173 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09919300-eae6-40d8-8dff-0e19b0aa6030 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 0.999733 Sep 18 01:14:24.782830 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1398/2898] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:23 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:24.810523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:24.811169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:24.820626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:24.820834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:24.825531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:24.827576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:24.830504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:24.831157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:25.373120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:25.383286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:25.384728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:25.404735 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e7c438cd-f226-46c9-b86a-3d521ca24ced tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1486 microversion: 2.91 time: 0.600163 Sep 18 01:14:25.405202 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1399/2899] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:24 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1486 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:25.409805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:25.418415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:25.429276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:25.430193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:25.431019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:25.431929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:25.432722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:25.433588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:25.714283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:25.729284 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-415e3c76-7c36-4f8a-b0cd-4b1ebc66ce57 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 1.540171 Sep 18 01:14:25.734008 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1501/2900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:24 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:25.743049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-61672fe7-e9ac-41c0-a5b0-f824605ae772 req-8ebdc7d2-fd6a-44db-bccf-ee4648470957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8104143-3ea0-401c-9057-7f71d7cce8ed", "tag": "81f99da0-b91a-4dc2-ab5f-c396ef392004"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:25.769229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-61672fe7-e9ac-41c0-a5b0-f824605ae772 req-8ebdc7d2-fd6a-44db-bccf-ee4648470957 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:25.770200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-61672fe7-e9ac-41c0-a5b0-f824605ae772 req-8ebdc7d2-fd6a-44db-bccf-ee4648470957 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:25.770843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-61672fe7-e9ac-41c0-a5b0-f824605ae772 req-8ebdc7d2-fd6a-44db-bccf-ee4648470957 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:25.805462 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-61672fe7-e9ac-41c0-a5b0-f824605ae772 req-8ebdc7d2-fd6a-44db-bccf-ee4648470957 service nova] Creating event network-changed:81f99da0-b91a-4dc2-ab5f-c396ef392004 for instance f8104143-3ea0-401c-9057-7f71d7cce8ed on n-h2-master-1 Sep 18 01:14:25.813457 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-61672fe7-e9ac-41c0-a5b0-f824605ae772 req-8ebdc7d2-fd6a-44db-bccf-ee4648470957 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077673 Sep 18 01:14:25.818195 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1502/2901] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:25.828122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:25.829360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:25.843194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:25.844000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:25.845195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:25.846221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:25.846896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:25.847541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:25.892931 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:25.916787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:25.928137 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f017114d-d06f-43d2-8bcb-399b2e383deb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1272 microversion: 2.1 time: 0.521819 Sep 18 01:14:25.943968 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1400/2902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:25 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1272 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:26.435754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:26.436515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:26.444939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:26.449641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:26.450417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:26.458227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:26.462016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:26.463796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:26.695348 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=38 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:26.784394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:26.803270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:26.806232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:26.807387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:26.816892 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-23947438-b937-46b5-8e4f-25f0d6c92cbc tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 0.997271 Sep 18 01:14:26.820922 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68b3c32d-1a04-43ea-b835-d0f193e7c271 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.389557 Sep 18 01:14:26.821809 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1503/2904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:25 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:26.822022 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1401/2904] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:26 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:14:26.834166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:26.842199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:26.859940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:26.861278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:26.862028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:26.862921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:26.864482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:26.865146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:26.951428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:26.952133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:26.960516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:26.961480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:26.962159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:26.963361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:26.964030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:26.964667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:27.326463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:27.335212 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b40f60b5-f6a4-4f45-b467-7883f3217cc0 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1272 microversion: 2.1 time: 0.387980 Sep 18 01:14:27.342963 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1504/2905] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:26 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:27.443565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:27.452574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c224d7ea-35b1-4b6c-a091-7e73168cc395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 0.629434 Sep 18 01:14:27.456076 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1402/2906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:26 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:27.855467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:27.856096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:27.858023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:27.858971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:27.899790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:27.900280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:27.901000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:27.904779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:27.905269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:27.914268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:27.915067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:27.915554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:27.915997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:27.917921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:27.918808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:27.919429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:28.673208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:28.684000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:28.692998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:28.707522 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69a8bdac-cb91-4768-88a4-15e81ca9b6ca tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.861166 Sep 18 01:14:28.710230 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1403/2907] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:27 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:28.719844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:28.720861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:28.735492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:28.738245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:28.739514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:28.741942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:28.742659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:28.743291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:29.038860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:29.047736 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d9ca341-6d50-4409-be0f-14e9d8d6b454 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1272 microversion: 2.1 time: 0.335985 Sep 18 01:14:29.059416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1404/2908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:28 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:29.074833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:29.075464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:29.115096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:29.125699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:29.126406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:29.129231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:29.130275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:29.132674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:29.948071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:29.960814 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2c4736e-6eb3-4e82-be0d-5ab408d8f403 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 2.116897 Sep 18 01:14:29.965363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1505/2909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:27 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:29.978909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4b89469d-335e-4276-9d58-64354e884340 req-a4d1e6f6-e535-4cad-90a6-7f231dd3cc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07", "name": "network-vif-plugged", "status": "completed", "tag": "d6772adf-629a-4a86-8862-d5884609244c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:30.006545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b89469d-335e-4276-9d58-64354e884340 req-a4d1e6f6-e535-4cad-90a6-7f231dd3cc40 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:30.010511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b89469d-335e-4276-9d58-64354e884340 req-a4d1e6f6-e535-4cad-90a6-7f231dd3cc40 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:30.011353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b89469d-335e-4276-9d58-64354e884340 req-a4d1e6f6-e535-4cad-90a6-7f231dd3cc40 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:30.045213 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4b89469d-335e-4276-9d58-64354e884340 req-a4d1e6f6-e535-4cad-90a6-7f231dd3cc40 service nova] Creating event network-vif-plugged:d6772adf-629a-4a86-8862-d5884609244c for instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 on n-h1-master-1 Sep 18 01:14:30.056624 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4b89469d-335e-4276-9d58-64354e884340 req-a4d1e6f6-e535-4cad-90a6-7f231dd3cc40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089589 Sep 18 01:14:30.058407 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1506/2910] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:30.076771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:30.082780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:30.091860 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:30.092703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:30.093392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:30.095100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:30.095664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:30.096207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:30.443014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:30.457151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:30.459368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:30.493200 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ef359022-8db6-415f-8ea6-8e39d21c21fe tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.430233 Sep 18 01:14:30.494099 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1507/2911] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:30 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:30.503441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:30.507668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:30.518976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:30.521137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:30.522347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:30.523791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:30.525010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:30.526998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:31.039929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:31.049280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:31.054952 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61094d13-d0c1-4d2f-b26c-688e73934ad6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.559450 Sep 18 01:14:31.058410 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1508/2912] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:30 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:31.059345 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0726d5c-e9bc-45ed-a67c-8c1094f56b3e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 1.998712 Sep 18 01:14:31.061378 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1405/2913] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:29 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:31.096277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:31.103719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:31.116718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:31.138802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:31.139434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:31.140212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:31.140692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:31.141156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:31.529277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:31.529913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:31.540387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:31.543720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:31.544430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:31.546434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:31.547076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:31.548878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:31.677046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:31.698645 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fcb9f630-4fad-4704-9c57-e436119d0857 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 0.638890 Sep 18 01:14:31.703015 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1509/2914] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:31 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:31.746147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:31.759720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:31.762743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:31.770843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e913923-0bca-4503-b856-670c5ce6fad8 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.245787 Sep 18 01:14:31.772663 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1406/2915] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:31 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:14:31.903830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-36dff8ef-8351-40e3-882e-0d20a96f3906 req-96e9c7ce-97f8-49a7-967d-af3fa3bbab6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a09f58-2baa-476a-9155-f1016a25f44f", "tag": "70b262f8-ad73-4c17-9883-1a1098d51c7f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:31.934672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-36dff8ef-8351-40e3-882e-0d20a96f3906 req-96e9c7ce-97f8-49a7-967d-af3fa3bbab6d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:31.936773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-36dff8ef-8351-40e3-882e-0d20a96f3906 req-96e9c7ce-97f8-49a7-967d-af3fa3bbab6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:31.938615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-36dff8ef-8351-40e3-882e-0d20a96f3906 req-96e9c7ce-97f8-49a7-967d-af3fa3bbab6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:31.955018 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-36dff8ef-8351-40e3-882e-0d20a96f3906 req-96e9c7ce-97f8-49a7-967d-af3fa3bbab6d service nova] Creating event network-changed:70b262f8-ad73-4c17-9883-1a1098d51c7f for instance d9a09f58-2baa-476a-9155-f1016a25f44f on n-h2-master-1 Sep 18 01:14:31.965123 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-36dff8ef-8351-40e3-882e-0d20a96f3906 req-96e9c7ce-97f8-49a7-967d-af3fa3bbab6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066994 Sep 18 01:14:31.967285 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1510/2916] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:32.099350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:32.100465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:32.101183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:32.101848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:32.112682 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:32.113988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:32.114515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:32.114953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:32.115679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:32.118773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:32.121046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:32.122250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:32.122411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:32.122793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:32.124148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:32.125844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:32.126830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:32.257196 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=28 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:32.986568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:32.997158 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1383a9b0-0676-4eb9-9002-8b3651facd83 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.903919 Sep 18 01:14:33.017313 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1407/2917] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:32 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:33.031170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:33.036716 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:33.051359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:33.052147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:33.052803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:33.055391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:33.056193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:33.057258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:33.292365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:33.314142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76bea9b3-4d54-43bf-9224-f2226b20b1bd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 1.210359 Sep 18 01:14:33.317661 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1511/2918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:32 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:33.322949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:33.335227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:33.361979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:33.362814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:33.363516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:33.364492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:33.367196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:33.367892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:34.113031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:34.132282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:34.137222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:34.173493 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e5a6f44-addc-44d0-b078-06ea00572c99 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.853750 Sep 18 01:14:34.182138 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1512/2919] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:33 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:34.189078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4b282439-c955-4bb6-bc25-0dd9d1271d95 req-c57428b3-8df1-4f25-8fe0-4f6f527ad915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f354c30-7ca1-41fa-b98b-024302f6544c", "tag": "e8130d77-3807-4849-af92-54003c070986"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:34.221792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b282439-c955-4bb6-bc25-0dd9d1271d95 req-c57428b3-8df1-4f25-8fe0-4f6f527ad915 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:34.223679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b282439-c955-4bb6-bc25-0dd9d1271d95 req-c57428b3-8df1-4f25-8fe0-4f6f527ad915 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:34.227273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b282439-c955-4bb6-bc25-0dd9d1271d95 req-c57428b3-8df1-4f25-8fe0-4f6f527ad915 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:34.259170 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4b282439-c955-4bb6-bc25-0dd9d1271d95 req-c57428b3-8df1-4f25-8fe0-4f6f527ad915 service nova] Creating event network-changed:e8130d77-3807-4849-af92-54003c070986 for instance 5f354c30-7ca1-41fa-b98b-024302f6544c on n-h1-master-1 Sep 18 01:14:34.270106 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4b282439-c955-4bb6-bc25-0dd9d1271d95 req-c57428b3-8df1-4f25-8fe0-4f6f527ad915 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085939 Sep 18 01:14:34.271072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1513/2920] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:34.286001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:34.286776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:34.310054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:34.311238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:34.314176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:34.315253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:34.316435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:34.319402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:34.377730 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:34.453391 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:34.478350 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7e9e7faf-4ab9-40cb-8bc8-83d3088cc476 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 1.448074 Sep 18 01:14:34.486342 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1408/2921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:33 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:34.491407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:34.494271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:34.528240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:34.528960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:34.532585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:34.535098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:34.540354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:34.541831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:34.715350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:34.724865 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ecb4c1ce-ac9b-4d82-847f-677db3ca8075 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.452150 Sep 18 01:14:34.725469 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1514/2922] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:34 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:34.733777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c6001793-f374-4989-a192-09f236ea69e4 req-c7c08da3-58ef-40ed-8e2b-3943e40b4965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8104143-3ea0-401c-9057-7f71d7cce8ed", "name": "network-vif-plugged", "status": "completed", "tag": "81f99da0-b91a-4dc2-ab5f-c396ef392004"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:34.753377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c6001793-f374-4989-a192-09f236ea69e4 req-c7c08da3-58ef-40ed-8e2b-3943e40b4965 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:34.753988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c6001793-f374-4989-a192-09f236ea69e4 req-c7c08da3-58ef-40ed-8e2b-3943e40b4965 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:34.754565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c6001793-f374-4989-a192-09f236ea69e4 req-c7c08da3-58ef-40ed-8e2b-3943e40b4965 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:34.771225 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c6001793-f374-4989-a192-09f236ea69e4 req-c7c08da3-58ef-40ed-8e2b-3943e40b4965 service nova] Creating event network-vif-plugged:81f99da0-b91a-4dc2-ab5f-c396ef392004 for instance f8104143-3ea0-401c-9057-7f71d7cce8ed on n-h2-master-1 Sep 18 01:14:34.782776 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c6001793-f374-4989-a192-09f236ea69e4 req-c7c08da3-58ef-40ed-8e2b-3943e40b4965 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054864 Sep 18 01:14:34.787782 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1515/2923] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:34.939810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:34.956481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e5f46cf-130f-4989-89df-340b331d76cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 0.465176 Sep 18 01:14:34.957392 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1409/2924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:34 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:35.205914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:35.207597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:35.228466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:35.232511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:35.234074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:35.238602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:35.239966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:35.242662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:35.487162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:35.510391 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:35.511504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:35.512235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:35.515385 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:35.525151 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e7ed678-9cec-49cb-a0bd-d3fc68e9636f tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.325388 Sep 18 01:14:35.526834 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1516/2925] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:35 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:35.529694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:35.530731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:35.531386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:35.532335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:35.533523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:35.541140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:35.755096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:35.755934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:35.795020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:35.796102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:35.796597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:35.803628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:35.804124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:35.804568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:36.211211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:36.230832 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bef9edf0-d930-4270-aaa0-7a2977f8cfd3 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 0.715551 Sep 18 01:14:36.255969 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1410/2926] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:35 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:36.274546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:36.276610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:36.293901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:36.300953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:36.301810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:36.302779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:36.305481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:36.316296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:36.786257 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:36.824763 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8eeee42-fb90-4e6c-9cfc-e7f72a49a102 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 1.076040 Sep 18 01:14:36.834131 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1517/2927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:35 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:36.840220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-588648a8-2b55-4f73-b82b-68dd91a4cdba req-4168a08c-0897-4cc4-a9a2-661e3a1d707c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5630c51-cb2e-4be2-8071-62ddb2cc6581", "tag": "b7cc2f81-18db-413b-96f5-8062a09b3bd2"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:36.853417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-588648a8-2b55-4f73-b82b-68dd91a4cdba req-4168a08c-0897-4cc4-a9a2-661e3a1d707c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:36.854775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-588648a8-2b55-4f73-b82b-68dd91a4cdba req-4168a08c-0897-4cc4-a9a2-661e3a1d707c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:36.855432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-588648a8-2b55-4f73-b82b-68dd91a4cdba req-4168a08c-0897-4cc4-a9a2-661e3a1d707c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:36.888280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-588648a8-2b55-4f73-b82b-68dd91a4cdba req-4168a08c-0897-4cc4-a9a2-661e3a1d707c service nova] Creating event network-changed:b7cc2f81-18db-413b-96f5-8062a09b3bd2 for instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 on n-h2-master-1 Sep 18 01:14:36.904744 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-588648a8-2b55-4f73-b82b-68dd91a4cdba req-4168a08c-0897-4cc4-a9a2-661e3a1d707c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066567 Sep 18 01:14:36.908561 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1518/2928] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:36.923382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:36.926822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:36.943817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:36.946975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:36.948989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:36.950465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:36.953055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:36.957479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:37.156056 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:37.176174 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13a807cb-88f5-4757-b0a1-b0cf19c86eac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 0.914343 Sep 18 01:14:37.177768 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1411/2929] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:36 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:37.275774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:37.276678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:37.287496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:37.290271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:37.290926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:37.291852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:37.294122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:37.294815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:37.531350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:37.553504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:37.577604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:37.610572 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01df18e4-8556-4bb3-adcb-87764a9cdbd5 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.693536 Sep 18 01:14:37.625762 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1519/2930] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:36 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:37.863833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:37.864743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:37.887093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:37.887714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:37.888258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:37.889251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:37.889995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:37.890770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:38.697719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:38.716919 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8ec6380d-5540-42c5-9295-ab06290a18cf tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.857701 Sep 18 01:14:38.717574 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1520/2931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:37 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:38.754719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:38.758377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:38.765394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:38.776074 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-af0f2532-94b6-49f8-98b8-bed8722f197e tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1350 microversion: 2.1 time: 1.504213 Sep 18 01:14:38.779773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:38.780277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:38.780901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:38.781413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:38.782496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:38.786240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:38.796296 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1412/2932] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:37 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1350 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:38.814016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:38.830089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:38.850371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:38.852069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:38.854434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:38.856105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:38.858000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:38.871669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:39.094454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:39.103871 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:39.113396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:39.119259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:39.148003 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-406c6de7-7931-4001-9291-06eef24c3f0d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.350283 Sep 18 01:14:39.149097 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1413/2933] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:38 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:39.560843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:39.571698 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a323b285-3f73-4152-83a9-8d29719e8e00 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 0.832006 Sep 18 01:14:39.572278 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1521/2934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:38 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:39.744907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:39.745535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:39.753008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:39.753988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:39.754696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:39.755631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:39.756255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:39.756833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:39.812165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:39.813537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:39.849104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:39.850055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:39.855621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:39.858449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:39.865838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:39.866650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:40.202847 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:40.209249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:40.215722 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f13b912b-926b-4e5d-9666-b051685cb1e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.474606 Sep 18 01:14:40.217956 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1414/2935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:39 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:40.224057 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1575bb2f-35a0-44c5-8fa4-8b19afcee887 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1540 microversion: 2.1 time: 0.412762 Sep 18 01:14:40.225021 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1522/2936] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:39 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1540 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:40.244494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:40.259271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:40.264437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:40.265400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:40.266549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:40.267285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:40.268046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:40.268997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:40.269867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:40.270513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:40.280213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:40.280921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:40.281672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:40.283127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:40.283760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:40.284348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:40.360089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:40.370656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:40.373672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:40.383102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-53b83be5-7c4e-4435-92f1-e662a62deb33 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.163375 Sep 18 01:14:40.384285 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1415/2937] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:40 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:40.403769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-323e45e4-3781-416e-b588-91db79f57031 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144126 Sep 18 01:14:40.405289 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1523/2938] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:14:40 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:40.595552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:40.596171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:40.612992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:40.613403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:40.613871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:40.614664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:40.615130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:40.615559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:41.260318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:41.260944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:41.267900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:41.268596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:41.269245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:41.270155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:41.270775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:41.271372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:41.674146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:41.691498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:41.697618 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ab7464b-95cf-478c-83cd-e2d27a797397 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.440726 Sep 18 01:14:41.704691 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07931b93-aaa4-4885-b8dd-b634d7764739 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 1.113361 Sep 18 01:14:41.711696 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1524/2939] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:41 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:41.726381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1416/2940] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:40 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:41.733109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:41.737720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:41.749632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:41.757519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:41.758370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:41.759706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:41.760385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:41.761028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:41.991432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:42.009455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:42.011135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:42.020477 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b564f62-ba74-4222-b939-70bea3adafc0 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.305237 Sep 18 01:14:42.021181 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1525/2941] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:41 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:42.745007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:42.746428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:42.749992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:42.752039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:42.756657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:42.757171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:42.764327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:42.766567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:42.770103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:42.776085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:42.776697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:42.778193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:42.781421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:42.782478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:42.787521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:42.787782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:43.242583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:43.252484 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ccece14-6d8b-4332-82f9-39bd866b4f8e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.508234 Sep 18 01:14:43.259689 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1526/2942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:42 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:43.276985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:43.286829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:43.303503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:43.304741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:43.305487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:43.306843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:43.307674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:43.308827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:43.342839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:43.360965 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a866fd40-36db-43e0-a583-b1cca9ab38ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 0.617262 Sep 18 01:14:43.363668 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1417/2943] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:42 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:43.390430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f39b606e-d336-4d3c-a744-258f39a7384f req-057ae951-8821-4fe1-9ed9-abc0d10d0960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a09f58-2baa-476a-9155-f1016a25f44f", "name": "network-vif-plugged", "status": "completed", "tag": "70b262f8-ad73-4c17-9883-1a1098d51c7f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:43.412810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f39b606e-d336-4d3c-a744-258f39a7384f req-057ae951-8821-4fe1-9ed9-abc0d10d0960 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:43.414418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f39b606e-d336-4d3c-a744-258f39a7384f req-057ae951-8821-4fe1-9ed9-abc0d10d0960 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:43.415394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f39b606e-d336-4d3c-a744-258f39a7384f req-057ae951-8821-4fe1-9ed9-abc0d10d0960 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:43.448909 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f39b606e-d336-4d3c-a744-258f39a7384f req-057ae951-8821-4fe1-9ed9-abc0d10d0960 service nova] Creating event network-vif-plugged:70b262f8-ad73-4c17-9883-1a1098d51c7f for instance d9a09f58-2baa-476a-9155-f1016a25f44f on n-h2-master-1 Sep 18 01:14:43.462557 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f39b606e-d336-4d3c-a744-258f39a7384f req-057ae951-8821-4fe1-9ed9-abc0d10d0960 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096143 Sep 18 01:14:43.470288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1418/2944] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:43.489684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:43.503061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:43.519678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:43.533813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-020a5eb3-635e-4724-8b2b-2be2955e262d tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1544 microversion: 2.91 time: 0.270723 Sep 18 01:14:43.534520 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1527/2945] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:43 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1544 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:44.270248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ca97a289-b68f-4504-af77-885e47a5bb30 req-871df64c-5aca-4a14-a274-999eebe80635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8104143-3ea0-401c-9057-7f71d7cce8ed", "tag": "81f99da0-b91a-4dc2-ab5f-c396ef392004"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:44.284379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:44.285748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:44.301566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:44.302497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:44.305649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:44.306723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:44.307531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:44.309799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:44.310657 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:44.312786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca97a289-b68f-4504-af77-885e47a5bb30 req-871df64c-5aca-4a14-a274-999eebe80635 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:44.313279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca97a289-b68f-4504-af77-885e47a5bb30 req-871df64c-5aca-4a14-a274-999eebe80635 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:44.314702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca97a289-b68f-4504-af77-885e47a5bb30 req-871df64c-5aca-4a14-a274-999eebe80635 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:44.342588 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ca97a289-b68f-4504-af77-885e47a5bb30 req-871df64c-5aca-4a14-a274-999eebe80635 service nova] Creating event network-changed:81f99da0-b91a-4dc2-ab5f-c396ef392004 for instance f8104143-3ea0-401c-9057-7f71d7cce8ed on n-h2-master-1 Sep 18 01:14:44.365703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ca97a289-b68f-4504-af77-885e47a5bb30 req-871df64c-5aca-4a14-a274-999eebe80635 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121264 Sep 18 01:14:44.367079 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1419/2946] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:44.428012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:44.444271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:44.482199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:44.492421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:44.493264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:44.494614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:44.509546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:44.521834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:44.679204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:44.697497 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc32c4c8-2e2c-4a35-a7ae-8416a7e6a947 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.418153 Sep 18 01:14:44.698826 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1528/2947] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:44 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:44.704216 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:44.708859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:44.722680 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:44.727296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:44.729938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:44.730590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:44.733491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:44.735429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:44.736180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:45.519730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:45.540909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:45.544663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:45.566475 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-719d8c63-0f76-4843-a525-1cb12792507a tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1531 microversion: 2.91 time: 0.865896 Sep 18 01:14:45.568416 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1529/2948] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:44 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1531 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:45.574867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-aeff395f-7265-4f95-af39-b0e584b244a7 req-21a95795-c0d0-49b3-9818-42357064ca61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f354c30-7ca1-41fa-b98b-024302f6544c", "name": "network-vif-plugged", "status": "completed", "tag": "e8130d77-3807-4849-af92-54003c070986"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:45.604932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aeff395f-7265-4f95-af39-b0e584b244a7 req-21a95795-c0d0-49b3-9818-42357064ca61 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:45.606460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aeff395f-7265-4f95-af39-b0e584b244a7 req-21a95795-c0d0-49b3-9818-42357064ca61 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:45.607127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aeff395f-7265-4f95-af39-b0e584b244a7 req-21a95795-c0d0-49b3-9818-42357064ca61 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:45.633336 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-aeff395f-7265-4f95-af39-b0e584b244a7 req-21a95795-c0d0-49b3-9818-42357064ca61 service nova] Creating event network-vif-plugged:e8130d77-3807-4849-af92-54003c070986 for instance 5f354c30-7ca1-41fa-b98b-024302f6544c on n-h1-master-1 Sep 18 01:14:45.647883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-aeff395f-7265-4f95-af39-b0e584b244a7 req-21a95795-c0d0-49b3-9818-42357064ca61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076350 Sep 18 01:14:45.652688 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1530/2949] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:45.662208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:45.666817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:45.681634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:45.682138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:45.686925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:45.687824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:45.688651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:45.689249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:45.757197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:45.768554 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7310b32-26b3-4c29-80e3-37a9172cca7b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1322 microversion: 2.1 time: 1.377767 Sep 18 01:14:45.791552 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1420/2950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:44 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1322 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:45.809422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:45.826763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:45.836609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:45.840368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:45.841144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:45.843044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:45.844964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:45.845630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:45.869534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] Lazy-loading 'services' on Instance uuid 630051a8-a626-45b4-bc41-aeb93e5e6617 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:14:45.934942 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e4237fd3-0685-476f-b613-9ea8db27a3ce tempest-UnshelveToHostMultiNodesTest-1238034250 tempest-UnshelveToHostMultiNodesTest-1238034250-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1936 microversion: 2.91 time: 0.280910 Sep 18 01:14:45.936948 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1531/2951] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:45 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1936 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:45.996897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:45.997900 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:46.009948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:46.013880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:46.016470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:46.019956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:46.021033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:46.031847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:46.080825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:14:46.085310 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:46.138013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:46.153252 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0c8c49a-6469-4f0d-abd6-dda9c05f6f5c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.347909 Sep 18 01:14:46.159219 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1421/2952] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:45 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:46.234195 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f5bd5c9a-3550-4432-bb0e-a66a9634bd5e tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "DELETE /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 204 len: 0 microversion: 2.91 time: 0.241060 Sep 18 01:14:46.235868 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1532/2953] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:14:45 2022] DELETE /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:14:46.244628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:46.245486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:46.256323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:46.257131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:46.257881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:46.259044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:46.259988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:46.260641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:46.379276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:46.394237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:46.396646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:46.415750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e56af23-526a-4d0a-a8eb-84ddb6a33e36 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.175728 Sep 18 01:14:46.418836 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1422/2954] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:46 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:46.796830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:46.797545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:46.805035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:46.805531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:46.805998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:46.806706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:46.809210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:46.809641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:47.039890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:47.053513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08e3d067-d5ab-40c3-befa-9dd2db986871 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1516 microversion: 2.1 time: 0.261840 Sep 18 01:14:47.070956 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1533/2955] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:46 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:47.084098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:47.086239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:47.102659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:47.103160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:47.103599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:47.104937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:47.105598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:47.106024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:47.159556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lazy-loading 'flavor' on Instance uuid d9a09f58-2baa-476a-9155-f1016a25f44f {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:14:47.302053 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b140d9c-2685-4edd-b5bb-f28827bdd4f2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action" status: 200 len: 32 microversion: 2.1 time: 0.223378 Sep 18 01:14:47.303394 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1423/2956] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:14:47 2022] POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:14:47.311591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:47.314801 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:47.348544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:47.349361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:47.349998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:47.357588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:47.358521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:47.359743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:47.725886 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb4f0448-e8b0-4ad1-9dfc-a9d805ec27a1 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f700a7d6670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2023018800", "description": "tempest-description-1944763106"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:48.012683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:48.028933 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f4d1b9b3-4f8f-4fbe-850d-6f9e9451d92b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.724042 Sep 18 01:14:48.029906 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1424/2957] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:47 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:48.042317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:48.046094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:48.069268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:48.070092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:48.070746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:48.071673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:48.072311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:48.072913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:48.354479 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb4f0448-e8b0-4ad1-9dfc-a9d805ec27a1 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.205865 Sep 18 01:14:48.363824 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1534/2958] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:14:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:48.363824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:48.364878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:48.381726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:48.383761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:48.384425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:48.386000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:48.388177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:48.391510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:48.404234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:48.415610 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb7b30df-2344-47fb-a317-d7a3c64a67cf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.384313 Sep 18 01:14:48.425756 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1425/2959] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:48 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:48.443926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d988c8f5-2599-433d-8a43-57215e124a7d req-62fabb74-3364-4982-a8db-e2deabc18815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5630c51-cb2e-4be2-8071-62ddb2cc6581", "name": "network-vif-plugged", "status": "completed", "tag": "b7cc2f81-18db-413b-96f5-8062a09b3bd2"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:48.461339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d988c8f5-2599-433d-8a43-57215e124a7d req-62fabb74-3364-4982-a8db-e2deabc18815 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:48.461846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d988c8f5-2599-433d-8a43-57215e124a7d req-62fabb74-3364-4982-a8db-e2deabc18815 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:48.466413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d988c8f5-2599-433d-8a43-57215e124a7d req-62fabb74-3364-4982-a8db-e2deabc18815 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:48.492004 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d988c8f5-2599-433d-8a43-57215e124a7d req-62fabb74-3364-4982-a8db-e2deabc18815 service nova] Creating event network-vif-plugged:b7cc2f81-18db-413b-96f5-8062a09b3bd2 for instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 on n-h2-master-1 Sep 18 01:14:48.506511 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d988c8f5-2599-433d-8a43-57215e124a7d req-62fabb74-3364-4982-a8db-e2deabc18815 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079139 Sep 18 01:14:48.507852 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1426/2960] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:48.575910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:48.618840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:48.636673 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:48.659374 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55f076d7-f7ff-43d2-aa3a-932e470a9541 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1537 microversion: 2.91 time: 0.302253 Sep 18 01:14:48.672730 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1535/2961] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:48 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1537 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:48.683676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cda51387-ba87-4624-a289-00b38fa15e60 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f7005492790>, body: {"security_group_rule": {"parent_group_id": "f4ea0f78-0346-4d70-acfc-2eeb47fa0508", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:48.929470 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-663685541", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:49.030060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] validate_networks() for [('972e89e0-1dc6-4f89-aa18-8875eb7b4545', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:49.728632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:14:49.729307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:14:49.729499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:14:49.730338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:14:49.731037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:14:49.751229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:49.753887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:49.756132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:49.760131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:49.762258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:49.763831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:49.788626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Getting quotas for project 00b76e1b50e349be98bb1071da0f1deb. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:49.796495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Getting quotas for user 71884d0ec6ee40f99c2977b1bda550e9 and project 00b76e1b50e349be98bb1071da0f1deb. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:49.813370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:14:49.817300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:14:49.903636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a557fc4c-1a65-4851-9441-f26079a52c36 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394288 Sep 18 01:14:49.910864 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1427/2962] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:14:49.925437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:49.926281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:49.939321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:49.939982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:49.940954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:49.942086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:49.942740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:49.943236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:50.029636 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cda51387-ba87-4624-a289-00b38fa15e60 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.354794 Sep 18 01:14:50.030835 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1536/2963] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:50.036107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:50.036925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:50.050950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:50.054283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:50.055133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:50.056060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:50.058137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:50.058795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:50.451206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:50.477165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1108e3c1-1b01-44c1-a1a8-07116957baf5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.444271 Sep 18 01:14:50.483231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1537/2964] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:50 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:50.492018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:50.495820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:50.497389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:50.505251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f87659a9-18db-46e7-b60d-eec37b8ef2ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1314 microversion: 2.1 time: 0.593172 Sep 18 01:14:50.506869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:50.507637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:50.508211 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1428/2965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:49 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:50.508741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:50.509889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:50.510603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:50.511262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:50.561650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-250f5bfa-6f6d-442a-8a57-f641ee36c832 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:50.575347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-250f5bfa-6f6d-442a-8a57-f641ee36c832 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:50.682348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:50.683192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:50.683893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:50.684607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lazy-loading 'fault' on Instance uuid 630051a8-a626-45b4-bc41-aeb93e5e6617 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:14:50.762242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-250f5bfa-6f6d-442a-8a57-f641ee36c832 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:50.774126 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-250f5bfa-6f6d-442a-8a57-f641ee36c832 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1223 microversion: 2.1 time: 0.264553 Sep 18 01:14:50.784181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:50.785573 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1429/2966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:50 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1223 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:50.790686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31bccc1c-fd03-450a-bf17-5fb583153955 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f7005fdc4c0>, body: {"security_group_rule": {"parent_group_id": "f4ea0f78-0346-4d70-acfc-2eeb47fa0508", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:50.813583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:50.815391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5474aa392484529b280cbab7436a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a8f982c2b47d6a6f4ab57424ac2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:50.825456 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-39395a3c-04bc-4fb2-bbcb-ecc1e334fd40 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 200 len: 1542 microversion: 2.91 time: 0.340368 Sep 18 01:14:50.830358 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1538/2967] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:50 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 1542 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:14:50.973141 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-31bccc1c-fd03-450a-bf17-5fb583153955 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: This rule already exists in group f4ea0f78-0346-4d70-acfc-2eeb47fa0508 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31bccc1c-fd03-450a-bf17-5fb583153955 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 138 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: {"security_group_rule": {"parent_group_id": "f4ea0f78-0346-4d70-acfc-2eeb47fa0508", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: exception: This rule already exists in group f4ea0f78-0346-4d70-acfc-2eeb47fa0508 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f4ea0f78-0346-4d70-acfc-2eeb47fa0508', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f4ea0f78-0346-4d70-acfc-2eeb47fa0508 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f4ea0f78-0346-4d70-acfc-2eeb47fa0508 Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:50.974748 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:50.980706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:50.980706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:50.980706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f4ea0f78-0346-4d70-acfc-2eeb47fa0508 Sep 18 01:14:50.980706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:50.980706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31bccc1c-fd03-450a-bf17-5fb583153955 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 400 to user: This rule already exists in group f4ea0f78-0346-4d70-acfc-2eeb47fa0508 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:50.980706 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-31bccc1c-fd03-450a-bf17-5fb583153955 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.189909 Sep 18 01:14:50.980706 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1430/2968] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:50 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:50.988462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb8ae874-366a-4e14-86df-be755d9eec8d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Calling method '.version_select at 0x7f7005455ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:51.517146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:51.519718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:51.573039 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb8ae874-366a-4e14-86df-be755d9eec8d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/e229995a-04cd-45ab-943e-308dbd06cc8f" status: 202 len: 0 microversion: 2.1 time: 0.589297 Sep 18 01:14:51.575465 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1539/2969] 10.222.0.25 () {58 vars in 1287 bytes} [Sun Sep 18 01:14:50 2022] DELETE /compute/v2.1/os-security-group-rules/e229995a-04cd-45ab-943e-308dbd06cc8f => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:14:51.584306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:51.605727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:51.606480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:51.607260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:51.608576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:51.621226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:51.626010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:51.626817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:51.651405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:51.661905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:51.667264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:51.669156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:51.673108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:51.674470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:52.072529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:52.094562 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f696bc41-9438-4c4c-852a-23ca6f48baa1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.586587 Sep 18 01:14:52.098245 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1431/2970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:51 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:14:52.120760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b781e5e7-692f-45bd-ba2d-152df6de9308 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f70065cd160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-60863303", "description": "tempest-description-500837740"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:52.252761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:52.270131 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bbc816fb-fe88-41c5-9d78-47c181394444 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1463 microversion: 2.1 time: 0.692335 Sep 18 01:14:52.294843 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1540/2971] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:51 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1463 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:52.305936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:52.307137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:52.320198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:52.320723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:52.321182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:52.321949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:52.322413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:52.322840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:52.459172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:52.486531 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-75ca46d9-5a6c-4ac1-ad36-f2fead0e84a8 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1275 microversion: 2.1 time: 0.190053 Sep 18 01:14:52.489707 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1541/2972] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:52 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:52.502857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:52.506293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] [instance: 630051a8-a626-45b4-bc41-aeb93e5e6617] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:52.535043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:52.542990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:52.546133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:52.547224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:52.550639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:52.551394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:52.605350 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] HTTP exception thrown: Instance 630051a8-a626-45b4-bc41-aeb93e5e6617 could not be found. Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Request method failure captured: Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 HTTP/1.1 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnA5MtjjWScuewCpiGoJHcc4XQPi4foSI5_M1n5qcBNJLCnSboOr8pOrejpCcT1S1CqI_0csx9GAY0r0Ai07dPGc8D_GYN5CNl2ZyW2MhZSCdtLVFz-JaK2GPO7mvZRY2M90ts2lbae2Z6VYrP7gaxg4--7yHws0_MMLpYuVWV1zJf8 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.91 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 768a8f982c2b47d6a6f4ab57424ac2a6 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-988928526 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/768a8f982c2b47d6a6f4ab57424ac2a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/768a8f982c2b47d6a6f4ab57424ac2a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_768a8f982c2b47d6a6f4ab57424ac2a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/768a8f982c2b47d6a6f4ab57424ac2a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-988928526 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 768a8f982c2b47d6a6f4ab57424ac2a6 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-988928526 Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-UnshelveToHostMultiNodesTest-988928526-project Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: f5474aa392484529b280cbab7436a24b Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-988928526-project Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 630051a8-a626-45b4-bc41-aeb93e5e6617 could not be found. Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '630051a8-a626-45b4-bc41-aeb93e5e6617'} Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630051a8-a626-45b4-bc41-aeb93e5e6617 could not be found. Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630051a8-a626-45b4-bc41-aeb93e5e6617 could not be found. Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.607105 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630051a8-a626-45b4-bc41-aeb93e5e6617 could not be found. Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] Returning 404 to user: Instance 630051a8-a626-45b4-bc41-aeb93e5e6617 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1db2bcbd-3e68-4ebb-90fd-533d99712924 tempest-UnshelveToHostMultiNodesTest-988928526 tempest-UnshelveToHostMultiNodesTest-988928526-project] 10.222.0.25 "GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617" status: 404 len: 111 microversion: 2.91 time: 0.117367 Sep 18 01:14:52.624462 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1542/2973] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:14:52 2022] GET /compute/v2.1/servers/630051a8-a626-45b4-bc41-aeb93e5e6617 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:52.665785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:52.667756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:52.680184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:52.680673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:52.681300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:52.692055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:52.710851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:52.711776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:52.720359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b781e5e7-692f-45bd-ba2d-152df6de9308 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.620104 Sep 18 01:14:52.720970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1432/2974] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:14:52 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:52.736872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13cfc9be-5107-4981-aeb9-85414dccc367 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f7005f67040>, body: {"security_group_rule": {"parent_group_id": "13701d1f-c198-43ed-9973-0464fc589a68", "ip_protocol": "tcp", "from_port": 1826478163, "to_port": 22}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:52.907076 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-13cfc9be-5107-4981-aeb9-85414dccc367 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: Invalid port range 1826478163:22. Former value cannot be greater than the later Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13cfc9be-5107-4981-aeb9-85414dccc367 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 146 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: {"security_group_rule": {"parent_group_id": "13701d1f-c198-43ed-9973-0464fc589a68", "ip_protocol": "tcp", "from_port": 1826478163, "to_port": 22}} Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid port range 1826478163:22. Former value cannot be greater than the later Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'security_group_rule': {'parent_group_id': '13701d1f-c198-43ed-9973-0464fc589a68', 'ip_protocol': 'tcp', 'from_port': 1826478163, 'to_port': 22}}} Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1826478163:22. Former value cannot be greater than the later Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1826478163:22. Former value cannot be greater than the later Sep 18 01:14:52.909809 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1826478163:22. Former value cannot be greater than the later Sep 18 01:14:52.914777 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.918353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13cfc9be-5107-4981-aeb9-85414dccc367 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 400 to user: Invalid port range 1826478163:22. Former value cannot be greater than the later {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:52.920423 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13cfc9be-5107-4981-aeb9-85414dccc367 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.190090 Sep 18 01:14:52.922758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1433/2975] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:52 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:14:52.942947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ec83968-5320-42ec-a665-60f12120da6d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f7006b33af0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1139690202", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:52.956067 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-5ec83968-5320-42ec-a665-60f12120da6d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: Security group id should be uuid Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ec83968-5320-42ec-a665-60f12120da6d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 131 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1139690202", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: exception: Security group id should be uuid Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1139690202', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:52.963721 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:52.971384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 18 01:14:52.971384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:52.976873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ec83968-5320-42ec-a665-60f12120da6d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 400 to user: Security group id should be uuid {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:52.981649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ec83968-5320-42ec-a665-60f12120da6d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.048342 Sep 18 01:14:52.991705 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1434/2976] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:52 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:14:53.011413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eef9364a-9413-499c-aa7f-9a8192fb7a8d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f70063be5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-136318230", "description": "tempest-description-1206289245"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:53.353382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eef9364a-9413-499c-aa7f-9a8192fb7a8d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.353827 Sep 18 01:14:53.354052 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1435/2977] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:14:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:14:53.367690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:53.369945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:53.397795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:53.398304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:53.398900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:53.401626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:53.403381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:53.403660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:53.423439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:53.437092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4139afad-0ac3-44db-8644-965be7b4a1b8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1462 microversion: 2.1 time: 0.812529 Sep 18 01:14:53.442345 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1543/2978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:52 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1462 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:53.475789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a59854e7-d6dc-47b2-b838-b3ddec4ddc9b tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f70061df160>, body: {"security_group_rule": {"parent_group_id": "db35187b-2042-4f2c-adf3-8d99197a16da", "ip_protocol": "tempest-999-988724532", "from_port": 22, "to_port": 22}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:53.589223 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-a59854e7-d6dc-47b2-b838-b3ddec4ddc9b tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: Invalid IP protocol tempest-999-988724532. Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a59854e7-d6dc-47b2-b838-b3ddec4ddc9b tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 156 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: {"security_group_rule": {"parent_group_id": "db35187b-2042-4f2c-adf3-8d99197a16da", "ip_protocol": "tempest-999-988724532", "from_port": 22, "to_port": 22}} Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid IP protocol tempest-999-988724532. Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'db35187b-2042-4f2c-adf3-8d99197a16da', 'ip_protocol': 'tempest-999-988724532', 'from_port': 22, 'to_port': 22}}} Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-988724532. Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-988724532. Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:53.591980 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-988724532. Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:53.599251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a59854e7-d6dc-47b2-b838-b3ddec4ddc9b tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 400 to user: Invalid IP protocol tempest-999-988724532. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:53.602160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a59854e7-d6dc-47b2-b838-b3ddec4ddc9b tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.149319 Sep 18 01:14:53.612985 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1544/2979] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:53 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:14:53.679484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:53.680686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:53.715266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:53.730174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:53.733687 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff58a824-357e-4d5b-bb6c-d21dd131171e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.378523 Sep 18 01:14:53.750618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:53.751899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:53.756576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:53.763808 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1436/2980] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:53 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:53.764849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:53.778566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:53.801443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e79291d-c8bb-44e3-9f42-e051deb46427 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f7005fdc3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1090247271", "description": "tempest-description-527225349"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:54.058780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:54.070380 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-faee1ccb-ed2f-4805-8fc0-0880a33b020d tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1281 microversion: 2.1 time: 0.466038 Sep 18 01:14:54.080427 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1545/2981] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:53 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1281 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:54.093465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2056845661", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5f354c30-7ca1-41fa-b98b-024302f6544c"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:54.256686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:14:54.543562 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e79291d-c8bb-44e3-9f42-e051deb46427 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.772441 Sep 18 01:14:54.545386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1437/2982] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:14:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:54.710319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:14:54.710906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:14:54.711203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:14:54.711616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:14:54.712027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:14:54.725451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:54.725976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:54.726414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:54.727140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:54.727688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:54.728116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:54.754460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Getting quotas for project c68b241d9f2e4caba8024093c0bdf903. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:54.762911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Getting quotas for user a16a5f20794549518f8c3ab8d40492d6 and project c68b241d9f2e4caba8024093c0bdf903. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:54.788378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:14:54.791250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:14:54.856951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2effd0b6-ffc7-4664-b65d-2618c31f2e61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'create', calling method: .version_select at 0x7f7005e83550>, body: {"keypair": {"name": "tempest-keypair-56794768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUZK4p10lpve5NONIMJCu51Zbcc4XBhkOmZWihnlK0IE7yAU2jpfArl8aY1L94UJPlDUj9OAjvkefLiw0qVWmTOSj3UW+b8DwZuIfZtWvD0bhtOTmOwLMwtY1KDCTKKfg=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:54.895277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2effd0b6-ffc7-4664-b65d-2618c31f2e61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for project faf8394fe0f148b8b5794af678f368b6. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:14:54.898358 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab5728dc-aafe-4fee-80e3-6e8930780958 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815717 Sep 18 01:14:54.899938 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1546/2983] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:14:54.916384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2effd0b6-ffc7-4664-b65d-2618c31f2e61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for user 0212658356c1456ebe01dfe00dcd4fd2 and project faf8394fe0f148b8b5794af678f368b6. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:14:54.919125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c58a4ec3-a555-4012-b406-34da618e44ee tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f7005447a60>, body: {"security_group_rule": {"parent_group_id": "0ee9fcb2-ebd6-4151-9d9c-73bc0ca426cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:54.987803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2effd0b6-ffc7-4664-b65d-2618c31f2e61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.440994 Sep 18 01:14:54.997025 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1438/2984] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:14:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:55.004019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:55.005017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:55.019169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:55.019892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:55.020536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:55.022159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:55.022982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:55.023775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:55.031635 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:55.071985 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c58a4ec3-a555-4012-b406-34da618e44ee tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c58a4ec3-a555-4012-b406-34da618e44ee tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 138 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: {"security_group_rule": {"parent_group_id": "0ee9fcb2-ebd6-4151-9d9c-73bc0ca426cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ee9fcb2-ebd6-4151-9d9c-73bc0ca426cd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 18 01:14:55.074071 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:55.079514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c58a4ec3-a555-4012-b406-34da618e44ee tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:55.080465 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c58a4ec3-a555-4012-b406-34da618e44ee tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.168873 Sep 18 01:14:55.087642 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1547/2985] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:54 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:55.092505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ca28e38-8ef3-47d3-b447-3a499ca18d5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:55.096157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ca28e38-8ef3-47d3-b447-3a499ca18d5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:55.217615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ca28e38-8ef3-47d3-b447-3a499ca18d5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:55.226902 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ca28e38-8ef3-47d3-b447-3a499ca18d5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1214 microversion: 2.1 time: 0.144038 Sep 18 01:14:55.228553 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1548/2986] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:55 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:55.242149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a0a3c85-3f2f-4510-b71c-f6e739886b9d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f7005447e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1423195686", "description": "tempest-description-1931085838"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:55.567380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:55.591231 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b521c0c7-513b-439a-810a-ef0327468e91 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.592653 Sep 18 01:14:55.622293 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1439/2987] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:54 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:55.628025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:55.628767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:55.642770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:55.643272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:55.643711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:55.644484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:55.644864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:55.645278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:55.982226 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a0a3c85-3f2f-4510-b71c-f6e739886b9d tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.751430 Sep 18 01:14:55.991697 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1549/2988] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:14:55 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:14:55.996478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd8222a8-2b93-4deb-ba62-ea2702e2de95 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f700540e940>, body: {"security_group_rule": {"parent_group_id": "f90f0e8e-aef3-4d9a-af0d-68873b436cbc", "ip_protocol": "tcp", "from_port": 22, "to_port": 663014363}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:56.190091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:56.201076 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50e11b9b-d781-4021-b226-068705a8a90e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 0.577353 Sep 18 01:14:56.227744 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1440/2989] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:55 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:56.259338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:56.260308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:56.267181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:56.268022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:56.268680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:56.270701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:56.271388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:56.272053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:56.422552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:56.444051 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dd6e9f7b-39f7-486a-b826-1f1b66c47f5d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1210 microversion: 2.1 time: 0.194145 Sep 18 01:14:56.460205 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1441/2990] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:56 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1210 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:56.533634 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-dd8222a8-2b93-4deb-ba62-ea2702e2de95 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: Invalid port range 22:663014363. Valid TCP ports should be between 1-65535 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd8222a8-2b93-4deb-ba62-ea2702e2de95 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 145 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: {"security_group_rule": {"parent_group_id": "f90f0e8e-aef3-4d9a-af0d-68873b436cbc", "ip_protocol": "tcp", "from_port": 22, "to_port": 663014363}} Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid port range 22:663014363. Valid TCP ports should be between 1-65535 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f90f0e8e-aef3-4d9a-af0d-68873b436cbc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 663014363}}} Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:663014363. Valid TCP ports should be between 1-65535 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:663014363. Valid TCP ports should be between 1-65535 Sep 18 01:14:56.535041 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:663014363. Valid TCP ports should be between 1-65535 Sep 18 01:14:56.539577 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.541025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd8222a8-2b93-4deb-ba62-ea2702e2de95 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 400 to user: Invalid port range 22:663014363. Valid TCP ports should be between 1-65535 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:56.542220 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dd8222a8-2b93-4deb-ba62-ea2702e2de95 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.549631 Sep 18 01:14:56.548275 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1550/2991] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:55 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:14:56.553997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b472c563-b962-48f9-be40-5d9a84d2fdf4 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Action: 'create', calling method: .version_select at 0x7f700666a670>, body: {"security_group_rule": {"parent_group_id": "533aa599-36f8-467b-8e77-518fab113ea7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:14:56.590615 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-b472c563-b962-48f9-be40-5d9a84d2fdf4 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:14:56.591361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-b472c563-b962-48f9-be40-5d9a84d2fdf4 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Neutron security group 533aa599-36f8-467b-8e77-518fab113ea7 not found {{(pid=122373) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:14:56.591975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b472c563-b962-48f9-be40-5d9a84d2fdf4 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist Sep 18 01:14:56.591975 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-18bb75f9-676a-4f79-a3b6-0e128035dc9f'] Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b472c563-b962-48f9-be40-5d9a84d2fdf4 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 138 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: {"security_group_rule": {"parent_group_id": "533aa599-36f8-467b-8e77-518fab113ea7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: exception: Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-18bb75f9-676a-4f79-a3b6-0e128035dc9f'] Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'security_group_rule': {'parent_group_id': '533aa599-36f8-467b-8e77-518fab113ea7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:14:56.594234 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18bb75f9-676a-4f79-a3b6-0e128035dc9f'] Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18bb75f9-676a-4f79-a3b6-0e128035dc9f'] Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18bb75f9-676a-4f79-a3b6-0e128035dc9f'] Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18bb75f9-676a-4f79-a3b6-0e128035dc9f'] Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b472c563-b962-48f9-be40-5d9a84d2fdf4 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 404 to user: Security group 533aa599-36f8-467b-8e77-518fab113ea7 does not exist Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-18bb75f9-676a-4f79-a3b6-0e128035dc9f'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:56.598843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b472c563-b962-48f9-be40-5d9a84d2fdf4 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.045974 Sep 18 01:14:56.607396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b227cfa-acb1-4fad-9296-eeea745878d7 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Calling method '.version_select at 0x7f7005455820>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:56.610802 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1442/2992] 10.222.0.25 () {60 vars in 1195 bytes} [Sun Sep 18 01:14:56 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:14:56.623531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:56.624153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:56.665724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:56.666226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:56.666669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:56.667729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:56.668676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:56.669201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:56.675725 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-2b227cfa-acb1-4fad-9296-eeea745878d7 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:14:56.676892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-2b227cfa-acb1-4fad-9296-eeea745878d7 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Neutron security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 not found {{(pid=122374) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 18 01:14:56.677749 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-2b227cfa-acb1-4fad-9296-eeea745878d7 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] HTTP exception thrown: Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist Sep 18 01:14:56.677749 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-a850a656-8f52-4485-8cc0-81d508dd3c48'] Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b227cfa-acb1-4fad-9296-eeea745878d7 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Request method failure captured: Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-security-group-rules/963a7f18-7352-4e28-8c08-bb3eb2f42786 HTTP/1.1 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEHr2m0f-QoIvjw4K1IFzg5R7lWst3WioDEic4XuO_joI18-rC9_UK9IZw6t_3EU2wRzgnM6POczJUHJvrTjFVnH-eezBt6TMDnKe8FNsDjOKplQ0DDFTrEUB0MTxAlpyrxc2y_5VVo_904alpn2N1DDLprITAmYMsXPSnckXmNbkE Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d49ce2d20a46219359ea3cd7d5c231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 69d49ce2d20a46219359ea3cd7d5c231 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 41ced90bdd754ef4948a34825553a5dc Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-512482191-project Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: exception: Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-a850a656-8f52-4485-8cc0-81d508dd3c48'] Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '963a7f18-7352-4e28-8c08-bb3eb2f42786'} Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:14:56.679823 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a850a656-8f52-4485-8cc0-81d508dd3c48'] Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a850a656-8f52-4485-8cc0-81d508dd3c48'] Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a850a656-8f52-4485-8cc0-81d508dd3c48'] Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a850a656-8f52-4485-8cc0-81d508dd3c48'] Sep 18 01:14:56.683726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:14:56.687353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b227cfa-acb1-4fad-9296-eeea745878d7 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Returning 404 to user: Security group rule 963a7f18-7352-4e28-8c08-bb3eb2f42786 does not exist Sep 18 01:14:56.687353 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-a850a656-8f52-4485-8cc0-81d508dd3c48'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:14:56.688453 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b227cfa-acb1-4fad-9296-eeea745878d7 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/963a7f18-7352-4e28-8c08-bb3eb2f42786" status: 404 len: 199 microversion: 2.1 time: 0.086238 Sep 18 01:14:56.689175 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1551/2993] 10.222.0.25 () {58 vars in 1287 bytes} [Sun Sep 18 01:14:56 2022] DELETE /compute/v2.1/os-security-group-rules/963a7f18-7352-4e28-8c08-bb3eb2f42786 => generated 199 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:14:56.699758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d49aed47-2055-498a-b4d8-25abc0df5c9c tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Calling method '.version_select at 0x7f70061dff70>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:57.045974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:57.067752 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-443ae93d-6a84-4e7c-9a08-b6a23f77dc6e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.454615 Sep 18 01:14:57.080481 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1443/2994] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:56 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:57.227251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:57.228258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:57.237789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:57.240718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:57.241442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:57.252734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:57.257327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:57.259181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:58.333917 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d49aed47-2055-498a-b4d8-25abc0df5c9c tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f90f0e8e-aef3-4d9a-af0d-68873b436cbc" status: 202 len: 0 microversion: 2.1 time: 1.639320 Sep 18 01:14:58.340162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1552/2995] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:14:56 2022] DELETE /compute/v2.1/os-security-groups/f90f0e8e-aef3-4d9a-af0d-68873b436cbc => generated 0 bytes in 1641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:14:58.340395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:58.342874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:58.356321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:58.361218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:58.363090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:58.364015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:58.364712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:58.365792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:58.606431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:58.637291 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f3c3b8f3-6242-44c3-840a-18db9f7dfdeb tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1272 microversion: 2.1 time: 0.301165 Sep 18 01:14:58.641211 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1553/2996] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:58 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:58.649485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:58.651423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:58.666109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:58.668121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:58.674375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:58.675939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:58.678052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:58.679014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:59.241412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:59.268737 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-76b7a607-2c32-4060-b7a9-79d86e0eaa05 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 2.044934 Sep 18 01:14:59.273197 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1444/2997] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:57 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:59.293753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efcd0534-30f5-45b9-b951-4af72ec4e19c tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Calling method '.version_select at 0x7f7006fc2a60>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:59.591669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:59.611839 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-199561af-c45b-4ade-8851-ed6ba3ef7b71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.965089 Sep 18 01:14:59.612856 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1554/2998] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:58 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:14:59.684805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:14:59.685509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:14:59.700413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:59.700909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:59.701348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:59.702084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:14:59.703487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:14:59.712257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:14:59.779306 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:14:59.885368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:14:59.899448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3468d1c-6661-4f29-95fa-5ab6cba139ab tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1272 microversion: 2.1 time: 0.226948 Sep 18 01:14:59.901474 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1555/2999] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:14:59 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:00.221702 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f8c2a2b0-5cfe-48cd-a599-de3424c7a8ba tempest-TenantUsagesNegativeTestJSON-448468232 tempest-TenantUsagesNegativeTestJSON-448468232-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-17T01%3A14%3A59.754035&end=2022-09-19T01%3A14%3A59.754035" status: 404 len: 112 microversion: - time: 0.318483 Sep 18 01:15:00.222653 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1556/3000] 10.222.0.25 () {58 vars in 1316 bytes} [Sun Sep 18 01:14:59 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-17T01%3A14%3A59.754035&end=2022-09-19T01%3A14%3A59.754035 => generated 112 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 18 01:15:00.228609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-503706a5-84d1-4404-83c9-7c6f0145141a req-438d9b91-0f7d-484a-b7dc-cc5c9c258242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa8b251-c626-4388-898a-8855a6706f55", "tag": "946eb9df-4527-4d9c-ac37-0e6b31c6e39f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:00.240416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-503706a5-84d1-4404-83c9-7c6f0145141a req-438d9b91-0f7d-484a-b7dc-cc5c9c258242 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:00.241353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-503706a5-84d1-4404-83c9-7c6f0145141a req-438d9b91-0f7d-484a-b7dc-cc5c9c258242 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:00.241853 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efcd0534-30f5-45b9-b951-4af72ec4e19c tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0ee9fcb2-ebd6-4151-9d9c-73bc0ca426cd" status: 202 len: 0 microversion: 2.1 time: 0.965826 Sep 18 01:15:00.242481 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1445/3001] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:14:59 2022] DELETE /compute/v2.1/os-security-groups/0ee9fcb2-ebd6-4151-9d9c-73bc0ca426cd => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:00.246572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-503706a5-84d1-4404-83c9-7c6f0145141a req-438d9b91-0f7d-484a-b7dc-cc5c9c258242 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:00.249192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88677281-6233-4a2e-a77e-e300599e3c1b tempest-TenantUsagesNegativeTestJSON-448468232 tempest-TenantUsagesNegativeTestJSON-448468232-project-admin] Calling method '.version_select at 0x7f7005f67670>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:00.260528 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-88677281-6233-4a2e-a77e-e300599e3c1b tempest-TenantUsagesNegativeTestJSON-448468232 tempest-TenantUsagesNegativeTestJSON-448468232-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88677281-6233-4a2e-a77e-e300599e3c1b tempest-TenantUsagesNegativeTestJSON-448468232 tempest-TenantUsagesNegativeTestJSON-448468232-project-admin] Request method failure captured: Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-simple-tenant-usage/213aada0a4ff4f1ebfd5c4038c0375a7?start=2022-09-19T01%3A14%3A59.754035&end=2022-09-17T01%3A14%3A59.754035 HTTP/1.1 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnETaVlON40CBzCO2NyLobqdf6AL24ZDgdcPVP-M4mp3Xf2JSmrNE7ShIdW6OVGC0fWgmkktSB8kNRFGi8AxuhNUF0HL9eEJpPIH0jjKWaLyywWt9JFKy8B36daN7KEnkZKfm6wrWmSG8uF-BZJz9flmktBCYIHogTE8zFM2Fv4JewI Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 7a3d3ac820fe4fdfad006af552535c32 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-448468232 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a3d3ac820fe4fdfad006af552535c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7a3d3ac820fe4fdfad006af552535c32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7a3d3ac820fe4fdfad006af552535c32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a3d3ac820fe4fdfad006af552535c32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-448468232 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 7a3d3ac820fe4fdfad006af552535c32 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-448468232 Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TenantUsagesNegativeTestJSON-448468232-project-admin Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cc85e4eabfd34fb19d085f30d43a982b Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-448468232-project-admin Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid start time. The start time cannot occur after the end time. Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '213aada0a4ff4f1ebfd5c4038c0375a7'} Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 18 01:15:00.266580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:00.275099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88677281-6233-4a2e-a77e-e300599e3c1b tempest-TenantUsagesNegativeTestJSON-448468232 tempest-TenantUsagesNegativeTestJSON-448468232-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:00.275099 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88677281-6233-4a2e-a77e-e300599e3c1b tempest-TenantUsagesNegativeTestJSON-448468232 tempest-TenantUsagesNegativeTestJSON-448468232-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/213aada0a4ff4f1ebfd5c4038c0375a7?start=2022-09-19T01%3A14%3A59.754035&end=2022-09-17T01%3A14%3A59.754035" status: 400 len: 111 microversion: 2.1 time: 0.024544 Sep 18 01:15:00.275099 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1446/3002] 10.222.0.25 () {58 vars in 1412 bytes} [Sun Sep 18 01:15:00 2022] GET /compute/v2.1/os-simple-tenant-usage/213aada0a4ff4f1ebfd5c4038c0375a7?start=2022-09-19T01%3A14%3A59.754035&end=2022-09-17T01%3A14%3A59.754035 => generated 111 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:15:00.278854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-503706a5-84d1-4404-83c9-7c6f0145141a req-438d9b91-0f7d-484a-b7dc-cc5c9c258242 service nova] Creating event network-changed:946eb9df-4527-4d9c-ac37-0e6b31c6e39f for instance 1aa8b251-c626-4388-898a-8855a6706f55 on n-h1-master-1 Sep 18 01:15:00.292802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-503706a5-84d1-4404-83c9-7c6f0145141a req-438d9b91-0f7d-484a-b7dc-cc5c9c258242 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068129 Sep 18 01:15:00.294379 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1557/3003] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:00.302330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b0d1def-ca57-419f-a4d4-1ca3265aead9 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Calling method '.version_select at 0x7f700558b1f0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:00.562031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e02ee8d-78ae-424c-9d96-7dfcf4ba09d2 tempest-TenantUsagesNegativeTestJSON-1899109147 tempest-TenantUsagesNegativeTestJSON-1899109147-project] Calling method '.version_select at 0x7f7005455d30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:00.576561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e02ee8d-78ae-424c-9d96-7dfcf4ba09d2 tempest-TenantUsagesNegativeTestJSON-1899109147 tempest-TenantUsagesNegativeTestJSON-1899109147-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8583665691724504a47cd6169135b2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213aada0a4ff4f1ebfd5c4038c0375a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e02ee8d-78ae-424c-9d96-7dfcf4ba09d2 tempest-TenantUsagesNegativeTestJSON-1899109147 tempest-TenantUsagesNegativeTestJSON-1899109147-project] Request method failure captured: Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-17T01%3A14%3A59.754035&end=2022-09-19T01%3A14%3A59.754035&detailed=1 HTTP/1.1 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnES_X1vfcuK40IcCfjHZJBH_yK-8jjcT3V4XzkUJ7UnFiF_SWSdScYZqFpaYMKTk0NZ5yXar68HSjGirD34vLBrSaINrHQz3SV3o7Ga1Mgr9-0F4lpBDZiLk-TjTpb0RpuRliRgfQa6xkLOcMtaSkmNJhthkkQHi2qKHYK_VlclCzs Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 213aada0a4ff4f1ebfd5c4038c0375a7 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1899109147 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/213aada0a4ff4f1ebfd5c4038c0375a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/213aada0a4ff4f1ebfd5c4038c0375a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_213aada0a4ff4f1ebfd5c4038c0375a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/213aada0a4ff4f1ebfd5c4038c0375a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1899109147 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 213aada0a4ff4f1ebfd5c4038c0375a7 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1899109147 Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TenantUsagesNegativeTestJSON-1899109147-project Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 8583665691724504a47cd6169135b2ac Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1899109147-project Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: action_args: {} Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise self.value Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 18 01:15:00.582726 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 18 01:15:00.596365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:00.603427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e02ee8d-78ae-424c-9d96-7dfcf4ba09d2 tempest-TenantUsagesNegativeTestJSON-1899109147 tempest-TenantUsagesNegativeTestJSON-1899109147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:00.605806 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e02ee8d-78ae-424c-9d96-7dfcf4ba09d2 tempest-TenantUsagesNegativeTestJSON-1899109147 tempest-TenantUsagesNegativeTestJSON-1899109147-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-17T01%3A14%3A59.754035&end=2022-09-19T01%3A14%3A59.754035&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.309642 Sep 18 01:15:00.607484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1558/3004] 10.222.0.25 () {58 vars in 1335 bytes} [Sun Sep 18 01:15:00 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-17T01%3A14%3A59.754035&end=2022-09-19T01%3A14%3A59.754035&detailed=1 => generated 123 bytes in 312 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:00.632036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:00.636587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:00.674520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:00.680481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:00.682782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:00.685652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:00.686937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:00.688086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:01.205450 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b0d1def-ca57-419f-a4d4-1ca3265aead9 tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/db35187b-2042-4f2c-adf3-8d99197a16da" status: 202 len: 0 microversion: 2.1 time: 0.928435 Sep 18 01:15:01.207882 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1447/3005] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:15:00 2022] DELETE /compute/v2.1/os-security-groups/db35187b-2042-4f2c-adf3-8d99197a16da => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:01.214033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:01.216717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:01.253716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:01.267185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:01.272322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:01.276975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:01.283385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:01.284557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:01.364644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:01.386609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34a4edce-59df-435b-86e6-66ac4407ef0b tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 0.775510 Sep 18 01:15:01.391697 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1559/3006] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:00 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:01.410594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:01.412100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:01.430204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:01.430955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:01.431543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:01.432413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:01.435633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:01.437978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:02.024274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:02.044556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:02.064891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ec7ea241-6682-4e51-843e-73d19a6971d3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.671453 Sep 18 01:15:02.067337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1560/3007] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:01 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:02.069804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ca4bcaf-5cb9-4dbc-ad41-90c668161a9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.860132 Sep 18 01:15:02.076264 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1448/3008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:01 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:02.078552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b1ac614-18c9-4090-b51c-5b2cfd47388c tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Calling method '.version_select at 0x7f7005447430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:02.417904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:02.419429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:02.431736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:02.432245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:02.434841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:02.435950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:02.437926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:02.438499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:02.573584 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b1ac614-18c9-4090-b51c-5b2cfd47388c tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/13701d1f-c198-43ed-9973-0464fc589a68" status: 202 len: 0 microversion: 2.1 time: 0.504426 Sep 18 01:15:02.574346 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1561/3009] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:15:02 2022] DELETE /compute/v2.1/os-security-groups/13701d1f-c198-43ed-9973-0464fc589a68 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:02.583167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1267571840", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65461795-2411-4531-b404-f7689b9c28a9"}], "security_groups": [{"name": "tempest-securitygroup--1748096767"}], "key_name": "tempest-keypair-56794768", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:02.913807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:02.918924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] validate_networks() for [('65461795-2411-4531-b404-f7689b9c28a9', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:15:02.946818 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-159da772-6232-4b63-9e2c-f36713f073f2 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 0.532831 Sep 18 01:15:02.947871 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1449/3010] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:02 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:02.954711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e5b97f58-d649-4eb7-b102-83aeaa00b0cf tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] Calling method '.version_select at 0x7f70065929d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:04.705810 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e5b97f58-d649-4eb7-b102-83aeaa00b0cf tempest-SecurityGroupRulesNegativeTestJSON-512482191 tempest-SecurityGroupRulesNegativeTestJSON-512482191-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f4ea0f78-0346-4d70-acfc-2eeb47fa0508" status: 202 len: 0 microversion: 2.1 time: 1.756370 Sep 18 01:15:04.707113 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1450/3011] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:15:02 2022] DELETE /compute/v2.1/os-security-groups/f4ea0f78-0346-4d70-acfc-2eeb47fa0508 => generated 0 bytes in 1759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:04.716807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:04.718745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:04.741125 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:04.756091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:04.756781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:04.757246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:04.758349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:04.761393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:04.762146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:04.946384 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:04.952901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:15:04.955824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:15:04.956678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:15:04.957169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:15:04.957749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:15:04.993537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:04.997319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:05.002319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:05.007056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:05.014266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:05.016466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:05.096951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:15:05.127996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for user 0212658356c1456ebe01dfe00dcd4fd2 and project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:15:05.164811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:15:05.167816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:15:05.321263 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d61427b-87b6-4413-8168-fc620b3a0c12 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.734373 Sep 18 01:15:05.323622 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1562/3012] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:15:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:15:05.342195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:05.344343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:05.356141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:05.356998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:05.357697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:05.358693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:05.359399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:05.360240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:05.367302 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:05.850204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:05.893960 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-602e482a-469d-406c-812b-e0c41fddfd92 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 1.185192 Sep 18 01:15:05.897276 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1451/3013] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:04 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:05.920747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:05.925397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:05.957634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:05.959128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:05.961223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:05.963345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:05.967624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:05.969126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:06.064220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:06.082446 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d3161a15-da6f-4e62-9e7c-4fcb26ddbf6c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.757396 Sep 18 01:15:06.085821 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1563/3014] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:05 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:06.103795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66620b47-bbba-43f0-8203-05cef0943c9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:06.104437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66620b47-bbba-43f0-8203-05cef0943c9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:06.290584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-66620b47-bbba-43f0-8203-05cef0943c9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:06.315598 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-66620b47-bbba-43f0-8203-05cef0943c9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1237 microversion: 2.1 time: 0.228231 Sep 18 01:15:06.320582 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1564/3015] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:06 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1237 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:06.689570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:06.707472 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-100ba9b1-8de5-4f2b-9d69-8e6f833d4af1 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 0.803902 Sep 18 01:15:06.711861 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1452/3016] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:05 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:06.851979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-cf2fb8c6-21c9-4095-9f2d-8083d02edaeb req-3e0d4c51-4b9a-45ac-8b8e-0913d5ae4bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc6f73cf-af88-443a-a139-80a88425f4d4", "tag": "89aed95c-f166-48ff-8887-a87e549b54de"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:06.871662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cf2fb8c6-21c9-4095-9f2d-8083d02edaeb req-3e0d4c51-4b9a-45ac-8b8e-0913d5ae4bfe service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:06.883990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cf2fb8c6-21c9-4095-9f2d-8083d02edaeb req-3e0d4c51-4b9a-45ac-8b8e-0913d5ae4bfe service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:06.888792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cf2fb8c6-21c9-4095-9f2d-8083d02edaeb req-3e0d4c51-4b9a-45ac-8b8e-0913d5ae4bfe service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:06.936151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-cf2fb8c6-21c9-4095-9f2d-8083d02edaeb req-3e0d4c51-4b9a-45ac-8b8e-0913d5ae4bfe service nova] Creating event network-changed:89aed95c-f166-48ff-8887-a87e549b54de for instance bc6f73cf-af88-443a-a139-80a88425f4d4 on n-h1-master-1 Sep 18 01:15:06.955801 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-cf2fb8c6-21c9-4095-9f2d-8083d02edaeb req-3e0d4c51-4b9a-45ac-8b8e-0913d5ae4bfe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108418 Sep 18 01:15:06.956587 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1453/3017] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:06.965760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:06.966488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:06.982798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:06.984759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:06.986908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:06.987948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:06.993761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:06.994489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:07.078623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b84c50e2-49b8-42bd-8d93-6bce5986f8a5 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:07.110228 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b84c50e2-49b8-42bd-8d93-6bce5986f8a5 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.431866 Sep 18 01:15:07.143301 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1565/3018] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:07.159844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:07.161030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:07.165340 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:07.169843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:07.173003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:07.173807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:07.176311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:07.177057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:07.178081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:07.548794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:07.559270 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-29b7832b-d0ae-4c34-a6e2-a9cb80a9b6ed tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.600017 Sep 18 01:15:07.565646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1454/3019] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:06 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:07.583818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d498142-693f-4da8-b967-959b9a70fb93 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:07.622686 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d498142-693f-4da8-b967-959b9a70fb93 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.054679 Sep 18 01:15:07.629380 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1455/3020] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 01:15:07 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:07.637703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:07.639084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:07.646957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:07.648320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:07.649491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:07.651802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:07.659693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:07.660651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:07.726455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:07.743247 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b61ff1c-60ae-4328-b7d6-aac7ba8a04d8 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.598418 Sep 18 01:15:07.744264 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1566/3021] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:07 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:07.755091 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ea43a39-b5f1-40b7-b111-e7ab4562a571 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:07.766075 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ea43a39-b5f1-40b7-b111-e7ab4562a571 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018614 Sep 18 01:15:07.767624 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1567/3022] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:07.777696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:07.779253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:07.790735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:07.791824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:07.792493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:07.793676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:07.794349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:07.794964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:07.862949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:07.899649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d73c7274-0fd5-49ff-ab95-26329ef8ecab tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1289 microversion: 2.1 time: 0.267235 Sep 18 01:15:07.910315 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1456/3023] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:07 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1289 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:07.935070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9695f6c3-8b52-4f27-833a-a4fa67acfc31 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:07.948803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9695f6c3-8b52-4f27-833a-a4fa67acfc31 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036620 Sep 18 01:15:07.950035 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1457/3024] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:07.969378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc45f040-d6b7-47b0-9e64-e4ea6a36410f tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.020434 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc45f040-d6b7-47b0-9e64-e4ea6a36410f tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.057940 Sep 18 01:15:08.022001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1458/3025] 10.222.0.25 () {58 vars in 1165 bytes} [Sun Sep 18 01:15:07 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:08.055330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f780ad0-a2e2-4974-8174-8ecd429b40b0 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.071598 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f780ad0-a2e2-4974-8174-8ecd429b40b0 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027452 Sep 18 01:15:08.073073 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1459/3026] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:08.087307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2fcf91c-e524-4fbd-bec8-3b2b2bdf7fd4 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.206006 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2fcf91c-e524-4fbd-bec8-3b2b2bdf7fd4 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.121670 Sep 18 01:15:08.207652 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1460/3027] 10.222.0.25 () {58 vars in 1169 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:08.231860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1b627dc1-d3bb-47b6-8565-c7dadb3a6288 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.265578 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1b627dc1-d3bb-47b6-8565-c7dadb3a6288 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.037191 Sep 18 01:15:08.270616 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1461/3028] 10.222.0.25 () {58 vars in 1161 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:08.281085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c8e2423-714d-4bfc-b72f-2ba8c374a74a tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.303195 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c8e2423-714d-4bfc-b72f-2ba8c374a74a tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026882 Sep 18 01:15:08.309299 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1462/3029] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:08.318866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d483a61-fd1a-489e-ab49-702676ec7c58 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.411208 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d483a61-fd1a-489e-ab49-702676ec7c58 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.094350 Sep 18 01:15:08.416385 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1463/3030] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:08.439307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eaf3f30e-6795-4516-b6a4-e9813a272011 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.454751 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eaf3f30e-6795-4516-b6a4-e9813a272011 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020254 Sep 18 01:15:08.455673 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1464/3031] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:15:08.475060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1bd313c1-01ba-4f54-a449-56ac81355cc3 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.493291 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:08.540078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1bd313c1-01ba-4f54-a449-56ac81355cc3 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.073766 Sep 18 01:15:08.551412 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1465/3032] 10.222.0.25 () {58 vars in 1144 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:08.560304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40a39586-40f5-4d8b-b806-eeb50d8a0d18 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.574577 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40a39586-40f5-4d8b-b806-eeb50d8a0d18 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019672 Sep 18 01:15:08.590143 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1466/3033] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:15:08.597098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.598535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:08.614169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:08.615056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:08.615193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:08.617323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:08.618404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:08.619074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:08.876841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:08.887288 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-afe31f57-d620-4e1b-9ab6-e51a4aa6f086 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 1.117586 Sep 18 01:15:08.899268 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1568/3034] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:07 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:08.916101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa87700a-a26a-4627-9e8a-ca8e956a52a7 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:08.990326 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa87700a-a26a-4627-9e8a-ca8e956a52a7 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.092412 Sep 18 01:15:08.992566 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1569/3035] 10.222.0.25 () {58 vars in 1148 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:09.003487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:09.005154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:09.014614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:09.016115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:09.016797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:09.017845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:09.018561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:09.019249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:09.536412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:09.546262 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47d34b36-944f-4046-8594-8b1762f6fa74 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.954357 Sep 18 01:15:09.546841 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1467/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:09.562772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a37a3ac4-ad23-4133-9847-f231f66ed665 req-943f21a6-452a-4e8d-abb3-74059104340d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa8b251-c626-4388-898a-8855a6706f55", "name": "network-vif-plugged", "status": "completed", "tag": "946eb9df-4527-4d9c-ac37-0e6b31c6e39f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:09.590039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a37a3ac4-ad23-4133-9847-f231f66ed665 req-943f21a6-452a-4e8d-abb3-74059104340d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:09.590913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a37a3ac4-ad23-4133-9847-f231f66ed665 req-943f21a6-452a-4e8d-abb3-74059104340d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:09.591606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a37a3ac4-ad23-4133-9847-f231f66ed665 req-943f21a6-452a-4e8d-abb3-74059104340d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:09.641521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a37a3ac4-ad23-4133-9847-f231f66ed665 req-943f21a6-452a-4e8d-abb3-74059104340d service nova] Creating event network-vif-plugged:946eb9df-4527-4d9c-ac37-0e6b31c6e39f for instance 1aa8b251-c626-4388-898a-8855a6706f55 on n-h1-master-1 Sep 18 01:15:09.665703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a37a3ac4-ad23-4133-9847-f231f66ed665 req-943f21a6-452a-4e8d-abb3-74059104340d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106427 Sep 18 01:15:09.667474 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1468/3037] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:09.680770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:09.687013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:09.724286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:09.729049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:09.730517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:09.732723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:09.733629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:09.734568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:09.816246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:09.840383 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e602fa7-b824-4d94-99f3-c21cc68e4f77 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.842264 Sep 18 01:15:09.854162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1570/3038] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:08 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:09.859395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53a4951a-03d7-4037-b987-3a8b000f9459 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:09.872710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53a4951a-03d7-4037-b987-3a8b000f9459 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017329 Sep 18 01:15:09.873612 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1571/3039] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Sep 18 01:15:09 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:09.890624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:09.891466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9017081-592e-4c3e-83d9-60c0c915ff89 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:09.901501 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f145bba-e494-463e-b6c7-fd8a3d3b17a6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1295 microversion: 2.1 time: 0.232300 Sep 18 01:15:09.910704 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1469/3040] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:09 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1295 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:09.911267 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c9017081-592e-4c3e-83d9-60c0c915ff89 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026776 Sep 18 01:15:09.914311 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1572/3041] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:09.927502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:09.928129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:09.928925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78c06fff-a8d7-4c80-96e8-7ae6d1d637fd tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:09.947005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:09.947879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:09.948639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:09.949616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:09.950324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:09.950936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:10.004618 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78c06fff-a8d7-4c80-96e8-7ae6d1d637fd tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.079478 Sep 18 01:15:10.005011 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1573/3042] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:15:09 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:10.024599 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e78fd9c-fabb-4466-a150-c160f214e270 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:10.076448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e78fd9c-fabb-4466-a150-c160f214e270 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060260 Sep 18 01:15:10.077054 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1574/3043] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:15:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:10.114173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5edd535-331b-4997-8e19-602a79f68da6 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:10.124828 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5edd535-331b-4997-8e19-602a79f68da6 tempest-FlavorsV2TestJSON-523795482 tempest-FlavorsV2TestJSON-523795482-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014135 Sep 18 01:15:10.126536 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1575/3044] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:15:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:10.568554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:10.569164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:10.576698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:10.577176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:10.578003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:10.578620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:10.579514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:10.580132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:10.580712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:10.592025 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-688ba5bd-783c-422f-976a-3e6b595fef44 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 0.668800 Sep 18 01:15:10.596075 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1470/3045] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:09 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:10.867251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:10.867879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:10.892918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:10.893995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:10.894648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:10.895806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:10.896532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:10.897255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:10.910495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:10.929158 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-254c5392-e9d4-4a2b-9a63-83e771221d2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.364448 Sep 18 01:15:10.943299 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1576/3046] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:10 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:10.961823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:10.962794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:10.983165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:10.984363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:10.984989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:10.985928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:10.986553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:10.987159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:11.524959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:11.528489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:11.536558 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c8bc544b-2844-4b21-bbdc-9132b00dbf73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 0.591750 Sep 18 01:15:11.541278 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0abf9a99-fe96-4dda-bac1-65c61f632a63 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.678513 Sep 18 01:15:11.541986 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1577/3047] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:10 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:11.543718 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1471/3048] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:10 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:11.617271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:11.618246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:11.629047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:11.629047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:11.629047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:11.629047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:11.629047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:11.629047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:11.956148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:11.957495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:11.971664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:11.972580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:11.973199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:11.974774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:11.975240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:11.975669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:12.010225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:12.024577 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c4be8dc8-d40e-4c22-a011-246d19ad79ec tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1323 microversion: 2.1 time: 0.410327 Sep 18 01:15:12.042648 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1578/3049] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:11 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:12.413790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:12.441544 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2b1034b-5db8-454d-84ed-c372dabdded7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.489232 Sep 18 01:15:12.448556 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1472/3050] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:11 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:12.573309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:12.575698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:12.576881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:12.577153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:12.602574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:12.605233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:12.607923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:12.610746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:12.611443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:12.615018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:12.616387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:12.618743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:12.619590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:12.620681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:12.621414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:12.622927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:12.723827 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:13.660541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:13.691596 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c963eab7-3769-45f3-adb4-c67ae22de09b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 1.122397 Sep 18 01:15:13.701609 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1473/3051] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:12 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:13.701609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:13.701609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:13.726775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:13.727274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:13.727712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:13.736104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:13.736605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:13.737040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:13.816493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:13.827312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6962c94d-0062-4fbc-ac5d-e184cbb30f8d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 1.261732 Sep 18 01:15:13.831481 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1579/3052] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:12 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:13.841758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:13.844530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:13.861986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:13.863335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:13.863998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:13.865509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:13.866205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:13.882021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:14.889282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:14.893788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:14.907579 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f20c261-0644-4f75-9794-f21d85a5ede7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 1.074397 Sep 18 01:15:14.909596 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92c28e86-79e3-4e95-a230-ddb0618773df tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1520 microversion: 2.1 time: 1.214850 Sep 18 01:15:14.911544 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1580/3053] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:13 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:14.913019 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1474/3054] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:13 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1520 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:14.925466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6e1194ce-d58b-4a56-bf86-35dfeaee5182 req-02f920c5-8cca-43e8-aba5-e6b7aa4c42e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:14.926462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:14.927093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:14.943001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:14.943504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:14.943946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:14.944655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:14.948530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:14.949056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e1194ce-d58b-4a56-bf86-35dfeaee5182 req-02f920c5-8cca-43e8-aba5-e6b7aa4c42e1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:14.949261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:14.950506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e1194ce-d58b-4a56-bf86-35dfeaee5182 req-02f920c5-8cca-43e8-aba5-e6b7aa4c42e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:14.951654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e1194ce-d58b-4a56-bf86-35dfeaee5182 req-02f920c5-8cca-43e8-aba5-e6b7aa4c42e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:14.979492 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6e1194ce-d58b-4a56-bf86-35dfeaee5182 req-02f920c5-8cca-43e8-aba5-e6b7aa4c42e1 service nova] Creating event network-changed:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:15:14.986826 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6e1194ce-d58b-4a56-bf86-35dfeaee5182 req-02f920c5-8cca-43e8-aba5-e6b7aa4c42e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070849 Sep 18 01:15:14.988212 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1581/3055] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:14.994174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:14.995393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:15.023030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:15.024117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:15.025996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:15.027938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:15.028540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:15.031072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:15.096446 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:15.607406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:15.648766 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92725c47-a45b-4569-a428-fccc6b877ee5 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.734179 Sep 18 01:15:15.650027 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1475/3056] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:14 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:15.657159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a4edf42-d687-4cc6-bea1-57ae6a8ac2ee tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-108100909", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a4edf42-d687-4cc6-bea1-57ae6a8ac2ee tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 242 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-108100909", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-108100909', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '972e89e0-1dc6-4f89-aa18-8875eb7b4545'}]}}} Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:15:15.663052 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a4edf42-d687-4cc6-bea1-57ae6a8ac2ee tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:15.670459 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a4edf42-d687-4cc6-bea1-57ae6a8ac2ee tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.013424 Sep 18 01:15:15.682057 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1476/3057] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:15:15 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:15:15.695869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e7500601-9ba6-43d4-9021-24aeba886c4a req-0d79229e-69c4-4d3b-8d33-6278b81d446c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6f73cf-af88-443a-a139-80a88425f4d4", "name": "network-vif-plugged", "status": "completed", "tag": "89aed95c-f166-48ff-8887-a87e549b54de"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:15.712821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e7500601-9ba6-43d4-9021-24aeba886c4a req-0d79229e-69c4-4d3b-8d33-6278b81d446c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:15.713664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e7500601-9ba6-43d4-9021-24aeba886c4a req-0d79229e-69c4-4d3b-8d33-6278b81d446c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:15.714256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e7500601-9ba6-43d4-9021-24aeba886c4a req-0d79229e-69c4-4d3b-8d33-6278b81d446c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:15.734871 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e7500601-9ba6-43d4-9021-24aeba886c4a req-0d79229e-69c4-4d3b-8d33-6278b81d446c service nova] Creating event network-vif-plugged:89aed95c-f166-48ff-8887-a87e549b54de for instance bc6f73cf-af88-443a-a139-80a88425f4d4 on n-h1-master-1 Sep 18 01:15:15.741056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e7500601-9ba6-43d4-9021-24aeba886c4a req-0d79229e-69c4-4d3b-8d33-6278b81d446c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054195 Sep 18 01:15:15.742509 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1477/3058] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:15.758273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53be225c-9127-4dee-96c3-430c7a218657 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:15.758864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-53be225c-9127-4dee-96c3-430c7a218657 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 6e71e94a-69e1-454e-8ec0-19b46a6d4374] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:15.779463 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-53be225c-9127-4dee-96c3-430c7a218657 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] HTTP exception thrown: Instance 6e71e94a-69e1-454e-8ec0-19b46a6d4374 could not be found. Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53be225c-9127-4dee-96c3-430c7a218657 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6e71e94a-69e1-454e-8ec0-19b46a6d4374/metadata HTTP/1.1 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6e71e94a-69e1-454e-8ec0-19b46a6d4374 could not be found. Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '6e71e94a-69e1-454e-8ec0-19b46a6d4374'} Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e71e94a-69e1-454e-8ec0-19b46a6d4374 could not be found. Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e71e94a-69e1-454e-8ec0-19b46a6d4374 could not be found. Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.792636 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.800248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:15.800248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:15.800248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e71e94a-69e1-454e-8ec0-19b46a6d4374 could not be found. Sep 18 01:15:15.800248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.802446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53be225c-9127-4dee-96c3-430c7a218657 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 404 to user: Instance 6e71e94a-69e1-454e-8ec0-19b46a6d4374 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:15.804197 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-53be225c-9127-4dee-96c3-430c7a218657 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/6e71e94a-69e1-454e-8ec0-19b46a6d4374/metadata" status: 404 len: 111 microversion: 2.1 time: 0.060279 Sep 18 01:15:15.804972 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1478/3059] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:15:15 2022] GET /compute/v2.1/servers/6e71e94a-69e1-454e-8ec0-19b46a6d4374/metadata => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:15.873001 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca2b9bb1-18c5-447b-bb8b-fa50eeda3e2c tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1183061211", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca2b9bb1-18c5-447b-bb8b-fa50eeda3e2c tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 499 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1183061211", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1183061211', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '972e89e0-1dc6-4f89-aa18-8875eb7b4545'}]}}} Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:15:15.888991 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca2b9bb1-18c5-447b-bb8b-fa50eeda3e2c tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:15.893360 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca2b9bb1-18c5-447b-bb8b-fa50eeda3e2c tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.024305 Sep 18 01:15:15.905381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1479/3060] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:15:15 2022] POST /compute/v2.1/servers => generated 687 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:15:15.970455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3dc75ca2-5903-4598-bd2a-07dc8f7713fc tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1705502839", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3dc75ca2-5903-4598-bd2a-07dc8f7713fc tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 500 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1705502839", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1705502839', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '972e89e0-1dc6-4f89-aa18-8875eb7b4545'}]}}} Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:15:15.977065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:15.980611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:15.987389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3dc75ca2-5903-4598-bd2a-07dc8f7713fc tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:15.988285 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3dc75ca2-5903-4598-bd2a-07dc8f7713fc tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.023357 Sep 18 01:15:15.989273 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1480/3061] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:15:15 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:15:16.006733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:16.019035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:16.019679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:16.028147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.034341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.036218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31d007a1-6fd5-4640-9a9e-8a79b6ed6cfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 1.046056 Sep 18 01:15:16.036982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:16.037132 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1582/3062] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:14 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:16.038651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.039452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.040195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:16.104342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bd07c75-7bcc-4873-a47e-c01a686fc71e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-972263333", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bd07c75-7bcc-4873-a47e-c01a686fc71e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 753 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-972263333", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-972263333', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '972e89e0-1dc6-4f89-aa18-8875eb7b4545'}]}}} Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:15:16.127073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:15:16.130583 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:15:16.133521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.133521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.133521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bd07c75-7bcc-4873-a47e-c01a686fc71e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:16.133521 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3bd07c75-7bcc-4873-a47e-c01a686fc71e tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.030823 Sep 18 01:15:16.133521 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1583/3063] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:15:16 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 18 01:15:16.256563 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01e7435d-297e-4cb1-88fb-ceab3e0c79ef tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-71043574", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01e7435d-297e-4cb1-88fb-ceab3e0c79ef tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 1264 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-71043574", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "972e89e0-1dc6-4f89-aa18-8875eb7b4545"}]}} Sep 18 01:15:16.264626 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-71043574', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '972e89e0-1dc6-4f89-aa18-8875eb7b4545'}]}}} Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.275148 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:15:16.279828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:15:16.287918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 18 01:15:16.287918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.287918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01e7435d-297e-4cb1-88fb-ceab3e0c79ef tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:16.287918 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01e7435d-297e-4cb1-88fb-ceab3e0c79ef tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013769 Sep 18 01:15:16.287918 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1584/3064] 10.222.0.25 () {60 vars in 1148 bytes} [Sun Sep 18 01:15:16 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 18 01:15:16.287918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b34203eb-3fb1-4091-8a02-bb5a4a8f3f38 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:16.290209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b34203eb-3fb1-4091-8a02-bb5a4a8f3f38 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 0b718d6e-405c-4b54-8269-fc3023736d0b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:16.300371 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=16 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:16.308459 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b34203eb-3fb1-4091-8a02-bb5a4a8f3f38 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] HTTP exception thrown: Instance 0b718d6e-405c-4b54-8269-fc3023736d0b could not be found. Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b34203eb-3fb1-4091-8a02-bb5a4a8f3f38 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/0b718d6e-405c-4b54-8269-fc3023736d0b/metadata/test2 HTTP/1.1 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0b718d6e-405c-4b54-8269-fc3023736d0b could not be found. Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '0b718d6e-405c-4b54-8269-fc3023736d0b', 'id': 'test2'} Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b718d6e-405c-4b54-8269-fc3023736d0b could not be found. Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b718d6e-405c-4b54-8269-fc3023736d0b could not be found. Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:16.311042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:16.316219 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:16.316219 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:16.316219 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b718d6e-405c-4b54-8269-fc3023736d0b could not be found. Sep 18 01:15:16.316219 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:16.318911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b34203eb-3fb1-4091-8a02-bb5a4a8f3f38 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 404 to user: Instance 0b718d6e-405c-4b54-8269-fc3023736d0b could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:16.321772 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b34203eb-3fb1-4091-8a02-bb5a4a8f3f38 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/0b718d6e-405c-4b54-8269-fc3023736d0b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.041868 Sep 18 01:15:16.321772 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1585/3065] 10.222.0.25 () {58 vars in 1281 bytes} [Sun Sep 18 01:15:16 2022] GET /compute/v2.1/servers/0b718d6e-405c-4b54-8269-fc3023736d0b/metadata/test2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:16.337432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:16.338385 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:16.350172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.350965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.351640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:16.352589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.354044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.354948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:16.413295 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:15:16.600989 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7b320fc3-a172-4790-ae2d-efc6bc57ab73 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 204 len: 0 microversion: 2.1 time: 0.266480 Sep 18 01:15:16.601999 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1586/3066] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:15:16 2022] DELETE /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:15:16.613352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:16.618764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:16.638666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.639470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.639740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:16.648926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.649426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.650672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:16.820838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:16.837092 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a9ecd19-992f-474a-a6aa-2a574f0c13be tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.846392 Sep 18 01:15:16.850561 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1481/3067] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:15 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:16.874618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:16.874618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:16.890530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.891183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.898975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:16.899725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:16.905913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:16.906468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:17.128561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:17.139229 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-659eef5c-8f2d-471a-9c59-ee4f4512cdb5 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1526 microversion: 2.1 time: 0.532371 Sep 18 01:15:17.141147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1587/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:16 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1526 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:17.151906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:17.152720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:17.161659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:17.163782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:17.164855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:17.165850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:17.166492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:17.167750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:17.552664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:17.570728 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-19261cab-014f-486d-bdd5-73a91335d305 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.718001 Sep 18 01:15:17.571946 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1482/3069] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:16 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:17.649561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:17.668239 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ccb6f09e-effb-43a8-8556-72e3c0bcbe28 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 0.523130 Sep 18 01:15:17.673789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1588/3070] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:17 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:17.886641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:17.894511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:17.920078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:17.924246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:17.925296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:17.926757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:17.927669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:17.930535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:18.171514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:18.173113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:18.193034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:18.194330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:18.197746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:18.198970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:18.199752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:18.200493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:18.314165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:18.328541 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54e6867d-ded3-4b6a-aaa2-9ee8bdf4e3f0 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.451311 Sep 18 01:15:18.343137 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1483/3071] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:17 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:18.594176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:18.603274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:18.607832 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:18.620291 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-def1c066-1ee4-470f-b8b2-b061e5b669f0 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1526 microversion: 2.1 time: 0.452279 Sep 18 01:15:18.624065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:18.624854 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1589/3072] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:18 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1526 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:18.625974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:18.627129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:18.628572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:18.629794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:18.630885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:18.703508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:18.704603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:18.722840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:18.724444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:18.725204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:18.726727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:18.727241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:18.727676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:19.079200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:19.086363 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:19.089495 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e1c6b291-6821-420d-ba44-7387f72bc748 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 0.390442 Sep 18 01:15:19.090514 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1590/3073] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:18 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:19.122928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:19.147118 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5471563e-dd95-4ed3-bc36-99576e6c1266 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1314 microversion: 2.1 time: 0.549300 Sep 18 01:15:19.153783 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1484/3074] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:18 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:19.356158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:19.357422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:19.376669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:19.377949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:19.378533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:19.379705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:19.382252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:19.384819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:19.668319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:19.670251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:19.699006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:19.700981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:19.702333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:19.703541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:19.705633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:19.707105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:19.713195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:19.762549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c72a48f-f62c-49c0-ac60-fafb9d36834c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.410035 Sep 18 01:15:19.802066 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1591/3075] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:19 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:20.121318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:20.122462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:20.147336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:20.147647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:20.149414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:20.151081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:20.157786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:20.158949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:20.159848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:20.173251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5558111c-314c-487a-971f-a654d556603a tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1526 microversion: 2.1 time: 0.510383 Sep 18 01:15:20.195385 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1485/3076] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:19 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1526 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:20.210093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:20.211129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:20.243531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:20.243531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:20.243531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:20.244382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:20.247171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:20.248198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:20.606415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:20.623233 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-35e2b6d5-70d5-4ef0-9550-acd6316b25dc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 0.512661 Sep 18 01:15:20.635472 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1592/3077] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:20 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:20.825910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:20.830286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:20.834289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:20.850479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:20.852722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:20.853840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:20.859816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:20.860600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:20.861225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:20.861359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc08f272-2bca-4360-b50c-8e162a8e8131 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1464 microversion: 2.1 time: 0.664140 Sep 18 01:15:20.869001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1486/3078] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:20 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1464 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:21.263940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:21.278462 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c178997-a588-4a22-8974-9a1547dd3462 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1522 microversion: 2.1 time: 0.460700 Sep 18 01:15:21.280848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1593/3079] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:20 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:21.297210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:21.301090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:21.326605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.327008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.331123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:21.333061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.336414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.337544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:21.476806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71884d0ec6ee40f99c2977b1bda550e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b76e1b50e349be98bb1071da0f1deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:21.498276 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e21475f9-d705-40b6-9843-121e3486dbcf tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 200 len: 1484 microversion: 2.1 time: 0.214249 Sep 18 01:15:21.501976 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1594/3080] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:21 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 1484 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:21.551925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:21.561435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Searching by: {'deleted': False, 'project_id': '5423e292dfaf454683f3dc92f095f8f5'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:21.574586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.575071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.575915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:21.577511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.578466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.579613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:21.620262 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6e846bb0-0e23-4228-972e-5a5f898dbdf8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.730640 Sep 18 01:15:21.622395 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1487/3081] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:15:20 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:15:21.650717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:21.672202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:21.688071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:21.691154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Searching by: {'deleted': False} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:21.737485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.742337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.743714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.745024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:21.748121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.752026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.758636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:21.760524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.764553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:21.768531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:21.771938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:21.775581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:22.215213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:15:22.413431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:22.414322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:22.415305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:23.290541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:23.305502 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2e2a81e-2152-49e7-9ae6-1913b8a5a84b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 1.644286 Sep 18 01:15:23.322562 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1488/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:21 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:23.329501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4a1f492c-e462-4d5a-8f3b-d11bf9c7ae5c req-65936ecc-3c0b-470d-b8e1-0bf1bd7595a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa8b251-c626-4388-898a-8855a6706f55", "name": "network-vif-deleted", "tag": "946eb9df-4527-4d9c-ac37-0e6b31c6e39f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:23.344026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4a1f492c-e462-4d5a-8f3b-d11bf9c7ae5c req-65936ecc-3c0b-470d-b8e1-0bf1bd7595a7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:23.344971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4a1f492c-e462-4d5a-8f3b-d11bf9c7ae5c req-65936ecc-3c0b-470d-b8e1-0bf1bd7595a7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:23.345866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4a1f492c-e462-4d5a-8f3b-d11bf9c7ae5c req-65936ecc-3c0b-470d-b8e1-0bf1bd7595a7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:23.361368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4a1f492c-e462-4d5a-8f3b-d11bf9c7ae5c req-65936ecc-3c0b-470d-b8e1-0bf1bd7595a7 service nova] Creating event network-vif-deleted:946eb9df-4527-4d9c-ac37-0e6b31c6e39f for instance 1aa8b251-c626-4388-898a-8855a6706f55 on n-h1-master-1 Sep 18 01:15:23.369688 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4a1f492c-e462-4d5a-8f3b-d11bf9c7ae5c req-65936ecc-3c0b-470d-b8e1-0bf1bd7595a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044645 Sep 18 01:15:23.371426 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1489/3083] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:23.379403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:23.380425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:23.392226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:23.395886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:23.397082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:23.398741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:23.399841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:23.402565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.273856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:24.312180 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50f5bb38-5116-47a1-bbb3-29069dd05870 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1502 microversion: 2.1 time: 0.938790 Sep 18 01:15:24.314605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1490/3084] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:23 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1502 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:24.329365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:24.330525 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19d8b27b-927d-4d35-8541-c907d9d4a3eb tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12903 microversion: 2.1 time: 2.686502 Sep 18 01:15:24.338316 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1595/3085] 10.222.0.25 () {58 vars in 1171 bytes} [Sun Sep 18 01:15:21 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12903 bytes in 2688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:15:24.338707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] [instance: 1aa8b251-c626-4388-898a-8855a6706f55] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:24.349496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b4095cef-e4c8-4c2b-a595-d97c27f07cb0 req-987e42b7-e6a2-48ed-9101-c90454a69595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-plugged", "status": "completed", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:24.363770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:24.365321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:24.366374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.367376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:24.368133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:24.369631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.382237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b4095cef-e4c8-4c2b-a595-d97c27f07cb0 req-987e42b7-e6a2-48ed-9101-c90454a69595 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:24.382743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b4095cef-e4c8-4c2b-a595-d97c27f07cb0 req-987e42b7-e6a2-48ed-9101-c90454a69595 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:24.383186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b4095cef-e4c8-4c2b-a595-d97c27f07cb0 req-987e42b7-e6a2-48ed-9101-c90454a69595 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.413643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b4095cef-e4c8-4c2b-a595-d97c27f07cb0 req-987e42b7-e6a2-48ed-9101-c90454a69595 service nova] Creating event network-vif-plugged:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:15:24.420010 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b4095cef-e4c8-4c2b-a595-d97c27f07cb0 req-987e42b7-e6a2-48ed-9101-c90454a69595 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086553 Sep 18 01:15:24.421826 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1596/3086] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:24.428252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:24.429165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:24.432541 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] HTTP exception thrown: Instance 1aa8b251-c626-4388-898a-8855a6706f55 could not be found. Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Request method failure captured: Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 HTTP/1.1 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEHNswnXjmpJm0Zpm2fxWlXTgyfoC0I9ijoaLcouaGe863a3JH9UB3873li7rz6xU-WdWk0NS1gyWvyF-C0o0jp52WHj7IJ6-yuAfkv14LsQvz7t0ztcdd0uTpvA7thctbQM9dGnSRFlqr94LbKsVnWJYI38LuCZdcbLDc4YAp6nV0 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00b76e1b50e349be98bb1071da0f1deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 00b76e1b50e349be98bb1071da0f1deb Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-732789404 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 71884d0ec6ee40f99c2977b1bda550e9 Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-732789404-project Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 1aa8b251-c626-4388-898a-8855a6706f55 could not be found. Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '1aa8b251-c626-4388-898a-8855a6706f55'} Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa8b251-c626-4388-898a-8855a6706f55 could not be found. Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa8b251-c626-4388-898a-8855a6706f55 could not be found. Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:24.436639 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa8b251-c626-4388-898a-8855a6706f55 could not be found. Sep 18 01:15:24.442195 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:24.445195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:24.445750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:24.446195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.446911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:24.447846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] Returning 404 to user: Instance 1aa8b251-c626-4388-898a-8855a6706f55 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:24.448889 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-085124d7-2998-4e07-8a22-76e0eb6f04c3 tempest-ServerMetadataNegativeTestJSON-732789404 tempest-ServerMetadataNegativeTestJSON-732789404-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55" status: 404 len: 111 microversion: 2.1 time: 0.131823 Sep 18 01:15:24.459770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:24.461465 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1491/3087] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:24 2022] GET /compute/v2.1/servers/1aa8b251-c626-4388-898a-8855a6706f55 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:24.465935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.478283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:24.479393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:24.494610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:24.497692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:24.503234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.504708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:24.505528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:24.506168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:24.958575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:24.977885 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78288ffa-96b5-41fa-b865-85434bead7ca tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1517 microversion: 2.1 time: 0.514353 Sep 18 01:15:24.979067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1492/3088] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:24 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:24.988961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:24.999335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Searching by: {'deleted': False, 'project_id': '5423e292dfaf454683f3dc92f095f8f5'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:25.007578 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.008516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.009216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.010502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.011375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.012078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.051485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:25.062549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92b18daf-0b14-408c-b12e-c8143f1fa5d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 0.636153 Sep 18 01:15:25.063315 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1597/3089] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:24 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:25.068055 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68fae9db-8891-4935-b1d8-22f8a8460fe2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=c68b241d9f2e4caba8024093c0bdf903" status: 200 len: 15 microversion: 2.1 time: 0.086630 Sep 18 01:15:25.073937 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1493/3090] 10.222.0.25 () {58 vars in 1231 bytes} [Sun Sep 18 01:15:24 2022] GET /compute/v2.1/servers/detail?tenant_id=c68b241d9f2e4caba8024093c0bdf903 => generated 15 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:15:25.075110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b84b36bd-c68f-49d7-a301-a1256e313a93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:25.078081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b84b36bd-c68f-49d7-a301-a1256e313a93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 35978cbe-8d9a-48d0-a4fc-a748d4d532fb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:25.094173 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b84b36bd-c68f-49d7-a301-a1256e313a93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Instance 35978cbe-8d9a-48d0-a4fc-a748d4d532fb could not be found. Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b84b36bd-c68f-49d7-a301-a1256e313a93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/35978cbe-8d9a-48d0-a4fc-a748d4d532fb/action HTTP/1.1 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 14 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: {"rescue": {}} Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 35978cbe-8d9a-48d0-a4fc-a748d4d532fb could not be found. Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '35978cbe-8d9a-48d0-a4fc-a748d4d532fb', 'body': {'rescue': {}}} Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35978cbe-8d9a-48d0-a4fc-a748d4d532fb could not be found. Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35978cbe-8d9a-48d0-a4fc-a748d4d532fb could not be found. Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:25.105777 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:25.114557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:25.114557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:25.114557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:25.114557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:25.114557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35978cbe-8d9a-48d0-a4fc-a748d4d532fb could not be found. Sep 18 01:15:25.114557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:25.123533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:25.132647 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b84b36bd-c68f-49d7-a301-a1256e313a93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 404 to user: Instance 35978cbe-8d9a-48d0-a4fc-a748d4d532fb could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:25.137813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b84b36bd-c68f-49d7-a301-a1256e313a93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/35978cbe-8d9a-48d0-a4fc-a748d4d532fb/action" status: 404 len: 111 microversion: 2.1 time: 0.069274 Sep 18 01:15:25.147578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1598/3091] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:25 2022] POST /compute/v2.1/servers/35978cbe-8d9a-48d0-a4fc-a748d4d532fb/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:25.154547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:25.155612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:25.158821 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Searching by: {'tenant_id': 'c68b241d9f2e4caba8024093c0bdf903', 'deleted': False} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:25.169113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.172489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.175829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.177614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.182453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.183455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.194485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.195608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.196476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.198584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.199545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.200359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.270673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:15:25.341068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.343237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.344193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.384343 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-13afdcfd-1021-4819-b8f1-136861d16951 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action" status: 202 len: 0 microversion: 2.1 time: 0.234437 Sep 18 01:15:25.388952 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1599/3092] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:25 2022] POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:25.401498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:25.403316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:25.413097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.414313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.415750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:25.417221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:25.417954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:25.418607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.006874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:26.012657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8322d88e-e12a-49ec-9532-d3fecc41c2e4 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c68b241d9f2e4caba8024093c0bdf903" status: 200 len: 4825 microversion: 2.1 time: 0.895704 Sep 18 01:15:26.013263 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1494/3093] 10.222.0.25 () {58 vars in 1257 bytes} [Sun Sep 18 01:15:25 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c68b241d9f2e4caba8024093c0bdf903 => generated 4825 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:26.026097 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b7d21bf-f5ae-4471-b9e5-10013dede25e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1522 microversion: 2.1 time: 0.625226 Sep 18 01:15:26.026097 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1600/3094] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:25 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:26.053851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:26.060808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Searching by: {'tenant_id': '5423e292dfaf454683f3dc92f095f8f5', 'deleted': False} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:26.075764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.076495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.077167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.090733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.091533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.092144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.118317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:26.119599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:26.126309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8a866a3-249d-4872-9fc9-84e691b9840e tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5423e292dfaf454683f3dc92f095f8f5" status: 200 len: 15 microversion: 2.1 time: 0.078221 Sep 18 01:15:26.127535 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1601/3095] 10.222.0.25 () {58 vars in 1257 bytes} [Sun Sep 18 01:15:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5423e292dfaf454683f3dc92f095f8f5 => generated 15 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:15:26.168553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.169815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.171436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.172950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.174085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.175132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.191203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-98db4153-3fd1-42f7-91e8-c58c72dd9137 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:26.204155 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-98db4153-3fd1-42f7-91e8-c58c72dd9137 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.040019 Sep 18 01:15:26.210708 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1602/3096] 10.222.0.25 () {58 vars in 1189 bytes} [Sun Sep 18 01:15:26 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:15:26.248458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:26.252024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:26.270486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.271451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.273406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.276693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.277406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.278046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.405263 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70db6f0b-02a8-49db-8bba-eec33938667a tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action" status: 202 len: 0 microversion: 2.1 time: 0.160223 Sep 18 01:15:26.407083 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1603/3097] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:26 2022] POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:15:26.430784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:26.438400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:26.439395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:26.447609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.448510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.449206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.450264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.451246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.453468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.646370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:15:26.765810 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28f14f65-8394-42b1-bd01-d02ffa2ac94d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.339428 Sep 18 01:15:26.775069 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1604/3098] 10.222.0.25 () {58 vars in 1150 bytes} [Sun Sep 18 01:15:26 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:15:26.789103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:26.793741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:26.805935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.806634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.807138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.807853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.808303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.808720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.906633 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:26.910823 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d93f428-d3aa-49cd-a1a7-2cf7202b1757 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action" status: 202 len: 0 microversion: 2.1 time: 0.133941 Sep 18 01:15:26.915097 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1605/3099] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:26 2022] POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:26.922616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:26.923238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:26.929496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.929990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.930430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:26.931133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:26.931588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:26.932002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:27.253951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:27.290432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf42eb23-2c3a-4ccd-a7d0-10ba68d228d7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1363 microversion: 2.1 time: 1.166880 Sep 18 01:15:27.291103 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1495/3100] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:26 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1363 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:27.302503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:27.306519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:27.324280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:27.324780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:27.325417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:27.326340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:27.330543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:27.331514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:27.375998 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:28.227722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0cbeef15-4d04-4e26-9481-baf9f630cd7c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1613 microversion: 2.1 time: 1.311057 Sep 18 01:15:28.246996 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1606/3101] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:26 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1613 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:28.272080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:28.273517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:28.297000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:28.298071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:28.298775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:28.299753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:28.300445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:28.301101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:28.455777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:28.484982 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff995adf-33eb-4034-bab5-ab3b79ac4f9e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1502 microversion: 2.1 time: 1.188364 Sep 18 01:15:28.485671 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1496/3102] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:27 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1502 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:28.506987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:28.508120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:28.532943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:28.535243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:28.536238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:28.538965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:28.541926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:28.544250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:28.933417 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed092d2a-e7ab-4378-bbd6-cc1ed95c0cc8 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1613 microversion: 2.1 time: 0.665179 Sep 18 01:15:28.934424 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1607/3103] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:28 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1613 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:28.951347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:28.955490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:28.971646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:28.972144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:28.978600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:28.980420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:28.981369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:28.982240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.027992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:29.053633 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3664457e-6010-4cfe-bf61-61c3d11fc4e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1549 microversion: 2.1 time: 0.566039 Sep 18 01:15:29.054331 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1497/3104] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:28 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1549 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:29.070451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:29.076375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lazy-loading 'flavor' on Instance uuid 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:15:29.078481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:29.094278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.097815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.098591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.100276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.103684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.104313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.141427 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Cannot 'rescue' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state paused Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action HTTP/1.1 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 14 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: {"rescue": {}} Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'rescue' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state paused Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07', 'body': {'rescue': {}}} Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 in vm_state paused. Cannot rescue while the instance is in this state. Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state paused Sep 18 01:15:29.148605 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state paused Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:29.153452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 409 to user: Cannot 'rescue' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state paused {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:29.158857 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60730774-9f6c-4236-a223-24f8fe38494b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action" status: 409 len: 144 microversion: 2.1 time: 0.221226 Sep 18 01:15:29.166953 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1608/3105] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:28 2022] POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action => generated 144 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:15:29.208604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:29.210875 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:29.260509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.262765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.267307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.269645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.272349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.273806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.486545 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-302af2d0-94bc-4600-9f3a-15edcee8b91e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.317101 Sep 18 01:15:29.487146 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1609/3106] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:15:29 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/os-interface => generated 285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:29.487579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:15:29.492098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:29.492830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:29.505529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.514948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.515407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.516224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.516690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.517141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.633536 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-444d48b9-8585-41ba-9ce7-99357a3ebfe1 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 1325 microversion: 2.1 time: 0.577420 Sep 18 01:15:29.645708 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1498/3107] 10.222.0.25 () {58 vars in 1190 bytes} [Sun Sep 18 01:15:29 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:29.654812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:29.655376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:29.662509 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-57d7a6c6-af83-4db6-aa1b-b5a04782edd4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action" status: 202 len: 0 microversion: 2.1 time: 0.173794 Sep 18 01:15:29.663346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.665364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.665992 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1610/3108] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:29 2022] POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:29.671754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.675028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.676852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:29.677596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.678733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.689171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:15:29.706565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.707184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.707673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.710684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.711213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.711665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.732641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:15:29.890154 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00a59e4c-5161-4187-90f4-e8f1c493fac0 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.222458 Sep 18 01:15:29.891453 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1611/3109] 10.222.0.25 () {58 vars in 1196 bytes} [Sun Sep 18 01:15:29 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:15:29.913830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:29.914479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:29.915354 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13bc764b-5129-4df6-bfa2-5024d90e8d75 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 204 len: 0 microversion: 2.1 time: 0.267101 Sep 18 01:15:29.916382 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1499/3110] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:15:29 2022] DELETE /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:15:29.936720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:29.936720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:29.943791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.944291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.944428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.944728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.945083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.945446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.945854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.946024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.946342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:29.946565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:29.947240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:29.947591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:30.251350 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15a64a2e-b6c1-43eb-8b92-43779b7519c7 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action" status: 202 len: 0 microversion: 2.1 time: 0.333570 Sep 18 01:15:30.252354 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1500/3111] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:29 2022] POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:30.274916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:30.276875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:30.288208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:30.289356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:30.290083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:30.291425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:30.292165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:30.294024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:30.786158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:30.800551 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c1f4d706-ddf1-4f75-9a4d-111683a756c6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1509 microversion: 2.1 time: 0.896203 Sep 18 01:15:30.801150 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1612/3112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:29 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1509 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:30.814595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:30.822396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:30.847047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:30.847843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:30.848487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:30.849386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:30.850039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:30.850631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:31.008610 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:31.015337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:15:31.021582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:15:31.025944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:15:31.026710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:15:31.027350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:15:31.167675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:31.190554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:31.190554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:31.190952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:31.192027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:31.193088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:31.194519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:31.226333 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abed52d5-d6d5-48ca-bb03-8bbe9ca31098 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action" status: 202 len: 1066 microversion: 2.1 time: 0.424004 Sep 18 01:15:31.241727 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1613/3113] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:30 2022] POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action => generated 1066 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 18 01:15:31.248107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:31.249710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:31.256407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:31.257205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:31.257838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:31.258813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:31.259435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:31.260021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:32.177937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:32.194675 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e33a6763-8783-4aaf-bee7-2e3f6e233f0a tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1664 microversion: 2.1 time: 1.940991 Sep 18 01:15:32.199607 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1501/3114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:30 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1664 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:32.215947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:32.216969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:32.231480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:32.232175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:32.234275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:32.235200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:32.236016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:32.236626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:32.388958 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:32.890062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:32.899733 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db20768b-48ba-45bc-81b4-a9387e0d7ebe tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1470 microversion: 2.1 time: 1.656608 Sep 18 01:15:32.901878 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1614/3115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:31 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1470 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:33.133770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:33.150634 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6bf0fb69-7ff0-48d1-a5be-679a885753e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1517 microversion: 2.1 time: 0.948327 Sep 18 01:15:33.151580 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1502/3116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:32 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1517 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:33.226848 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:33.227787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:33.242913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:33.247867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:33.249037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:33.250555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:33.252789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:33.253404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:33.663902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13e96851-1ef5-4192-8aed-70e1834425c4 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Action: 'create', calling method: .version_select at 0x7f700a7b0b80>, body: {"pool": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:34.042938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:34.068594 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8e442ade-a7a0-40ca-a9da-83a1fed408b7 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1664 microversion: 2.1 time: 0.844442 Sep 18 01:15:34.069643 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1615/3117] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:33 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1664 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:34.083970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:34.085254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:34.092995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:34.093835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:34.094526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:34.095465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:34.096397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:34.097646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:35.193964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:35.202919 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-df8bd8dc-912f-4704-9e2a-574c8f6bd56a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1470 microversion: 2.1 time: 1.131646 Sep 18 01:15:35.207784 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1616/3118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:34 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1470 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:35.224563 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:35.227164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:35.259748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:35.260513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:35.261015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:35.261847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:35.262293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:35.262978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:35.324128 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:36.054442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:36.077758 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f21fe42-4f8d-418b-bcb7-b9dc9b6d46be tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1664 microversion: 2.1 time: 0.863627 Sep 18 01:15:36.078663 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1617/3119] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:35 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1664 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:36.403337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d31e6295-f3c2-4afc-b866-20859e318e21 req-0c985ed4-78bf-4f29-86dd-5197cc6a2636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:36.422780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d31e6295-f3c2-4afc-b866-20859e318e21 req-0c985ed4-78bf-4f29-86dd-5197cc6a2636 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:36.424703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d31e6295-f3c2-4afc-b866-20859e318e21 req-0c985ed4-78bf-4f29-86dd-5197cc6a2636 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:36.425396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d31e6295-f3c2-4afc-b866-20859e318e21 req-0c985ed4-78bf-4f29-86dd-5197cc6a2636 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:36.472163 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d31e6295-f3c2-4afc-b866-20859e318e21 req-0c985ed4-78bf-4f29-86dd-5197cc6a2636 service nova] Creating event network-changed:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:15:36.500307 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d31e6295-f3c2-4afc-b866-20859e318e21 req-0c985ed4-78bf-4f29-86dd-5197cc6a2636 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.416674 Sep 18 01:15:36.503486 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1618/3120] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:36.526307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:36.531964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:36.567059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:36.569590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:36.570459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:36.572056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:36.573366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:36.574254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:36.625143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lazy-loading 'flavor' on Instance uuid 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:15:36.721606 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:36.749096 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ac2228b-bc56-4390-96a3-35b78c4278d6 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action" status: 200 len: 32 microversion: 2.1 time: 0.242182 Sep 18 01:15:36.750981 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1619/3121] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:36 2022] POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:15:36.764641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:36.766664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:36.776360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:36.777739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:36.778783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:36.781679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:36.782760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:36.784113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:37.462754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:37.473151 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be11f04f-2def-47fb-8313-9c2d8e5f491d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1470 microversion: 2.1 time: 0.719163 Sep 18 01:15:37.477768 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1620/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:36 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1470 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:37.495016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:37.497303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:37.515927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:37.520002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:37.520989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:37.524813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:37.525951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:37.527426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:37.935859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:37.948574 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c3c1613-7fb8-4e88-8991-2c0185a128ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.469331 Sep 18 01:15:37.949958 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1621/3123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:37 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:37.963968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:37.964595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:37.990567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:37.991317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:37.991926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:37.993491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:37.994149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:37.994740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:38.080106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:38.080410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:38.080846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:38.081367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lazy-loading 'fault' on Instance uuid f8104143-3ea0-401c-9057-7f71d7cce8ed {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:15:38.274518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b51519d90f44a04b65fa5730e644760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70699b2280334f19ad596b183f3718fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:38.292058 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d5467331-d333-4708-914c-65620669eec8 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 200 len: 1314 microversion: 2.1 time: 0.340796 Sep 18 01:15:38.292667 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1622/3124] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:37 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:38.514201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:38.514894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:38.525520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:38.528760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:38.529217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:38.530619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:38.535249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:38.535877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:39.113240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:39.122535 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d95390c-ae98-491e-9dfe-5d2ad02073ef tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1470 microversion: 2.1 time: 0.612153 Sep 18 01:15:39.124324 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1623/3125] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:38 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1470 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:39.129082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-35f51176-1d51-4c1c-acc4-fb086a054acd req-4ebd780f-16d0-4275-b616-0c4d8768b3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8104143-3ea0-401c-9057-7f71d7cce8ed", "name": "network-vif-deleted", "tag": "81f99da0-b91a-4dc2-ab5f-c396ef392004"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:39.152076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-35f51176-1d51-4c1c-acc4-fb086a054acd req-4ebd780f-16d0-4275-b616-0c4d8768b3d1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:39.153246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-35f51176-1d51-4c1c-acc4-fb086a054acd req-4ebd780f-16d0-4275-b616-0c4d8768b3d1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:39.155250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-35f51176-1d51-4c1c-acc4-fb086a054acd req-4ebd780f-16d0-4275-b616-0c4d8768b3d1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:39.185055 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-35f51176-1d51-4c1c-acc4-fb086a054acd req-4ebd780f-16d0-4275-b616-0c4d8768b3d1 service nova] Creating event network-vif-deleted:81f99da0-b91a-4dc2-ab5f-c396ef392004 for instance f8104143-3ea0-401c-9057-7f71d7cce8ed on n-h2-master-1 Sep 18 01:15:39.199815 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-35f51176-1d51-4c1c-acc4-fb086a054acd req-4ebd780f-16d0-4275-b616-0c4d8768b3d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073162 Sep 18 01:15:39.201026 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1624/3126] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:39.216615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:39.217591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:39.232798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:39.233298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:39.233779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:39.234497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:39.234945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:39.235366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:39.280086 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:39.790617 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:39.801691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:39.815081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cde89540-7113-4afb-8a9a-d99cd66b8ddd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.610801 Sep 18 01:15:39.817731 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1625/3127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:39 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:39.829805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:39.830978 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] [instance: f8104143-3ea0-401c-9057-7f71d7cce8ed] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:39.848077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:39.848737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:39.850589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:39.851561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:39.856403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:39.866378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:39.926450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] HTTP exception thrown: Instance f8104143-3ea0-401c-9057-7f71d7cce8ed could not be found. Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Request method failure captured: Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed HTTP/1.1 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDYXonp6JhF8bps-OIIXFkS03DHxN7bg1Gkuffr6IGw7YmYO3wesv5fPP-f5rx7D8GiXpRqlbsHlgUDhVmkJjYdtFmhPVR5GZwRm5SR7-zCBxhVhLSnfwOB1TgPew4YJLIPYLiL3qwyffS_2ohC7aO7IIKjt_eh3PRheAGW3CX1s0U Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 70699b2280334f19ad596b183f3718fe Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestFqdnHostnames-641106217 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70699b2280334f19ad596b183f3718fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70699b2280334f19ad596b183f3718fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70699b2280334f19ad596b183f3718fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70699b2280334f19ad596b183f3718fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestFqdnHostnames-641106217 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 70699b2280334f19ad596b183f3718fe Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-641106217 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestFqdnHostnames-641106217-project Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 3b51519d90f44a04b65fa5730e644760 Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestFqdnHostnames-641106217-project Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: exception: Instance f8104143-3ea0-401c-9057-7f71d7cce8ed could not be found. Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'f8104143-3ea0-401c-9057-7f71d7cce8ed'} Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8104143-3ea0-401c-9057-7f71d7cce8ed could not be found. Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8104143-3ea0-401c-9057-7f71d7cce8ed could not be found. Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:39.928747 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8104143-3ea0-401c-9057-7f71d7cce8ed could not be found. Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:15:39.934546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Returning 404 to user: Instance f8104143-3ea0-401c-9057-7f71d7cce8ed could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:39.935448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed" status: 404 len: 111 microversion: 2.1 time: 0.116129 Sep 18 01:15:39.940729 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1626/3128] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:39 2022] GET /compute/v2.1/servers/f8104143-3ea0-401c-9057-7f71d7cce8ed => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:39.942070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:39.943168 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-49892245-6aac-487c-ad73-c5cdcb07a601 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001524 Sep 18 01:15:39.944342 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1627/3129] 10.222.0.25 () {56 vars in 886 bytes} [Sun Sep 18 01:15:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 18 01:15:39.964481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '.version_select at 0x7f700515db80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:40.008343 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29610687" status: 202 len: 0 microversion: 2.1 time: 0.061903 Sep 18 01:15:40.010065 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1628/3130] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Sep 18 01:15:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29610687 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:40.012544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:40.015743 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003654 Sep 18 01:15:40.016151 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1629/3131] 10.222.0.25 () {54 vars in 1035 bytes} [Sun Sep 18 01:15:40 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 18 01:15:40.024143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:40.025425 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 18 01:15:40.025869 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1630/3132] 10.222.0.25 () {54 vars in 1041 bytes} [Sun Sep 18 01:15:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:15:40.038451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:40.039514 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91e6f75f-0677-48b5-96c6-683cc71891f0 tempest-ServersTestFqdnHostnames-641106217 tempest-ServersTestFqdnHostnames-641106217-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001347 Sep 18 01:15:40.039867 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1631/3133] 10.222.0.25 () {56 vars in 886 bytes} [Sun Sep 18 01:15:40 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 18 01:15:40.059124 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13e96851-1ef5-4192-8aed-70e1834425c4 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.495775 Sep 18 01:15:40.060061 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1503/3134] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:15:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:40.075342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e1c40dc9-be2e-4da5-bf7d-baae46697042 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Calling method '.version_select at 0x7f70053555e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:40.168220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:40.168881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:40.172010 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:40.189358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:40.189870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:40.194151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:40.197965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:40.198678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:40.200228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:40.887664 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e1c40dc9-be2e-4da5-bf7d-baae46697042 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/e8098dbf-d1c3-4e9c-8227-1ef9b3ea9c6c" status: 200 len: 142 microversion: 2.1 time: 0.816618 Sep 18 01:15:40.888265 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1632/3135] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:15:40 2022] GET /compute/v2.1/os-floating-ips/e8098dbf-d1c3-4e9c-8227-1ef9b3ea9c6c => generated 142 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:40.892865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:40.893483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:40.921832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:40.922334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:40.932680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:40.933743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:40.935405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:40.937125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:41.089285 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:41.102152 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-955358a4-69ba-465a-8cd1-62ea647965d6 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1470 microversion: 2.1 time: 0.939956 Sep 18 01:15:41.103398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1504/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:40 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1470 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:41.110443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1a202ae-2d76-4c5a-9452-d6ec1bb500fa tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Calling method '.version_select at 0x7f7006551670>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:41.994519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:42.002692 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-686d4d48-e509-4719-afca-614a3a2a9128 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 1.113247 Sep 18 01:15:42.003338 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1633/3137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:40 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:42.149061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:42.149714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:42.157596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:42.158386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:42.158991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:42.159888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:42.161164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:42.161782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:42.325904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1a202ae-2d76-4c5a-9452-d6ec1bb500fa tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.220458 Sep 18 01:15:42.337622 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1505/3138] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:15:41 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:42.345414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-725687fe-a81a-46be-a9e6-925dd977fe65 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Calling method '.version_select at 0x7f7006536d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:42.646538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:42.682281 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11b9da62-8e8f-406b-bb49-b9db1c37a3bd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1470 microversion: 2.1 time: 0.534669 Sep 18 01:15:42.685540 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1634/3139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:42 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1470 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:43.041973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:43.042759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:43.068354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:43.068752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:43.077145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:43.080056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:43.082212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:43.084011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:43.619627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:43.630965 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-43a0baf4-def3-4412-a8f4-4ab6b66c89c1 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.596261 Sep 18 01:15:43.631561 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1635/3140] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:43 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:43.993894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2097377811", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:44.142235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] validate_networks() for [('d94f6ca6-70ba-45bf-93c2-d48012732b5b', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:15:44.760627 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-725687fe-a81a-46be-a9e6-925dd977fe65 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e8098dbf-d1c3-4e9c-8227-1ef9b3ea9c6c" status: 202 len: 0 microversion: 2.1 time: 2.421202 Sep 18 01:15:44.763270 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1506/3141] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:15:42 2022] DELETE /compute/v2.1/os-floating-ips/e8098dbf-d1c3-4e9c-8227-1ef9b3ea9c6c => generated 0 bytes in 2425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:44.768921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:44.769854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:44.812552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:44.812552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:44.812552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:44.812552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:44.812552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:44.821057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:45.803093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:45.812365 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96b69444-154b-4006-96fd-13825cfc5e76 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1476 microversion: 2.1 time: 1.047114 Sep 18 01:15:45.813461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1507/3142] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:44 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1476 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:45.816515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:15:45.817022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:15:45.817987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:15:45.818509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:15:45.819291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:15:45.830548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:45.831525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:45.842650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:45.844152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:45.845073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:45.845711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:45.847688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:45.848146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:45.848805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:45.850219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:45.850898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:45.851821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:45.852000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:45.854472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:45.945400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Getting quotas for project 14e7c4ce195e4e7baed225946f8d353e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:15:45.964968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Getting quotas for user 914730a7091a46bf8f438ad5755c1fb9 and project 14e7c4ce195e4e7baed225946f8d353e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:15:45.993077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:15:45.999351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:15:46.098170 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0aa0c8a8-5e09-4300-8d97-a10e57424b34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.454600 Sep 18 01:15:46.100173 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1636/3143] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:15:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:15:46.127451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0390580b-69d7-4476-99e2-7b866985c14a tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Action: 'create', calling method: .version_select at 0x7f7005396a60>, body: {"pool": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:46.160825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:46.177417 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-755db691-4338-4a34-856a-05e5d12c7924 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.362656 Sep 18 01:15:46.193581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1508/3144] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:45 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:46.193581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0871a957-072f-42f4-84ac-3d0ab4a94f2e tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:46.193581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0871a957-072f-42f4-84ac-3d0ab4a94f2e tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:46.309656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0871a957-072f-42f4-84ac-3d0ab4a94f2e tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:46.327944 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0871a957-072f-42f4-84ac-3d0ab4a94f2e tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1223 microversion: 2.1 time: 0.146936 Sep 18 01:15:46.355697 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1509/3145] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:46 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:46.840804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:46.841731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:46.868119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:46.868673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:46.869131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:46.874081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:46.884925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:46.885509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:47.625593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:47.648160 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6159b3f8-e6a8-4ac4-810d-eb35ab31886b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1476 microversion: 2.1 time: 0.812073 Sep 18 01:15:47.665615 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1510/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:46 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1476 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:47.680252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:47.680252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:47.708251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:47.710569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:47.713075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:47.715693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:47.716516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:47.723871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:48.175552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:48.200595 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8d581c0-f345-4e80-b029-7832c088f1ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.540549 Sep 18 01:15:48.219832 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1511/3147] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:47 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:48.230137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:48.231991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:48.242026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:48.242768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:48.243463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:48.245190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:48.246544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:48.247186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:48.378116 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:48.399556 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b4ab7f6-9d49-4c55-a533-ef1b582d4275 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1275 microversion: 2.1 time: 0.177260 Sep 18 01:15:48.401250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1512/3148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:48 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:48.698460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:48.699503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:48.731851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:48.732515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:48.735018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:48.741563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:48.742351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:48.743896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:48.809062 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:49.540637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:49.556812 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a221f1a-070d-495f-a3f6-cf959f29390f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1476 microversion: 2.1 time: 0.873873 Sep 18 01:15:49.572431 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1513/3149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:48 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1476 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:49.596010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:49.599271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:49.640831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:49.641357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:49.654618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:49.655423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:49.655917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:49.656416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:50.760298 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:50.773504 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3e94157-e304-4927-b793-c908549523c4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 1.192242 Sep 18 01:15:50.779560 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1514/3150] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:49 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:50.792670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:50.793891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:50.805400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:50.812754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:50.813324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:50.814219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:50.814786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:50.815461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:50.946018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:50.954826 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78575240-bb97-472a-86d3-9f6bf3a03738 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1281 microversion: 2.1 time: 0.173715 Sep 18 01:15:50.958570 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1515/3151] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:50 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:50.994594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:51.011426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:51.018181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:51.018959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:51.019567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:51.023847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:51.024909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:51.025824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:51.755358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:51.789325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f639cc3b-4e87-42cd-a326-60c9b9adf42d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1476 microversion: 2.1 time: 0.798544 Sep 18 01:15:51.791974 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1516/3152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:50 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1476 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:52.108130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-565eafe2-0bf3-4bd7-9c0d-d493657bca98 req-c059644d-8944-40d1-ad3b-60f964df1f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f354c30-7ca1-41fa-b98b-024302f6544c", "name": "network-vif-plugged", "status": "completed", "tag": "e8130d77-3807-4849-af92-54003c070986"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:52.132232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-565eafe2-0bf3-4bd7-9c0d-d493657bca98 req-c059644d-8944-40d1-ad3b-60f964df1f89 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:52.133191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-565eafe2-0bf3-4bd7-9c0d-d493657bca98 req-c059644d-8944-40d1-ad3b-60f964df1f89 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:52.136673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-565eafe2-0bf3-4bd7-9c0d-d493657bca98 req-c059644d-8944-40d1-ad3b-60f964df1f89 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:52.156606 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-565eafe2-0bf3-4bd7-9c0d-d493657bca98 req-c059644d-8944-40d1-ad3b-60f964df1f89 service nova] Creating event network-vif-plugged:e8130d77-3807-4849-af92-54003c070986 for instance 5f354c30-7ca1-41fa-b98b-024302f6544c on n-h1-master-1 Sep 18 01:15:52.175682 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-565eafe2-0bf3-4bd7-9c0d-d493657bca98 req-c059644d-8944-40d1-ad3b-60f964df1f89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.381218 Sep 18 01:15:52.181052 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1517/3153] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:52.192796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:52.195465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:52.206427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:52.207280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:52.207936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:52.208984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:52.210063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:52.210662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:52.259488 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0390580b-69d7-4476-99e2-7b866985c14a tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.147530 Sep 18 01:15:52.261086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1637/3154] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:15:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:52.266403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:52.267310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:52.278113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:52.278966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:52.279850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:52.280850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:52.289142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:52.289629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:52.435678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:52.444916 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0146724-905e-4803-b846-2a67195cd867 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1281 microversion: 2.1 time: 0.182394 Sep 18 01:15:52.445721 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1638/3155] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:52 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:52.452313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1385c503-dce7-4ac7-aeaa-e5b09f40011a tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Calling method '.version_select at 0x7f7005111a60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:52.578409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:52.600410 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b92f8e0e-a39c-452b-8a53-8ca08a82eb71 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.416422 Sep 18 01:15:52.613591 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1518/3156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:52 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:52.815484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:52.816111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:52.825116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:52.825748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:52.826137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:52.826873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:52.827340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:52.827784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:53.386032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:53.403034 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f73a25ca-6cd1-45bd-9205-4affc7d67d87 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1476 microversion: 2.1 time: 0.591377 Sep 18 01:15:53.404319 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1519/3157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:52 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:53.473194 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:53.474959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:53.485991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:53.487374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:53.492574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:53.494347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:53.495094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:53.495766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:53.941196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:53.958913 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69e11ede-fc77-4c16-adad-cb31dee84fa4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 0.492853 Sep 18 01:15:53.960387 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1520/3158] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:53 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:53.967256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:53.968634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:53.976665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:53.977377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:53.978044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:53.979030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:53.979911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:53.981277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:55.395021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:55.414895 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-322b3392-85a5-493b-957b-94320ccfa894 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 1.453236 Sep 18 01:15:55.415881 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1521/3159] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:53 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:55.421345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:55.426804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:55.438934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:55.446682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:55.447645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:55.448643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:55.449326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:55.450019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:55.897789 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:55.980871 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:55.987545 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1385c503-dce7-4ac7-aeaa-e5b09f40011a tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305" status: 202 len: 0 microversion: 2.1 time: 3.540038 Sep 18 01:15:55.988452 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1639/3160] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:15:52 2022] DELETE /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 => generated 0 bytes in 3542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:15:55.993653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:55.996030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:56.026900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:56.028505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:56.030277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:56.032061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:56.033086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:56.034394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:56.323998 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:56.407279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:56.424697 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3e21899a-df10-4edb-8374-c67db6cad9e9 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1462 microversion: 2.1 time: 1.007596 Sep 18 01:15:56.425310 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1522/3161] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:55 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1462 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:56.458032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46a15a46-c141-4069-9f94-4687502d82a1 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Calling method '.version_select at 0x7f700a807040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:56.792667 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-46a15a46-c141-4069-9f94-4687502d82a1 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 could not be found", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:15:56.793388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-46a15a46-c141-4069-9f94-4687502d82a1 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] HTTP exception thrown: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46a15a46-c141-4069-9f94-4687502d82a1 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Request method failure captured: Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 HTTP/1.1 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnE1s1Nx5hVaXvl-Ou7r0QTqovqhfhzN7peg08lGTpoBMsxuhtw5DZSGCekJD7Ub-tMb1If-qnpyQ13RTJoTrUHydKFTjUFj25cSxeOuTRZ6fKmgzt0g7v9NLpGkMYTiZMSw8mKWvvWPGrEXJ-BkBDzddkWfHD_-uxKB8vlgW05Ztqc Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: b4fc329d4f0040869835510d7a08a284 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPsTestJSON-866233835 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4fc329d4f0040869835510d7a08a284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4fc329d4f0040869835510d7a08a284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4fc329d4f0040869835510d7a08a284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4fc329d4f0040869835510d7a08a284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPsTestJSON-866233835 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: b4fc329d4f0040869835510d7a08a284 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPsTestJSON-866233835 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPsTestJSON-866233835-project Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 2a8bf78e823d4e40a09ce3528b2d6b81 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPsTestJSON-866233835-project Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: exception: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd25dc7ec-8f69-43b4-a5e3-4ef03bb3f305'} Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 could not be found Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaaa5b9d-ae65-4cfa-b6dc-9e1dab1d9025'] Sep 18 01:15:56.796122 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305. Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46a15a46-c141-4069-9f94-4687502d82a1 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Returning 404 to user: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46a15a46-c141-4069-9f94-4687502d82a1 tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305" status: 404 len: 111 microversion: 2.1 time: 0.363778 Sep 18 01:15:56.800776 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1523/3162] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:15:56 2022] GET /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 => generated 111 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:56.806475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:56.806475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:56.831363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:56.831873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:56.832323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:56.833057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:56.833523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:56.848931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:57.235770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:57.250721 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc908d88-7aaf-4e92-a3ef-f3e9f8fb7ddb tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 1.260179 Sep 18 01:15:57.255055 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1640/3163] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:55 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:57.267871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:57.269934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:57.288700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:57.290488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:57.293166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:57.295100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:57.295881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:57.298582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:57.579191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:57.593432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea7568b3-3a43-498f-a317-3855ff84b6bf tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.794213 Sep 18 01:15:57.594635 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1524/3164] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:56 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:57.604461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00fea773-bb5f-4bb1-b013-f60df18cfb8b tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Calling method '.version_select at 0x7f700a819af0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:57.760718 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-00fea773-bb5f-4bb1-b013-f60df18cfb8b tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 could not be found", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:15:57.764282 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-00fea773-bb5f-4bb1-b013-f60df18cfb8b tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] HTTP exception thrown: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00fea773-bb5f-4bb1-b013-f60df18cfb8b tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Request method failure captured: Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 HTTP/1.1 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnE1s1Nx5hVaXvl-Ou7r0QTqovqhfhzN7peg08lGTpoBMsxuhtw5DZSGCekJD7Ub-tMb1If-qnpyQ13RTJoTrUHydKFTjUFj25cSxeOuTRZ6fKmgzt0g7v9NLpGkMYTiZMSw8mKWvvWPGrEXJ-BkBDzddkWfHD_-uxKB8vlgW05Ztqc Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: b4fc329d4f0040869835510d7a08a284 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPsTestJSON-866233835 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4fc329d4f0040869835510d7a08a284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4fc329d4f0040869835510d7a08a284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4fc329d4f0040869835510d7a08a284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4fc329d4f0040869835510d7a08a284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPsTestJSON-866233835 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: b4fc329d4f0040869835510d7a08a284 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPsTestJSON-866233835 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPsTestJSON-866233835-project Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 2a8bf78e823d4e40a09ce3528b2d6b81 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPsTestJSON-866233835-project Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: exception: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd25dc7ec-8f69-43b4-a5e3-4ef03bb3f305'} Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 could not be found Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2879b8-dd22-4a46-8d2b-12bcd1df7b80'] Sep 18 01:15:57.771079 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305. Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 Sep 18 01:15:57.776469 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:15:57.780454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00fea773-bb5f-4bb1-b013-f60df18cfb8b tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] Returning 404 to user: Floating IP not found for ID d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:15:57.781903 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00fea773-bb5f-4bb1-b013-f60df18cfb8b tempest-FloatingIPsTestJSON-866233835 tempest-FloatingIPsTestJSON-866233835-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305" status: 404 len: 111 microversion: 2.1 time: 0.185687 Sep 18 01:15:57.787919 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1525/3165] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:15:57 2022] DELETE /compute/v2.1/os-floating-ips/d25dc7ec-8f69-43b4-a5e3-4ef03bb3f305 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:15:57.912214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:57.925823 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d47057f-a612-482e-be8b-d8371922e12f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1462 microversion: 2.1 time: 0.667513 Sep 18 01:15:57.928099 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1641/3166] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:57 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1462 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:15:57.933780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5baebe35-c3fd-4a6c-9314-8006167d7f38 req-c534e7ce-71b0-4a04-91c0-397be7599e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3", "tag": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:57.949198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5baebe35-c3fd-4a6c-9314-8006167d7f38 req-c534e7ce-71b0-4a04-91c0-397be7599e04 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:57.952952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5baebe35-c3fd-4a6c-9314-8006167d7f38 req-c534e7ce-71b0-4a04-91c0-397be7599e04 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:57.954114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5baebe35-c3fd-4a6c-9314-8006167d7f38 req-c534e7ce-71b0-4a04-91c0-397be7599e04 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:57.975745 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5baebe35-c3fd-4a6c-9314-8006167d7f38 req-c534e7ce-71b0-4a04-91c0-397be7599e04 service nova] Creating event network-changed:9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 for instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 on n-h2-master-1 Sep 18 01:15:57.985808 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5baebe35-c3fd-4a6c-9314-8006167d7f38 req-c534e7ce-71b0-4a04-91c0-397be7599e04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055521 Sep 18 01:15:57.990587 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1642/3167] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:15:58.005284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:58.010215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:58.026708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.026708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.028281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:58.028932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.029386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.029860 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:58.048866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3676525-bd38-4c24-993b-0e248c24f8ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'create', calling method: .version_select at 0x7f70063b2820>, body: {"keypair": {"name": "tempest-keypair-1868027593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwpLpSIcclA+bIn2TSPptGR+a7TgSNza5Ym5QOV9DUGKaT6dkd/snB+ywLoIgyiDH+zbpTk5g1dPnJFIzCrfiZLJqOLZN3JtwGp9mhZyPZfD7vBt+P/89ZUw8kzJLgapg=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:15:58.089696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f3676525-bd38-4c24-993b-0e248c24f8ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:15:58.096513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-f3676525-bd38-4c24-993b-0e248c24f8ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for user 56d16d15d11b40e188f517d24819845b and project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:15:58.133480 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3676525-bd38-4c24-993b-0e248c24f8ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.348161 Sep 18 01:15:58.134476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1526/3168] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:15:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 350 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:15:58.143502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:15:58.144188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:15:58.144668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:15:58.145082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:15:58.145496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:15:58.230980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:58.237737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.238944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.239753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:58.240656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.241289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.241957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:58.276076 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0bf0dbf0-69e2-47a9-9878-ee0b84614192 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action" status: 202 len: 1066 microversion: 2.1 time: 0.281278 Sep 18 01:15:58.277265 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1643/3169] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:15:57 2022] POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action => generated 1066 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 18 01:15:58.295000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:58.295914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:58.298873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:58.299724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:58.308939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.309765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.310403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:58.311314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.312520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.313113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:58.318764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.319253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.319427 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:15:58.319686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:58.320824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:58.321288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:58.321743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:59.001818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:59.019397 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0d204af-15be-4716-8f28-ec61fc0fbd08 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.724712 Sep 18 01:15:59.020520 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1644/3170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:58 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:59.034531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:15:59.035688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:15:59.047758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:59.047758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:59.049143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:59.049143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:15:59.049525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:15:59.049781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:15:59.495793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:59.517175 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-688401b8-b291-4d07-a101-cbd1e2bc359a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 1.239637 Sep 18 01:15:59.533282 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1527/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:58 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:15:59.868173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:15:59.897620 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6241916e-74cf-432f-ae74-046d2474fb09 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.873907 Sep 18 01:15:59.899315 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1645/3172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:15:59 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:00.049435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:00.050101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:00.070297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:00.070947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:00.071374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:00.072335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:00.072800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:00.073231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:00.470748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:00.492657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4d27786-4d09-4746-9f94-6b0aa8f7e413 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.452876 Sep 18 01:16:00.525842 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1528/3173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:00 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:00.545583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:00.546817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:00.560372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:00.560987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:00.561520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:00.562501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:00.563952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:00.565405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:00.933601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:00.936075 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:00.965955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:00.966752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:00.967391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:00.968311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:00.968955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:00.969572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:00.994429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:01.016522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1bda277a-484a-436a-8044-69305a826556 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 0.479041 Sep 18 01:16:01.021300 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1646/3174] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:00 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:01.518498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:01.519130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:01.521229 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:01.539753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:01.540251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:01.540692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:01.541400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:01.541897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:01.542305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:01.744237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:01.802609 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6e7651bf-7a63-4731-8ddb-750cd5ae4082 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.837229 Sep 18 01:16:01.818923 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1529/3175] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:00 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:16:02.053151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:02.056301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:02.077922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:02.079253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:02.079926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:02.080873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:02.081959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:02.082666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:02.315785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:02.333513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b194b11a-8918-4173-a6ac-1610c6e79474 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.820211 Sep 18 01:16:02.360880 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1647/3176] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:01 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:02.478015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:02.487074 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-70358aef-9673-4151-b64e-979efcc837cc tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 0.444750 Sep 18 01:16:02.487680 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1530/3177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:02 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:02.858373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:02.860317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:02.878497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:02.880873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:02.882184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:02.883408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:02.885497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:02.886258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:03.154047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:03.168426 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4253e6ad-9bb6-4362-90b7-add784d35c1e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.321136 Sep 18 01:16:03.187123 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1648/3178] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:02 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:03.332304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-297178437", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "116170ea-5b23-4409-b3a0-d8364c6529b2"}], "security_groups": [{"name": "tempest-securitygroup--1371343085"}], "key_name": "tempest-keypair-1868027593", "user_data": "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:03.362275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:03.363197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:03.378144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:03.378650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:03.380948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:03.383918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:03.384505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:03.389584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:03.725918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] validate_networks() for [('116170ea-5b23-4409-b3a0-d8364c6529b2', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:16:04.462841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:04.488705 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d20d991e-9ac8-4a2f-a57d-fb88e8c62ed3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 1.127233 Sep 18 01:16:04.492924 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1649/3179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:03 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:04.527479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:04.533123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:04.559192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:04.563864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:04.564636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:04.565621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:04.569669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:04.570414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:05.339208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:05.405847 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34caca6e-a36b-4aae-9014-6a4ae7e17bd7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 0.902682 Sep 18 01:16:05.406644 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1650/3180] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:04 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:05.431265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:05.434354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:05.452536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:05.453711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:05.454613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:05.455825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:05.456523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:05.457345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:05.927748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:16:05.928292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:16:05.928641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:16:05.929305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:16:05.929461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:16:05.950781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:05.952943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:05.953385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:05.957042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:05.957799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:05.958413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:05.972712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:05.990955 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adc54b7f-c284-4335-b92f-6c86f570ac26 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.579964 Sep 18 01:16:05.992582 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1651/3181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:05 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:06.001939 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:06.002943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:06.010668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.011624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.013152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:06.014146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.015912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.016874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:06.022472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:16:06.038289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for user 56d16d15d11b40e188f517d24819845b and project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:16:06.073337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:16:06.076280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:16:06.211229 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60500ed8-54da-4ac1-8ef6-b519b1e2eaa3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.883084 Sep 18 01:16:06.219455 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1531/3182] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:16:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 18 01:16:06.224878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:06.225756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:06.233468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.234516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.237695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:06.238798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.241532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.244145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:06.371864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:06.383139 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d18434a-167a-48e6-9533-74b6d189297b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.388887 Sep 18 01:16:06.385111 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1652/3183] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:05 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:06.392170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce4e87f7-1704-47ce-96c4-e47dd01c566c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:06.393297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce4e87f7-1704-47ce-96c4-e47dd01c566c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:06.718755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:06.728148 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a3266a6d-4e39-4679-9c81-0c5f03049b8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.507253 Sep 18 01:16:06.734447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce4e87f7-1704-47ce-96c4-e47dd01c566c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:06.744455 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1532/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:06 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:06.747670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce4e87f7-1704-47ce-96c4-e47dd01c566c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:06.752809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:06.756566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce4e87f7-1704-47ce-96c4-e47dd01c566c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:06.758271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce4e87f7-1704-47ce-96c4-e47dd01c566c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1281 microversion: 2.20 time: 0.371388 Sep 18 01:16:06.761527 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1653/3185] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:06 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1281 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:06.762372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:06.771471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.773159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.774112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:06.775754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.776531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.777243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:06.800529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:06.802238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:06.819335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.820508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.822385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:06.825591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:06.827485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:06.829649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.149826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:07.161410 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7035a4b3-2fa3-464b-b1de-5cfa5dfa5138 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 0.415174 Sep 18 01:16:07.171856 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1533/3186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:06 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:07.202432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:07.203478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:07.213285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.222309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.223863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.239090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.239812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.240338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.305241 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:07.317616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:07.340029 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b6801e8-3fcb-4e34-b14e-9b9f14616178 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.539315 Sep 18 01:16:07.352297 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1654/3187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:06 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:16:07.440093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:07.445623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:07.500848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.502614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.505830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.510293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.511560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.512220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.594165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:07.620108 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4449618a-03cf-4dcf-911b-18db0a8e840f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.446185 Sep 18 01:16:07.623650 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1534/3188] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:07 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:07.628802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:07.636296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:07.656704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.658488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.659239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.660404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.661926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.665072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.891135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:07.910123 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b0450ba-a320-42d8-9b8b-4ccb6567b58c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.526573 Sep 18 01:16:07.912390 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1655/3189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:07 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:07.923953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:07.925065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:07.954997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.968139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.969473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:07.975680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:07.977663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:07.978362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:08.069994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:08.081803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-477149e5-5db5-4cac-a056-6a23902b71ca tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.456578 Sep 18 01:16:08.097796 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1535/3190] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:07 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:08.097796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-217447375"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:08.097796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:08.106205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:08.116380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:08.117442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:08.117876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:08.118046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:08.118698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:08.119017 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9ee2f015-347b-43ad-9de5-744c5dd91104 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1333 microversion: 2.20 time: 0.205284 Sep 18 01:16:08.119488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:08.119953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:08.120380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:08.126746 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1656/3191] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:07 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1333 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:08.134802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bbc8b1fd-ea85-4252-8e5b-70fd8a8b76e6 req-70955361-8766-4823-a353-194d89de1f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3", "name": "network-vif-plugged", "status": "completed", "tag": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:08.153927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bbc8b1fd-ea85-4252-8e5b-70fd8a8b76e6 req-70955361-8766-4823-a353-194d89de1f32 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:08.154546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bbc8b1fd-ea85-4252-8e5b-70fd8a8b76e6 req-70955361-8766-4823-a353-194d89de1f32 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:08.155061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bbc8b1fd-ea85-4252-8e5b-70fd8a8b76e6 req-70955361-8766-4823-a353-194d89de1f32 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:08.185630 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bbc8b1fd-ea85-4252-8e5b-70fd8a8b76e6 req-70955361-8766-4823-a353-194d89de1f32 service nova] Creating event network-vif-plugged:9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 for instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 on n-h2-master-1 Sep 18 01:16:08.193835 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bbc8b1fd-ea85-4252-8e5b-70fd8a8b76e6 req-70955361-8766-4823-a353-194d89de1f32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065735 Sep 18 01:16:08.201298 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1657/3192] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:08.216627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:08.217475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:08.225823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:08.225823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:08.230335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:08.232148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:08.232881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:08.235192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:08.566348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:08.590407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e57fad91-a915-4ee1-a3df-a09d5f59374a tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 0.389266 Sep 18 01:16:08.600702 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1658/3193] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:08 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:08.642898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e65623c-0b7c-4d28-820b-2a145db47511 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.557962 Sep 18 01:16:08.648958 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1536/3194] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:08 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 18 01:16:08.655234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:08.655955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:08.676643 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:08.686930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:08.688218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:08.693352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:08.694139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:08.697419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:09.112490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:09.113743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:09.131215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:09.134746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:09.137430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:09.140895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:09.145856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:09.148119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:09.211221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:09.237451 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0aa4051c-7415-43b4-a0dc-02d3897bc4ee tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.571114 Sep 18 01:16:09.237451 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1659/3195] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:08 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:09.237451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:09.239204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:09.253637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:09.258348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:09.258798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:09.259537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:09.260216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:09.260773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:09.446856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:09.458344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:09.465650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:09.468705 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f3a87e9-4e9d-4bfc-8c1c-f7fbe31b1cf1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1339 microversion: 2.20 time: 0.239395 Sep 18 01:16:09.485582 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1660/3196] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:09 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:09.589492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:09.598937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4617865-33cc-4df1-8cc5-04ff5cf95dc2 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.492757 Sep 18 01:16:09.610210 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1537/3197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:09 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:09.634887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:09.638958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:09.662606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:09.663166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:09.663858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:09.667738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:09.668484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:09.670166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:10.147850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:10.158990 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca51863d-6a91-40b1-a88d-b3b41169a5ff tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1323 microversion: 2.1 time: 0.531381 Sep 18 01:16:10.160093 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1661/3198] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:09 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:10.246316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:10.247826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:10.250246 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:10.259895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:10.272261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:10.272925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:10.274266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:10.276862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:10.277326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:10.508350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:10.509347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:10.517244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:10.518192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:10.518711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:10.519672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:10.520361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:10.521038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:10.568094 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:11.149153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:11.193745 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b05bb7e4-1006-4f38-9d84-dc176bf871f5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1503 microversion: 2.1 time: 0.952685 Sep 18 01:16:11.198782 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1538/3199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:10 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1503 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:11.225941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:11.229101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:11.250435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:11.252556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:11.262673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:11.264166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:11.265086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:11.266531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:11.375692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:11.406953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:11.410683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:11.414462 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba7d90e0-858e-448b-9b27-b6667a0a66fc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.914430 Sep 18 01:16:11.430318 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1662/3200] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:10 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:11.486055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:11.487367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:11.506750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:11.507918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:11.508915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:11.512083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:11.512083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:11.527629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:11.678776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:11.691910 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20a24310-fe08-44b2-9c65-7c12ce970abd tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.472393 Sep 18 01:16:11.693125 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1539/3201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:11 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:11.709068 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50228cd0-413b-4175-9af5-1901e1767fa6"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:11.712470 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:11.745972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:11.748348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:11.748793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:11.750596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:11.752679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:11.753770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:11.823201 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Cannot 'attach_volume' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state rescued Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/os-volume_attachments HTTP/1.1 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 74 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: {"volumeAttachment": {"volumeId": "50228cd0-413b-4175-9af5-1901e1767fa6"}} Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot 'attach_volume' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state rescued Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07', 'body': {'volumeAttachment': {'volumeId': '50228cd0-413b-4175-9af5-1901e1767fa6'}}} Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 18 01:16:11.826580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state rescued Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state rescued Sep 18 01:16:11.831450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:16:11.835646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 409 to user: Cannot 'attach_volume' instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 while it is in vm_state rescued {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:16:11.837500 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f6388a5-e22a-48d6-8c47-5db71176863d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.142290 Sep 18 01:16:11.838486 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1540/3202] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:16:11 2022] POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/os-volume_attachments => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:16:12.053358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:12.071422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37418c01-d667-4cf4-bef4-4835977bba54 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1516 microversion: 2.1 time: 0.639596 Sep 18 01:16:12.074684 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1663/3203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:11 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1516 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:12.089910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:12.091705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:12.101116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:12.101987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:12.102637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:12.104235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:12.105139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:12.105798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:12.164645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-49095809", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:12.291166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:16:12.320034 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bfcc0b55-e3b5-49e8-b40f-d3f33ec79f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action" status: 202 len: 0 microversion: 2.1 time: 0.242205 Sep 18 01:16:12.323701 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1664/3204] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:12 2022] POST /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:16:12.341617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:12.363992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:12.383168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:12.385182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:12.385922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:12.386878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:12.387843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:12.390212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:12.454398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lazy-loading 'flavor' on Instance uuid b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:16:12.598394 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cff1fc3b-6f3c-4bbb-9406-7c289947bcc7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action" status: 200 len: 32 microversion: 2.1 time: 0.275645 Sep 18 01:16:12.611740 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1665/3205] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:12 2022] POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:16:12.629388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:12.633234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:12.657730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:12.658730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:12.659427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:12.660369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:12.667270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:12.667737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:13.113053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:16:13.114177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:16:13.114673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:16:13.115089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:16:13.115502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:16:13.135257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:13.136970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:13.138043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:13.140876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:13.141566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:13.143983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:13.196226 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Getting quotas for project 6db9c6b25fe3493a80c7c9b1217c4bc0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:16:13.203385 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Getting quotas for user cbf3a969568d469881994b9486788ac1 and project 6db9c6b25fe3493a80c7c9b1217c4bc0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:16:13.233192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:16:13.237309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:16:13.348173 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-591bed07-2a4f-42d9-8e0d-c5d59e0785de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508290 Sep 18 01:16:13.348847 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1541/3206] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:16:13.353460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:13.362166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:13.371925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:13.385924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:13.386541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:13.389979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:13.390910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:13.391009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:14.311016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:14.320882 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9bf92ef5-a6fb-49ac-8549-a53159d798a9 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1511 microversion: 2.1 time: 1.707477 Sep 18 01:16:14.327359 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1666/3207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:12 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1511 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:14.354348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:14.355222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:14.363476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:14.364232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:14.364908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:14.366156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:14.366794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:14.367396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:14.597707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:14.615097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:14.616710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:14.617888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57aa2b83-660d-4349-9a44-2406e554f69e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 1.268009 Sep 18 01:16:14.659457 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1542/3208] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:13 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:14.672427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:14.672964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:14.690409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:14.690911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:14.693525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:14.694562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:14.699484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:14.700751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:14.741708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:14.754193 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8d7f55e4-298a-4583-8302-ee9915b06574 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.425366 Sep 18 01:16:14.756673 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1667/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:14 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:14.776255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:14.778004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:14.789525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:14.797201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:14.798375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:14.799595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:14.800562 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:14.803078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:15.037669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:15.042897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:15.051772 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e9dcc648-6556-42aa-8f86-81a81e268672 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.389033 Sep 18 01:16:15.052903 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1543/3210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:14 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:15.062192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a6f63691-db20-4ab1-995a-330d9b39a288 req-03c56946-da39-4251-9193-6cb0919aa8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:15.078976 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ac27319-6a41-4424-94ad-df643d8e4764 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1267 microversion: 2.1 time: 0.315387 Sep 18 01:16:15.087986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a6f63691-db20-4ab1-995a-330d9b39a288 req-03c56946-da39-4251-9193-6cb0919aa8f2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:15.088479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a6f63691-db20-4ab1-995a-330d9b39a288 req-03c56946-da39-4251-9193-6cb0919aa8f2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:15.088912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a6f63691-db20-4ab1-995a-330d9b39a288 req-03c56946-da39-4251-9193-6cb0919aa8f2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:15.098307 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1668/3211] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:14 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:15.128304 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a6f63691-db20-4ab1-995a-330d9b39a288 req-03c56946-da39-4251-9193-6cb0919aa8f2 service nova] Creating event network-changed:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h2-master-1 Sep 18 01:16:15.157127 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a6f63691-db20-4ab1-995a-330d9b39a288 req-03c56946-da39-4251-9193-6cb0919aa8f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102758 Sep 18 01:16:15.158379 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1544/3212] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:15.363608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:15.364300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:15.373954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:15.373954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:15.373954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:15.374453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:15.374883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:15.375539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:15.637220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f521ec18-f991-4a52-9b68-200937bca8ef req-1a312ded-ca0f-4bc9-afcf-8a9698cd2ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-plugged", "status": "completed", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:15.665033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f521ec18-f991-4a52-9b68-200937bca8ef req-1a312ded-ca0f-4bc9-afcf-8a9698cd2ac8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:15.666196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f521ec18-f991-4a52-9b68-200937bca8ef req-1a312ded-ca0f-4bc9-afcf-8a9698cd2ac8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:15.672413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f521ec18-f991-4a52-9b68-200937bca8ef req-1a312ded-ca0f-4bc9-afcf-8a9698cd2ac8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:15.702986 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f521ec18-f991-4a52-9b68-200937bca8ef req-1a312ded-ca0f-4bc9-afcf-8a9698cd2ac8 service nova] Creating event network-vif-plugged:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:16:15.715961 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f521ec18-f991-4a52-9b68-200937bca8ef req-1a312ded-ca0f-4bc9-afcf-8a9698cd2ac8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083030 Sep 18 01:16:15.719024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1545/3213] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:16:15.734894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:15.736344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:15.754973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:15.756421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:15.758903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:15.763595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:15.764825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:15.766790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:16.018595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:16.031000 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb786e1f-878f-4648-a07d-e8ce5c738f03 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1511 microversion: 2.1 time: 0.671686 Sep 18 01:16:16.034269 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1669/3214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:15 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:16.060058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:16.066479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:16.099860 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:16.105726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:16.106748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:16.111100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:16.114742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:16.117301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:16.356891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:16.372928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:16.377328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:16.382068 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c144b2c9-06c5-4b6b-b8fd-33fd44ff52e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.660836 Sep 18 01:16:16.394496 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1546/3215] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:15 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:16.511661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80e5d30c-a33e-416f-81b0-39597b57226a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'create', calling method: .version_select at 0x7f7005e5a9d0>, body: {"keypair": {"name": "tempest-keypair-111454713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0xyl09XDUXT6i/DJIYPE81xU34TSq6/gKiwlJ+jCRmCxsw8DT+F59UTU0W4nrfAud1eOvy0hRiPoS1CgpSbUSO1iUBynSMMbGMzZURFau7QNOWb3F80BxpLxt5C5JYew=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:16.552214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-80e5d30c-a33e-416f-81b0-39597b57226a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for project ceb6afe234e1433eabf8eee5c780c799. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:16:16.568771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-80e5d30c-a33e-416f-81b0-39597b57226a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for user 29c7d6ca88464aa29691e7ddfa5e5897 and project ceb6afe234e1433eabf8eee5c780c799. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:16:16.633106 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80e5d30c-a33e-416f-81b0-39597b57226a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.244167 Sep 18 01:16:16.635602 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1547/3216] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:16.649323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:16.652293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:16.673660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:16.675001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:16.676707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:16.677575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:16.680212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:16.680668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:16.742839 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:17.056344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:17.083428 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2adc3c8c-b013-4621-86aa-493a0e7c91d9 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 1.047748 Sep 18 01:16:17.086127 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1670/3217] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:16 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:17.110971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:17.118116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:17.141156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:17.153961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:17.154458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:17.155842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:17.156306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:17.156675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:17.263353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:17.279864 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7eadf7f7-9e30-4c8f-885a-a6443c68822f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.642659 Sep 18 01:16:17.280668 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1548/3218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:16 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:17.300233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:17.300872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:17.317493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:17.318016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:17.318455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:17.319188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:17.342130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:17.342670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:17.393264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:17.409775 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28166601-fc41-48f7-b49b-e81115510e55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1273 microversion: 2.1 time: 0.319194 Sep 18 01:16:17.413068 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1671/3219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:17 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1273 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:17.432976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:17.438589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:17.464498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:17.470893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:17.474844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:17.485291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:17.486152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:17.486865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:17.802785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:17.816753 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f925abb-f816-465d-9342-72deb8e22726 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1511 microversion: 2.1 time: 0.519199 Sep 18 01:16:17.820501 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1549/3220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:17 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:17.961162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:18.037892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:18.046698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:18.053231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e5bcde8-4c54-4f1a-93f7-f963332374fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.635553 Sep 18 01:16:18.058415 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1672/3221] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:17 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:18.111697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:18.112406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:18.141249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:18.149749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:18.155537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:18.155827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:18.156316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:18.156753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:18.302932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:18.303558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:18.313576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:18.314077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:18.314516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:18.315228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:18.315683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:18.316665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:18.717038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:18.729445 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-614e099d-4e82-4477-82f1-4cdd6e3296c2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.621958 Sep 18 01:16:18.730234 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1550/3222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:18 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:18.742227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:18.746412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:18.768138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:18.768831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:18.769450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:18.770483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:18.771098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:18.771793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:18.960374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:18.974680 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c11f73be-9c95-4c55-91c0-6cfd33c976ab tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1273 microversion: 2.1 time: 0.242991 Sep 18 01:16:18.976147 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1551/3223] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:18 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:18.985815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:18.989311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:19.010552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:19.011183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:19.011720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:19.012699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:19.013282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:19.013842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:19.328902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:19.361225 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-906df54e-b515-476b-8df8-376161f3936a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 1.062054 Sep 18 01:16:19.362033 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1673/3224] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:18 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:16:19.369808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:19.371165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:19.380651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:19.381379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:19.382615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:19.389732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:19.390597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:19.393525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:19.541742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:19.551319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e0f84f7-a74f-44dd-b4ec-c0de6d4b8d21 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1517 microversion: 2.1 time: 0.573894 Sep 18 01:16:19.558509 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1552/3225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:18 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1517 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:19.758584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:19.759579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:19.779653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:19.782536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:19.783295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:19.785529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:19.789209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:19.790116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:19.796723 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:19.980165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:19.994548 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:20.004562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:20.007087 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d81def30-ac24-442d-8ddb-47000eb08336 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.642053 Sep 18 01:16:20.009910 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1674/3226] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:19 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:20.023825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:20.027096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:20.048108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:20.049948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:20.052474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:20.055594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:20.057123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:20.060768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:20.601518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:20.614481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac5f8d67-e8b3-402a-8f50-9ca68819e2f4 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.860409 Sep 18 01:16:20.625226 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1553/3227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:19 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:20.645752 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:20.649191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:20.671138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:20.677196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:20.677926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:20.682392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:20.686302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:20.687021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:20.754199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:20.778972 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-825777cd-57af-4474-bbef-8c785fe8cdff tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 0.765536 Sep 18 01:16:20.797330 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1675/3228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:20 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:21.040051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:21.040673 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:21.062583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:21.068919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:21.070220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:21.071007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:21.071839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:21.071947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:21.127456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:21.143086 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:21.143337 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d0392428-7c6d-4e95-8b90-c8dbed5bf91f tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.515873 Sep 18 01:16:21.143918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1554/3229] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:20 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:21.461134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:21.476569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:21.478642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:21.480217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-710e75ca-8778-44a0-a440-785bb51adb65 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.444407 Sep 18 01:16:21.481295 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1676/3230] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:21 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:21.644178 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:21.644793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:21.682109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:21.687335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:21.692814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:21.700248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:21.702321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:21.711606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:21.805487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:21.807021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:21.830659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:21.832723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:21.834033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:21.838019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:21.839013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:21.839661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:22.100656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:22.118323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-237a7435-e97d-4c3d-be84-2e75fda6209d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.478345 Sep 18 01:16:22.131214 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1555/3231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:21 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:22.171330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:22.172356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:22.191374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:22.193310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:22.194057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:22.197138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:22.197974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:22.199534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:22.216666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:22.255353 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f79780bd-6846-4669-a56f-c0ccf78737f1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 0.450309 Sep 18 01:16:22.257212 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1677/3232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:21 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:22.510403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:22.511134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:22.521342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:22.521859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:22.522303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:22.523015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:22.523469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:22.523898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:23.157718 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:23.185651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:23.198267 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:23.202140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:23.203812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a54931e-325c-4d9c-a5fc-3cdcba10aee6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.697569 Sep 18 01:16:23.205885 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1678/3233] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:22 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:23.214701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:23.216655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:23.225340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:23.226665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:23.227736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:23.229275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:23.230153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:23.230856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:23.491983 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:23.516239 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4792c460-6576-4752-8e10-44325ccdc108 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 1.348470 Sep 18 01:16:23.521223 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1556/3234] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:22 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:23.551583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:23.552220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:23.568753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:23.570727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:23.572329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:23.573724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:23.575680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:23.576293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:23.856731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:23.864760 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ccb4d7be-a4f0-4bca-8dad-f3477d2e5bea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.657553 Sep 18 01:16:23.865924 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1679/3235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:23 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:23.871251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-322306e2-bfa0-4262-9cc8-3a9f0e315264 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'create', calling method: .version_select at 0x7f7005336040>, body: {"keypair": {"name": "tempest-keypair-643136168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSajrl4baml20ghqVerC1YtbZAKbdTKq3UNTJFGNqSJ6iNEjahFyKeOp0T/Mb17Ed/qFXs5Wg/OUa8CBguXty4YOmmLZyo3qe72nzerpKNomoyN5rmnXfd6//vnOW7vqw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:23.911706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-322306e2-bfa0-4262-9cc8-3a9f0e315264 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for project 941f245a91fa4b078afc8047e827227e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:16:23.924773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-322306e2-bfa0-4262-9cc8-3a9f0e315264 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for user 4a53e55c3a684703a1ed5878f240f6c4 and project 941f245a91fa4b078afc8047e827227e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:16:23.969710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-322306e2-bfa0-4262-9cc8-3a9f0e315264 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102482 Sep 18 01:16:23.970703 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1680/3236] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:16:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:24.063114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:24.071444 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0af51a3e-b0b7-4b09-bc4d-9a34761f5b70 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 0.541869 Sep 18 01:16:24.072023 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1557/3237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:23 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:24.072559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5869697f-50ae-418e-a23f-07a1710b16fd req-248b02a6-ac18-4cd0-a7a8-e70260831227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a21ef3d-97ba-40ad-b574-72a10a149eac", "tag": "31cfae35-0642-49fe-8133-54e05e4f2311"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:24.090752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5869697f-50ae-418e-a23f-07a1710b16fd req-248b02a6-ac18-4cd0-a7a8-e70260831227 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:24.091330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5869697f-50ae-418e-a23f-07a1710b16fd req-248b02a6-ac18-4cd0-a7a8-e70260831227 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:24.091957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5869697f-50ae-418e-a23f-07a1710b16fd req-248b02a6-ac18-4cd0-a7a8-e70260831227 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:24.107617 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5869697f-50ae-418e-a23f-07a1710b16fd req-248b02a6-ac18-4cd0-a7a8-e70260831227 service nova] Creating event network-changed:31cfae35-0642-49fe-8133-54e05e4f2311 for instance 3a21ef3d-97ba-40ad-b574-72a10a149eac on n-h2-master-1 Sep 18 01:16:24.118565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5869697f-50ae-418e-a23f-07a1710b16fd req-248b02a6-ac18-4cd0-a7a8-e70260831227 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145295 Sep 18 01:16:24.120442 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1681/3238] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:24.235751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:24.236534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:24.248965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:24.249927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:24.252342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:24.255147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:24.255840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:24.257435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:24.344429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2049747914", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39861c7c-66ab-4ccd-ba39-a41edf5a6ba2"}], "security_groups": [{"name": "tempest-securitygroup--1543739313"}], "key_name": "tempest-keypair-111454713", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:24.581033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] validate_networks() for [('39861c7c-66ab-4ccd-ba39-a41edf5a6ba2', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:16:24.764416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:24.781876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:24.783856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:24.788768 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30197bbe-de3c-49e3-a7e8-a6d9589fe31f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.558666 Sep 18 01:16:24.793135 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1558/3239] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:24 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:24.810941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:24.814828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:24.831955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:24.832707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:24.835822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:24.836898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:24.837586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:24.840107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:25.548219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:25.613886 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60eabb7d-ab2a-444f-b049-1cf57672cc92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1471 microversion: 2.1 time: 0.797385 Sep 18 01:16:25.616063 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1559/3240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:24 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1471 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:25.621688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:25.632325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:25.652213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:25.658118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:25.659065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:25.660010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:25.661047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:25.666283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:26.222511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:26.232208 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b13d78ba-9251-4281-b0f8-01386c60ab00 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.614537 Sep 18 01:16:26.235622 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1560/3241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:25 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:26.244043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-973b432d-1ab4-4c32-bd59-b4535c806d32 req-cf8e04a3-eaef-4843-8cba-e7c7ed34c2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "name": "network-vif-plugged", "status": "completed", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:26.292141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-973b432d-1ab4-4c32-bd59-b4535c806d32 req-cf8e04a3-eaef-4843-8cba-e7c7ed34c2e0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:26.292536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-973b432d-1ab4-4c32-bd59-b4535c806d32 req-cf8e04a3-eaef-4843-8cba-e7c7ed34c2e0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:26.298064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-973b432d-1ab4-4c32-bd59-b4535c806d32 req-cf8e04a3-eaef-4843-8cba-e7c7ed34c2e0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:26.335796 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-973b432d-1ab4-4c32-bd59-b4535c806d32 req-cf8e04a3-eaef-4843-8cba-e7c7ed34c2e0 service nova] Creating event network-vif-plugged:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h2-master-1 Sep 18 01:16:26.353121 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-973b432d-1ab4-4c32-bd59-b4535c806d32 req-cf8e04a3-eaef-4843-8cba-e7c7ed34c2e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113986 Sep 18 01:16:26.353800 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1561/3242] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:26.359689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:16:26.360512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:16:26.361418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:16:26.362248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:16:26.363036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:16:26.372785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:26.376544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:26.410112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:26.410600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:26.411523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:26.412343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:26.412730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:26.413738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:26.414421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:26.415366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:26.416277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:26.417143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:26.418578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:26.420432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:26.492350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for project ceb6afe234e1433eabf8eee5c780c799. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:16:26.509256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for user 29c7d6ca88464aa29691e7ddfa5e5897 and project ceb6afe234e1433eabf8eee5c780c799. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:16:26.559710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:16:26.562530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:16:26.592087 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=20 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:26.665271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b7a4674c-e7cf-40c4-9976-d40212487760 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.325867 Sep 18 01:16:26.673593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1682/3243] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:16:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:16:26.681148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:26.682985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:26.685689 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:26.698706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:26.699203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:26.700873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:26.701619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:26.702083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:26.702598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:27.216942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:27.234432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f948908c-0ee9-424a-b417-0b583f1b48d2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 0.874549 Sep 18 01:16:27.238123 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1562/3244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:26 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:27.252079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:27.253318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:27.258732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:27.263644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:27.265225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:27.268114 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:27.269371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:27.271503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:27.272872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:27.275224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:27.278481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:27.281837 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-09f889af-2f7d-4df1-adbf-6129faac7691 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.610989 Sep 18 01:16:27.282450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1683/3245] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:26 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:27.313485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-836b413d-37b5-4a16-8836-6145bd576a13 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:27.315269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-836b413d-37b5-4a16-8836-6145bd576a13 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:27.559460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-836b413d-37b5-4a16-8836-6145bd576a13 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:27.572664 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-836b413d-37b5-4a16-8836-6145bd576a13 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1237 microversion: 2.1 time: 0.282910 Sep 18 01:16:27.575593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1684/3246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:27 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1237 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:27.602973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:27.606592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:27.620770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:27.630581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:27.634807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:27.635985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:27.636714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:27.638138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:27.745659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:27.758319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67bbc557-7a3e-49fd-8677-b63c61c5261c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1477 microversion: 2.1 time: 0.517627 Sep 18 01:16:27.759302 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1563/3247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:27 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1477 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:28.082266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:28.095160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7fb29b7b-ef7f-423e-858e-62be66f239f7 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.507616 Sep 18 01:16:28.095770 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1685/3248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:27 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:28.262877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:28.264336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:28.274592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:28.275616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:28.276242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:28.278528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:28.279157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:28.279739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:28.320319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:28.321279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:28.332881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:28.337027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:28.338207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:28.339351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:28.341324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:28.344287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:28.922418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:28.935121 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-153e24ea-e0fc-4929-8f0f-2af6841e7f2b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 0.677197 Sep 18 01:16:28.938534 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1564/3249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:28 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:28.951126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:28.968664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:28.969843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:28.970708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:28.977065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:28.983525 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5999b955-dbe2-401e-8c33-2d65b4c80616 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1407 microversion: 2.20 time: 0.670457 Sep 18 01:16:28.990182 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1686/3250] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:28 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1407 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:16:28.992801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:28.998246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:28.998953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.001707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:29.003169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:29.003904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.007209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:29.011268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:29.026803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:29.042456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.044005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:29.045289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:29.046114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.046831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:29.148889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:29.163475 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67ac31c2-5fde-48a5-8340-3638bf061e08 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1289 microversion: 2.1 time: 0.222059 Sep 18 01:16:29.164882 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1565/3251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:28 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1289 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:29.174963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:29.185399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:29.192635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:29.200351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.201334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:29.202392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:29.203114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.203769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:29.429306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:29.446792 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca36f314-63e4-43d0-94b8-68b28a81da6a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1477 microversion: 2.1 time: 0.453011 Sep 18 01:16:29.447421 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1687/3252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:28 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:29.666273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:29.675281 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a27b763-7f8b-4e55-818a-c266115bddaa tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.504068 Sep 18 01:16:29.681270 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1566/3253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:29 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:29.787243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1411734383", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28a4f8d7-540d-4650-8fc6-4ab30db92cdd"}], "security_groups": [{"name": "tempest-securitygroup--1459560506"}], "key_name": "tempest-keypair-643136168", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:29.963089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:29.963998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:29.977113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] validate_networks() for [('28a4f8d7-540d-4650-8fc6-4ab30db92cdd', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:16:29.986437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:29.990097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.991059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:29.992070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:29.992832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:29.993506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:30.427402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:30.436803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1820345a-1390-4e21-ab2b-d0e156b6f2bb tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 0.477970 Sep 18 01:16:30.439993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1567/3254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:29 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:30.450283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:30.459256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:30.482195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:30.491698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:30.495385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:30.500184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:30.510988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:30.511452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:30.813181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:30.822458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:30.845802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:30.850697 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c0b9cb2-6e4c-4caa-a930-cb8dd59ae9b8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1598 microversion: 2.20 time: 0.409562 Sep 18 01:16:30.851948 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1568/3255] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:16:30 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1598 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:16:30.884538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:30.885737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:30.901941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:30.907163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:30.908020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:30.909025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:30.909774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:30.914870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:31.206937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:16:31.208286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:16:31.208998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:16:31.209674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:16:31.210312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:16:31.228567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:31.239776 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-decd499c-1932-45bc-8385-ea738d402392 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1295 microversion: 2.1 time: 0.382791 Sep 18 01:16:31.240026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:31.240317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:31.240769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:31.241509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:31.242037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:31.242506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:31.244845 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1569/3256] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:30 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1295 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:31.255890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:31.258777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:31.281266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:31.282158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:31.287819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for project 941f245a91fa4b078afc8047e827227e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:16:31.288703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:31.289721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:31.290417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:31.291127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:31.299876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Getting quotas for user 4a53e55c3a684703a1ed5878f240f6c4 and project 941f245a91fa4b078afc8047e827227e. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:16:31.317005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:16:31.319533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:16:31.353966 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:31.432272 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-87aa5ad9-ad5e-41ce-8416-0174d7916e44 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.662023 Sep 18 01:16:31.439055 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1688/3257] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:16:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:16:31.446093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:31.447640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:31.475471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:31.475968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:31.476433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:31.477194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:31.488344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:31.488857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:32.143991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:32.159738 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6b3d324d-779c-4c79-a988-be63673dfa98 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1477 microversion: 2.1 time: 0.913147 Sep 18 01:16:32.161774 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1570/3258] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:31 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1477 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:32.176405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:32.178537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:32.222151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:32.225217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:32.226635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:32.230016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:32.233923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:32.234675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:32.252765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:32.293923 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cedcc368-0706-4393-ac2b-8323035a7d92 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.857928 Sep 18 01:16:32.294783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1689/3259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:31 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:32.323820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9d3a73f-3b0e-4e67-b2eb-8a96526c4a1b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:32.324548 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9d3a73f-3b0e-4e67-b2eb-8a96526c4a1b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:32.602387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9d3a73f-3b0e-4e67-b2eb-8a96526c4a1b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:32.628200 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9d3a73f-3b0e-4e67-b2eb-8a96526c4a1b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1245 microversion: 2.1 time: 0.305566 Sep 18 01:16:32.629400 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1690/3260] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:32 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1245 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:32.646737 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26521ad2-984d-49eb-bef0-09193849b14e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.483224 Sep 18 01:16:32.647729 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1571/3261] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 18 01:16:32 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-interface => generated 284 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:16:32.657728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:32.657969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:32.681114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:32.681114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:32.681114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:32.682503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:32.683406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:32.683804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:32.687121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:32.692128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:32.717291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:32.719772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:32.724562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:32.731947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:32.732799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:32.734325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:33.633356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:33.653104 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5af7db50-fe51-440f-8532-e16f4ca4423a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1363 microversion: 2.1 time: 0.996592 Sep 18 01:16:33.658474 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1572/3262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:32 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1363 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:33.668188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:33.671695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:33.686129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:33.687045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:33.690469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:33.691534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:33.692195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:33.695747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:33.733143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:33.763099 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e0c7ace-8a63-4fb8-87c2-d57c3422e1ad tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 1.130150 Sep 18 01:16:33.764950 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1691/3263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:32 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:33.779001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:33.783136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:33.817587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:33.818128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:33.829725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:33.830498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:33.830985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:33.831415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:34.591473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:34.610530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb775362-f035-4bf8-b754-1a2b5271327f tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.844018 Sep 18 01:16:34.611492 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1692/3264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:33 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:34.614117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:34.616380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:34.616997 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:34.625376 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1e1bb01-00d3-4f29-990d-4574bcab5718 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1477 microversion: 2.1 time: 0.964875 Sep 18 01:16:34.626587 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1573/3265] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:33 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1477 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:34.632583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-7e8112bb-e82f-4eed-9663-442665f8e080 req-404191cf-541d-44ff-af4d-154a30576e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a21ef3d-97ba-40ad-b574-72a10a149eac", "name": "network-vif-plugged", "status": "completed", "tag": "31cfae35-0642-49fe-8133-54e05e4f2311"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:34.641594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:34.642130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:34.642734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:34.643632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:34.644263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:34.644863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:34.701454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7e8112bb-e82f-4eed-9663-442665f8e080 req-404191cf-541d-44ff-af4d-154a30576e92 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:34.702987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7e8112bb-e82f-4eed-9663-442665f8e080 req-404191cf-541d-44ff-af4d-154a30576e92 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:34.705098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7e8112bb-e82f-4eed-9663-442665f8e080 req-404191cf-541d-44ff-af4d-154a30576e92 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:34.723415 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-7e8112bb-e82f-4eed-9663-442665f8e080 req-404191cf-541d-44ff-af4d-154a30576e92 service nova] Creating event network-vif-plugged:31cfae35-0642-49fe-8133-54e05e4f2311 for instance 3a21ef3d-97ba-40ad-b574-72a10a149eac on n-h2-master-1 Sep 18 01:16:34.731008 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-7e8112bb-e82f-4eed-9663-442665f8e080 req-404191cf-541d-44ff-af4d-154a30576e92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102379 Sep 18 01:16:34.732693 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1574/3266] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:34.740476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:34.741891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:34.749950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:34.750995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:34.752050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:34.754588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:34.755858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:34.756484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:34.906219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:34.925659 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f715866a-de70-42d5-a957-4856bcd84388 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1303 microversion: 2.1 time: 0.312499 Sep 18 01:16:34.927102 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1693/3267] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:34 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1303 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:34.950938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:34.952112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:34.962083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:34.972072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:34.972903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:34.973932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:34.974623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:34.975551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.206504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:36.221108 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26282920-9eaf-4d52-ac3d-5f6482c0eef5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1363 microversion: 2.1 time: 1.486734 Sep 18 01:16:36.221837 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1575/3268] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:34 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1363 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:36.237260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-910f5e97-1d76-4435-a63e-2331f1ba76ae req-1abeaf02-b652-4cbc-a758-0ac47422b129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dda0da1-d84d-460a-b22c-8cfed7d264ad", "tag": "3c43219b-327e-4a80-a386-bb8f0ed5a108"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:36.254804 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:36.270252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-910f5e97-1d76-4435-a63e-2331f1ba76ae req-1abeaf02-b652-4cbc-a758-0ac47422b129 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:36.271593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-910f5e97-1d76-4435-a63e-2331f1ba76ae req-1abeaf02-b652-4cbc-a758-0ac47422b129 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:36.272567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-910f5e97-1d76-4435-a63e-2331f1ba76ae req-1abeaf02-b652-4cbc-a758-0ac47422b129 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.306999 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-910f5e97-1d76-4435-a63e-2331f1ba76ae req-1abeaf02-b652-4cbc-a758-0ac47422b129 service nova] Creating event network-changed:3c43219b-327e-4a80-a386-bb8f0ed5a108 for instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad on n-h1-master-1 Sep 18 01:16:36.321001 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-910f5e97-1d76-4435-a63e-2331f1ba76ae req-1abeaf02-b652-4cbc-a758-0ac47422b129 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097177 Sep 18 01:16:36.322485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1576/3269] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:36.339279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:36.347938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:36.364124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:36.369422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:36.370211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.371256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:36.371951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:36.382342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.576438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:36.594836 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3a0aac2-a344-44e5-9473-1fdbedf50565 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 1.664188 Sep 18 01:16:36.596630 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1694/3270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:34 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:36.605063 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:36.606073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:36.620821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:36.623024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:36.623584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.625005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:36.626445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:36.627120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.784239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:36.803388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78c8aa70-373b-4b8b-aa54-379b6d68caab tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.471459 Sep 18 01:16:36.804513 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1577/3271] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:36 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:36.809766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:36.810376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:36.818154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:36.818650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:36.819107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.819923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:36.820375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:36.820996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:36.999554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:37.030704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-08308905-c775-4846-91b1-3215e82262ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1303 microversion: 2.1 time: 0.224636 Sep 18 01:16:37.042694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:37.043304 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1578/3272] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:36 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1303 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:37.054440 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd551268-6ad5-4678-9405-79e16d440c47 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1477 microversion: 2.1 time: 0.456635 Sep 18 01:16:37.057508 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d3f3a028-56a4-4291-bc11-7204ec0f1ad2 req-d927d67b-305d-4faa-b071-586ea34a89bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f354c30-7ca1-41fa-b98b-024302f6544c", "name": "network-vif-plugged", "status": "completed", "tag": "e8130d77-3807-4849-af92-54003c070986"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:37.059341 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1695/3273] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:36 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:37.098732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d3f3a028-56a4-4291-bc11-7204ec0f1ad2 req-d927d67b-305d-4faa-b071-586ea34a89bd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:37.100178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d3f3a028-56a4-4291-bc11-7204ec0f1ad2 req-d927d67b-305d-4faa-b071-586ea34a89bd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:37.101909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d3f3a028-56a4-4291-bc11-7204ec0f1ad2 req-d927d67b-305d-4faa-b071-586ea34a89bd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:37.121877 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d3f3a028-56a4-4291-bc11-7204ec0f1ad2 req-d927d67b-305d-4faa-b071-586ea34a89bd service nova] Creating event network-vif-plugged:e8130d77-3807-4849-af92-54003c070986 for instance 5f354c30-7ca1-41fa-b98b-024302f6544c on n-h1-master-1 Sep 18 01:16:37.140262 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d3f3a028-56a4-4291-bc11-7204ec0f1ad2 req-d927d67b-305d-4faa-b071-586ea34a89bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092365 Sep 18 01:16:37.141687 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1579/3274] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:37.248114 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:37.248920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:37.261444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:37.262638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:37.263345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:37.266069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:37.266871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:37.267561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:37.626779 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:37.627668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:37.642345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:37.654032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:37.654660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:37.655546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:37.657988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:37.661092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:37.805657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:37.816968 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d0637606-4bb7-4258-9ff2-b4dfe9ef6c34 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1363 microversion: 2.1 time: 0.573985 Sep 18 01:16:37.828090 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1696/3275] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:37 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1363 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:16:37.894375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:37.895605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:37.941050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:37.941584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:37.942051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:37.949854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:37.950442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:37.950903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:38.312123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:38.325934 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-602b289e-40a5-48eb-bf59-1847057c26f7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1315 microversion: 2.1 time: 0.704416 Sep 18 01:16:38.334657 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1580/3276] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:37 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:16:38.341723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:38.357050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:38.364153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:38.365031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:38.365685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:38.366651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:38.369771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:38.370829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:38.704917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:38.708045 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:38.724684 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31166367-c2e1-4ff0-9c43-7a42998115ea tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.894389 Sep 18 01:16:38.727478 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1697/3277] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:37 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:38.736032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:38.743701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:38.762386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:38.765750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:38.766649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:38.771342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:38.772547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:38.777403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:39.090942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:39.100105 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b722f1e7-cab5-4d06-99d6-6a47dfff5b0c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.764060 Sep 18 01:16:39.104691 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1581/3278] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:38 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:39.131100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-fc6775b5-f338-48ad-94ac-38136ccf0b13 req-d06061b5-e8bb-48c8-ba6b-16c26f3e2300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:39.162330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fc6775b5-f338-48ad-94ac-38136ccf0b13 req-d06061b5-e8bb-48c8-ba6b-16c26f3e2300 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:39.163070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fc6775b5-f338-48ad-94ac-38136ccf0b13 req-d06061b5-e8bb-48c8-ba6b-16c26f3e2300 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:39.163683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fc6775b5-f338-48ad-94ac-38136ccf0b13 req-d06061b5-e8bb-48c8-ba6b-16c26f3e2300 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:39.265702 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-fc6775b5-f338-48ad-94ac-38136ccf0b13 req-d06061b5-e8bb-48c8-ba6b-16c26f3e2300 service nova] Creating event network-changed:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h2-master-1 Sep 18 01:16:39.294134 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-fc6775b5-f338-48ad-94ac-38136ccf0b13 req-d06061b5-e8bb-48c8-ba6b-16c26f3e2300 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186306 Sep 18 01:16:39.297921 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1582/3279] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:39.325824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:39.335098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:39.354884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:39.356310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:39.361774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:39.363523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:39.371049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:39.372200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:39.580051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:39.593996 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-621e6d73-509d-4c75-981c-208dd60cbc8c tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1477 microversion: 2.1 time: 0.865061 Sep 18 01:16:39.616776 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1698/3280] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:38 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1477 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:39.633007 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:39.633828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:39.661019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:39.663762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:39.664260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:39.665026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:39.665503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:39.667134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:40.188419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:40.197039 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-404e51eb-8011-4597-a12a-13672b5a3aac tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1363 microversion: 2.1 time: 0.896581 Sep 18 01:16:40.200966 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1583/3281] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:39 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1363 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:40.214147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:40.225331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:40.232785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:40.233668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:40.234840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:40.235814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:40.241276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:40.242082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:40.547876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:40.563127 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36cd220d-7561-4511-ac2c-6a8f099a9c45 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1464 microversion: 2.1 time: 0.944524 Sep 18 01:16:40.571752 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1699/3282] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:39 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1464 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:40.589889 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:40.591606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:40.601997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:40.602508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:40.605113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:40.606261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:40.609097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:40.609792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:40.934647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:40.987620 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c7154f2-6239-44f3-8123-c03284e11f97 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.784763 Sep 18 01:16:40.991445 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1584/3283] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:40 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:41.006318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:41.007217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:41.033742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.035175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.043974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:41.046365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:41.051171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.052363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.054465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:41.070666 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15cef407-d31b-45e7-8191-9d2de5d0d68a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.494963 Sep 18 01:16:41.079748 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1700/3284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:40 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:41.095218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1146535530", "metadata": {"image_type": "test"}}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:41.098218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:41.130915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.134534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.135223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:41.138013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.142618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.143413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:41.251927 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Getting quotas for project 6db9c6b25fe3493a80c7c9b1217c4bc0. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:16:41.266146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Getting quotas for user cbf3a969568d469881994b9486788ac1 and project 6db9c6b25fe3493a80c7c9b1217c4bc0. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:16:41.294329 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:41.566819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:41.597312 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-484e98e7-7e7d-4c55-94f3-b0cda9172de5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.604380 Sep 18 01:16:41.599126 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1585/3285] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:40 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:41.615392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:41.616912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:41.632580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.633849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.639472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:41.640851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.641701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.642731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:41.683107 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46dcc81b-4ef9-42b5-b9cc-129db190cb3f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "POST /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac/action" status: 202 len: 0 microversion: 2.1 time: 0.601645 Sep 18 01:16:41.692609 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1701/3286] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:41 2022] POST /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:16:41.692609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:41.692609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:41.700946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.701449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.702405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:41.702749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:41.703989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:41.704455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.048388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:42.061981 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-559fc3a2-b278-421a-bfb6-a9d6181c2bcc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1462 microversion: 2.1 time: 0.460175 Sep 18 01:16:42.062997 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1586/3287] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:41 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1462 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:42.071676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:42.072807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-28663dc4-c61f-4e6b-8ea8-4acc947e9691 req-d8b58ddc-8b74-4d95-b27b-85af11853396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68599e5f-a57f-4820-b215-7ad064c4d1ad", "tag": "526a01a9-634f-4f06-bafc-d867b3f4007b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:42.097273 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e864d6dd-55c4-408e-989f-837103809fad tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1363 microversion: 2.1 time: 0.410537 Sep 18 01:16:42.098397 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1702/3288] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:41 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:42.105436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-28663dc4-c61f-4e6b-8ea8-4acc947e9691 req-d8b58ddc-8b74-4d95-b27b-85af11853396 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.106805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-28663dc4-c61f-4e6b-8ea8-4acc947e9691 req-d8b58ddc-8b74-4d95-b27b-85af11853396 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.108063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-28663dc4-c61f-4e6b-8ea8-4acc947e9691 req-d8b58ddc-8b74-4d95-b27b-85af11853396 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.131256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1924956436"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:42.136484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:42.139975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-28663dc4-c61f-4e6b-8ea8-4acc947e9691 req-d8b58ddc-8b74-4d95-b27b-85af11853396 service nova] Creating event network-changed:526a01a9-634f-4f06-bafc-d867b3f4007b for instance 68599e5f-a57f-4820-b215-7ad064c4d1ad on n-h2-master-1 Sep 18 01:16:42.146751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.148061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.149027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.150509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.150695 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-28663dc4-c61f-4e6b-8ea8-4acc947e9691 req-d8b58ddc-8b74-4d95-b27b-85af11853396 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084576 Sep 18 01:16:42.151514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.152250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.152479 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1587/3289] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:42.163244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-39c42cce-c511-485e-a781-ce7963282f65 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700a8070d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:42.252789 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-39c42cce-c511-485e-a781-ce7963282f65 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.097200 Sep 18 01:16:42.254019 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1588/3290] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:42 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:42.262363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:42.263564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:42.275709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.277003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.277780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.278874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.280251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.280996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.511830 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ea540d9-bda5-455f-ad28-18ccccedf433 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.393829 Sep 18 01:16:42.513204 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1703/3291] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:42 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 18 01:16:42.528626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:42.536359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:42.557656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.559761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.561624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.563067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.566207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.568078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.581981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:42.599105 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64163753-7523-42c2-9b2c-330253ccd449 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.343274 Sep 18 01:16:42.599723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1589/3292] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:42 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:42.614434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:42.623008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:42.642923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.646382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.647525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.648692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.650313 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=20 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:42.651199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.652156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.739015 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:42.773296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33f89f6b-7913-43e8-b979-a33e741a7b1c tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action" status: 202 len: 0 microversion: 2.1 time: 0.171147 Sep 18 01:16:42.775502 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1590/3293] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:42 2022] POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:16:42.782734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e54649f5-c2ad-4f25-98d8-6449b7f5826d req-eac3418e-dd8c-4956-96b1-2a56bcc76cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dda0da1-d84d-460a-b22c-8cfed7d264ad", "name": "network-vif-plugged", "status": "completed", "tag": "3c43219b-327e-4a80-a386-bb8f0ed5a108"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:42.796147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e54649f5-c2ad-4f25-98d8-6449b7f5826d req-eac3418e-dd8c-4956-96b1-2a56bcc76cea service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.796648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e54649f5-c2ad-4f25-98d8-6449b7f5826d req-eac3418e-dd8c-4956-96b1-2a56bcc76cea service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.797078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e54649f5-c2ad-4f25-98d8-6449b7f5826d req-eac3418e-dd8c-4956-96b1-2a56bcc76cea service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.811710 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e54649f5-c2ad-4f25-98d8-6449b7f5826d req-eac3418e-dd8c-4956-96b1-2a56bcc76cea service nova] Creating event network-vif-plugged:3c43219b-327e-4a80-a386-bb8f0ed5a108 for instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad on n-h1-master-1 Sep 18 01:16:42.817121 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e54649f5-c2ad-4f25-98d8-6449b7f5826d req-eac3418e-dd8c-4956-96b1-2a56bcc76cea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040127 Sep 18 01:16:42.818143 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1591/3294] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:42.823663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:42.824698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:42.832443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.833727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.835086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.836658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.838581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.839464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.939481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:42.961824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:42.962499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:42.963454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:42.964274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lazy-loading 'fault' on Instance uuid 5f354c30-7ca1-41fa-b98b-024302f6544c {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:16:42.983883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-acb23ec6-77d0-48db-8e85-332ba88b1f69 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.468783 Sep 18 01:16:43.003372 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1704/3295] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:42 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:43.143447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:43.144735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:43.153460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.154670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.155184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:43.155924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.156389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.156821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:43.314091 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2c99926b-8ea7-4242-91bc-e7697726b285 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1596 microversion: 2.1 time: 0.494426 Sep 18 01:16:43.316763 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1592/3296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:42 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1596 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:43.341468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5fc9b11-e6a4-41c8-a07e-5e83cf68a5f2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700a6e3940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:43.426098 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5fc9b11-e6a4-41c8-a07e-5e83cf68a5f2 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.106515 Sep 18 01:16:43.426758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1593/3297] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:43 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:43.431506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:43.439650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:43.459136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.459644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.460088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:43.460832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.461292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.462273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:43.569950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:43.596959 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab5fe40d-c5d3-4607-a4a9-9f848ef399cc tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1363 microversion: 2.1 time: 0.456515 Sep 18 01:16:43.598859 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1705/3298] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:43 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1363 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:43.628730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:43.630271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:43.654416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.661177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.672940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:43.675278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.677085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.678055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:43.714772 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2af750d4-621b-4554-83a5-a7a7ba56db4f tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action" status: 202 len: 0 microversion: 2.1 time: 0.286574 Sep 18 01:16:43.715555 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1594/3299] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:43 2022] POST /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:16:43.726844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:43.728481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:43.739911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.741464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.741464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:43.742225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:43.743363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:43.743584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:44.211488 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-48674db9-a716-494b-84ab-91fcb837dae2 tempest-ServersAdminTestJSON-1091849279 tempest-ServersAdminTestJSON-1091849279-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1613 microversion: 2.1 time: 0.490400 Sep 18 01:16:44.217642 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1595/3300] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:43 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1613 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:44.218569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:44.226392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:44.227988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:44.243219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:44.244728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:44.245909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:44.248027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:44.249319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:44.250421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:44.260512 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1674dc3c-02d4-42c6-b198-6d330c0086d5 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.635059 Sep 18 01:16:44.263207 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1706/3301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:43 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:44.278867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:44.283117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:44.300871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:44.302528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:44.302768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:44.304605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:44.305528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:44.306487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:44.362160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:16:44.493807 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8ac203a0-0f50-4ab1-b753-6685faec8e4a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 204 len: 0 microversion: 2.1 time: 0.227489 Sep 18 01:16:44.499215 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1707/3302] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:16:44 2022] DELETE /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:16:44.511574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c277983f-16d8-4bbb-b348-7d7d22b0bb66 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053c80d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:44.584101 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c277983f-16d8-4bbb-b348-7d7d22b0bb66 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.081657 Sep 18 01:16:44.585149 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1708/3303] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:44 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:44.590538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:44.591523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:44.600283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:44.600795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:44.601754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:44.602595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:44.603397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:44.603925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.137212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:45.152532 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b6ed998d-6bb5-4a96-8dcf-3742e895528d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.937421 Sep 18 01:16:45.153750 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1596/3304] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:44 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:45.162435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:45.163460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:45.181055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:45.184299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:45.185037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.186248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:45.186941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:45.187634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.413433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:45.430775 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd0bb5e5-a297-47dc-bfdc-3de0498c981b tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1470 microversion: 2.1 time: 0.843764 Sep 18 01:16:45.432154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1709/3305] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:44 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1470 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:45.450335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-71e5adbd-4d21-4880-ab63-b18c174af1fd req-0c9be01a-2be0-4fda-9a98-712a9f34580a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:45.467625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-71e5adbd-4d21-4880-ab63-b18c174af1fd req-0c9be01a-2be0-4fda-9a98-712a9f34580a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:45.468514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-71e5adbd-4d21-4880-ab63-b18c174af1fd req-0c9be01a-2be0-4fda-9a98-712a9f34580a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:45.469488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-71e5adbd-4d21-4880-ab63-b18c174af1fd req-0c9be01a-2be0-4fda-9a98-712a9f34580a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.491884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-71e5adbd-4d21-4880-ab63-b18c174af1fd req-0c9be01a-2be0-4fda-9a98-712a9f34580a service nova] Creating event network-vif-unplugged:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:16:45.501349 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-71e5adbd-4d21-4880-ab63-b18c174af1fd req-0c9be01a-2be0-4fda-9a98-712a9f34580a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064664 Sep 18 01:16:45.503263 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1710/3306] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:45.512993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:45.514993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:45.528221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:45.531874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:45.533067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.534695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:45.535887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:45.537002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.541936 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:45.600478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:45.620231 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a8e1e38-c3a2-4903-9e21-1678f57ee8b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1547 microversion: 2.1 time: 0.465192 Sep 18 01:16:45.625246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1597/3307] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:45 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1547 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:45.641345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3e25f60-d068-4b3e-8541-6a0765e7b31f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7005572e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:45.700793 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3e25f60-d068-4b3e-8541-6a0765e7b31f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.074344 Sep 18 01:16:45.701736 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1598/3308] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:45 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:45.708905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:45.709691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:45.717787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:45.719006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:45.720124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.721701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:45.722776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:45.723552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:45.871078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-25451cfa-4ff1-4c69-b295-abca78d2776f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167976 Sep 18 01:16:45.871970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1599/3309] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:16:45 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:45.891136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:45.918386 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-653344dd-5f7a-4c7c-8af2-f54bee1f0993 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.412112 Sep 18 01:16:45.920618 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1711/3310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:45 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:46.191019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:46.191853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:46.209525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:46.210136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:46.210594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:46.211353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:46.211822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:46.212259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:46.459527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:46.460340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:46.473223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:46.474337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:46.475038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:46.476954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:46.477766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:46.478428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:46.954142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:46.989100 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2f90df8-0a7f-4f70-aecb-080f7e60e609 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.803324 Sep 18 01:16:46.990094 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1600/3311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:46 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:16:47.008286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a022032a-89c8-499c-a407-c43f62bb5595 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700540d280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:47.042234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:47.055280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ea5bf805-ad92-429e-8605-ed217695b502 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1470 microversion: 2.1 time: 0.600979 Sep 18 01:16:47.058897 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1712/3312] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:46 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1470 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:47.068960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:47.070026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:47.080259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:47.080940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:47.081696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:47.082899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:47.083641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:47.084848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:47.119472 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a022032a-89c8-499c-a407-c43f62bb5595 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.127425 Sep 18 01:16:47.120374 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1601/3313] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:46 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:47.360977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:47.375223 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd877bbf-84cb-4760-96a8-f77b0d7f0652 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.313811 Sep 18 01:16:47.376478 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1713/3314] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:47 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:47.791691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-39a3e775-6e8c-45e2-86b3-25ab3ac8407d req-ea4ac9fd-c493-42b7-b5ca-b857c680aea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6f73cf-af88-443a-a139-80a88425f4d4", "name": "network-vif-deleted", "tag": "89aed95c-f166-48ff-8887-a87e549b54de"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:47.824081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-39a3e775-6e8c-45e2-86b3-25ab3ac8407d req-ea4ac9fd-c493-42b7-b5ca-b857c680aea0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:47.824864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-39a3e775-6e8c-45e2-86b3-25ab3ac8407d req-ea4ac9fd-c493-42b7-b5ca-b857c680aea0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:47.825471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-39a3e775-6e8c-45e2-86b3-25ab3ac8407d req-ea4ac9fd-c493-42b7-b5ca-b857c680aea0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:47.849732 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-39a3e775-6e8c-45e2-86b3-25ab3ac8407d req-ea4ac9fd-c493-42b7-b5ca-b857c680aea0 service nova] Creating event network-vif-deleted:89aed95c-f166-48ff-8887-a87e549b54de for instance bc6f73cf-af88-443a-a139-80a88425f4d4 on n-h1-master-1 Sep 18 01:16:47.872766 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-39a3e775-6e8c-45e2-86b3-25ab3ac8407d req-ea4ac9fd-c493-42b7-b5ca-b857c680aea0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086642 Sep 18 01:16:47.875039 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1602/3315] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:16:48.020117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:48.021209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:48.051182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:48.054723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:48.055918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:48.057465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:48.059664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:48.064863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:48.097691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:48.107896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:48.122244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:48.123029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:48.129080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:48.130352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:48.131030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:48.131626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:48.240942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:48.247065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:48.247671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:48.248144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lazy-loading 'fault' on Instance uuid bc6f73cf-af88-443a-a139-80a88425f4d4 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:16:48.472577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:48.491692 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-427ab38c-f867-4f0a-9019-567e348e68dc tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 200 len: 1304 microversion: 2.1 time: 0.398394 Sep 18 01:16:48.492537 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1603/3316] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:48 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 1304 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:48.506974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0aa3411b-d0a7-4967-911f-78f289ac45a5 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700540d9d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:48.588741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0aa3411b-d0a7-4967-911f-78f289ac45a5 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.095004 Sep 18 01:16:48.595853 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1604/3317] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:48 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:48.609085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:48.612836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:48.641908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:48.645346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:48.646426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:48.651413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:48.658338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:48.659492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:48.965456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:49.017541 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac461388-c18b-4147-a9f7-c6f969e20743 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 1.003494 Sep 18 01:16:49.025596 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1714/3318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:48 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:49.069954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-08959130-f649-479e-91d9-9913b97130d1 req-fc14a2c3-1d79-458e-83ff-3a6790982826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dda0da1-d84d-460a-b22c-8cfed7d264ad", "tag": "3c43219b-327e-4a80-a386-bb8f0ed5a108"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:49.157868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08959130-f649-479e-91d9-9913b97130d1 req-fc14a2c3-1d79-458e-83ff-3a6790982826 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:49.158881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08959130-f649-479e-91d9-9913b97130d1 req-fc14a2c3-1d79-458e-83ff-3a6790982826 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:49.164230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08959130-f649-479e-91d9-9913b97130d1 req-fc14a2c3-1d79-458e-83ff-3a6790982826 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:49.225218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-08959130-f649-479e-91d9-9913b97130d1 req-fc14a2c3-1d79-458e-83ff-3a6790982826 service nova] Creating event network-changed:3c43219b-327e-4a80-a386-bb8f0ed5a108 for instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad on n-h1-master-1 Sep 18 01:16:49.245481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:49.246430 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-08959130-f649-479e-91d9-9913b97130d1 req-fc14a2c3-1d79-458e-83ff-3a6790982826 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216919 Sep 18 01:16:49.248689 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1715/3319] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:49.284396 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6cea1df4-2f27-4a72-a9a0-01ff82ea001d tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.686362 Sep 18 01:16:49.297449 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1605/3320] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:48 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:49.539545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:49.540268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: bc6f73cf-af88-443a-a139-80a88425f4d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:49.572254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:49.572822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:49.573203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:49.587851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:49.594250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:49.595421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:49.619617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee200158-3acc-4688-99d1-63c33edb788f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70055451f0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:49.712465 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] HTTP exception thrown: Instance bc6f73cf-af88-443a-a139-80a88425f4d4 could not be found. Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Request method failure captured: Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 HTTP/1.1 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDnkIgqrEp96OlUjiepkLDB1BJLSFP2FM0A5SS0uSnDjlXnLwMPbBM1DG1Os_o5Y-mDAT52nisc8Ot_IhUNcEqHzkwNRzi63ZcKTqClAkxbRmbxjflwU7KyB2NGt2Mh4aQIUND3TowuqN9URtZrjrYVpjcPZLQXFOpP1nBgPQANWNQ Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c68b241d9f2e4caba8024093c0bdf903 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c68b241d9f2e4caba8024093c0bdf903 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersAdminTestJSON-1365839508-project Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a16a5f20794549518f8c3ab8d40492d6 Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersAdminTestJSON-1365839508-project Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: exception: Instance bc6f73cf-af88-443a-a139-80a88425f4d4 could not be found. Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'bc6f73cf-af88-443a-a139-80a88425f4d4'} Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc6f73cf-af88-443a-a139-80a88425f4d4 could not be found. Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc6f73cf-af88-443a-a139-80a88425f4d4 could not be found. Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:16:49.714222 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:49.720213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:49.720213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:16:49.720213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:16:49.720213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:16:49.720213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:16:49.720213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc6f73cf-af88-443a-a139-80a88425f4d4 could not be found. Sep 18 01:16:49.720213 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:49.725467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Returning 404 to user: Instance bc6f73cf-af88-443a-a139-80a88425f4d4 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:16:49.728322 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9dc95197-1d0a-4faa-8033-05168ed24d4d tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4" status: 404 len: 111 microversion: 2.1 time: 0.199238 Sep 18 01:16:49.734876 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1716/3321] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:49 2022] GET /compute/v2.1/servers/bc6f73cf-af88-443a-a139-80a88425f4d4 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:16:49.747907 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee200158-3acc-4688-99d1-63c33edb788f tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.132510 Sep 18 01:16:49.759997 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1606/3322] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:49 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:49.763335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:49.765203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:49.785808 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:49.809730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:49.812096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:49.814285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:49.821142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:49.824608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:49.825289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:49.925387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:16:50.060802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:50.061900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:50.116575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:50.117803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:50.118849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:50.121216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:50.122344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:50.125021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:50.206754 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46659ebc-031e-4015-9675-2c07dd693b9a tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 204 len: 0 microversion: 2.1 time: 0.463807 Sep 18 01:16:50.213910 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1717/3323] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:16:49 2022] DELETE /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:16:50.234814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:50.235345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:50.253377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:50.254409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:50.256519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:50.258687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:50.259530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:50.260982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:50.752936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:50.764215 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-824f9f56-6ede-4075-a8e1-91e36a4fa1ad tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.712189 Sep 18 01:16:50.770859 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1607/3324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:50 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:16:50.776315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-159c59fe-dd57-4db0-b06f-ee9818fb1084 req-d0ce7982-719c-4951-94b6-e2cb67ad4176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68599e5f-a57f-4820-b215-7ad064c4d1ad", "name": "network-vif-plugged", "status": "completed", "tag": "526a01a9-634f-4f06-bafc-d867b3f4007b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:50.800721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-159c59fe-dd57-4db0-b06f-ee9818fb1084 req-d0ce7982-719c-4951-94b6-e2cb67ad4176 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:50.808893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-159c59fe-dd57-4db0-b06f-ee9818fb1084 req-d0ce7982-719c-4951-94b6-e2cb67ad4176 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:50.809685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-159c59fe-dd57-4db0-b06f-ee9818fb1084 req-d0ce7982-719c-4951-94b6-e2cb67ad4176 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:50.876244 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-159c59fe-dd57-4db0-b06f-ee9818fb1084 req-d0ce7982-719c-4951-94b6-e2cb67ad4176 service nova] Creating event network-vif-plugged:526a01a9-634f-4f06-bafc-d867b3f4007b for instance 68599e5f-a57f-4820-b215-7ad064c4d1ad on n-h2-master-1 Sep 18 01:16:50.895565 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-159c59fe-dd57-4db0-b06f-ee9818fb1084 req-d0ce7982-719c-4951-94b6-e2cb67ad4176 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122702 Sep 18 01:16:50.909785 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1608/3325] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:50.915612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:50.922015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:50.939176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:50.943964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:50.944764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:50.947475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:50.948154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:50.952765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:51.375814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:51.398735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:51.402303 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0951abe8-5372-44b4-8602-b0320cab4f06 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1522 microversion: 2.1 time: 0.490412 Sep 18 01:16:51.414049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1609/3326] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:50 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:51.423862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b4e2180-70cd-4f0c-a592-c09804d9c236 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7005416ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:51.432596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41fee78d-a747-4e09-8b4e-96f4e9a0ae92 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1469 microversion: 2.1 time: 1.216060 Sep 18 01:16:51.445690 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1718/3327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:50 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1469 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:51.563353 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b4e2180-70cd-4f0c-a592-c09804d9c236 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.142058 Sep 18 01:16:51.564549 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1610/3328] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:51 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:51.796223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:51.796927 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:51.813873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:51.819773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:51.820864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:51.827330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:51.828582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:51.832227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:52.403557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:52.436120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53a209d7-b567-4735-a539-45db13c44183 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.643248 Sep 18 01:16:52.440969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:52.442532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:52.454817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:52.455925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:52.462115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:52.464319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:52.465581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:52.466688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:52.474321 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1719/3329] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:51 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:52.494987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:52.497313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:52.511427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:52.512305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:52.513161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:52.514635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:52.522703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:52.524191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:53.010474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:53.032218 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-819e5c21-a463-42d7-9c81-02ef7d4bbef0 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1502 microversion: 2.1 time: 0.601788 Sep 18 01:16:53.040411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1611/3330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:52 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1502 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:53.060039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfb20daf-daef-4e3e-af6b-17d938976004 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053ef280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:53.096343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:53.116275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae0dcded-46f4-43d4-8567-e9eb342830e3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1469 microversion: 2.1 time: 0.639624 Sep 18 01:16:53.118400 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1720/3331] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:52 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1469 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:53.132305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c043e747-2715-4444-8aac-e7e854ca16b2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'create', calling method: .version_select at 0x7f7005f54b80>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-118777480", "description": "tempest-description-229225508"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:53.581410 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dfb20daf-daef-4e3e-af6b-17d938976004 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.538864 Sep 18 01:16:53.588519 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1612/3332] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:53 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:53.601217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1a9c3c34-f84d-441b-996a-3b6bd15c29a7 req-1123bdce-b353-4b1c-ad43-e25a39faeadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-plugged", "status": "completed", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:53.630522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a9c3c34-f84d-441b-996a-3b6bd15c29a7 req-1123bdce-b353-4b1c-ad43-e25a39faeadf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:53.631333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a9c3c34-f84d-441b-996a-3b6bd15c29a7 req-1123bdce-b353-4b1c-ad43-e25a39faeadf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:53.632017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a9c3c34-f84d-441b-996a-3b6bd15c29a7 req-1123bdce-b353-4b1c-ad43-e25a39faeadf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:53.662889 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1a9c3c34-f84d-441b-996a-3b6bd15c29a7 req-1123bdce-b353-4b1c-ad43-e25a39faeadf service nova] Creating event network-vif-plugged:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:16:53.678913 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1a9c3c34-f84d-441b-996a-3b6bd15c29a7 req-1123bdce-b353-4b1c-ad43-e25a39faeadf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088497 Sep 18 01:16:53.686436 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1613/3333] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:53.716662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:53.718452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:53.745229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:53.751527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:53.752728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:53.758204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:53.759382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:53.760443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:54.195850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:54.200277 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:16:54.218223 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1634fc2-ae13-4b54-b407-d2e47b44e628 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1371 microversion: 2.1 time: 0.529208 Sep 18 01:16:54.220417 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1614/3334] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:53 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1371 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:54.220690 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c043e747-2715-4444-8aac-e7e854ca16b2 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.100158 Sep 18 01:16:54.222223 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1721/3335] 10.222.0.25 () {60 vars in 1180 bytes} [Sun Sep 18 01:16:53 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:54.248140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:54.249342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:54.267734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-118777480"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:54.268255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:54.278494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:54.279286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:54.279850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:54.280889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:54.282920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:54.283499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:54.285851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:54.286367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:54.286763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:54.293023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:54.296582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:54.297251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:55.306280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Adding security group 5d59cec1-693b-4de3-b0ab-da3ee6a7ddc3 to port 9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 Sep 18 01:16:55.335536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:55.394711 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a173a27-0e46-4c2c-b66b-81024b400af3 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 200 len: 1469 microversion: 2.1 time: 1.169980 Sep 18 01:16:55.396042 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1615/3336] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:54 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 1469 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:55.420652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d57d1d8-2de5-472a-9396-755350a09cc9 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700540d3a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:58.122663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca421bb6-6f42-4424-b41d-0f7e10701f78 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action" status: 202 len: 0 microversion: 2.1 time: 3.858850 Sep 18 01:16:58.123603 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1722/3337] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:54 2022] POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action => generated 0 bytes in 3860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:16:58.129112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:58.134989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:58.160581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:58.161537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:58.163417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:58.165762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:58.166437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:58.167063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:58.640059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:16:58.661812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4571367e-1ab4-4044-bb73-7f4ae57831f3 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1566 microversion: 2.1 time: 0.536457 Sep 18 01:16:58.688066 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1723/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:58 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1566 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:16:58.718326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0d161bff-b658-4836-8b40-f416935d7c70 req-34dc07ce-6183-4c9d-8a23-7454cadd003c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a21ef3d-97ba-40ad-b574-72a10a149eac", "name": "network-vif-plugged", "status": "completed", "tag": "31cfae35-0642-49fe-8133-54e05e4f2311"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:58.760111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0d161bff-b658-4836-8b40-f416935d7c70 req-34dc07ce-6183-4c9d-8a23-7454cadd003c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:58.765574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0d161bff-b658-4836-8b40-f416935d7c70 req-34dc07ce-6183-4c9d-8a23-7454cadd003c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:58.770792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0d161bff-b658-4836-8b40-f416935d7c70 req-34dc07ce-6183-4c9d-8a23-7454cadd003c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:58.818618 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0d161bff-b658-4836-8b40-f416935d7c70 req-34dc07ce-6183-4c9d-8a23-7454cadd003c service nova] Creating event network-vif-plugged:31cfae35-0642-49fe-8133-54e05e4f2311 for instance 3a21ef3d-97ba-40ad-b574-72a10a149eac on n-h2-master-1 Sep 18 01:16:58.844353 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0d161bff-b658-4836-8b40-f416935d7c70 req-34dc07ce-6183-4c9d-8a23-7454cadd003c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151013 Sep 18 01:16:58.847244 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1724/3339] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:58.872901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-93d96fb7-7988-4688-9bbb-f71118fd3859 req-40955cfb-0a64-4396-9971-e7d64c1e0930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5630c51-cb2e-4be2-8071-62ddb2cc6581", "name": "network-vif-deleted", "tag": "b7cc2f81-18db-413b-96f5-8062a09b3bd2"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:58.926791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-93d96fb7-7988-4688-9bbb-f71118fd3859 req-40955cfb-0a64-4396-9971-e7d64c1e0930 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:58.926791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-93d96fb7-7988-4688-9bbb-f71118fd3859 req-40955cfb-0a64-4396-9971-e7d64c1e0930 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:58.927150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-93d96fb7-7988-4688-9bbb-f71118fd3859 req-40955cfb-0a64-4396-9971-e7d64c1e0930 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:58.974127 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-93d96fb7-7988-4688-9bbb-f71118fd3859 req-40955cfb-0a64-4396-9971-e7d64c1e0930 service nova] Creating event network-vif-deleted:b7cc2f81-18db-413b-96f5-8062a09b3bd2 for instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 on n-h2-master-1 Sep 18 01:16:58.994271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-93d96fb7-7988-4688-9bbb-f71118fd3859 req-40955cfb-0a64-4396-9971-e7d64c1e0930 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139791 Sep 18 01:16:59.000068 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1725/3340] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:16:59.017197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:16:59.022658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: a5630c51-cb2e-4be2-8071-62ddb2cc6581] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:59.048086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:59.053638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:59.055198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:59.056533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:59.058735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:59.065822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:59.112538 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] HTTP exception thrown: Instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 could not be found. Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Request method failure captured: Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 HTTP/1.1 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDnkIgqrEp96OlUjiepkLDB1BJLSFP2FM0A5SS0uSnDjlXnLwMPbBM1DG1Os_o5Y-mDAT52nisc8Ot_IhUNcEqHzkwNRzi63ZcKTqClAkxbRmbxjflwU7KyB2NGt2Mh4aQIUND3TowuqN9URtZrjrYVpjcPZLQXFOpP1nBgPQANWNQ Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c68b241d9f2e4caba8024093c0bdf903 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c68b241d9f2e4caba8024093c0bdf903 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersAdminTestJSON-1365839508-project Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: a16a5f20794549518f8c3ab8d40492d6 Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersAdminTestJSON-1365839508-project Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 could not be found. Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a5630c51-cb2e-4be2-8071-62ddb2cc6581'} Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 could not be found. Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 could not be found. Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:16:59.119567 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 could not be found. Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Returning 404 to user: Instance a5630c51-cb2e-4be2-8071-62ddb2cc6581 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0dc995b-7f18-4129-9b52-9b76aa27cc44 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581" status: 404 len: 111 microversion: 2.1 time: 0.125842 Sep 18 01:16:59.132015 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1726/3341] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:16:58 2022] GET /compute/v2.1/servers/a5630c51-cb2e-4be2-8071-62ddb2cc6581 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:16:59.140316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-118777480"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:16:59.146970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:16:59.162004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:59.168003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:59.168793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:59.169678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:16:59.170272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:16:59.170797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:16:59.536600 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Removing security group 5d59cec1-693b-4de3-b0ab-da3ee6a7ddc3 from port 9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 Sep 18 01:17:00.602635 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56bad9e1-dd4b-431b-90e1-a5a317272588 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action" status: 202 len: 0 microversion: 2.1 time: 1.469343 Sep 18 01:17:00.603802 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1727/3342] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:16:59 2022] POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action => generated 0 bytes in 1472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:17:00.610065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:00.612558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:00.625587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:00.628795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:00.632941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:00.634346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:00.635077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:00.635720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:00.969527 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dc4e4bf2-e360-46a7-9c47-187d8b4f8152 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.364146 Sep 18 01:17:00.971044 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1728/3343] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:17:00 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-interface => generated 285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:01.011525 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:01.012424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:01.052027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:01.052027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:01.052541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:01.053174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:01.053659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:01.054091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:01.152090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:17:01.380184 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:01.474474 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8093fad3-537f-4d01-adac-1793ae27bc84 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 204 len: 0 microversion: 2.1 time: 0.501689 Sep 18 01:17:01.480714 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1729/3344] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:17:00 2022] DELETE /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:17:01.515965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-69d89ced-08fe-4f3d-8339-44596a9be478 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'create', calling method: .version_select at 0x7f70061c34c0>, body: {"pool": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:04.270175 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=67 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:05.384445 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:05.680738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-69d89ced-08fe-4f3d-8339-44596a9be478 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.197418 Sep 18 01:17:05.683354 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1730/3345] 10.222.0.25 () {60 vars in 1170 bytes} [Sun Sep 18 01:17:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:05.697877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-30a0ab72-62f3-4754-ac58-1b16405df623 req-afa79fad-cd8e-4df2-8038-da65c8111e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3", "tag": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9"}, {"name": "network-changed", "server_uuid": "b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3", "tag": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:05.781992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-30a0ab72-62f3-4754-ac58-1b16405df623 req-afa79fad-cd8e-4df2-8038-da65c8111e8e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:05.789924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-30a0ab72-62f3-4754-ac58-1b16405df623 req-afa79fad-cd8e-4df2-8038-da65c8111e8e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:05.792018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-30a0ab72-62f3-4754-ac58-1b16405df623 req-afa79fad-cd8e-4df2-8038-da65c8111e8e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:05.863581 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-30a0ab72-62f3-4754-ac58-1b16405df623 req-afa79fad-cd8e-4df2-8038-da65c8111e8e service nova] Creating event network-changed:9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 for instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 on n-h2-master-1 Sep 18 01:17:05.895446 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-30a0ab72-62f3-4754-ac58-1b16405df623 req-afa79fad-cd8e-4df2-8038-da65c8111e8e service nova] Creating event network-changed:9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 for instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 on n-h2-master-1 Sep 18 01:17:05.907340 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-30a0ab72-62f3-4754-ac58-1b16405df623 req-afa79fad-cd8e-4df2-8038-da65c8111e8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.222237 Sep 18 01:17:05.910807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1731/3346] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:05.948060 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:05.951259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:05.977606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:05.978902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:05.979981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:05.981579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:05.982680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:05.983886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:06.054443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:06.056725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:06.072717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:06.074226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lazy-loading 'fault' on Instance uuid 5f354c30-7ca1-41fa-b98b-024302f6544c {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:17:06.173424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16a5f20794549518f8c3ab8d40492d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b241d9f2e4caba8024093c0bdf903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:06.218646 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14f6e464-bfdc-4e5a-8c10-282bfffd4403 tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 200 len: 1303 microversion: 2.1 time: 0.287040 Sep 18 01:17:06.226542 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1732/3347] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:05 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 1303 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:06.250662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a2d0e3ea-85e1-45b2-8b1f-37b9eeb05557 req-4ee2ccb3-8449-45fe-be62-24102dd1b835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f354c30-7ca1-41fa-b98b-024302f6544c", "name": "network-vif-deleted", "tag": "e8130d77-3807-4849-af92-54003c070986"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:06.317661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a2d0e3ea-85e1-45b2-8b1f-37b9eeb05557 req-4ee2ccb3-8449-45fe-be62-24102dd1b835 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:06.318161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a2d0e3ea-85e1-45b2-8b1f-37b9eeb05557 req-4ee2ccb3-8449-45fe-be62-24102dd1b835 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:06.318604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a2d0e3ea-85e1-45b2-8b1f-37b9eeb05557 req-4ee2ccb3-8449-45fe-be62-24102dd1b835 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:06.396679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a2d0e3ea-85e1-45b2-8b1f-37b9eeb05557 req-4ee2ccb3-8449-45fe-be62-24102dd1b835 service nova] Creating event network-vif-deleted:e8130d77-3807-4849-af92-54003c070986 for instance 5f354c30-7ca1-41fa-b98b-024302f6544c on n-h1-master-1 Sep 18 01:17:06.403203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a2d0e3ea-85e1-45b2-8b1f-37b9eeb05557 req-4ee2ccb3-8449-45fe-be62-24102dd1b835 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174584 Sep 18 01:17:06.414407 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1733/3348] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:06.438351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.212"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:06.450122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:06.469265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:06.473659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:06.474469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:06.475438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:06.476167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:06.484527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:06.575343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "refresh_cache-b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:17:06.575977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquired lock "refresh_cache-b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:17:13.372237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:17:14.758858 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d57d1d8-2de5-472a-9396-755350a09cc9 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 19.358491 Sep 18 01:17:14.762119 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1616/3349] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:16:55 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 19363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:14.786297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:14.790473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] [instance: 5f354c30-7ca1-41fa-b98b-024302f6544c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:14.819182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:14.820736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:14.826646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:14.836019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:14.836958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:14.837606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:14.895219 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] HTTP exception thrown: Instance 5f354c30-7ca1-41fa-b98b-024302f6544c could not be found. Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Request method failure captured: Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c HTTP/1.1 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnDnkIgqrEp96OlUjiepkLDB1BJLSFP2FM0A5SS0uSnDjlXnLwMPbBM1DG1Os_o5Y-mDAT52nisc8Ot_IhUNcEqHzkwNRzi63ZcKTqClAkxbRmbxjflwU7KyB2NGt2Mh4aQIUND3TowuqN9URtZrjrYVpjcPZLQXFOpP1nBgPQANWNQ Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c68b241d9f2e4caba8024093c0bdf903 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c68b241d9f2e4caba8024093c0bdf903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c68b241d9f2e4caba8024093c0bdf903 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAdminTestJSON-1365839508 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAdminTestJSON-1365839508-project Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: a16a5f20794549518f8c3ab8d40492d6 Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAdminTestJSON-1365839508-project Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5f354c30-7ca1-41fa-b98b-024302f6544c could not be found. Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5f354c30-7ca1-41fa-b98b-024302f6544c'} Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f354c30-7ca1-41fa-b98b-024302f6544c could not be found. Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f354c30-7ca1-41fa-b98b-024302f6544c could not be found. Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:14.902529 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:14.913811 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:14.913811 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:14.913811 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:14.913811 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:17:14.913811 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:17:14.913811 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f354c30-7ca1-41fa-b98b-024302f6544c could not be found. Sep 18 01:17:14.913811 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:14.920867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] Returning 404 to user: Instance 5f354c30-7ca1-41fa-b98b-024302f6544c could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:17:14.923329 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a7929e8-3e78-4e07-956a-a7f0f82bca3e tempest-ServersAdminTestJSON-1365839508 tempest-ServersAdminTestJSON-1365839508-project] 10.222.0.25 "GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c" status: 404 len: 111 microversion: 2.1 time: 0.159066 Sep 18 01:17:14.928960 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1617/3350] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:14 2022] GET /compute/v2.1/servers/5f354c30-7ca1-41fa-b98b-024302f6544c => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:17:14.948736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-91023c26-0b87-40fc-9118-f75eaa4fe6ec req-493450e4-40af-4262-aee2-e25250ce72e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68599e5f-a57f-4820-b215-7ad064c4d1ad", "tag": "526a01a9-634f-4f06-bafc-d867b3f4007b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:14.988472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-91023c26-0b87-40fc-9118-f75eaa4fe6ec req-493450e4-40af-4262-aee2-e25250ce72e9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:14.989680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-91023c26-0b87-40fc-9118-f75eaa4fe6ec req-493450e4-40af-4262-aee2-e25250ce72e9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:14.990701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-91023c26-0b87-40fc-9118-f75eaa4fe6ec req-493450e4-40af-4262-aee2-e25250ce72e9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:15.032472 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-91023c26-0b87-40fc-9118-f75eaa4fe6ec req-493450e4-40af-4262-aee2-e25250ce72e9 service nova] Creating event network-changed:526a01a9-634f-4f06-bafc-d867b3f4007b for instance 68599e5f-a57f-4820-b215-7ad064c4d1ad on n-h2-master-1 Sep 18 01:17:15.058611 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-91023c26-0b87-40fc-9118-f75eaa4fe6ec req-493450e4-40af-4262-aee2-e25250ce72e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125928 Sep 18 01:17:15.070657 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1618/3351] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:15.089210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:15.090981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:15.117778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:15.119193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:15.122444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:15.124021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:15.131262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:15.132371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:16.187422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Updating instance_info_cache with network_info: [{"id": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9", "address": "fa:16:3e:c1:c7:8e", "network": {"id": "d94f6ca6-70ba-45bf-93c2-d48012732b5b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-25011200-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14e7c4ce195e4e7baed225946f8d353e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f50f97c-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:17:16.206525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Releasing lock "refresh_cache-b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:17:16.207764 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-920002e6-4195-4952-8434-fe510decee34 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action" status: 202 len: 0 microversion: 2.1 time: 9.785920 Sep 18 01:17:16.210400 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1734/3352] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:17:06 2022] POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action => generated 0 bytes in 9789 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:17:16.222811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-148c37a1-a296-4b0a-ae25-2781d09b21e8 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700a7c9ca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:16.354664 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-148c37a1-a296-4b0a-ae25-2781d09b21e8 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.142031 Sep 18 01:17:16.360198 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1735/3353] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:16 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:16.380554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.212"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:16.451744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:16.459252 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:16.474510 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-83196acf-02d6-40c5-9155-51ab07d1b681 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 1.401521 Sep 18 01:17:16.475149 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1619/3354] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:15 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:17.128940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8b9b5fa0-48ed-4a19-801d-d24bcb4820c8 req-8ed08aa6-e86c-48ec-aa7e-5afdee55018a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3", "tag": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:17.160272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8b9b5fa0-48ed-4a19-801d-d24bcb4820c8 req-8ed08aa6-e86c-48ec-aa7e-5afdee55018a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:17.165508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8b9b5fa0-48ed-4a19-801d-d24bcb4820c8 req-8ed08aa6-e86c-48ec-aa7e-5afdee55018a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:17.167914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8b9b5fa0-48ed-4a19-801d-d24bcb4820c8 req-8ed08aa6-e86c-48ec-aa7e-5afdee55018a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:17.231748 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8b9b5fa0-48ed-4a19-801d-d24bcb4820c8 req-8ed08aa6-e86c-48ec-aa7e-5afdee55018a service nova] Creating event network-changed:9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 for instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 on n-h2-master-1 Sep 18 01:17:17.295359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8b9b5fa0-48ed-4a19-801d-d24bcb4820c8 req-8ed08aa6-e86c-48ec-aa7e-5afdee55018a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171697 Sep 18 01:17:17.296783 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1620/3355] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:17.395045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e42c801-7657-4677-a93e-f0246b4962e6 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7005e5a040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:17.510442 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e42c801-7657-4677-a93e-f0246b4962e6 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.137110 Sep 18 01:17:17.522159 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1621/3356] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:17 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:17.532494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:17.535195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:17.536541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:17.552532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:17.553914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:17.554996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:17.556912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:17.558145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:17.559490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:17.567635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:17.568153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:17.568600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:17.571227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:17.571776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:17.572227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:18.582942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:18.598621 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64947650-b937-4d1e-b799-416f69af7381 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.074023 Sep 18 01:17:18.623370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1622/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:17 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:18.643866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7288cb55-6063-4ca5-823d-4b610cea9a5d tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70054019d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:18.728708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7288cb55-6063-4ca5-823d-4b610cea9a5d tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1424 microversion: 2.1 time: 0.091435 Sep 18 01:17:18.730461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1623/3358] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:18 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:18.741904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-421970835"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:18.746609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:18.761920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:18.762811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:18.763774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:18.764739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:18.765218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:18.765690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:18.953361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "refresh_cache-b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 01:17:18.953921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquired lock "refresh_cache-b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 01:17:19.217419 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dca4ee00-1315-4d40-8678-46326f0015a0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.483821 Sep 18 01:17:19.221658 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1624/3359] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:17:18 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 18 01:17:19.227939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-03090965-a07b-44d7-9c2d-34426b7ac8b1 req-9ae262bb-e550-4cdf-bead-a33732c6b56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:19.242013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-03090965-a07b-44d7-9c2d-34426b7ac8b1 req-9ae262bb-e550-4cdf-bead-a33732c6b56e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:19.242906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-03090965-a07b-44d7-9c2d-34426b7ac8b1 req-9ae262bb-e550-4cdf-bead-a33732c6b56e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:19.243378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-03090965-a07b-44d7-9c2d-34426b7ac8b1 req-9ae262bb-e550-4cdf-bead-a33732c6b56e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:19.266067 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-03090965-a07b-44d7-9c2d-34426b7ac8b1 req-9ae262bb-e550-4cdf-bead-a33732c6b56e service nova] Creating event network-vif-unplugged:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:17:19.272055 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-03090965-a07b-44d7-9c2d-34426b7ac8b1 req-9ae262bb-e550-4cdf-bead-a33732c6b56e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048521 Sep 18 01:17:19.273013 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1625/3360] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:19.280715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:19.281454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:19.290630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:19.291715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:19.292201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:19.293085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:19.293624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:19.294053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:20.130930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:20.143728 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-16bf9790-0ccc-4de2-8e17-9098934669a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.868507 Sep 18 01:17:20.146087 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1626/3361] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:19 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:20.152865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-875e99f4-f9d9-4ee3-9686-e655e926e08b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7005eb78b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:20.219900 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-875e99f4-f9d9-4ee3-9686-e655e926e08b tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1433 microversion: 2.1 time: 0.072343 Sep 18 01:17:20.220944 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1627/3362] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:20 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1433 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:20.247275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-28ef4ef6-3533-42dd-a0c6-cacb44d02d55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053b5af0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:20.320296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-28ef4ef6-3533-42dd-a0c6-cacb44d02d55 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 200 len: 1433 microversion: 2.1 time: 0.079358 Sep 18 01:17:20.321141 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1628/3363] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:20 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 1433 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:20.341363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:20.342029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:20.349604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:20.350109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:20.350546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:20.351728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:20.352527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:20.353517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:20.693687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:20.703725 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64b7f99f-f9a6-4244-b5fa-c778cdb540e0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1464 microversion: 2.1 time: 0.366266 Sep 18 01:17:20.705145 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1629/3364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:20 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:20.734667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee82d33f-b746-4170-b9e6-ea593451d0b0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70063b2d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:20.926273 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee82d33f-b746-4170-b9e6-ea593451d0b0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/6f723c18-9162-4fbf-98cf-c1c9072c0368" status: 200 len: 784 microversion: 2.1 time: 0.200574 Sep 18 01:17:20.939571 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1630/3365] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:20 2022] GET /compute/v2.1/images/6f723c18-9162-4fbf-98cf-c1c9072c0368 => generated 784 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:17:20.945446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c8d881a3-f9fb-4918-84b8-509862b2efd5 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:20.963813 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c8d881a3-f9fb-4918-84b8-509862b2efd5 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021740 Sep 18 01:17:20.966252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Building network info cache for instance {{(pid=122374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 18 01:17:20.975279 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1631/3366] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:17:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:20.985139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b421605-6b34-484d-849c-c665787bb28a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053b5160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:22.149567 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b421605-6b34-484d-849c-c665787bb28a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "DELETE /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 204 len: 0 microversion: 2.1 time: 1.172312 Sep 18 01:17:22.151882 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1632/3367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:20 2022] DELETE /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:17:22.170557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d5544a8a-c683-427b-a4fd-7f27429b9527 req-91560c8a-4ab0-40b7-8515-86a0ae22684e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3", "tag": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:22.194039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d5544a8a-c683-427b-a4fd-7f27429b9527 req-91560c8a-4ab0-40b7-8515-86a0ae22684e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:22.194859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d5544a8a-c683-427b-a4fd-7f27429b9527 req-91560c8a-4ab0-40b7-8515-86a0ae22684e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:22.195464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d5544a8a-c683-427b-a4fd-7f27429b9527 req-91560c8a-4ab0-40b7-8515-86a0ae22684e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:22.208789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Updating instance_info_cache with network_info: [{"id": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9", "address": "fa:16:3e:c1:c7:8e", "network": {"id": "d94f6ca6-70ba-45bf-93c2-d48012732b5b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-25011200-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14e7c4ce195e4e7baed225946f8d353e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f50f97c-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:17:22.226346 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d5544a8a-c683-427b-a4fd-7f27429b9527 req-91560c8a-4ab0-40b7-8515-86a0ae22684e service nova] Creating event network-changed:9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 for instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 on n-h2-master-1 Sep 18 01:17:22.229034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Releasing lock "refresh_cache-b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" {{(pid=122374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 01:17:22.230652 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d9a76b84-9d33-418a-ad73-0d270dd4a845 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action" status: 202 len: 0 microversion: 2.1 time: 5.869261 Sep 18 01:17:22.237651 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1736/3368] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:17:16 2022] POST /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3/action => generated 0 bytes in 5873 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 18 01:17:22.245220 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d5544a8a-c683-427b-a4fd-7f27429b9527 req-91560c8a-4ab0-40b7-8515-86a0ae22684e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085449 Sep 18 01:17:22.248742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:22.249512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:22.253209 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1633/3369] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:22.261856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac88fdd1-f8df-43f9-bcba-7c83371f7267 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700540dca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:22.270929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:22.271787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:22.278620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:22.280198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:22.283746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:22.289068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:22.335221 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ac88fdd1-f8df-43f9-bcba-7c83371f7267 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] HTTP exception thrown: Image not found. Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac88fdd1-f8df-43f9-bcba-7c83371f7267 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Request method failure captured: Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 HTTP/1.1 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFbtDb2cKszU7nj-4gWL0cUHGNxpe7HqQtYYb1W3JXoNfCZdjXHe1wRNoB2AsmB_K-Fyzu01qYeeAxsSlyAJh2PrKGb0QaU1zSmHmO9biLmYUQ4IazOz8JvqCc9ig6CyJivi41n14sx-_uea3I0UB-_whuEhArLoENBE2lcBpPTpGM Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 6db9c6b25fe3493a80c7c9b1217c4bc0 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 6db9c6b25fe3493a80c7c9b1217c4bc0 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerTestJSON-1784278378-project Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cbf3a969568d469881994b9486788ac1 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerTestJSON-1784278378-project Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '02ab689c-55d1-4134-ba0d-d6fa2e754b74'} Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 02ab689c-55d1-4134-ba0d-d6fa2e754b74 Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 18 01:17:22.340384 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02ab689c-55d1-4134-ba0d-d6fa2e754b74 could not be found. Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac88fdd1-f8df-43f9-bcba-7c83371f7267 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac88fdd1-f8df-43f9-bcba-7c83371f7267 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 404 len: 62 microversion: 2.1 time: 0.088036 Sep 18 01:17:22.351478 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1634/3370] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:22 2022] GET /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:17:22.368447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dd2aafce-9c98-4ee6-955d-f8599f2df81b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '.version_select at 0x7f7005e5a0d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:23.378901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:23.405835 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f3720e4-d1e3-41f0-82d2-c2316ea35411 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1685 microversion: 2.1 time: 1.169782 Sep 18 01:17:23.410665 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1737/3371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:22 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1685 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:23.425522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1325387370"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:23.434271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:23.446774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:23.447729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:23.448311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:23.449203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:23.449692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:23.450321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:23.828609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0e2805b4-a3c9-422c-98bb-3f4e7fdcc00a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "POST /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac/action" status: 202 len: 0 microversion: 2.1 time: 0.415475 Sep 18 01:17:23.833986 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1738/3372] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:17:23 2022] POST /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:17:23.862877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:23.871401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:23.884464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:23.890630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:23.891897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:23.893283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:23.904457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:23.905351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:23.968288 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d6b2dae-3e93-4407-b486-bc9b3f199547 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/ips" status: 200 len: 150 microversion: 2.20 time: 0.131688 Sep 18 01:17:23.970904 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1739/3373] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Sep 18 01:17:23 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/ips => generated 150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:17:23.980672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c802d857-59c8-4d47-8c50-0712eab72003 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700a7c90d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:24.068791 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c802d857-59c8-4d47-8c50-0712eab72003 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 0.095419 Sep 18 01:17:24.070468 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1740/3374] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:23 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:24.093597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:24.094495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:24.105168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:24.106036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:24.106660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:24.107610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:24.108290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:24.108909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:24.184854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96a91c66-ce5b-428b-98f9-f86495dcb7cd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/ips" status: 200 len: 143 microversion: 2.1 time: 0.096189 Sep 18 01:17:24.198071 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1741/3375] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:17:24 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/ips => generated 143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:17:24.413099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-71075ab9-73e6-48e8-af3d-51f11dc0d20d req-495b88bd-3749-4b84-8107-7cdb8774c480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a21ef3d-97ba-40ad-b574-72a10a149eac", "name": "network-vif-unplugged", "status": "completed", "tag": "31cfae35-0642-49fe-8133-54e05e4f2311"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:24.452461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-71075ab9-73e6-48e8-af3d-51f11dc0d20d req-495b88bd-3749-4b84-8107-7cdb8774c480 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:24.458737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-71075ab9-73e6-48e8-af3d-51f11dc0d20d req-495b88bd-3749-4b84-8107-7cdb8774c480 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:24.462477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-71075ab9-73e6-48e8-af3d-51f11dc0d20d req-495b88bd-3749-4b84-8107-7cdb8774c480 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:24.495944 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-71075ab9-73e6-48e8-af3d-51f11dc0d20d req-495b88bd-3749-4b84-8107-7cdb8774c480 service nova] Creating event network-vif-unplugged:31cfae35-0642-49fe-8133-54e05e4f2311 for instance 3a21ef3d-97ba-40ad-b574-72a10a149eac on n-h2-master-1 Sep 18 01:17:24.510937 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-71075ab9-73e6-48e8-af3d-51f11dc0d20d req-495b88bd-3749-4b84-8107-7cdb8774c480 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103328 Sep 18 01:17:24.513355 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1742/3376] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:24.519037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:24.519756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:24.528704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:24.529217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:24.529716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:24.530468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:24.530928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:24.531361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:26.374166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:26.423127 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-89925425-0988-4da2-a1bc-18c4ea83200d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 1.907170 Sep 18 01:17:26.462572 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1743/3377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:24 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:26.499802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bfc61eb5-8b03-442f-bccc-ffaf4cb71f02 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7005336430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:26.669681 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bfc61eb5-8b03-442f-bccc-ffaf4cb71f02 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 0.204430 Sep 18 01:17:26.676020 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1744/3378] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:26 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:27.478865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:27.482176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:27.534988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:27.541028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:27.542512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:27.544178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:27.552881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:27.562817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:28.808826 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dd2aafce-9c98-4ee6-955d-f8599f2df81b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/1bf36a7e-0a0b-4a74-a9dc-6677a9ae2aeb" status: 202 len: 0 microversion: 2.1 time: 6.460878 Sep 18 01:17:28.810402 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1635/3379] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:17:22 2022] DELETE /compute/v2.1/os-floating-ips/1bf36a7e-0a0b-4a74-a9dc-6677a9ae2aeb => generated 0 bytes in 6466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:17:28.839186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a8d4875-191b-42e2-8504-f1873b836f12 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700541ddc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:29.018488 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a8d4875-191b-42e2-8504-f1873b836f12 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 0.206512 Sep 18 01:17:29.031589 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1636/3380] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:28 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:29.034382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ef314c42-b77f-4bb6-bc67-1f0090d5aaa8 req-ce6fa58b-22ca-4112-9bcc-9785c3b60996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-plugged", "status": "completed", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:29.093202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ef314c42-b77f-4bb6-bc67-1f0090d5aaa8 req-ce6fa58b-22ca-4112-9bcc-9785c3b60996 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:29.094696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ef314c42-b77f-4bb6-bc67-1f0090d5aaa8 req-ce6fa58b-22ca-4112-9bcc-9785c3b60996 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:29.098006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ef314c42-b77f-4bb6-bc67-1f0090d5aaa8 req-ce6fa58b-22ca-4112-9bcc-9785c3b60996 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:29.138883 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ef314c42-b77f-4bb6-bc67-1f0090d5aaa8 req-ce6fa58b-22ca-4112-9bcc-9785c3b60996 service nova] Creating event network-vif-plugged:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:17:29.158925 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ef314c42-b77f-4bb6-bc67-1f0090d5aaa8 req-ce6fa58b-22ca-4112-9bcc-9785c3b60996 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136300 Sep 18 01:17:29.160927 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1637/3381] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:29.174763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e62951e3-bc8e-4010-bc09-0fb6538b4292 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '.version_select at 0x7f70054019d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:29.491837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:29.513628 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01dd17b2-5a22-4703-a3e2-8f35ceca0cb4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 2.043785 Sep 18 01:17:29.530501 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1745/3382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:27 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:29.906194 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e62951e3-bc8e-4010-bc09-0fb6538b4292 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5d59cec1-693b-4de3-b0ab-da3ee6a7ddc3" status: 202 len: 0 microversion: 2.1 time: 0.742503 Sep 18 01:17:29.912731 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1638/3383] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:17:29 2022] DELETE /compute/v2.1/os-security-groups/5d59cec1-693b-4de3-b0ab-da3ee6a7ddc3 => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:17:29.919482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:29.920151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:29.943953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:29.944463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:29.945145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:29.946118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:29.946794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:29.950114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:29.985412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:17:30.053876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad5ebf5e-4567-4144-9b2f-aa3f57e7554a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053a4940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:30.161406 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ad5ebf5e-4567-4144-9b2f-aa3f57e7554a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 0.113671 Sep 18 01:17:30.165115 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1639/3384] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:30 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:30.189301 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7dd8b645-0d82-4ae4-a661-3e312d3c123b tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 204 len: 0 microversion: 2.1 time: 0.274899 Sep 18 01:17:30.191456 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1746/3385] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:17:29 2022] DELETE /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:17:30.201176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:30.203846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce107691-7159-44ec-aeda-14011ab321cc"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:30.207463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:30.213431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:30.228142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:30.233639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:30.234721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:30.235457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:30.236551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:30.237216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:30.237930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:30.240694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:30.243328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:30.247985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:30.253749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:30.258324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:30.903983 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-10b13996-9d00-4d2d-935b-f02d0b38e63e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733860 Sep 18 01:17:30.905355 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1640/3386] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:17:30 2022] POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:30.912839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:30.914353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:30.924436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:30.925220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:30.925933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:30.927367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:30.928077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:30.928790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:30.998056 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lazy-loading 'flavor' on Instance uuid 4eb07fa2-83c3-452e-9777-fd357c981454 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:17:31.138266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:31.154762 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d41d020-62a4-4bef-8dfc-8b2b3b80383c tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1508 microversion: 2.1 time: 0.958075 Sep 18 01:17:31.180134 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1747/3387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:30 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1508 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:31.195296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:31.202962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:31.225247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:31.230453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:31.234532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:31.235577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:31.236506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:31.237197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:31.321014 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:31.716059 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d7ab3668-0a13-4b6a-966c-255ef943824b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/action" status: 202 len: 0 microversion: 2.20 time: 0.806580 Sep 18 01:17:31.728282 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1641/3388] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:17:30 2022] POST /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:17:31.749370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b122eef-a788-4719-911b-5ce5293a96a7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053c0d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:31.895740 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b122eef-a788-4719-911b-5ce5293a96a7 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 0.162154 Sep 18 01:17:31.902140 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1642/3389] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:31 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:31.924749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:31.927550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:31.952904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:31.960314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:31.963400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:31.969689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:31.971152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:31.972370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:31.986412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:31.996397 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83ac918a-8106-41e6-bacf-1c497575d2a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 0.814762 Sep 18 01:17:32.001874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1748/3390] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:31 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:32.204791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:32.205844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:32.227647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:32.228158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:32.228638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:32.229370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:32.232939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:32.233771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:33.107247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:33.128079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:33.131759 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3cdc219-8979-4c98-841b-e32fd3b4dd11 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1508 microversion: 2.1 time: 0.916074 Sep 18 01:17:33.137474 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1749/3391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:32 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1508 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:33.140366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:33.146031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9797b238-4867-492a-bf20-2efe131fee17 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70054325e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:33.148366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:33.150127 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb955de7-1c5c-4d38-8bde-5c3adbf15b25 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 1.245004 Sep 18 01:17:33.154943 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1643/3392] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:31 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:33.175599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:33.179435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:33.192935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:33.193448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:33.193923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:33.209138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:33.219150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:33.219722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:33.368936 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9797b238-4867-492a-bf20-2efe131fee17 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 0.230149 Sep 18 01:17:33.369611 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1750/3393] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:33 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:34.172746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:34.181644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:34.231009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:34.231916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:34.232652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:34.258558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:34.264652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:34.282111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:35.240930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:35.268114 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bddde0e-2825-4bbc-98f6-9dee91310f9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 2.108176 Sep 18 01:17:35.271431 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1644/3394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:33 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:35.290770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:35.293157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:35.319524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:35.327965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:35.333022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:35.334701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:35.336201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:35.337305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:35.461957 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:36.358271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:36.368770 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-864b1519-49d5-4486-8f75-a40900257bbf tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1508 microversion: 2.1 time: 2.204134 Sep 18 01:17:36.369727 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1751/3395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:34 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1508 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:36.403580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-364348ee-6244-4cbe-ac23-d847807ba307 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7006ec24c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:36.516705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:36.528820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:36.531112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:36.535747 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d33d5c5-0cd3-4012-9382-3220fdcace40 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 1.262160 Sep 18 01:17:36.538908 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1645/3396] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:35 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:36.548856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:36.551126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:36.566556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:36.567381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:36.570031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:36.571018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:36.571670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:36.574409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:36.886624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:36.897748 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13d5ff15-888d-4a99-8233-460158b584a8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 0.357518 Sep 18 01:17:36.909812 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1646/3397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:36 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:36.914898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-266ca76e-1242-4e9a-b31e-b9aea86be3a3 req-63f014b9-7471-4f92-a8cd-759cf16ea7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3", "name": "network-vif-deleted", "tag": "9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:36.980770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-266ca76e-1242-4e9a-b31e-b9aea86be3a3 req-63f014b9-7471-4f92-a8cd-759cf16ea7af service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:36.981285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-266ca76e-1242-4e9a-b31e-b9aea86be3a3 req-63f014b9-7471-4f92-a8cd-759cf16ea7af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:36.981754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-266ca76e-1242-4e9a-b31e-b9aea86be3a3 req-63f014b9-7471-4f92-a8cd-759cf16ea7af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:37.036101 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-266ca76e-1242-4e9a-b31e-b9aea86be3a3 req-63f014b9-7471-4f92-a8cd-759cf16ea7af service nova] Creating event network-vif-deleted:9f50f97c-85fd-4ebb-aafb-b116b1b9dfa9 for instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 on n-h2-master-1 Sep 18 01:17:37.073342 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-266ca76e-1242-4e9a-b31e-b9aea86be3a3 req-63f014b9-7471-4f92-a8cd-759cf16ea7af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153472 Sep 18 01:17:37.075119 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1647/3398] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:37.395822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:37.396557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:37.427400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:37.432123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:37.439200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:37.448100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:37.452836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:37.456670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:37.582680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:37.584835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:37.586210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:37.588292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lazy-loading 'fault' on Instance uuid b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:17:37.931722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914730a7091a46bf8f438ad5755c1fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e7c4ce195e4e7baed225946f8d353e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:37.953152 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d597ffc9-19d8-4bda-91c9-5aef64e198d6 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 200 len: 1313 microversion: 2.1 time: 0.563033 Sep 18 01:17:37.962743 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1648/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:37 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:37.992087 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:38.001047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:38.017267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:38.021584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:38.022493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:38.023555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:38.024354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:38.026230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:39.361261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:39.372518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:39.401290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:39.408499 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-62eb6be6-f5b7-4cb4-800c-e1ab04a1adb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 1.438024 Sep 18 01:17:39.409164 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1649/3400] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:37 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:39.455557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-aeaa3b74-0f01-42a0-9834-4e3324821d8e req-c95d20d5-847e-4d3f-aaf9-c066e46f63e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a21ef3d-97ba-40ad-b574-72a10a149eac", "name": "network-vif-plugged", "status": "completed", "tag": "31cfae35-0642-49fe-8133-54e05e4f2311"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:39.521480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aeaa3b74-0f01-42a0-9834-4e3324821d8e req-c95d20d5-847e-4d3f-aaf9-c066e46f63e8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:39.523399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aeaa3b74-0f01-42a0-9834-4e3324821d8e req-c95d20d5-847e-4d3f-aaf9-c066e46f63e8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:39.524604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aeaa3b74-0f01-42a0-9834-4e3324821d8e req-c95d20d5-847e-4d3f-aaf9-c066e46f63e8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:39.564613 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-aeaa3b74-0f01-42a0-9834-4e3324821d8e req-c95d20d5-847e-4d3f-aaf9-c066e46f63e8 service nova] Creating event network-vif-plugged:31cfae35-0642-49fe-8133-54e05e4f2311 for instance 3a21ef3d-97ba-40ad-b574-72a10a149eac on n-h2-master-1 Sep 18 01:17:39.574982 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-aeaa3b74-0f01-42a0-9834-4e3324821d8e req-c95d20d5-847e-4d3f-aaf9-c066e46f63e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150605 Sep 18 01:17:39.581326 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1650/3401] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:39.587506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:39.592205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:39.609190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:39.610150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:39.614604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:39.615893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:39.617703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:39.618344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:40.427826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:40.443037 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-738b1a79-fc5c-44c2-9426-bff12a07e257 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 0.857947 Sep 18 01:17:40.444854 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1651/3402] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:39 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:40.456712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:40.469997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] [instance: b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:40.482525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:40.495546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:40.496439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:40.497429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:40.498162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:40.498848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:40.571815 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] HTTP exception thrown: Instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 could not be found. Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Request method failure captured: Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 HTTP/1.1 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnE-AXdbkJqCF_6FpoqpgxKrVI_hNrfMKoKcTA9piO5QhlLWKWKXzJrT1ZwX4xHxWCrAJA7PUWOzCbfXCtYgyci80r_WJ56kpHHfD4RY6vteWmel-iNvv40RscRGQEsGb36ivT1Y4CfivWZWjL0_uaH9Sm9oazu7eLG_X_dGCWfpEg8 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 14e7c4ce195e4e7baed225946f8d353e Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-167664426 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14e7c4ce195e4e7baed225946f8d353e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14e7c4ce195e4e7baed225946f8d353e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14e7c4ce195e4e7baed225946f8d353e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14e7c4ce195e4e7baed225946f8d353e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-167664426 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 14e7c4ce195e4e7baed225946f8d353e Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-167664426 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerRescueTestJSONUnderV235-167664426-project Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 914730a7091a46bf8f438ad5755c1fb9 Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-167664426-project Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: exception: Instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 could not be found. Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3'} Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 could not be found. Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 could not be found. Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:40.591682 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 could not be found. Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] Returning 404 to user: Instance b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:17:40.599270 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54f35c46-c315-440c-9905-bb880c1e4a47 tempest-ServerRescueTestJSONUnderV235-167664426 tempest-ServerRescueTestJSONUnderV235-167664426-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3" status: 404 len: 111 microversion: 2.1 time: 0.145724 Sep 18 01:17:40.603671 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1652/3403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:40 2022] GET /compute/v2.1/servers/b2ccd428-1bc4-4cbe-aaaf-fbf43e5f28e3 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:17:40.619918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:40.620245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:40.677262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:40.683577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:40.684113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:40.684890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:40.685470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:40.692735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:41.655867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:41.679541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:41.691499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:41.693312 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ee5034c-b7fb-476a-b815-5fe84c966c88 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 1.092600 Sep 18 01:17:41.694574 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1653/3404] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:40 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:42.148748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed8db45d-15bd-433d-88d0-a33b5ca44e48 tempest-FloatingIPDetailsNegativeTestJSON-1043820068 tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project] Calling method '.version_select at 0x7f70053c18b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:42.761121 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-ed8db45d-15bd-433d-88d0-a33b5ca44e48 tempest-FloatingIPDetailsNegativeTestJSON-1043820068 tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 75652e6e-48b1-4fc6-af4c-f7054b48f157 could not be found", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:17:42.767084 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ed8db45d-15bd-433d-88d0-a33b5ca44e48 tempest-FloatingIPDetailsNegativeTestJSON-1043820068 tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project] HTTP exception thrown: Floating IP not found for ID 75652e6e-48b1-4fc6-af4c-f7054b48f157 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed8db45d-15bd-433d-88d0-a33b5ca44e48 tempest-FloatingIPDetailsNegativeTestJSON-1043820068 tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project] Request method failure captured: Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-floating-ips/75652e6e-48b1-4fc6-af4c-f7054b48f157 HTTP/1.1 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnG0UFXuoXaPm4X3wj8ZHIeBcnjqDlHMPxTmFcZlDKVnXB3yXYRL8aBJ0N8zC0ic1tX0Z9caiwcMehTD9J4fM3U5ddISZOo_ap-mGXWWYQ63XGtW5-6vCSKHA9bFqLXB4hGJiJMpWHSiELZHaxsLJv8NagN3i3otW5I2NA_k4CCLiSg Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d814d4d56fd543b2babd38ac06ca1fee Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1043820068 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d814d4d56fd543b2babd38ac06ca1fee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d814d4d56fd543b2babd38ac06ca1fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d814d4d56fd543b2babd38ac06ca1fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d814d4d56fd543b2babd38ac06ca1fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1043820068 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d814d4d56fd543b2babd38ac06ca1fee Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1043820068 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: bd779b7820cf44df80ea569486d00a4e Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: exception: Floating IP not found for ID 75652e6e-48b1-4fc6-af4c-f7054b48f157 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '75652e6e-48b1-4fc6-af4c-f7054b48f157'} Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:17:42.770516 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 75652e6e-48b1-4fc6-af4c-f7054b48f157 could not be found Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-798711ac-465c-494a-8b8c-16ab4aeedde1'] Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 75652e6e-48b1-4fc6-af4c-f7054b48f157. Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 75652e6e-48b1-4fc6-af4c-f7054b48f157 Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 75652e6e-48b1-4fc6-af4c-f7054b48f157 Sep 18 01:17:42.778737 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:17:42.787732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed8db45d-15bd-433d-88d0-a33b5ca44e48 tempest-FloatingIPDetailsNegativeTestJSON-1043820068 tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project] Returning 404 to user: Floating IP not found for ID 75652e6e-48b1-4fc6-af4c-f7054b48f157 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:17:42.793900 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed8db45d-15bd-433d-88d0-a33b5ca44e48 tempest-FloatingIPDetailsNegativeTestJSON-1043820068 tempest-FloatingIPDetailsNegativeTestJSON-1043820068-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/75652e6e-48b1-4fc6-af4c-f7054b48f157" status: 404 len: 111 microversion: 2.1 time: 1.084908 Sep 18 01:17:42.796184 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1654/3405] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:17:41 2022] GET /compute/v2.1/os-floating-ips/75652e6e-48b1-4fc6-af4c-f7054b48f157 => generated 111 bytes in 1101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:17:42.827167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:42.832622 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:42.862341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:42.862902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:42.863458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:42.865477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:42.866268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:42.871064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:43.758497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:43.785270 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bda8f281-43fd-4695-a186-f2bdb1ad1c1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 0.987116 Sep 18 01:17:43.801992 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1655/3406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:42 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:43.827882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:43.828521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:43.848156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:43.854371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:43.857188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:43.859118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:43.865943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:43.866588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:44.208963 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:45.180552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:45.194398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:45.213212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:45.229905 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-041f9858-d8c1-44f8-8198-eee8c99c596b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 1.420146 Sep 18 01:17:45.230916 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1656/3407] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:43 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:45.245435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:45.252872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:45.278530 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=57 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:45.283792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:45.287635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:45.289817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:45.294139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:45.296927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:45.301904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:46.366117 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=17 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:46.821545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:46.832499 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4908ef86-0671-4fee-91cf-ba600e6b1088 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 1.599279 Sep 18 01:17:46.841968 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1657/3408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:45 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:46.853604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:46.854286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:46.883942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:46.884491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:46.884938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:46.885690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:46.886149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:46.886574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:47.373259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:47.388915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:47.390430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:47.391641 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-70e9b94c-aaf8-4de4-96be-dc33d5b1c7b7 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 0.548608 Sep 18 01:17:47.392217 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1658/3409] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:46 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:47.863278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:47.866472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:47.898113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:47.899444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:47.900426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:47.901391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:47.911928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:47.912685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:49.051689 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:49.068868 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-597dc6fc-ebfa-4bf8-a74f-2f58d0b09098 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 1.203788 Sep 18 01:17:49.069588 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1659/3410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:47 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:49.094038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:49.094733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:49.112124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:49.112646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:49.118527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:49.127662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:49.128253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:49.128705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:50.612810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:50.640058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:50.643126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:50.645009 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc61844e-247e-4d96-8e04-4af9753b0b76 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 1.574553 Sep 18 01:17:50.648784 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1660/3411] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:49 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:50.664161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:50.665065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:50.683805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:50.685080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:50.685744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:50.686672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:50.691069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:50.691783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:51.705316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:51.730940 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4697df28-66fe-4ecd-b9fe-418a4b50ac6f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 1.080816 Sep 18 01:17:51.732179 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1661/3412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:50 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:51.740806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:51.750517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:51.766323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:51.767059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:51.767701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:51.768738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:51.776347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:51.776783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:52.675170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:52.692324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:52.693913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:52.695592 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-10d8b488-70cb-4d7a-b5a4-f0a30190af9c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 0.961976 Sep 18 01:17:52.696614 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1662/3413] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:51 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:52.755961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:52.756670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:52.772097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:52.772978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:52.773778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:52.775449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:52.775997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:52.776551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:53.491403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:53.503569 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-240ef75f-737e-4969-9611-47f4b02376ae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1680 microversion: 2.1 time: 0.751422 Sep 18 01:17:53.507430 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1663/3414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:52 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1680 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:53.540065 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-364348ee-6244-4cbe-ac23-d847807ba307 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 17.149545 Sep 18 01:17:53.549765 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1752/3415] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:36 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 17179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:53.731759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:53.733444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:53.751652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:53.754017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:53.755969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:53.757148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:53.760346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:53.761416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:53.822051 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:17:54.528542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:54.534365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:54.535049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:54.546993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:54.548626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:54.555540 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fdeea6c1-81e4-4fbd-a948-78006756632b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 0.828186 Sep 18 01:17:54.568804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:54.570354 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1664/3416] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:53 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:54.573771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:54.574505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:54.580091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:54.583734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:54.586715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1bc135a5-b77f-4142-9745-b48317854cc0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053c98b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:54.587635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:55.257582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:55.281009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-036083a2-8c3e-4334-a306-6a9944bdf60c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.750794 Sep 18 01:17:55.294549 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1753/3417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:54 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:55.301836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73c60748-7a17-4042-b21e-464d3ab9b56a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:55.311898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73c60748-7a17-4042-b21e-464d3ab9b56a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:55.313872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73c60748-7a17-4042-b21e-464d3ab9b56a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:55.314392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73c60748-7a17-4042-b21e-464d3ab9b56a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:55.406740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-73c60748-7a17-4042-b21e-464d3ab9b56a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Going to try to stop instance {{(pid=122374) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:17:55.517786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-73c60748-7a17-4042-b21e-464d3ab9b56a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action" status: 202 len: 0 microversion: 2.1 time: 0.231918 Sep 18 01:17:55.520189 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1754/3418] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:17:55 2022] POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:17:55.543393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:55.545036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:55.578126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:55.579232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:55.579834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:55.580718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:55.581354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:55.585151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:56.043589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:56.069983 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2c0d575-389e-4b60-b94c-0760f6303bb0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.538941 Sep 18 01:17:56.097280 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1755/3419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:55 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:56.122599 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:56.123369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:56.148681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:56.158083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:56.161041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:56.166105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:56.176373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:56.176373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:56.210061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1bc135a5-b77f-4142-9745-b48317854cc0 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 1.638385 Sep 18 01:17:56.220556 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1665/3420] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:54 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:56.289600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:56.291661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:56.306332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:56.309301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:56.310018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:56.310980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:56.311735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:56.312445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:57.234551 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:57.257715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:57.264035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:57.272471 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f98ca591-f85f-422e-8bf3-7c41757c2d1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1743 microversion: 2.20 time: 1.173674 Sep 18 01:17:57.274043 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1756/3421] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:56 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1743 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:17:57.295264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:57.296232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:57.323647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:57.324367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:57.325088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:57.325893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:57.326423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:57.326990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:57.347566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:57.365927 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3df29ecb-0820-4f17-b105-e9e7bde87223 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.080894 Sep 18 01:17:57.370366 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1666/3422] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:56 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:57.392152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48f05b9a-2671-4de7-bc4f-ae76bf298eba"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:57.395249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:57.417304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:57.418034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:57.418890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:57.420467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:57.421200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:57.421896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:58.111204 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c42e49b1-c730-4fe9-938f-bb9d1b2bb373 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736963 Sep 18 01:17:58.114528 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1667/3423] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:17:57 2022] POST /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:17:58.141528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1fee6ce9-8adb-4a7e-9983-6da1ca9eff88 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7005e5a3a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:58.192330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:58.266759 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7f122e27-cb5b-44e1-9f32-0c06a492af25 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.977480 Sep 18 01:17:58.272375 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1757/3424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:57 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:17:58.324609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:58.325396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:58.339319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:58.341145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:58.341914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:58.348164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:58.348895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:58.349439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:58.765468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:58.800240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:58.801884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:58.803623 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0e3ed8ac-4805-4686-a523-ad8f1dd88d8c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1743 microversion: 2.20 time: 0.492542 Sep 18 01:17:58.818886 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1758/3425] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:58 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1743 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:17:58.895380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-42daeffc-bfbb-421c-b02a-8b4d93905127 req-0afba25b-e118-4875-884f-e917688bb290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:17:58.911671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-42daeffc-bfbb-421c-b02a-8b4d93905127 req-0afba25b-e118-4875-884f-e917688bb290 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:58.912436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-42daeffc-bfbb-421c-b02a-8b4d93905127 req-0afba25b-e118-4875-884f-e917688bb290 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:58.913176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-42daeffc-bfbb-421c-b02a-8b4d93905127 req-0afba25b-e118-4875-884f-e917688bb290 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:58.950907 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-42daeffc-bfbb-421c-b02a-8b4d93905127 req-0afba25b-e118-4875-884f-e917688bb290 service nova] Creating event network-vif-unplugged:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:17:58.977985 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-42daeffc-bfbb-421c-b02a-8b4d93905127 req-0afba25b-e118-4875-884f-e917688bb290 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085922 Sep 18 01:17:58.981840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1759/3426] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:17:59.319434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:59.320184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:59.333872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:59.339069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:59.343042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:59.348329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:59.349103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:59.350310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:59.755089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:17:59.777927 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a101f2df-3524-4d71-bd2a-95b1f57dbdae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.463031 Sep 18 01:17:59.784189 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1760/3427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:17:59 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:17:59.848403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:17:59.849022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:17:59.896885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:59.897415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:59.897894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:17:59.898657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:17:59.899123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:17:59.900097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:00.246402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:00.270144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:00.272440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:00.277544 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2fcf14b3-742b-4a08-a408-066bc29d4135 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.429506 Sep 18 01:18:00.296301 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1761/3428] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:17:59 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:18:00.720165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:00.721489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:00.737225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1fee6ce9-8adb-4a7e-9983-6da1ca9eff88 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1429 microversion: 2.1 time: 2.615453 Sep 18 01:18:00.738740 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1668/3429] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:17:58 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1429 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:00.744346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:00.744856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:00.745294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:00.755865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:00.756364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:00.756802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:00.812189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:00.813088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:00.831116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:00.831980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:00.834124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:00.835060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:00.837570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:00.843768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:01.234485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:01.245099 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-29d86b96-62ba-488c-bc02-3c4b89ba19f2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.529334 Sep 18 01:18:01.267106 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1762/3430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:00 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:01.275614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:01.285921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ab38521f-8179-47a0-b224-92347df5c222 req-8e771c78-48d8-4c26-8895-9f7050bff078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "name": "network-vif-plugged", "status": "completed", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:01.297744 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-730f79ac-53fb-443a-b590-2788b53ed427 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.489303 Sep 18 01:18:01.298853 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1669/3431] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:00 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:01.309502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:01.314206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ab38521f-8179-47a0-b224-92347df5c222 req-8e771c78-48d8-4c26-8895-9f7050bff078 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:01.314612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:01.317504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ab38521f-8179-47a0-b224-92347df5c222 req-8e771c78-48d8-4c26-8895-9f7050bff078 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:01.319379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ab38521f-8179-47a0-b224-92347df5c222 req-8e771c78-48d8-4c26-8895-9f7050bff078 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:01.328514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:01.332089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:01.334306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:01.336743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:01.337996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:01.342808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:01.350504 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ab38521f-8179-47a0-b224-92347df5c222 req-8e771c78-48d8-4c26-8895-9f7050bff078 service nova] Creating event network-vif-plugged:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h2-master-1 Sep 18 01:18:01.371762 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ab38521f-8179-47a0-b224-92347df5c222 req-8e771c78-48d8-4c26-8895-9f7050bff078 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096007 Sep 18 01:18:01.377607 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1763/3432] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:01.398899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:01.400717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:01.431489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:01.431996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:01.435437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:01.439673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:01.442471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:01.442636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:01.900803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:01.920023 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fc03bd5-8761-4c5f-b8c9-fabbf254e28d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.611554 Sep 18 01:18:01.923872 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1670/3433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:01 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:01.953200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-58b9c056-5056-449f-880b-0581002bbc05 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70053d6ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:02.015413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:02.060618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:02.062766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:02.064420 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e4f0788-e6d8-4770-ac07-186ca3048c1b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.685188 Sep 18 01:18:02.086386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1764/3434] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:01 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:02.091849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:02.092470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:02.117879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:02.119182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:02.119815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:02.120900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:02.121859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:02.122673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:02.543840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:02.554890 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e69b504-9b0b-403b-b0d5-5e303f09a75a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.466908 Sep 18 01:18:02.564303 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1765/3435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:02 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:02.590200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:02.594861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:02.617745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:02.622296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:02.624881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:02.632684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:02.638319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:02.640829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:03.264011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:03.282515 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-571182a0-e663-4aef-b9b3-4addd6440507 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.716025 Sep 18 01:18:03.283282 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1766/3436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:02 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:03.304068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:03.307328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:03.323623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:03.324140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:03.324587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:03.336070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:03.336755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:03.337230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:03.640002 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5db27a9-afe1-49a2-9e01-ecc359dd0eae tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.354085 Sep 18 01:18:03.650436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1767/3437] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:18:03 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:18:03.663478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:03.664405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:03.691400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:03.693691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:03.698908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:03.699833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:03.700475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:03.701067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:03.879113 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-58b9c056-5056-449f-880b-0581002bbc05 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1438 microversion: 2.1 time: 1.937593 Sep 18 01:18:03.881844 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1671/3438] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:01 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1438 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:03.904868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:03.907372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:03.923215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:03.926358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:03.927494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:03.938037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:03.945447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:03.948538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:04.618886 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:04.626416 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:04.651404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:04.662261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:04.678952 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e5e2ddf1-d9c0-4529-868c-740495a82323 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 1.025859 Sep 18 01:18:04.693600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1768/3439] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:03 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:04.710362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11fa3a0f-d6bd-4039-95e2-d369bc24fac4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f7005e54310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:05.425902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:05.438075 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-84ed9af1-3277-4613-8d92-b2dd2c08abbe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1669 microversion: 2.1 time: 1.552404 Sep 18 01:18:05.439191 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1672/3440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:03 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1669 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:05.453830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:05.455000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:05.467615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:05.468405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:05.470607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:05.480307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:05.482207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:05.482970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:05.721792 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11fa3a0f-d6bd-4039-95e2-d369bc24fac4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 200 len: 1438 microversion: 2.1 time: 1.031180 Sep 18 01:18:05.731921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1769/3441] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:04 2022] GET /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 1438 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:05.731921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ba57797-8a68-4d38-8da3-05c03c87efd7 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f70071f9b80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:05.811197 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ba57797-8a68-4d38-8da3-05c03c87efd7 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c" status: 200 len: 637 microversion: 2.1 time: 0.084741 Sep 18 01:18:05.820897 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1770/3442] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:05 2022] GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c => generated 637 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:05.823995 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:05.824623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:05.838030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:05.838552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:05.839189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:05.842903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:05.843398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:05.843842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:05.954604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:05.965434 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-da567bf5-edf2-466d-bba9-5770cb201d6e tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.525031 Sep 18 01:18:05.985888 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1673/3443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:05 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:05.992503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:05.993468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:06.000977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:06.001792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:06.002447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:06.003351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:06.003985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:06.004580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:06.975049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:06.988243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e479f2f-9d13-4901-82a4-e4b623e669de tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1464 microversion: 2.1 time: 1.000869 Sep 18 01:18:07.013403 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1674/3444] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:05 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1464 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:07.021723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d6863de-58d4-4ceb-bde2-97a2ef1f4170 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update_all', calling method: .version_select at 0x7f70053a4d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:07.066098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:07.086078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:07.088604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:07.095277 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b7681fb6-ab3f-4f8a-b2a0-91b3b0111670 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 1.281900 Sep 18 01:18:07.101923 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1771/3445] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:05 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:07.112094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:07.116852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:07.138812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:07.144370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:07.146547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:07.147673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:07.149078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3d6863de-58d4-4ceb-bde2-97a2ef1f4170 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:07.152427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:07.154944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:07.172574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3d6863de-58d4-4ceb-bde2-97a2ef1f4170 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:07.651853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:07.661801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e5c0c34c-7531-4b2c-ba6b-120aafee29e8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1674 microversion: 2.1 time: 0.558470 Sep 18 01:18:07.689105 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1772/3446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:07 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1674 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:07.695426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:07.699764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:07.713373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:07.723976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:07.724430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:07.725185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:07.733822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:07.734423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:07.888179 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d6863de-58d4-4ceb-bde2-97a2ef1f4170 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.873049 Sep 18 01:18:07.889038 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1675/3447] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:18:07 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 61 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:07.894201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11ae0a0f-22b5-4947-aa1d-d6c99ff9a61a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f70062a1b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:08.144840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:08.157951 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b8c1735-c7ac-4fc8-912e-9936b91ef69f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.467240 Sep 18 01:18:08.182982 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1773/3448] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:07 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:08.188650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-888d41a9-62f5-4f3a-a8b2-586490f037e2 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f700646cd30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:08.940548 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11ae0a0f-22b5-4947-aa1d-d6c99ff9a61a tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "DELETE /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2" status: 204 len: 0 microversion: 2.1 time: 1.050239 Sep 18 01:18:08.945616 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1676/3449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:07 2022] DELETE /compute/v2.1/images/c43fcb68-b383-4f9c-9e60-182f529feed2 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:18:08.954292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:08.970782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:08.985229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:09.007697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:09.011055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:09.012216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:09.014582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:09.017722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:09.328486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:09.341736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:09.348944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:09.352971 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e627855-571b-4f5a-9f11-0eb33cd45810 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.404797 Sep 18 01:18:09.378131 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1677/3450] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:08 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:09.387889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ab405786-4289-4870-ad76-c14906b2a155 req-6f498a18-04a1-445a-9c69-aeb162aea333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a21ef3d-97ba-40ad-b574-72a10a149eac", "name": "network-vif-unplugged", "status": "completed", "tag": "31cfae35-0642-49fe-8133-54e05e4f2311"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:09.412997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ab405786-4289-4870-ad76-c14906b2a155 req-6f498a18-04a1-445a-9c69-aeb162aea333 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:09.413461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ab405786-4289-4870-ad76-c14906b2a155 req-6f498a18-04a1-445a-9c69-aeb162aea333 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:09.417028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ab405786-4289-4870-ad76-c14906b2a155 req-6f498a18-04a1-445a-9c69-aeb162aea333 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:09.434742 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-888d41a9-62f5-4f3a-a8b2-586490f037e2 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "DELETE /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 1.250533 Sep 18 01:18:09.435608 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1774/3451] 10.222.0.25 () {58 vars in 1296 bytes} [Sun Sep 18 01:18:08 2022] DELETE /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata/os_version => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:18:09.440332 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ab405786-4289-4870-ad76-c14906b2a155 req-6f498a18-04a1-445a-9c69-aeb162aea333 service nova] Creating event network-vif-unplugged:31cfae35-0642-49fe-8133-54e05e4f2311 for instance 3a21ef3d-97ba-40ad-b574-72a10a149eac on n-h2-master-1 Sep 18 01:18:09.440633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:09.441260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:09.449890 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ab405786-4289-4870-ad76-c14906b2a155 req-6f498a18-04a1-445a-9c69-aeb162aea333 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070177 Sep 18 01:18:09.451198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1678/3452] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:09.456756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46bfc29f-4e47-455c-94a8-5c774832f5d4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '.version_select at 0x7f700540da60>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:09.465661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:09.466297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:09.466747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:09.467479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:09.470994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:09.471444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:09.483243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-46bfc29f-4e47-455c-94a8-5c774832f5d4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] HTTP exception thrown: Image not found. Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46bfc29f-4e47-455c-94a8-5c774832f5d4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Request method failure captured: Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 HTTP/1.1 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFbtDb2cKszU7nj-4gWL0cUHGNxpe7HqQtYYb1W3JXoNfCZdjXHe1wRNoB2AsmB_K-Fyzu01qYeeAxsSlyAJh2PrKGb0QaU1zSmHmO9biLmYUQ4IazOz8JvqCc9ig6CyJivi41n14sx-_uea3I0UB-_whuEhArLoENBE2lcBpPTpGM Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 6db9c6b25fe3493a80c7c9b1217c4bc0 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 6db9c6b25fe3493a80c7c9b1217c4bc0 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ImagesOneServerTestJSON-1784278378-project Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cbf3a969568d469881994b9486788ac1 Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ImagesOneServerTestJSON-1784278378-project Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: exception: Image not found. Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '02ab689c-55d1-4134-ba0d-d6fa2e754b74'} Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 02ab689c-55d1-4134-ba0d-d6fa2e754b74 to delete Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02ab689c-55d1-4134-ba0d-d6fa2e754b74 could not be found. Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:09.485383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 18 01:18:09.490896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:09.494180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46bfc29f-4e47-455c-94a8-5c774832f5d4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Returning 404 to user: Image not found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:18:09.495224 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46bfc29f-4e47-455c-94a8-5c774832f5d4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "DELETE /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74" status: 404 len: 62 microversion: 2.1 time: 0.042712 Sep 18 01:18:09.496649 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1679/3453] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:09 2022] DELETE /compute/v2.1/images/02ab689c-55d1-4134-ba0d-d6fa2e754b74 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:18:09.503428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:09.504402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:09.512093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:09.513298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:09.514136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:09.515049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:09.515740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:09.516337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:09.986000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:09.994146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:09.998014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e49c68c-8793-46eb-b0f1-02c5761b5b18 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 0.500089 Sep 18 01:18:10.007697 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28dc1f12-cf6c-443b-bda6-78d7d2bc33c0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1674 microversion: 2.1 time: 0.570961 Sep 18 01:18:10.011858 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1775/3454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:09 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1674 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:10.018535 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1680/3455] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:09 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:10.028332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a41a2b05-cd14-4457-864d-9e3b0ca76186 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f7005e545e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:10.034368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:10.035245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:10.059600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:10.064147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:10.066132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:10.067286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:10.074442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:10.075986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:10.116405 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a41a2b05-cd14-4457-864d-9e3b0ca76186 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.103658 Sep 18 01:18:10.117088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1776/3456] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:18:10 2022] GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 37 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:10.127542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d6aec0b-7680-48e7-aa37-0b2b04a94239 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update_all', calling method: .version_select at 0x7f700a82f790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:10.167635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:18:10.222735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1d6aec0b-7680-48e7-aa37-0b2b04a94239 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:10.236474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1d6aec0b-7680-48e7-aa37-0b2b04a94239 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:10.398706 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72ee4fb5-b332-4809-98d0-18ad9242c676 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 204 len: 0 microversion: 2.1 time: 0.377254 Sep 18 01:18:10.401898 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1681/3457] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:18:10 2022] DELETE /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:18:10.420032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:10.420773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:10.436592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:10.437134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:10.437606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:10.438582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:10.439056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:10.439545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:11.067301 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d6aec0b-7680-48e7-aa37-0b2b04a94239 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.943689 Sep 18 01:18:11.075349 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1777/3458] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:18:10 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 61 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:18:11.082397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:11.099629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:11.119938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:11.122075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:11.124178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:11.125473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:11.127205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:11.128085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:11.160732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:11.182111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:11.190924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:11.199680 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98e603f7-3462-49b8-80d3-f4378039a10d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.796321 Sep 18 01:18:11.209349 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1682/3459] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:10 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:11.215275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:11.229053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:11.247284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:11.252813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:11.253397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:11.254286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:11.256268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:11.257481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:11.835614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:11.861278 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4851a4fb-d10f-4a68-a890-1de88ae7782e tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1470 microversion: 2.1 time: 0.783895 Sep 18 01:18:11.861844 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1778/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:11 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1470 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:11.901580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:11.902219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:11.925220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:11.925754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:11.926207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:11.926929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:11.927391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:11.927817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:12.764029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:12.780496 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94ee55cf-87e0-46ac-a3b0-e21721b402aa tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 1.569586 Sep 18 01:18:12.790701 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1683/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:11 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:12.806465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ea969f3-c7bd-4261-96d9-15c23ac198a5 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f700541d8b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:12.916401 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ea969f3-c7bd-4261-96d9-15c23ac198a5 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.124174 Sep 18 01:18:12.929307 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1684/3462] 10.222.0.25 () {58 vars in 1290 bytes} [Sun Sep 18 01:18:12 2022] GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata/os_distro => generated 33 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:12.943038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:12.943717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:12.966767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:12.969443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:12.971148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:12.976199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:12.976768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:12.977310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:13.497505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:13.509235 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7b110800-44f4-41cf-b94f-568e4f7509cf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1674 microversion: 2.1 time: 1.642874 Sep 18 01:18:13.529682 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1779/3463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:11 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1674 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:13.546237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:13.547338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:13.554928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:13.555692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:13.556246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:13.557361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:13.557962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:13.558503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:14.404773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:14.420580 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a27c41df-9137-4fea-9951-1c6c7498d2f4 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1470 microversion: 2.1 time: 0.892839 Sep 18 01:18:14.422206 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1780/3464] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:13 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1470 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:14.443736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-674f44f6-9c35-4b3c-ada2-66a421824c7c tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update_all', calling method: .version_select at 0x7f7005492670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:14.604503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-674f44f6-9c35-4b3c-ada2-66a421824c7c tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:14.615248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:14.618061 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:14.642262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:14.652865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:14.654780 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-836fae09-49e4-48d5-8feb-2e3ef08e5b9f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 1.724157 Sep 18 01:18:14.656590 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1685/3465] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:12 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:14.663496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:14.666700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-674f44f6-9c35-4b3c-ada2-66a421824c7c tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:14.667662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:14.689241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:14.690177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:14.691178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:14.693728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:14.694597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:14.695499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:15.186308 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-674f44f6-9c35-4b3c-ada2-66a421824c7c tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.761888 Sep 18 01:18:15.191083 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1781/3466] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:18:14 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 61 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:15.197537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:15.199541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:15.215620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:15.216270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:15.216869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:15.218342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:15.221246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:15.222069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:15.772805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:15.791760 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aecc5174-ea25-4a02-a135-f2edb0077232 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1721 microversion: 2.1 time: 1.133906 Sep 18 01:18:15.797441 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1686/3467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:14 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1721 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:15.827241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-519fc1a8-cfd5-485b-bdb7-f39d8d1247d4 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f70053c0ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:15.941971 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-519fc1a8-cfd5-485b-bdb7-f39d8d1247d4 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.142903 Sep 18 01:18:15.943885 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1687/3468] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:18:15 2022] GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 61 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:15.964579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:15.965200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:15.984971 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:16.011367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:16.011870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:16.012459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:16.013176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:16.016822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:16.022579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:16.124069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:16.126817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:16.128204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:16.131887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lazy-loading 'fault' on Instance uuid 3a21ef3d-97ba-40ad-b574-72a10a149eac {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:18:16.188687 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:16.199976 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb95ac83-8172-4eec-89d1-a60d73fde241 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.007361 Sep 18 01:18:16.205484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1782/3469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:15 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:16.216906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e2cd0b54-69d3-41d1-a7e0-79e001a7a6c1 req-ea0aa6c9-7c2d-4e1b-b4a7-e10fa384ef0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a21ef3d-97ba-40ad-b574-72a10a149eac", "name": "network-vif-deleted", "tag": "31cfae35-0642-49fe-8133-54e05e4f2311"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:16.271881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e2cd0b54-69d3-41d1-a7e0-79e001a7a6c1 req-ea0aa6c9-7c2d-4e1b-b4a7-e10fa384ef0a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:16.272400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e2cd0b54-69d3-41d1-a7e0-79e001a7a6c1 req-ea0aa6c9-7c2d-4e1b-b4a7-e10fa384ef0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:16.272845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e2cd0b54-69d3-41d1-a7e0-79e001a7a6c1 req-ea0aa6c9-7c2d-4e1b-b4a7-e10fa384ef0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:16.314917 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e2cd0b54-69d3-41d1-a7e0-79e001a7a6c1 req-ea0aa6c9-7c2d-4e1b-b4a7-e10fa384ef0a service nova] Creating event network-vif-deleted:31cfae35-0642-49fe-8133-54e05e4f2311 for instance 3a21ef3d-97ba-40ad-b574-72a10a149eac on n-h2-master-1 Sep 18 01:18:16.323788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e2cd0b54-69d3-41d1-a7e0-79e001a7a6c1 req-ea0aa6c9-7c2d-4e1b-b4a7-e10fa384ef0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116668 Sep 18 01:18:16.324502 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1783/3470] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:16.338360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:16.339116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:16.391453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:16.396058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:16.398133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:16.399931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:16.401959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:16.402882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:16.541111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf3a969568d469881994b9486788ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db9c6b25fe3493a80c7c9b1217c4bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:16.554625 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3273bac-08f6-4ac5-984c-d98e68e74720 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 200 len: 1305 microversion: 2.1 time: 0.609573 Sep 18 01:18:16.555499 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1688/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:15 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 1305 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:16.578675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b95a6281-1ac9-413b-86cb-d66e3fadf408 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update_all', calling method: .version_select at 0x7f70053d0ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:16.736165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b95a6281-1ac9-413b-86cb-d66e3fadf408 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:16.746772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b95a6281-1ac9-413b-86cb-d66e3fadf408 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:17.078104 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b95a6281-1ac9-413b-86cb-d66e3fadf408 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.521265 Sep 18 01:18:17.078765 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1689/3472] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:18:16 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 61 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:17.084344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:17.103098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:17.120248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:17.131107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:17.135740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:17.136790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:17.137443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:17.138063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:17.215573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:17.225293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:17.227374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:17.229336 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-40805b3a-3811-43f5-baa7-efbfd5333a59 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.903482 Sep 18 01:18:17.230336 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1784/3473] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:16 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:17.235802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:17.236755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:17.244739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:17.245474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:17.246261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:17.255677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:17.256730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:17.257078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:17.262094 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb269c99-8887-4383-966f-a0f655cb945d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 200 len: 322 microversion: 2.1 time: 0.181083 Sep 18 01:18:17.266411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1690/3474] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:18:17 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:17.536687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-200631198", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:17.621129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:17.641145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] validate_networks() for [('443217fd-613c-4ff9-8148-2ed9e5504cb6', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:18:17.651093 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5ce727f0-319f-4323-9a60-b8f4081b1190 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1698 microversion: 2.1 time: 0.419395 Sep 18 01:18:17.651903 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1785/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:17 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1698 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:17.657616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db60b928-5914-4ee3-ad3c-7b74c274678f tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update_all', calling method: .version_select at 0x7f7006714040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:17.745469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-db60b928-5914-4ee3-ad3c-7b74c274678f tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:17.752830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-db60b928-5914-4ee3-ad3c-7b74c274678f tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:18.379044 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db60b928-5914-4ee3-ad3c-7b74c274678f tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.725365 Sep 18 01:18:18.386313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1786/3476] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:18:17 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 64 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:18.400221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:18.401437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:18.438478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:18.438984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:18.439430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:18.440158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:18.440622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:18.452275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:18.708845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:18:18.709434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:18:18.710212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:18:18.710810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:18:18.711383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:18:18.727944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:18.732614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:18.733380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:18.734686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:18.735390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:18.737109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:18.785099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Getting quotas for project 4436dd8d4d8e4a1d8c0e1948b7d767bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:18.803103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Getting quotas for user 9b90a04b7e9e424e93f3642f1b8f48b1 and project 4436dd8d4d8e4a1d8c0e1948b7d767bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:18.811690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:18.822984 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-33a5a005-f14c-42d1-a0ac-7b8cb7b93e7b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.435432 Sep 18 01:18:18.825122 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1787/3477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:18 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:18.829987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:18.830795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] [instance: 3a21ef3d-97ba-40ad-b574-72a10a149eac] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:18.836994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:18.837735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:18.838320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:18.839184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:18.839788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:18.840360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:18.858284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:18:18.860625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:18:18.891685 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] HTTP exception thrown: Instance 3a21ef3d-97ba-40ad-b574-72a10a149eac could not be found. Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Request method failure captured: Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac HTTP/1.1 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnFbtDb2cKszU7nj-4gWL0cUHGNxpe7HqQtYYb1W3JXoNfCZdjXHe1wRNoB2AsmB_K-Fyzu01qYeeAxsSlyAJh2PrKGb0QaU1zSmHmO9biLmYUQ4IazOz8JvqCc9ig6CyJivi41n14sx-_uea3I0UB-_whuEhArLoENBE2lcBpPTpGM Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 6db9c6b25fe3493a80c7c9b1217c4bc0 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6db9c6b25fe3493a80c7c9b1217c4bc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 6db9c6b25fe3493a80c7c9b1217c4bc0 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1784278378 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ImagesOneServerTestJSON-1784278378-project Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: cbf3a969568d469881994b9486788ac1 Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ImagesOneServerTestJSON-1784278378-project Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3a21ef3d-97ba-40ad-b574-72a10a149eac could not be found. Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3a21ef3d-97ba-40ad-b574-72a10a149eac'} Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a21ef3d-97ba-40ad-b574-72a10a149eac could not be found. Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a21ef3d-97ba-40ad-b574-72a10a149eac could not be found. Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:18.893372 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a21ef3d-97ba-40ad-b574-72a10a149eac could not be found. Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] Returning 404 to user: Instance 3a21ef3d-97ba-40ad-b574-72a10a149eac could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f007923-bcf4-4bd2-9c7b-0f7cbad887b1 tempest-ImagesOneServerTestJSON-1784278378 tempest-ImagesOneServerTestJSON-1784278378-project] 10.222.0.25 "GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac" status: 404 len: 111 microversion: 2.1 time: 0.068479 Sep 18 01:18:18.899307 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1788/3478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:18 2022] GET /compute/v2.1/servers/3a21ef3d-97ba-40ad-b574-72a10a149eac => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:18:18.924098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f3d22acf-2c22-46d6-ba55-b2bd811a97a3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:18.954211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3d22acf-2c22-46d6-ba55-b2bd811a97a3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:18.954707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3d22acf-2c22-46d6-ba55-b2bd811a97a3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:18.955147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3d22acf-2c22-46d6-ba55-b2bd811a97a3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:19.025587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f3d22acf-2c22-46d6-ba55-b2bd811a97a3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Going to try to start instance {{(pid=122374) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 01:18:19.071647 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6bb6d5f3-25aa-4a61-a4f5-afc31364271a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803909 Sep 18 01:18:19.072316 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1691/3479] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:18:19.096502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:19.100200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:19.113150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:19.113889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:19.114787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:19.116151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:19.116809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:19.118317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:19.186403 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f3d22acf-2c22-46d6-ba55-b2bd811a97a3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action" status: 202 len: 0 microversion: 2.1 time: 0.273681 Sep 18 01:18:19.192429 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1789/3480] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:18:18 2022] POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:18:19.198965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bbd391fd-0e21-436f-badb-523c25268737 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f7005e54310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:19.322369 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bbd391fd-0e21-436f-badb-523c25268737 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.128034 Sep 18 01:18:19.323527 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1790/3481] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:18:19 2022] GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 64 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:19.333156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:19.339467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:19.368924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:19.377245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:19.381219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:19.385365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:19.391878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:19.392670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:19.545839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:19.554818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:19.556388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:19.557605 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ad76166-a881-47d6-8d94-61ffb97ab367 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.480431 Sep 18 01:18:19.560095 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1692/3482] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:19 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:19.564739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cab68930-eb37-4402-b7ae-9b344fd513fa tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:19.565358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cab68930-eb37-4402-b7ae-9b344fd513fa tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:19.724666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cab68930-eb37-4402-b7ae-9b344fd513fa tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:19.736033 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cab68930-eb37-4402-b7ae-9b344fd513fa tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1216 microversion: 2.1 time: 0.173537 Sep 18 01:18:19.749579 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1693/3483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:19 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:19.749946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:19.751817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:19.754497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:19.757310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b759841-803f-469c-8b6e-9d73f6266125 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.432462 Sep 18 01:18:19.758002 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1791/3484] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:19 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:19.769812 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac6a214e-f5a7-4815-840f-f5fb91182003 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update_all', calling method: .version_select at 0x7f700a7c9670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:19.789695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:19.791410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:19.791952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:19.792754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:19.793289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:19.793983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:19.850597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ac6a214e-f5a7-4815-840f-f5fb91182003 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:19.862419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ac6a214e-f5a7-4815-840f-f5fb91182003 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:20.052802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:20.068436 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-630e9847-a40e-40f4-a582-e5335bf39aa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1707 microversion: 2.1 time: 0.327759 Sep 18 01:18:20.071488 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1694/3485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:19 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1707 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:20.084564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:20.087573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:20.106155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:20.106976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:20.107678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:20.108629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:20.111414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:20.112139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:20.170573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lazy-loading 'flavor' on Instance uuid 68599e5f-a57f-4820-b215-7ad064c4d1ad {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:18:20.480512 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-86c2b533-f716-4413-8377-e40883699e2d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/action" status: 200 len: 32 microversion: 2.1 time: 0.407551 Sep 18 01:18:20.490053 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1695/3486] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:18:20 2022] POST /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:20.530397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:20.531126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:20.568222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:20.568726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:20.569376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:20.570255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:20.571834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:20.572625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:20.725252 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac6a214e-f5a7-4815-840f-f5fb91182003 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.965650 Sep 18 01:18:20.726598 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1792/3487] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:18:19 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 61 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:20.735794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:20.736805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:20.753230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:20.757319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:20.758786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:20.762854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:20.770232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:20.771087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:21.527883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:21.544905 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bbbd92f1-1a73-40a6-9bf1-430f4f6e2c82 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.050653 Sep 18 01:18:21.557579 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1696/3488] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:20 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:21.568852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:21.570389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:21.589680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:21.592398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:21.593058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:21.594027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:21.595305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:21.599015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:21.614277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:21.632717 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dd0616da-6533-4eac-acc8-ff22cecfe545 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.904693 Sep 18 01:18:21.634998 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1793/3489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:20 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:21.646469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d9f5a64-9bc6-43cd-adf5-3104420ebe4d tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update', calling method: .version_select at 0x7f7005e54f70>, body: {"meta": {"os_version": "alt"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:21.756151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-9d9f5a64-9bc6-43cd-adf5-3104420ebe4d tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:21.787909 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:21.792595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-9d9f5a64-9bc6-43cd-adf5-3104420ebe4d tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:22.018281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:22.033128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:22.037636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:22.039173 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-faf5ed63-a84e-4f57-983d-6fe37b8f8061 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.490172 Sep 18 01:18:22.040815 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1697/3490] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:21 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:22.061266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:22.063120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:22.087910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:22.088890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:22.090300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:22.093462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:22.096883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:22.098105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:22.522819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:22.538587 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4bfa0934-b94a-4d2e-9344-4f4350ba3c24 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1276 microversion: 2.1 time: 0.492984 Sep 18 01:18:22.554805 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1698/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:22 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1276 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:22.562411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:22.567275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:22.588740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:22.589265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:22.589754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:22.590490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:22.605044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:22.605993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:22.629118 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d9f5a64-9bc6-43cd-adf5-3104420ebe4d tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.988369 Sep 18 01:18:22.635623 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1794/3492] 10.222.0.25 () {60 vars in 1313 bytes} [Sun Sep 18 01:18:21 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata/os_version => generated 31 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:22.642508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:22.646763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:22.666495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:22.667531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:22.668184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:22.669140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:22.669821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:22.670756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:23.029987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:23.048666 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-42d5e053-80af-4bfa-9250-a932e11d8508 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1707 microversion: 2.1 time: 0.492097 Sep 18 01:18:23.049592 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1699/3493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:22 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1707 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:23.064417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-411a8f9e-055f-4a5f-a615-708b58e7c4e6 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f70053d6160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:23.104191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:23.114202 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:23.121701 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa812bd5-290f-4ce5-91ca-e26fc64d8b88 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.484303 Sep 18 01:18:23.124036 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1795/3494] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:22 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:23.159047 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-411a8f9e-055f-4a5f-a615-708b58e7c4e6 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.108038 Sep 18 01:18:23.159632 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1700/3495] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:18:23 2022] GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 58 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:23.164870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:23.170848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:23.208507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:23.214296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:23.215089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:23.216047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:23.216697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:23.217314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:23.616612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:23.621504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b9558fb9-d8ee-4753-8ff7-7a3bc7ef76af tempest-ListImagesTestJSON-283486073 tempest-ListImagesTestJSON-283486073-project] Calling method '.version_select at 0x7f7005e2b1f0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:23.639147 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bee5736-8671-4945-a29f-9757e520ff5f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.476684 Sep 18 01:18:23.655945 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1701/3496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:23 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:23.670083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:23.674831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:23.699328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:23.701484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:23.702251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:23.706258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:23.709921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:23.710914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:23.730059 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b9558fb9-d8ee-4753-8ff7-7a3bc7ef76af tempest-ListImagesTestJSON-283486073 tempest-ListImagesTestJSON-283486073-project] 10.222.0.25 "GET /compute/v2.1/images/6f723c18-9162-4fbf-98cf-c1c9072c0368" status: 200 len: 784 microversion: 2.1 time: 0.604355 Sep 18 01:18:23.730374 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1796/3497] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:23 2022] GET /compute/v2.1/images/6f723c18-9162-4fbf-98cf-c1c9072c0368 => generated 784 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:23.746151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7239e708-1929-47a2-8e72-7cb829564bc8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'update_all', calling method: .version_select at 0x7f7005eb74c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:23.862154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7239e708-1929-47a2-8e72-7cb829564bc8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:23.892388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7239e708-1929-47a2-8e72-7cb829564bc8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:24.622743 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7239e708-1929-47a2-8e72-7cb829564bc8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.890829 Sep 18 01:18:24.628946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:24.629929 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1797/3498] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:18:23 2022] PUT /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 61 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:24.638884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1280165027", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "65461795-2411-4531-b404-f7689b9c28a9"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:24.643646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:24.653698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:24.655607 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d20ed36d-bd8b-4e3d-8ffa-3024399add30 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.994576 Sep 18 01:18:24.656381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1702/3499] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:23 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:24.683542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:24.695270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:24.720285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:24.727441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:24.728158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:24.729069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:24.729909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:24.742777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:24.833346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] validate_networks() for [('65461795-2411-4531-b404-f7689b9c28a9', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:18:25.905634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:25.919361 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d93ac865-de7f-43b2-896b-53d42ddb4cc6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1316 microversion: 2.1 time: 1.260611 Sep 18 01:18:25.922805 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1703/3500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:24 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1316 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:25.960641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5aa61268-b825-4fc5-bf2f-a272ebfb769f tempest-ListImagesTestJSON-283486073 tempest-ListImagesTestJSON-283486073-project] Calling method '.version_select at 0x7f70053d61f0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:26.070432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5aa61268-b825-4fc5-bf2f-a272ebfb769f tempest-ListImagesTestJSON-283486073 tempest-ListImagesTestJSON-283486073-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.126615 Sep 18 01:18:26.081134 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1704/3501] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Sep 18 01:18:25 2022] GET /compute/v2.1/images => generated 445 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:26.087855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:26.090063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:26.109462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:26.112849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:26.115079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:26.118624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:26.120397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:26.124173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:26.662446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:26.675329 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4153a4b9-0a73-4ca9-b511-952ecddd86ae tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1711 microversion: 2.1 time: 0.592354 Sep 18 01:18:26.690145 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1705/3502] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:26 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1711 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:26.703181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3c5c6f39-4f85-41f6-b7eb-87e8714ad6e8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Action: 'create', calling method: .version_select at 0x7f70053d6430>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:26.801365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3c5c6f39-4f85-41f6-b7eb-87e8714ad6e8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:26.819518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3c5c6f39-4f85-41f6-b7eb-87e8714ad6e8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Getting quotas for user 2e6dab97cf01411d83a7539fb95806e9 and project bac42706e01e4924b3c6c9123b1770bd. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:26.980629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:18:26.981169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:18:26.981511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:18:26.990155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:18:26.990688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:18:27.008922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:27.014574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:27.015253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:27.016215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:27.016867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:27.017466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:27.065058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:27.084562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for user 0212658356c1456ebe01dfe00dcd4fd2 and project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:27.155606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:18:27.162528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:18:27.280064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-33764b47-67a8-41c2-b707-310db2b6ace4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.648619 Sep 18 01:18:27.280913 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1798/3503] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:18:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:18:27.293248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:27.294119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:27.304134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:27.305494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:27.305977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:27.306973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:27.307162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:27.312763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:27.484629 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3c5c6f39-4f85-41f6-b7eb-87e8714ad6e8 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "POST /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.792705 Sep 18 01:18:27.485575 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1706/3504] 10.222.0.25 () {60 vars in 1281 bytes} [Sun Sep 18 01:18:26 2022] POST /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 85 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:27.498228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:27.499472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:27.520753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:27.522019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:27.523472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:27.524954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:27.525806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:27.526746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:27.531282 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:27.724923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:27.739317 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7b575c93-7bbe-4b98-9542-43ecaaa7723a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.452743 Sep 18 01:18:27.741869 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1799/3505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:27 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:27.751633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bfe56fe-c859-48ad-900f-ff589cbe389b tempest-ListImagesTestJSON-283486073 tempest-ListImagesTestJSON-283486073-project] Calling method '.version_select at 0x7f700680a430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:27.895825 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1bfe56fe-c859-48ad-900f-ff589cbe389b tempest-ListImagesTestJSON-283486073 tempest-ListImagesTestJSON-283486073-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.149751 Sep 18 01:18:27.897071 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1800/3506] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:18:27 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:27.905535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8b1e7a3c-5068-422f-a45e-da73cbfa92f5 req-5835dc6a-879d-4e65-be7b-96ce46c6b50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057d513c-5711-41e5-9f2d-449b777ff7bb", "tag": "61754220-27e3-4058-a935-ba4ce524fd38"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:27.943786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8b1e7a3c-5068-422f-a45e-da73cbfa92f5 req-5835dc6a-879d-4e65-be7b-96ce46c6b50d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:27.945135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8b1e7a3c-5068-422f-a45e-da73cbfa92f5 req-5835dc6a-879d-4e65-be7b-96ce46c6b50d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:27.948663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8b1e7a3c-5068-422f-a45e-da73cbfa92f5 req-5835dc6a-879d-4e65-be7b-96ce46c6b50d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:27.991268 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8b1e7a3c-5068-422f-a45e-da73cbfa92f5 req-5835dc6a-879d-4e65-be7b-96ce46c6b50d service nova] Creating event network-changed:61754220-27e3-4058-a935-ba4ce524fd38 for instance 057d513c-5711-41e5-9f2d-449b777ff7bb on n-h2-master-1 Sep 18 01:18:28.004077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8b1e7a3c-5068-422f-a45e-da73cbfa92f5 req-5835dc6a-879d-4e65-be7b-96ce46c6b50d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103443 Sep 18 01:18:28.005586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1801/3507] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:28.012705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:28.013962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:28.015456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:28.022817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:28.024064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:28.025209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:28.028927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:28.029875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:28.030615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:28.033854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:28.038225 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:28.041338 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c3c72d6-7f0a-4d7b-86be-8e62facd824f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.550470 Sep 18 01:18:28.048188 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1707/3508] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:27 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:28.057205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-406d041b-696f-4469-8f15-13da763f9372 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:28.061289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-406d041b-696f-4469-8f15-13da763f9372 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:28.269806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-406d041b-696f-4469-8f15-13da763f9372 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:28.279196 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=21 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:28.286360 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-406d041b-696f-4469-8f15-13da763f9372 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1215 microversion: 2.1 time: 0.231741 Sep 18 01:18:28.289821 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1708/3509] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:28 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:28.294833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:28.308913 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1dac14c0-ff0f-4c0e-8efe-66cd447cd85a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1316 microversion: 2.1 time: 0.301833 Sep 18 01:18:28.324922 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1802/3510] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:28 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:28.327760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ccb16e63-ed85-4153-a2c7-7acb54bbcec3 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] Calling method '.version_select at 0x7f70053b59d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:28.427489 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ccb16e63-ed85-4153-a2c7-7acb54bbcec3 tempest-ImagesMetadataTestJSON-183546595 tempest-ImagesMetadataTestJSON-183546595-project] 10.222.0.25 "GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.124352 Sep 18 01:18:28.430312 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1709/3511] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 18 01:18:28 2022] GET /compute/v2.1/images/28dbdecd-fbff-4386-ae95-28f514283a2c/metadata => generated 85 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:18:28.777335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:28.778601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:28.787974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:28.788477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:28.788918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:28.789689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:28.790344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:28.790938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:29.072507 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:29.079892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:29.081426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:29.112115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:29.114132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:29.118234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:29.126751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:29.128282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:29.130002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:29.198681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:29.239610 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-190d7977-7465-49ec-97a1-53e01e44258f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.464599 Sep 18 01:18:29.241106 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1803/3512] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:28 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:29.313953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:29.314728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:29.328416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:29.329247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:29.330102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:29.334191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:29.337122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:29.337837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:29.730526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:29.746658 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-948707ce-8d29-4bc5-b087-f3d6ccc93cd2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1267 microversion: 2.1 time: 0.437275 Sep 18 01:18:29.761631 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1804/3513] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:29 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1267 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:29.761631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:29.761631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:29.780209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:29.780705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:29.781146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:29.781934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:29.782394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:29.782816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:30.025693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:30.035291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:30.044264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:30.045807 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efdeabdd-cdcd-4799-bf46-da9fc1a639af tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.974911 Sep 18 01:18:30.047851 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1710/3514] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:29 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:30.268658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:30.270042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:30.270775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:30.290618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:30.291448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9967fce2-95e1-41b3-8e89-9fa3b44f6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1316 microversion: 2.1 time: 0.542810 Sep 18 01:18:30.291820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:30.292322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:30.293324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:30.294050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:30.294753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:30.311537 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1805/3515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:29 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:30.723744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:30.734748 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-812cfb1e-f9c7-4787-bba8-3367d31fd395 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.470783 Sep 18 01:18:30.742262 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1711/3516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:30 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:30.792123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:30.794688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:30.807591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:30.808438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:30.809187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:30.810458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:30.811262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:30.815159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:31.086925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:31.088405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:31.100866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:31.105576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:31.106073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:31.106517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:31.107230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:31.107687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:31.108108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:31.126040 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3b0e51b-3df7-4fa8-ad05-2c3613250cc7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1273 microversion: 2.1 time: 0.353366 Sep 18 01:18:31.127002 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1806/3517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:30 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:31.325289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:31.326034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:31.335745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:31.336781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:31.344903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:31.355799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:31.361055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:31.361899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:31.676186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:31.690426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:31.692906 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:31.699061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-331682b9-f997-4d19-9784-6e015326b678 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.619902 Sep 18 01:18:31.703319 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1712/3518] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:31 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:31.771518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:31.772122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:31.789927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:31.791357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:31.795173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:31.799558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:31.800356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:31.805499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:31.899365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:31.909996 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70144c2b-4b2b-4e41-98c1-dc5e702433e9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1316 microversion: 2.1 time: 0.589015 Sep 18 01:18:31.920161 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1807/3519] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:31 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:18:32.204818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:32.227151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3079f0e1-d690-4d28-950d-4d3cc065b287 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.459501 Sep 18 01:18:32.228519 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1713/3520] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:31 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:32.244540 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:32.247416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:32.264931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.267552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.268247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.270631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.272041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.272476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.467440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:32.483823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f722e5f4-ac70-4aee-9ef4-389816529ac2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1273 microversion: 2.1 time: 0.250066 Sep 18 01:18:32.486910 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1714/3521] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:32 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:32.505505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-26a30735-80f4-4222-87a0-8f5e4aa96e58 req-dffe8ec5-6a7b-45eb-a307-7dbe72d9be39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057d513c-5711-41e5-9f2d-449b777ff7bb", "name": "network-vif-plugged", "status": "completed", "tag": "61754220-27e3-4058-a935-ba4ce524fd38"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:32.529202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-26a30735-80f4-4222-87a0-8f5e4aa96e58 req-dffe8ec5-6a7b-45eb-a307-7dbe72d9be39 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.530962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-26a30735-80f4-4222-87a0-8f5e4aa96e58 req-dffe8ec5-6a7b-45eb-a307-7dbe72d9be39 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.532801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-26a30735-80f4-4222-87a0-8f5e4aa96e58 req-dffe8ec5-6a7b-45eb-a307-7dbe72d9be39 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.550737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] Calling method '.version_select at 0x7f7005e4f160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:32.565789 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-26a30735-80f4-4222-87a0-8f5e4aa96e58 req-dffe8ec5-6a7b-45eb-a307-7dbe72d9be39 service nova] Creating event network-vif-plugged:61754220-27e3-4058-a935-ba4ce524fd38 for instance 057d513c-5711-41e5-9f2d-449b777ff7bb on n-h2-master-1 Sep 18 01:18:32.584844 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-26a30735-80f4-4222-87a0-8f5e4aa96e58 req-dffe8ec5-6a7b-45eb-a307-7dbe72d9be39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088814 Sep 18 01:18:32.585107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.586636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.587728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.588770 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1715/3522] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:32.591925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.592826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.594107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.627260 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ba108fb-adc7-4766-b502-184e3ea930c6 tempest-AbsoluteLimitsTestJSON-867588290 tempest-AbsoluteLimitsTestJSON-867588290-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.644623 Sep 18 01:18:32.638259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1808/3523] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Sep 18 01:18:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:32.742814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:32.743521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:32.756280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.757705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.759222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.760683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.761641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.763401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.932357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:32.932982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:32.940376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.940870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.941310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:32.942053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:32.942509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:32.942951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:33.100162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:33.119829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:33.128004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:33.131952 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-39843580-08e6-4fd4-89f6-4b0de857013b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.401190 Sep 18 01:18:33.150749 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1716/3524] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:32 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:33.256090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:33.265315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:33.274474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:33.277868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:33.279573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:33.283414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:33.284796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:33.286088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:33.386524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:33.400564 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d8b44dd-9553-415b-8e0f-ad72a246a38b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1316 microversion: 2.1 time: 0.471911 Sep 18 01:18:33.402813 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1809/3525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:32 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:33.515546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:33.516532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:33.535721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:33.539256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:33.540277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:33.546055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:33.548217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:33.552551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:33.898435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:33.911230 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efbbcccd-aa89-4c8b-9ab1-b79722b4390d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.661618 Sep 18 01:18:33.916750 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1717/3526] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:33 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:33.966170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:33.986733 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2cdfd745-affc-4a8f-8094-d116c7c9b5c6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 0.479877 Sep 18 01:18:33.988120 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1810/3527] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:33 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:34.172122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:34.173155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:34.184788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:34.185437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:34.186560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:34.187511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:34.188275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:34.188774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:34.432131 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:34.439294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:34.439915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:34.457926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:34.458479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:34.459178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:34.461732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:34.462949 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c79d86d-fe2a-49c1-93dd-d7863a6c5ed6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1738 microversion: 2.20 time: 0.295551 Sep 18 01:18:34.463520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1718/3528] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:34 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:34.464279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:34.465163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:34.465880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:34.466341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:34.661922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:34.679092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-291c88cd-ffac-47d5-bcf8-71c9add28519 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1316 microversion: 2.1 time: 0.243330 Sep 18 01:18:34.679760 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1811/3529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:34 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:34.939022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:34.940089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:34.954141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:34.954637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:34.955078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:34.955849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:34.956312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:34.957019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:35.015407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:35.016079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:35.029239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:35.037793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:35.038633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:35.040719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:35.041404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:35.042410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:35.481124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:35.496111 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d2ef41f2-021d-4d1b-a234-8952784b1190 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.562464 Sep 18 01:18:35.497437 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1719/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:34 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:35.508635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-85c0feb1-1a93-4930-aad9-39b94bf96f05 req-f63715d0-870c-466c-aaa7-51fbe95514ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271b08cd-ead0-419b-a556-de0e468f4a74", "tag": "444667b2-a45c-4097-8add-787209ff3d3c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:35.519891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:35.546064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-85c0feb1-1a93-4930-aad9-39b94bf96f05 req-f63715d0-870c-466c-aaa7-51fbe95514ff service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:35.546839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-85c0feb1-1a93-4930-aad9-39b94bf96f05 req-f63715d0-870c-466c-aaa7-51fbe95514ff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:35.548784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-85c0feb1-1a93-4930-aad9-39b94bf96f05 req-f63715d0-870c-466c-aaa7-51fbe95514ff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:35.551549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7b2559a-3eac-4553-9fac-0330377a4b4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 0.540718 Sep 18 01:18:35.555896 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1812/3531] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:35 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:18:35.567382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-85c0feb1-1a93-4930-aad9-39b94bf96f05 req-f63715d0-870c-466c-aaa7-51fbe95514ff service nova] Creating event network-changed:444667b2-a45c-4097-8add-787209ff3d3c for instance 271b08cd-ead0-419b-a556-de0e468f4a74 on n-h1-master-1 Sep 18 01:18:35.568474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:35.570887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:35.579109 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-85c0feb1-1a93-4930-aad9-39b94bf96f05 req-f63715d0-870c-466c-aaa7-51fbe95514ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079739 Sep 18 01:18:35.588942 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1720/3532] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:35.594437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:35.595395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:35.595988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:35.597033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:35.597704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:35.598556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:35.715795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:35.716608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:35.727139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:35.732073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:35.734489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:35.735476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:35.736427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:35.736874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:36.009453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:36.028529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:36.030481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:36.031885 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3f867aa-c38c-4ff0-b6e1-a97851d54742 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1720 microversion: 2.20 time: 0.470652 Sep 18 01:18:36.032653 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1813/3533] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:35 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1720 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:36.040961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-393df0c8-5eeb-448d-9420-3c3fc74ef715 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006b36040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:36.086374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:36.094834 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-393df0c8-5eeb-448d-9420-3c3fc74ef715 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/17623fe6-8e05-41e2-9655-87a544676291" status: 200 len: 662 microversion: 2.1 time: 0.060940 Sep 18 01:18:36.105896 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1814/3534] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:36 2022] GET /compute/v2.1/images/17623fe6-8e05-41e2-9655-87a544676291 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:36.109668 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c66b9ee6-7cff-4934-bcbe-5ae5c4affce4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.397947 Sep 18 01:18:36.110872 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1721/3535] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:35 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:18:36.116005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bf384d7-0b1e-410e-baef-d6da7f2dc82d tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005e2bd30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:36.180265 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3bf384d7-0b1e-410e-baef-d6da7f2dc82d tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/17623fe6-8e05-41e2-9655-87a544676291" status: 200 len: 662 microversion: 2.1 time: 0.071733 Sep 18 01:18:36.181771 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1815/3536] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:36 2022] GET /compute/v2.1/images/17623fe6-8e05-41e2-9655-87a544676291 => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:36.280560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1711208677", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:36.357936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] validate_networks() for [('443217fd-613c-4ff9-8148-2ed9e5504cb6', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:18:36.532243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:36.536069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:36.557197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:36.558681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:36.559368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:36.560544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:36.561715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:36.562346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:36.966490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:36.975423 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f494605e-6fb7-45ea-b8da-cffe81d8497a tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.450886 Sep 18 01:18:36.976989 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1816/3537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:36 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:36.982128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:36.983072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:36.989663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:36.990496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:36.991187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:36.992740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:36.993414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:36.994140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:37.359080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:18:37.359586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:18:37.359950 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:18:37.360364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:18:37.360761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:18:37.376876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:37.380283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:37.380996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:37.382169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:37.382660 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:37.383686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:37.385049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:37.395693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d9379315-0bcd-4133-b083-bdf4be890973 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 0.417185 Sep 18 01:18:37.396301 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1817/3538] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:36 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:37.410041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:37.410983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:37.436870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:37.439316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:37.440474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:37.442546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:37.443566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:37.444240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:37.460412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Getting quotas for project 4436dd8d4d8e4a1d8c0e1948b7d767bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:37.474967 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:37.477245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Getting quotas for user 9b90a04b7e9e424e93f3642f1b8f48b1 and project 4436dd8d4d8e4a1d8c0e1948b7d767bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:37.541918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:18:37.544656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:18:37.681162 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e8def84e-4cc3-4a6a-888f-1babe6770e18 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.405169 Sep 18 01:18:37.684122 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1722/3539] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:18:37.695816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b765913b-ed0f-4c61-ac08-9a866c4a248a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:37.696446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b765913b-ed0f-4c61-ac08-9a866c4a248a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:37.914778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b765913b-ed0f-4c61-ac08-9a866c4a248a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:37.944462 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b765913b-ed0f-4c61-ac08-9a866c4a248a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1217 microversion: 2.1 time: 0.253713 Sep 18 01:18:37.947721 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1723/3540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:37 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:37.957081 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de2fe118-1bc1-425a-8f33-226e2e46d1a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70053c9ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:38.060011 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de2fe118-1bc1-425a-8f33-226e2e46d1a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a30046a3-fd32-4e2d-8769-7ee87f68a1d9" status: 200 len: 661 microversion: 2.1 time: 0.109994 Sep 18 01:18:38.065916 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1724/3541] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:37 2022] GET /compute/v2.1/images/a30046a3-fd32-4e2d-8769-7ee87f68a1d9 => generated 661 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:38.081263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:38.088563 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:38.102136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:38.139489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:38.142421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:38.143246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:38.150888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:38.153129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:38.154116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:38.158496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:38.159171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:38.176128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78bc1114-01f9-4344-8613-339b5ee068cf tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1720 microversion: 2.20 time: 0.765169 Sep 18 01:18:38.191537 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1818/3542] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:37 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1720 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:38.212017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-673e7d5c-3dba-4a7c-8171-0a9b85b0f5d5 req-d436ab23-ab30-4c56-97f4-a722e3007500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "name": "network-vif-unplugged", "status": "completed", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:38.252256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-673e7d5c-3dba-4a7c-8171-0a9b85b0f5d5 req-d436ab23-ab30-4c56-97f4-a722e3007500 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:38.259132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-673e7d5c-3dba-4a7c-8171-0a9b85b0f5d5 req-d436ab23-ab30-4c56-97f4-a722e3007500 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:38.260180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-673e7d5c-3dba-4a7c-8171-0a9b85b0f5d5 req-d436ab23-ab30-4c56-97f4-a722e3007500 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:38.286674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-673e7d5c-3dba-4a7c-8171-0a9b85b0f5d5 req-d436ab23-ab30-4c56-97f4-a722e3007500 service nova] Creating event network-vif-unplugged:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h2-master-1 Sep 18 01:18:38.314275 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-673e7d5c-3dba-4a7c-8171-0a9b85b0f5d5 req-d436ab23-ab30-4c56-97f4-a722e3007500 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120705 Sep 18 01:18:38.314895 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1819/3543] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:38.327376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8152d29d-baaf-45f9-8c79-15fa1a19e045 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700680adc0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:38.405977 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8152d29d-baaf-45f9-8c79-15fa1a19e045 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a30046a3-fd32-4e2d-8769-7ee87f68a1d9" status: 200 len: 661 microversion: 2.1 time: 0.088884 Sep 18 01:18:38.429111 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1820/3544] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:38 2022] GET /compute/v2.1/images/a30046a3-fd32-4e2d-8769-7ee87f68a1d9 => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:38.447748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:38.448520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:38.475901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:38.476045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:38.478211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:38.478998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:38.481502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:38.486644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:38.539296 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:39.093678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:39.109740 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efcaabd4-d282-469e-aac8-c6da20f2ae9d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 1.047486 Sep 18 01:18:39.110330 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1725/3545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:38 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:39.115636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:39.116656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:39.128504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:39.129335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:39.130030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:39.131542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:39.132290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:39.133006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:39.255268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:39.265536 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3e5dde3d-48e9-4002-b1f7-33f04d5c6865 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1213 microversion: 2.1 time: 0.153931 Sep 18 01:18:39.266152 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1726/3546] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:39 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:39.285615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:39.286115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:39.323129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:39.324289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:39.326672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:39.327691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:39.328363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:39.328972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:39.522723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:39.544135 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-87d0ea3e-0e03-4732-946a-4dbbfbf68b9f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 1.113209 Sep 18 01:18:39.552714 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1821/3547] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:38 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:39.668162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:39.687675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:39.689694 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:39.691321 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30a61d44-93f8-4601-9b33-1c5af7d86521 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1723 microversion: 2.20 time: 0.420501 Sep 18 01:18:39.707619 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1727/3548] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:39 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:39.723657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d16df657-3491-46cd-897f-82977fb8f859"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:39.756707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:39.769986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:39.772282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:39.772829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:39.774791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:39.775765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:39.776952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:40.154826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:40.160164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:40.186356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:40.189585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:40.192941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:40.194588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:40.195988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:40.197545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:40.668369 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e05d518a-9461-43e9-9e2b-7bc14d9f07fb tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.953797 Sep 18 01:18:40.691776 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1822/3549] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Sep 18 01:18:39 2022] POST /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 188 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:18:40.711305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:40.720275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:40.733746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:40.736331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:40.737067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:40.738831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:40.739606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:40.740280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:41.061522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:41.071196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:41.077251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be8f1d5f-e1a8-48c2-a355-1097398a2b8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1277 microversion: 2.1 time: 0.382380 Sep 18 01:18:41.078473 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1823/3550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:40 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:41.105412 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-59d829d2-7127-48fd-a06e-70df6e89078e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.968118 Sep 18 01:18:41.107430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb2b5c15-e468-4c11-82db-fe0ffd7323ba tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005eb75e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:41.107876 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1728/3551] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:40 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:41.113896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:41.114538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:41.144900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:41.145431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:41.146924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:41.147666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:41.148165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:41.148601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:41.179930 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb2b5c15-e468-4c11-82db-fe0ffd7323ba tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/5f827ceb-ffc7-4123-a6db-0f8c17c2fb67" status: 200 len: 662 microversion: 2.1 time: 0.098948 Sep 18 01:18:41.183438 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1824/3552] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:41 2022] GET /compute/v2.1/images/5f827ceb-ffc7-4123-a6db-0f8c17c2fb67 => generated 662 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:41.196460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:41.201336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:41.212995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:41.214808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:41.218384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:41.219414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:41.220124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:41.221706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:41.293083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122374) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 01:18:41.452480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:41.454888 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:41.465240 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3b47c180-55e1-4a19-8976-0826ce652292 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 0.356211 Sep 18 01:18:41.467483 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1729/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:41 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:41.473574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3342ed53-3158-4134-91d1-985593a6ba49 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700532cc10>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:41.484022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-615a8bf9-7909-4440-8706-f0ba76d88187 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/action" status: 202 len: 0 microversion: 2.20 time: 0.298974 Sep 18 01:18:41.493869 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1825/3554] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:18:41 2022] POST /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:18:41.532053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:41.532919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:41.552556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:41.553467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:41.559269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:41.564305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:41.564808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:41.565247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:41.572112 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3342ed53-3158-4134-91d1-985593a6ba49 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/5f827ceb-ffc7-4123-a6db-0f8c17c2fb67" status: 200 len: 662 microversion: 2.1 time: 0.103322 Sep 18 01:18:41.574002 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1730/3555] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:18:41 2022] GET /compute/v2.1/images/5f827ceb-ffc7-4123-a6db-0f8c17c2fb67 => generated 662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:41.822164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-613764596", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:41.966641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:18:42.246318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:42.262363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:42.264292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:42.266605 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9abc5fa4-cec9-4fce-b7b1-e5793f0188bd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1749 microversion: 2.20 time: 0.748446 Sep 18 01:18:42.281968 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1826/3556] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:41 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1749 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:42.300974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:42.302686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:42.309674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:42.310498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:42.311162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:42.312125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:42.312808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:42.313480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:42.518553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:42.536947 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3e25feb-b153-4df7-a461-8f12861f7e75 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1275 microversion: 2.1 time: 0.253354 Sep 18 01:18:42.537762 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1827/3557] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:42 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:42.561881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:42.562500 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:42.579983 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=32 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:42.584519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:42.585020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:42.585501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:42.605308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:42.605850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:42.606301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:42.611392 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:42.783159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:18:42.785740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:18:42.786850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:18:42.787514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:18:42.788148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:18:42.849223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:42.859074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:42.861383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:42.873842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:42.874574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:42.875166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:42.949388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Getting quotas for project de2dce77d67f4a9d8bbd8cb478b128b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:42.967498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Getting quotas for user 8464cc4e11bd4e1d9a80f75e8d88eafd and project de2dce77d67f4a9d8bbd8cb478b128b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:43.010515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:18:43.012908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:18:43.039900 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:43.052549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8679525-db80-48ab-aea3-844e3773293f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.494346 Sep 18 01:18:43.070990 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1828/3558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:42 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:43.093064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:43.093603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:43.109054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:43.111006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:43.114970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:43.118621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:43.119703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:43.121648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:43.155432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc92e6b9-c90e-4e89-bc18-d97c042ead09 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337598 Sep 18 01:18:43.163477 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1731/3559] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:18:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:18:43.302520 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:43.303647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:43.360792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:43.369536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:43.372710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:43.373896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:43.374645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:43.375330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:43.922027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:43.946625 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16548434-1999-493e-b401-b7979441716c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 0.874265 Sep 18 01:18:43.954831 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1829/3560] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:43 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:43.962256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1703039533", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:44.088107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:18:44.274762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:44.286378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:44.295556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:44.297906 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-518ee84b-ebec-490c-8343-f199abdff330 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1751 microversion: 2.20 time: 1.002755 Sep 18 01:18:44.300578 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1732/3561] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:43 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1751 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:44.314232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:44.315199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:44.342629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:44.345272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:44.345806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:44.346722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:44.347302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:44.347810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.017235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:45.024884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:18:45.025843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:18:45.026237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:18:45.026874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:18:45.028284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:18:45.048182 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b3d6176-c77d-450c-b1c8-e44f4b76585a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.745818 Sep 18 01:18:45.051308 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1733/3562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:44 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:45.066788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:45.067771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:45.068532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:45.069243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.070895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:45.071646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:45.071805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:45.072515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.081731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:45.082260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:45.082710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.083454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:45.083913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:45.084605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.108654 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Getting quotas for project de2dce77d67f4a9d8bbd8cb478b128b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:18:45.120882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Getting quotas for user 8464cc4e11bd4e1d9a80f75e8d88eafd and project de2dce77d67f4a9d8bbd8cb478b128b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:18:45.133249 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:45.159440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:18:45.162256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:18:45.230463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36dd86d6-ea98-4a06-9d88-bd65ec6cc02c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273659 Sep 18 01:18:45.231386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1830/3563] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:18:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:18:45.236185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-55ebe923-8ac6-4e7e-9760-487d5c0ca77e req-8693fb98-fe4e-4495-a152-7065d4c15d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271b08cd-ead0-419b-a556-de0e468f4a74", "name": "network-vif-plugged", "status": "completed", "tag": "444667b2-a45c-4097-8add-787209ff3d3c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:45.252206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-55ebe923-8ac6-4e7e-9760-487d5c0ca77e req-8693fb98-fe4e-4495-a152-7065d4c15d94 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:45.253099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-55ebe923-8ac6-4e7e-9760-487d5c0ca77e req-8693fb98-fe4e-4495-a152-7065d4c15d94 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:45.253877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-55ebe923-8ac6-4e7e-9760-487d5c0ca77e req-8693fb98-fe4e-4495-a152-7065d4c15d94 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.270894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-55ebe923-8ac6-4e7e-9760-487d5c0ca77e req-8693fb98-fe4e-4495-a152-7065d4c15d94 service nova] Creating event network-vif-plugged:444667b2-a45c-4097-8add-787209ff3d3c for instance 271b08cd-ead0-419b-a556-de0e468f4a74 on n-h1-master-1 Sep 18 01:18:45.291225 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-55ebe923-8ac6-4e7e-9760-487d5c0ca77e req-8693fb98-fe4e-4495-a152-7065d4c15d94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058321 Sep 18 01:18:45.294676 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1831/3564] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:45.312904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:45.314087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:45.337702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:45.338612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:45.340889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.343035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:45.349372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:45.351621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:45.920774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:45.935469 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-95333450-c5fc-4060-9973-d70cf0d40532 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 0.639229 Sep 18 01:18:45.951587 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:45.970435 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1832/3565] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:45 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:45.974630 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cd8e3972-ccef-40f5-85fa-5e25570de4ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.920687 Sep 18 01:18:45.975529 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1734/3566] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:45 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:45.980113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26536173-ba6a-4822-8590-b6a419feae5c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:45.980800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26536173-ba6a-4822-8590-b6a419feae5c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:45.995180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:45.999594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:46.017248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:46.021323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:46.022140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:46.023431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:46.028943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:46.029451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:46.236238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26536173-ba6a-4822-8590-b6a419feae5c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:46.247576 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26536173-ba6a-4822-8590-b6a419feae5c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1218 microversion: 2.1 time: 0.285324 Sep 18 01:18:46.248217 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1833/3567] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:45 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1218 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:46.266378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:46.268195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:46.292038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:46.292766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:46.293397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:46.296434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:46.297723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:46.298391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:47.009856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:47.020420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:47.029878 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80b75219-0486-4255-a1c7-3dae85818c92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.778238 Sep 18 01:18:47.035241 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1834/3568] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:46 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:47.042252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:47.049837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:47.052843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:47.073414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:47.073760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:47.074177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:47.074871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:47.075933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:47.076630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:47.077906 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca8d1b48-6155-470e-bd64-8f1f78e60542 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1751 microversion: 2.20 time: 1.100220 Sep 18 01:18:47.078600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:47.086007 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1735/3569] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:45 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1751 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:47.115932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:47.134130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:47.173254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:47.176159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:47.183513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:47.185849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:47.186930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:47.187879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:47.642468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:47.644173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:47.653501 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53157cf5-3258-49a0-aa66-fd44109aaad8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1315 microversion: 2.1 time: 0.616842 Sep 18 01:18:47.658437 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1835/3570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:47 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:47.672350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:47.675851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:47.689829 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c4b8c9c7-cf35-43e7-b8a0-7f1c3d091312 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.601769 Sep 18 01:18:47.697254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:47.700725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:47.702589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:47.707843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:47.711218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:47.711859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:47.722105 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1736/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:47 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:47.915156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:47.932723 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d91ee136-8d15-4a10-bfbe-4b6f7ca2c206 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1270 microversion: 2.1 time: 0.272474 Sep 18 01:18:47.947901 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1836/3572] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:47 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:48.080862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:48.082071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:48.114174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.116040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.118116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:48.120374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.121898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.123224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:48.144092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:48.145644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:48.189885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.190735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.191513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:48.192744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.193583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.232369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:48.337117 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:48.761427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:48.782379 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b968f62f-cf41-4d46-ac99-7510371b5487 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.708105 Sep 18 01:18:48.787004 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1737/3573] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:48 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:48.803336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:48.807262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:48.817434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.818319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.818982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:48.820566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.822278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.822928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:48.872210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:48.896137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:48.899066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:48.900908 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d23abf8b-8a57-4290-9cec-3ce1bc36261f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1751 microversion: 2.20 time: 0.764194 Sep 18 01:18:48.905359 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1837/3574] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:48 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1751 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:18:48.916338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:48.928758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:48.945410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.947434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.948509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:48.950428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:48.951565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:48.952602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:49.289141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:49.302631 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eb4142e2-cfd5-4771-b22e-8163b35d72cc tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1501 microversion: 2.1 time: 0.514200 Sep 18 01:18:49.313864 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1738/3575] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:48 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1501 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:49.322188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-61e4a334-9204-441e-92b0-d9b4bce44524 req-10bb665d-03ad-40cb-bfad-fd064d291951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83ed2e44-0f5a-4d0d-9870-2911d2dfaa88", "tag": "79579eac-5188-4f7e-bb9c-99d58987f9ab"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:49.373247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-61e4a334-9204-441e-92b0-d9b4bce44524 req-10bb665d-03ad-40cb-bfad-fd064d291951 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:49.380481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-61e4a334-9204-441e-92b0-d9b4bce44524 req-10bb665d-03ad-40cb-bfad-fd064d291951 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:49.380969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-61e4a334-9204-441e-92b0-d9b4bce44524 req-10bb665d-03ad-40cb-bfad-fd064d291951 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:49.426542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:49.446051 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-61e4a334-9204-441e-92b0-d9b4bce44524 req-10bb665d-03ad-40cb-bfad-fd064d291951 service nova] Creating event network-changed:79579eac-5188-4f7e-bb9c-99d58987f9ab for instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 on n-h2-master-1 Sep 18 01:18:49.463738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd57906e-faba-465e-b990-91f99e78e9cd tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.553147 Sep 18 01:18:49.479184 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1838/3576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:48 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:49.480784 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-61e4a334-9204-441e-92b0-d9b4bce44524 req-10bb665d-03ad-40cb-bfad-fd064d291951 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162055 Sep 18 01:18:49.495106 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1739/3577] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:49.512809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:49.514265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:49.520560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-27edfc36-b112-4e02-a424-74a1c7743d23 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:49.528440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:49.531831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:49.532638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:49.537329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:49.539006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:49.539649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27edfc36-b112-4e02-a424-74a1c7743d23 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:49.539881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:49.541373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27edfc36-b112-4e02-a424-74a1c7743d23 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:49.542552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27edfc36-b112-4e02-a424-74a1c7743d23 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:49.690138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-27edfc36-b112-4e02-a424-74a1c7743d23 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Going to try to stop instance {{(pid=122373) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:18:49.804129 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-27edfc36-b112-4e02-a424-74a1c7743d23 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74/action" status: 202 len: 0 microversion: 2.1 time: 0.304892 Sep 18 01:18:49.804871 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1740/3578] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:18:49 2022] POST /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:18:49.842486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:49.843325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:49.855151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:49.858474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:49.859027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:49.864405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:49.866607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:49.867081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:50.428428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:50.466458 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bac0c878-6f99-4c41-b977-c45d4d5339a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1278 microversion: 2.1 time: 0.978795 Sep 18 01:18:50.467865 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1839/3579] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:49 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1278 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:50.497949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:50.499305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:50.527850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:50.531869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:50.532794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:50.536510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:50.537501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:50.539092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:50.656253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:50.672382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f739f7d6-6db4-4779-a90e-efb8d46fa8bf tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.861826 Sep 18 01:18:50.672987 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1741/3580] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:49 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:50.678115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:50.678718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:50.700718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:50.701229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:50.701693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:50.702549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:50.703143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:50.703570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:51.024119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:51.048847 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-38d8e2ad-6001-406d-86e1-22c4b2d329bb tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.578564 Sep 18 01:18:51.060417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:51.061757 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1840/3581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:50 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:51.070774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:51.071669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:51.072407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:51.073884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:51.075251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-756c73ec-db29-4507-8a43-7e21e4d0aecc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1751 microversion: 2.20 time: 0.400610 Sep 18 01:18:51.075658 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1742/3582] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:50 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1751 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:51.079039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:51.079573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:51.080023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:51.080740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:51.081207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:51.081664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:51.489589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:51.494875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:51.495498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:51.502480 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91af5c68-54cb-43ab-9832-7ce7476bcd3c tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.439347 Sep 18 01:18:51.505136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:51.505603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:51.506045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:51.506745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:51.511082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:51.513344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:51.518357 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1841/3583] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:51 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:51.688622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c550d249-a79a-4acd-b5f1-000e211b9364 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Calling method '.version_select at 0x7f70065b51f0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:51.769020 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-c550d249-a79a-4acd-b5f1-000e211b9364 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:18:51.771062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-c550d249-a79a-4acd-b5f1-000e211b9364 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Neutron security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:18:51.772338 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c550d249-a79a-4acd-b5f1-000e211b9364 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] HTTP exception thrown: Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist Sep 18 01:18:51.772338 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-8c553911-c538-4d1e-8911-9df809fe3295'] Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c550d249-a79a-4acd-b5f1-000e211b9364 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Request method failure captured: Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-security-groups/e6b9cbf2-41ea-410d-b5f7-b336939b8032 HTTP/1.1 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnH7ILZXSxfKXkSpBD--ZRvM6KzMVI4bBrpb3f03OBKKSCJ6RJnytM_TjiUg6qFkE56HseUVoZRXJYIqHOvUBPnfImlPYUbhhXZQ_WOLzKkmKlIynQ-AVkggMqd5v9HvFEJPEAHbLE_uaBvBZC2GmvridzkaJNBzd6T-7NtTgErACvQ Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 08c7e5e347f64fb3aab6b861b51c729b Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: exception: Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-8c553911-c538-4d1e-8911-9df809fe3295'] Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e6b9cbf2-41ea-410d-b5f7-b336939b8032'} Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:18:51.776857 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c553911-c538-4d1e-8911-9df809fe3295'] Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c553911-c538-4d1e-8911-9df809fe3295'] Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c553911-c538-4d1e-8911-9df809fe3295'] Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c553911-c538-4d1e-8911-9df809fe3295'] Sep 18 01:18:51.781706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:51.784705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:51.787689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c550d249-a79a-4acd-b5f1-000e211b9364 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Returning 404 to user: Security group e6b9cbf2-41ea-410d-b5f7-b336939b8032 does not exist Sep 18 01:18:51.787689 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-8c553911-c538-4d1e-8911-9df809fe3295'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:18:51.789585 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c550d249-a79a-4acd-b5f1-000e211b9364 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e6b9cbf2-41ea-410d-b5f7-b336939b8032" status: 404 len: 194 microversion: 2.1 time: 0.269847 Sep 18 01:18:51.800078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1842/3584] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:18:51 2022] DELETE /compute/v2.1/os-security-groups/e6b9cbf2-41ea-410d-b5f7-b336939b8032 => generated 194 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:18:51.810899 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3eaf0a49-a114-442f-a236-c02a8744ecfb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1276 microversion: 2.1 time: 0.319405 Sep 18 01:18:51.815820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:51.817888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:51.834129 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1743/3585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:51 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:18:51.842907 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-177276ef-d2fd-4415-ae9b-45d8684f0acb tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006952 Sep 18 01:18:51.844687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:51.848738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:51.849639 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1744/3586] 10.222.0.25 () {58 vars in 1164 bytes} [Sun Sep 18 01:18:51 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 18 01:18:51.855263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:51.857328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:51.858512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:51.859214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:51.871656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56d800b8-6d3e-4d66-a8d0-17154eb202a2 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Calling method '.version_select at 0x7f700532ce50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:52.388988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:52.411920 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e8f8661-6a61-483a-bbcf-34ccad78eb64 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.610012 Sep 18 01:18:52.414638 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1843/3587] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:51 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:52.423435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:52.424409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:52.435124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:52.436008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:52.436705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:52.437709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:52.438439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:52.439205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:52.702068 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56d800b8-6d3e-4d66-a8d0-17154eb202a2 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.850508 Sep 18 01:18:52.703332 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1745/3588] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:18:51 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:52.715319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:52.718941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:52.740916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:52.741538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:52.742322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:52.743262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:52.744105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:52.744861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:52.893727 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:52.994023 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=15 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:53.170147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:53.185896 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02b7c594-6fcf-4edd-8410-e0ba94b3949e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.769511 Sep 18 01:18:53.186691 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1844/3589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:52 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:53.205277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:53.208437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:53.229625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:53.232679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:53.234044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:53.240163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:53.241026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:53.242392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:53.403680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:53.464973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:53.474151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:53.478409 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cea3052f-9025-497b-892f-ca636a9d7e71 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1751 microversion: 2.20 time: 0.773048 Sep 18 01:18:53.497010 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1746/3590] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:52 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1751 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:53.525105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4266a467-cbd6-4002-b949-0f61d302aaee tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Calling method '.version_select at 0x7f70053c18b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:54.162632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:54.192333 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3af0280c-2bf5-4684-b09b-4e353c3a3836 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1736 microversion: 2.1 time: 0.996472 Sep 18 01:18:54.213755 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1845/3591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:53 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1736 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:54.222674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:54.226918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:54.230561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:54.231161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:54.231676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:54.232467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:54.232996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:54.233434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:54.246478 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-4266a467-cbd6-4002-b949-0f61d302aaee tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:18:54.247307 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-4266a467-cbd6-4002-b949-0f61d302aaee tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 18 01:18:54.247307 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-07f07ae8-ba92-4c15-bb41-bcb6b7a8ad32'] Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4266a467-cbd6-4002-b949-0f61d302aaee tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Request method failure captured: Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-security-groups/3952fb56-832f-4c52-b345-f50b89fdbe61 HTTP/1.1 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnH7ILZXSxfKXkSpBD--ZRvM6KzMVI4bBrpb3f03OBKKSCJ6RJnytM_TjiUg6qFkE56HseUVoZRXJYIqHOvUBPnfImlPYUbhhXZQ_WOLzKkmKlIynQ-AVkggMqd5v9HvFEJPEAHbLE_uaBvBZC2GmvridzkaJNBzd6T-7NtTgErACvQ Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 08c7e5e347f64fb3aab6b861b51c729b Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: exception: Insufficient rights for removing default security group. Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-07f07ae8-ba92-4c15-bb41-bcb6b7a8ad32'] Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3952fb56-832f-4c52-b345-f50b89fdbe61'} Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:18:54.250994 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07f07ae8-ba92-4c15-bb41-bcb6b7a8ad32'] Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07f07ae8-ba92-4c15-bb41-bcb6b7a8ad32'] Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07f07ae8-ba92-4c15-bb41-bcb6b7a8ad32'] Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07f07ae8-ba92-4c15-bb41-bcb6b7a8ad32'] Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4266a467-cbd6-4002-b949-0f61d302aaee tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-07f07ae8-ba92-4c15-bb41-bcb6b7a8ad32'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:18:54.256664 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4266a467-cbd6-4002-b949-0f61d302aaee tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3952fb56-832f-4c52-b345-f50b89fdbe61" status: 400 len: 182 microversion: 2.1 time: 0.755603 Sep 18 01:18:54.269249 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1747/3592] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:18:53 2022] DELETE /compute/v2.1/os-security-groups/3952fb56-832f-4c52-b345-f50b89fdbe61 => generated 182 bytes in 759 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:18:54.271901 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:54.274042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:54.298278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:54.298899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:54.299425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:54.300236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:54.300789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:54.301299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:54.993388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:55.023130 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41442afa-94da-45b7-bf24-520ff0decfb6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 0.794838 Sep 18 01:18:55.026869 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1846/3593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:54 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:55.042746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:55.044304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:55.045445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:55.057445 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4fb4f77a-a1ba-4023-b86a-4ff6e375e43c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.797870 Sep 18 01:18:55.057764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:55.058604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:55.058737 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1748/3594] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:54 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:55.060049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:55.061027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:55.062283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:55.063474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:55.066009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb57441d-e135-4069-a7c0-8eaeb2d95ac7 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Calling method '.version_select at 0x7f700534c940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:55.094862 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:55.128007 n-d-master-1 devstack@n-api.service[122373]: DEBUG neutronclient.v2_0.client [None req-bb57441d-e135-4069-a7c0-8eaeb2d95ac7 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist", "detail": ""}} {{(pid=122373) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:18:55.128414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-bb57441d-e135-4069-a7c0-8eaeb2d95ac7 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Neutron security group 12d53124-0216-4557-a250-d1ec6b41ea1c not found {{(pid=122373) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:18:55.129341 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-bb57441d-e135-4069-a7c0-8eaeb2d95ac7 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] HTTP exception thrown: Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist Sep 18 01:18:55.129341 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-a7d9f027-5457-4611-b8ae-fb88050de487'] Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb57441d-e135-4069-a7c0-8eaeb2d95ac7 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Request method failure captured: Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-security-groups/12d53124-0216-4557-a250-d1ec6b41ea1c HTTP/1.1 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnH7ILZXSxfKXkSpBD--ZRvM6KzMVI4bBrpb3f03OBKKSCJ6RJnytM_TjiUg6qFkE56HseUVoZRXJYIqHOvUBPnfImlPYUbhhXZQ_WOLzKkmKlIynQ-AVkggMqd5v9HvFEJPEAHbLE_uaBvBZC2GmvridzkaJNBzd6T-7NtTgErACvQ Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 08c7e5e347f64fb3aab6b861b51c729b Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: exception: Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-a7d9f027-5457-4611-b8ae-fb88050de487'] Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '12d53124-0216-4557-a250-d1ec6b41ea1c'} Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:18:55.131222 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7d9f027-5457-4611-b8ae-fb88050de487'] Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7d9f027-5457-4611-b8ae-fb88050de487'] Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7d9f027-5457-4611-b8ae-fb88050de487'] Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7d9f027-5457-4611-b8ae-fb88050de487'] Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb57441d-e135-4069-a7c0-8eaeb2d95ac7 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Returning 404 to user: Security group 12d53124-0216-4557-a250-d1ec6b41ea1c does not exist Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: Neutron server returns request_ids: ['req-a7d9f027-5457-4611-b8ae-fb88050de487'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:18:55.138442 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb57441d-e135-4069-a7c0-8eaeb2d95ac7 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/12d53124-0216-4557-a250-d1ec6b41ea1c" status: 404 len: 194 microversion: 2.1 time: 0.073530 Sep 18 01:18:55.148914 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1749/3595] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:18:55 2022] GET /compute/v2.1/os-security-groups/12d53124-0216-4557-a250-d1ec6b41ea1c => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:18:55.148914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f8b7dce5-5eb8-4910-abc3-f62631ac1a5a req-0e7e1b7d-6c6d-451b-9982-0637327c687b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5fa157-6b6f-48ef-9827-7e92ff6b9208", "tag": "2bcc5467-2ebf-408b-ad54-6161ef7e1e1f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:55.187082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f8b7dce5-5eb8-4910-abc3-f62631ac1a5a req-0e7e1b7d-6c6d-451b-9982-0637327c687b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:55.187566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f8b7dce5-5eb8-4910-abc3-f62631ac1a5a req-0e7e1b7d-6c6d-451b-9982-0637327c687b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:55.187998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f8b7dce5-5eb8-4910-abc3-f62631ac1a5a req-0e7e1b7d-6c6d-451b-9982-0637327c687b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:55.215429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f8b7dce5-5eb8-4910-abc3-f62631ac1a5a req-0e7e1b7d-6c6d-451b-9982-0637327c687b service nova] Creating event network-changed:2bcc5467-2ebf-408b-ad54-6161ef7e1e1f for instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 on n-h1-master-1 Sep 18 01:18:55.234916 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f8b7dce5-5eb8-4910-abc3-f62631ac1a5a req-0e7e1b7d-6c6d-451b-9982-0637327c687b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094862 Sep 18 01:18:55.235660 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1750/3596] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:55.243717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:55.244891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:55.252096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:55.253924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:55.254771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:55.256098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:55.256966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:55.258140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:55.726966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:55.743160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b8c9751-3947-4955-afe4-1618d26901c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.714799 Sep 18 01:18:55.743783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1847/3597] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:55 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:55.748566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:55.759281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:55.760745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:55.764316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78aa1242-45be-4652-ac6b-b063ac0ae510 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Action: 'update', calling method: .version_select at 0x7f70069f78b0>, body: {"security_group": {"name": "tempest-sg-1430360533", "description": "tempest-description-586061424"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:55.769882 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb5a6923-8a39-4056-a5cb-8daac35023e6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.525028 Sep 18 01:18:55.779150 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1751/3598] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:55 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:55.794468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:55.795899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:55.804675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:55.806050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:55.809133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:55.810195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:55.812000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:55.813690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:55.838002 n-d-master-1 devstack@n-api.service[122374]: DEBUG neutronclient.v2_0.client [None req-78aa1242-45be-4652-ac6b-b063ac0ae510 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist", "detail": ""}} {{(pid=122374) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 18 01:18:55.838810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.security_group_api [None req-78aa1242-45be-4652-ac6b-b063ac0ae510 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Neutron security group 2852128d-ecb3-40f6-8cc0-9ced95630948 not found {{(pid=122374) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 18 01:18:55.839829 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-78aa1242-45be-4652-ac6b-b063ac0ae510 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] HTTP exception thrown: Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist Sep 18 01:18:55.839829 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-5e08c55e-a700-43a1-8db2-54f92ed3316f'] Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78aa1242-45be-4652-ac6b-b063ac0ae510 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Request method failure captured: Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/os-security-groups/2852128d-ecb3-40f6-8cc0-9ced95630948 HTTP/1.1 Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 101 Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnH7ILZXSxfKXkSpBD--ZRvM6KzMVI4bBrpb3f03OBKKSCJ6RJnytM_TjiUg6qFkE56HseUVoZRXJYIqHOvUBPnfImlPYUbhhXZQ_WOLzKkmKlIynQ-AVkggMqd5v9HvFEJPEAHbLE_uaBvBZC2GmvridzkaJNBzd6T-7NtTgErACvQ Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa34f522560547fbbf60b62e80c03ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fa34f522560547fbbf60b62e80c03ceb Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-949162700 Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 08c7e5e347f64fb3aab6b861b51c729b Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-949162700-project Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: {"security_group": {"name": "tempest-sg-1430360533", "description": "tempest-description-586061424"}} Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: exception: Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-5e08c55e-a700-43a1-8db2-54f92ed3316f'] Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2852128d-ecb3-40f6-8cc0-9ced95630948', 'body': {'security_group': {'name': 'tempest-sg-1430360533', 'description': 'tempest-description-586061424'}}} Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 18 01:18:55.842340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e08c55e-a700-43a1-8db2-54f92ed3316f'] Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e08c55e-a700-43a1-8db2-54f92ed3316f'] Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e08c55e-a700-43a1-8db2-54f92ed3316f'] Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e08c55e-a700-43a1-8db2-54f92ed3316f'] Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78aa1242-45be-4652-ac6b-b063ac0ae510 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] Returning 404 to user: Security group 2852128d-ecb3-40f6-8cc0-9ced95630948 does not exist Sep 18 01:18:55.848479 n-d-master-1 devstack@n-api.service[122374]: Neutron server returns request_ids: ['req-5e08c55e-a700-43a1-8db2-54f92ed3316f'] {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:18:55.865375 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78aa1242-45be-4652-ac6b-b063ac0ae510 tempest-SecurityGroupsNegativeTestJSON-949162700 tempest-SecurityGroupsNegativeTestJSON-949162700-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/2852128d-ecb3-40f6-8cc0-9ced95630948" status: 404 len: 194 microversion: 2.1 time: 0.103414 Sep 18 01:18:55.865375 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1848/3599] 10.222.0.25 () {60 vars in 1290 bytes} [Sun Sep 18 01:18:55 2022] PUT /compute/v2.1/os-security-groups/2852128d-ecb3-40f6-8cc0-9ced95630948 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:18:55.907518 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:56.049016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:56.052370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:56.073505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.074432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.075084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.076052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.076727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.077328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.245125 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:56.312860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:56.323881 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b352b8f-2cba-477a-a19f-f6c6aa6400d8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1716 microversion: 2.1 time: 0.543512 Sep 18 01:18:56.334322 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1752/3600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:55 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1716 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:56.348850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:56.349856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:56.358616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.359431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.360067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.360985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.361741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.362356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.704532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:56.724276 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c98fd8f-61cf-4ef0-a447-d6e38c8bf7b2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 0.676734 Sep 18 01:18:56.726575 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1849/3601] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:56 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:56.731713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e5fe2b5e-f036-4686-b6fc-fb67d93241e9 req-12877374-3d2b-4da0-ae1e-76f9d6d094c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e5cf62-23da-44ee-b6bf-7dcc733c98c8", "tag": "60f795cf-3fab-42b9-9683-a788a2d28e34"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:56.746108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5fe2b5e-f036-4686-b6fc-fb67d93241e9 req-12877374-3d2b-4da0-ae1e-76f9d6d094c5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.746474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5fe2b5e-f036-4686-b6fc-fb67d93241e9 req-12877374-3d2b-4da0-ae1e-76f9d6d094c5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.747280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e5fe2b5e-f036-4686-b6fc-fb67d93241e9 req-12877374-3d2b-4da0-ae1e-76f9d6d094c5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.766396 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e5fe2b5e-f036-4686-b6fc-fb67d93241e9 req-12877374-3d2b-4da0-ae1e-76f9d6d094c5 service nova] Creating event network-changed:60f795cf-3fab-42b9-9683-a788a2d28e34 for instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 on n-h2-master-1 Sep 18 01:18:56.777327 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e5fe2b5e-f036-4686-b6fc-fb67d93241e9 req-12877374-3d2b-4da0-ae1e-76f9d6d094c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049191 Sep 18 01:18:56.778608 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1850/3602] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:56.787791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:56.789922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:56.804288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.806087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.807518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.813883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.815032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.816597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.881837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:56.897334 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b24f6b0-2894-4253-ae4d-3605256a09f6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.559475 Sep 18 01:18:56.899303 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1753/3603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:56 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:56.923695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:56.928578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:56.939285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.940158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.940637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.941346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.942029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.942950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.954487 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Cannot 'detach_volume' instance 68599e5f-a57f-4820-b215-7ad064c4d1ad while it is in vm_state rescued Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments/48f05b9a-2671-4de7-bc4f-ae76bf298eba HTTP/1.1 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'detach_volume' instance 68599e5f-a57f-4820-b215-7ad064c4d1ad while it is in vm_state rescued Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '68599e5f-a57f-4820-b215-7ad064c4d1ad', 'id': '48f05b9a-2671-4de7-bc4f-ae76bf298eba'} Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68599e5f-a57f-4820-b215-7ad064c4d1ad in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 68599e5f-a57f-4820-b215-7ad064c4d1ad while it is in vm_state rescued Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:56.956744 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:18:56.962659 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:18:56.962659 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:18:56.962659 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:18:56.962659 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:18:56.962659 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 68599e5f-a57f-4820-b215-7ad064c4d1ad while it is in vm_state rescued Sep 18 01:18:56.962659 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:18:56.967571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 409 to user: Cannot 'detach_volume' instance 68599e5f-a57f-4820-b215-7ad064c4d1ad while it is in vm_state rescued {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:18:56.967571 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dbad4191-2deb-446d-b14d-a6006d22e535 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments/48f05b9a-2671-4de7-bc4f-ae76bf298eba" status: 409 len: 152 microversion: 2.1 time: 0.185012 Sep 18 01:18:56.967571 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1851/3604] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:18:56 2022] DELETE /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments/48f05b9a-2671-4de7-bc4f-ae76bf298eba => generated 152 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:18:56.974301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:56.975132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:56.985437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.988930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.991980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:56.992945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:56.993623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:56.996289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:57.428139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:57.442829 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7dd2f7c6-177a-4247-baa3-f1377663fb59 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.540945 Sep 18 01:18:57.443913 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1754/3605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:56 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:57.450194 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:57.450988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:57.458558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:57.459513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:57.460290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:57.461215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:57.461948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:57.462542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:57.479668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:57.501052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:57.504447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:57.506346 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b86b26f-aa81-461c-8cd7-b7757ad61c1a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.539080 Sep 18 01:18:57.527378 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1852/3606] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:56 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:57.646708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94603cf3-042d-4471-a01e-50dec40f136f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/action" status: 202 len: 0 microversion: 2.1 time: 0.199848 Sep 18 01:18:57.648463 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1755/3607] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:18:57 2022] POST /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:18:57.660219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:57.661360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:57.692405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:57.700928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:57.701777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:57.703074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:57.704064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:57.711397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:57.759472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:57.765173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:57.789631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:57.794461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:57.795894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:57.801903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:57.802748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:57.811101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:58.272801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:58.281233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:58.291597 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-268fe85f-2d57-42f9-adbf-5e0ce8cebaf8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1724 microversion: 2.1 time: 0.636546 Sep 18 01:18:58.299487 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8fa8174b-c348-4fdf-bb63-4b6711a1bec8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 0.550753 Sep 18 01:18:58.302138 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1756/3608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:57 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:58.310583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1853/3609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:57 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1724 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:58.314437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-18e21c49-7c44-4db1-930f-58ec18a0b4ed req-2e94ef0c-e11b-4a37-b073-8b8010dd1195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ed2e44-0f5a-4d0d-9870-2911d2dfaa88", "name": "network-vif-plugged", "status": "completed", "tag": "79579eac-5188-4f7e-bb9c-99d58987f9ab"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:18:58.338869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:58.339224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:58.352467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-18e21c49-7c44-4db1-930f-58ec18a0b4ed req-2e94ef0c-e11b-4a37-b073-8b8010dd1195 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:58.353925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:58.354712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:58.355169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-18e21c49-7c44-4db1-930f-58ec18a0b4ed req-2e94ef0c-e11b-4a37-b073-8b8010dd1195 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:58.359580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-18e21c49-7c44-4db1-930f-58ec18a0b4ed req-2e94ef0c-e11b-4a37-b073-8b8010dd1195 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:58.361348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:58.362149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:58.362638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:58.363073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:58.395102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-18e21c49-7c44-4db1-930f-58ec18a0b4ed req-2e94ef0c-e11b-4a37-b073-8b8010dd1195 service nova] Creating event network-vif-plugged:79579eac-5188-4f7e-bb9c-99d58987f9ab for instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 on n-h2-master-1 Sep 18 01:18:58.401962 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-18e21c49-7c44-4db1-930f-58ec18a0b4ed req-2e94ef0c-e11b-4a37-b073-8b8010dd1195 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097874 Sep 18 01:18:58.410601 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1757/3610] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:18:58.484984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:58.486253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:58.493853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:58.494511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:58.495055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:58.496069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:58.496721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:58.497257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.082914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:59.103637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:59.111999 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3038b787-9139-47cb-a386-3df47e3bb8fe tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.800193 Sep 18 01:18:59.113648 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00e32969-671f-4757-9027-cfb663bdf691 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.633086 Sep 18 01:18:59.114575 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1758/3611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:58 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:18:59.120742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:59.121922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:59.131074 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1854/3612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:58 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:18:59.138928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.139425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.139868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.140594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.141058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.141484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.327519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:59.328425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:59.337627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.343826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.344732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.345693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.348600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.349310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.671867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:59.691841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:59.695743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:59.698423 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d30a39a-3236-4db5-8d62-9185a6fca734 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.581617 Sep 18 01:18:59.700248 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1759/3613] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:18:59 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:18:59.711770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:59.713097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:59.722336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.723154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.723802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.724702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.726265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.726998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.727511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:18:59.749009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb6dc836-1f20-4ff6-b127-d4e59cee8eb4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1724 microversion: 2.1 time: 0.426378 Sep 18 01:18:59.751766 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1855/3614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:59 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1724 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:18:59.763547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:18:59.769599 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:18:59.777997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.778895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.779570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.780666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:18:59.781362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:18:59.782098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:18:59.926795 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:18:59.935739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lazy-loading 'services' on Instance uuid 3dda0da1-d84d-460a-b22c-8cfed7d264ad {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:19:00.074741 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3afdc0b7-50a9-4e6d-b27e-e24dfaa5259f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-volume_attachments/ce107691-7159-44ec-aeda-14011ab321cc" status: 202 len: 0 microversion: 2.1 time: 0.320616 Sep 18 01:19:00.076387 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1856/3615] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:18:59 2022] DELETE /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-volume_attachments/ce107691-7159-44ec-aeda-14011ab321cc => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:19:00.101821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ce965597-f9e4-44db-8c63-e21e258bd249 req-bfb89b44-247b-4b52-b568-f738e565b80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:00.124570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ce965597-f9e4-44db-8c63-e21e258bd249 req-bfb89b44-247b-4b52-b568-f738e565b80c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.126499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ce965597-f9e4-44db-8c63-e21e258bd249 req-bfb89b44-247b-4b52-b568-f738e565b80c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.128226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ce965597-f9e4-44db-8c63-e21e258bd249 req-bfb89b44-247b-4b52-b568-f738e565b80c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.136785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:00.150205 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8cf56706-c0d2-492f-800a-ae6995bd9768 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 0.442658 Sep 18 01:19:00.152018 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1760/3616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:18:59 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:00.166954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:00.167755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:00.173302 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ce965597-f9e4-44db-8c63-e21e258bd249 req-bfb89b44-247b-4b52-b568-f738e565b80c service nova] Creating event network-changed:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h1-master-1 Sep 18 01:19:00.179737 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ce965597-f9e4-44db-8c63-e21e258bd249 req-bfb89b44-247b-4b52-b568-f738e565b80c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099664 Sep 18 01:19:00.180998 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1857/3617] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:00.185686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.186372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.186834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.187564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.187919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:00.188068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.188450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.189310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:00.196176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.196920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.197529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.198671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.199301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.199898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.552404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:00.572277 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-582bec9f-a018-493a-a51b-e3f37f0f794e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.389616 Sep 18 01:19:00.574644 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1858/3618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:00 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:00.687517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:00.718672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b8ae216-a466-488f-86f4-64e2d1d0242b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1317 microversion: 2.1 time: 0.563182 Sep 18 01:19:00.721442 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1761/3619] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:00 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:00.756755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:00.758504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:00.769826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.770943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.771977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.792402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:00.795484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:00.797081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.802682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.803490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.861899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.862751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.863523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:00.864788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:00.876853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:00.878210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:01.251213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:01.269004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:01.270867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:01.274771 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b2d9c77-1e5b-49c0-8a32-b8abf91553d8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.526364 Sep 18 01:19:01.275579 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1859/3620] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:00 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:01.294277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:01.295324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:01.306856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:01.307646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:01.309964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:01.311039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:01.315568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:01.316292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:01.371622 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:01.381251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-843d426d-c7be-4ea1-9552-6444b1187557 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1724 microversion: 2.1 time: 0.604565 Sep 18 01:19:01.386501 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1762/3621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:00 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1724 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:01.597836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:01.598848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:01.613637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:01.617498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:01.619515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:01.620436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:01.625753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:01.626559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:02.400926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:02.412004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:02.420489 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60f4f648-b699-4ac6-9b48-2bdc5da3e52b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 1.143503 Sep 18 01:19:02.422730 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a0501684-a69e-40bc-a33c-793e0c7b69de tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.828608 Sep 18 01:19:02.430005 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1763/3622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:01 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:02.434317 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1860/3623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:01 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:02.453301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:02.453979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:02.469140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-9b116bb0-00e4-420f-83a0-29cfdf0c6177 req-b21598fc-44d3-49c9-917e-70d8d9c6f51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa157-6b6f-48ef-9827-7e92ff6b9208", "name": "network-vif-plugged", "status": "completed", "tag": "2bcc5467-2ebf-408b-ad54-6161ef7e1e1f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:02.480914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:02.481615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:02.482057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:02.482819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:02.483289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:02.483547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9b116bb0-00e4-420f-83a0-29cfdf0c6177 req-b21598fc-44d3-49c9-917e-70d8d9c6f51c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:02.484371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9b116bb0-00e4-420f-83a0-29cfdf0c6177 req-b21598fc-44d3-49c9-917e-70d8d9c6f51c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:02.485157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9b116bb0-00e4-420f-83a0-29cfdf0c6177 req-b21598fc-44d3-49c9-917e-70d8d9c6f51c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:02.492123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:02.499532 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-9b116bb0-00e4-420f-83a0-29cfdf0c6177 req-b21598fc-44d3-49c9-917e-70d8d9c6f51c service nova] Creating event network-vif-plugged:2bcc5467-2ebf-408b-ad54-6161ef7e1e1f for instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 on n-h1-master-1 Sep 18 01:19:02.515495 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-9b116bb0-00e4-420f-83a0-29cfdf0c6177 req-b21598fc-44d3-49c9-917e-70d8d9c6f51c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078345 Sep 18 01:19:02.518974 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1861/3624] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:02.538738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:02.540245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:02.556801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:02.561211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:02.566850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:02.572527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:02.573455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:02.574166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.000931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:03.019913 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2cce60b-ba0d-4d62-b5fa-b563e9e78e25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1506 microversion: 2.1 time: 0.587702 Sep 18 01:19:03.023814 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1764/3625] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:02 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:03.040428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:03.041456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:03.059604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.060556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.061013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.061800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.062267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.062694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.072355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:03.115494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:03.124665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:03.131031 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4419b4b-0eac-4056-aeb1-47c610c3cd04 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.610001 Sep 18 01:19:03.147043 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1862/3626] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:02 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:03.168301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:03.170161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:03.192577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.196387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.197742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.202359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.202993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.205001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.249288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:19:03.349479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:03.364067 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-138be830-0805-43c2-a47c-9775726427c5 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1724 microversion: 2.1 time: 0.337791 Sep 18 01:19:03.365210 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1765/3627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:03 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:03.452363 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c72b79be-6805-47d2-a83a-754b27987b9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "DELETE /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 204 len: 0 microversion: 2.1 time: 0.303017 Sep 18 01:19:03.455362 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1863/3628] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:19:03 2022] DELETE /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:19:03.468578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:03.471555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:03.472291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:03.472982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:03.483294 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:03.486588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.487406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.488228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.489329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.490024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.490708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.509660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.510687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.512927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.517059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.519775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.525485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.831714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:03.840363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1e07fe6e-47e1-40e2-9bc3-80ac399ad135 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1512 microversion: 2.1 time: 0.378623 Sep 18 01:19:03.844667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1766/3629] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:03 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:03.865123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:03.867011 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:03.873377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.874296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.874973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.876682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:03.877403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:03.878082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:03.945899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:03.966245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e6d0d8e1-a63a-49f9-b0d0-535557aeb3d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.503338 Sep 18 01:19:03.977679 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1864/3630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:03 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:04.107652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:04.125854 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-780bb1e5-1d1c-4424-817b-c6aee43b7b38 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 0.279488 Sep 18 01:19:04.127819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1767/3631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:03 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:04.175031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:04.175783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:04.192591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:04.193104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:04.193572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:04.194397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:04.194936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:04.195633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:04.393198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:04.393993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:04.404225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:04.404817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:04.405267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:04.406035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:04.406503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:04.409793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:05.011452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:05.060373 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:05.061907 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:05.073711 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80c7dfca-193b-4da4-804c-571f85375e06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.903975 Sep 18 01:19:05.091125 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1865/3632] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:04 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:05.108569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1bb37631-4b8f-4a30-a150-17c8fb63842b req-be59ecf9-6855-475e-b2b5-36d1510d8672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e5cf62-23da-44ee-b6bf-7dcc733c98c8", "name": "network-vif-plugged", "status": "completed", "tag": "60f795cf-3fab-42b9-9683-a788a2d28e34"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:05.172869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1bb37631-4b8f-4a30-a150-17c8fb63842b req-be59ecf9-6855-475e-b2b5-36d1510d8672 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:05.173928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1bb37631-4b8f-4a30-a150-17c8fb63842b req-be59ecf9-6855-475e-b2b5-36d1510d8672 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:05.175020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1bb37631-4b8f-4a30-a150-17c8fb63842b req-be59ecf9-6855-475e-b2b5-36d1510d8672 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:05.212780 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1bb37631-4b8f-4a30-a150-17c8fb63842b req-be59ecf9-6855-475e-b2b5-36d1510d8672 service nova] Creating event network-vif-plugged:60f795cf-3fab-42b9-9683-a788a2d28e34 for instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 on n-h2-master-1 Sep 18 01:19:05.222312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:05.231242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1bb37631-4b8f-4a30-a150-17c8fb63842b req-be59ecf9-6855-475e-b2b5-36d1510d8672 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133054 Sep 18 01:19:05.233583 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:05.246907 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1866/3633] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:05.252201 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aec5cc92-b427-41aa-afad-e80a6b5c6f0b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1724 microversion: 2.1 time: 0.863477 Sep 18 01:19:05.267784 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1768/3634] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:04 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1724 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:05.277265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:05.280213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:05.295967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:05.296582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:05.315773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:05.318285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:05.322156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:05.322653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:05.322832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:05.324113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:05.324803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:05.325768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:05.330924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:05.332503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:05.336057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:05.338528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:06.312751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:06.322337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:06.343962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f1a2ac6-f2e1-49a0-9494-37eddc265cb8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1512 microversion: 2.1 time: 1.093434 Sep 18 01:19:06.347506 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b6dff8c1-82a8-4eb2-b504-1ea512420b99 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 1.077834 Sep 18 01:19:06.355157 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1867/3635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:05 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1512 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:06.358840 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1769/3636] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:05 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:06.374379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:06.376144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:06.382412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:06.383423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:06.387758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:06.388836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:06.389838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:06.391264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:06.392037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:06.392777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:06.409999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:06.410811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:06.411535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:06.412452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:06.421456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:06.422276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:07.117944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:07.194540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:07.196631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:07.198126 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a6cb79c3-775e-4b55-94fe-c19e4dda824e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.828878 Sep 18 01:19:07.230693 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1868/3637] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:06 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:07.247422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:07.248544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:07.259053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:07.259828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:07.260472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:07.261402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:07.263724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:07.265294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:07.366998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:07.427373 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c154f1b-f1a2-4a51-834e-4eae160e3920 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 1.050525 Sep 18 01:19:07.468683 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1770/3638] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:06 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:07.479850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:07.502055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:07.559658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:07.563586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:07.567325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:07.569832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:07.570333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:07.574239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:07.933748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:07.958642 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b139b2c-2692-4bfe-ab14-36807133160e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1730 microversion: 2.1 time: 0.723724 Sep 18 01:19:07.960088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1869/3639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:07 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1730 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:07.967943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:07.982231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:08.003459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:08.004576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:08.005229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:08.006571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:08.007451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:08.012822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:08.148760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:08.165860 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bffb98c4-e08c-42e4-a81f-2ee898827c72 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1512 microversion: 2.1 time: 0.690881 Sep 18 01:19:08.177581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1771/3640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:07 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:08.548893 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:08.581264 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-542430a2-b40e-476c-8332-a2baaea3cb77 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.615705 Sep 18 01:19:08.595715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1870/3641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:07 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:08.626725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:08.632701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:08.674097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:08.677950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:08.679889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:08.682801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:08.686628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:08.687458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:09.090171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:09.117383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:09.121276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:09.123321 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e58c3c68-2114-4e8c-a567-74755bebe8de tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.526376 Sep 18 01:19:09.124878 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1871/3642] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:08 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:09.132562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:09.133646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:09.141752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:09.142624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:09.143274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:09.144212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:09.145502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:09.146863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:09.282423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:09.288540 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:09.311838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:09.314027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:09.316185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:09.319683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:09.322932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:09.324707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:09.775912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30632f3b-5bfe-4c00-a760-83d2cc453791 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.604051 Sep 18 01:19:09.776752 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1772/3643] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:19:08 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-interface => generated 285 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:09.783111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:09.787536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:09.804873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:09.805436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:09.808255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:09.810019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:09.814849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:09.815858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:09.889019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:09.934787 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e9dbeb2-808b-4fff-bf8c-3b2d56583454 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1318 microversion: 2.1 time: 0.791468 Sep 18 01:19:09.936332 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1872/3644] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:09 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:09.945026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c7c16f15-4bcc-4974-bc78-2933ed9c8db6 req-e75d8f1a-33c8-44dd-8367-166bdbba6141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ed2e44-0f5a-4d0d-9870-2911d2dfaa88", "name": "network-vif-deleted", "tag": "79579eac-5188-4f7e-bb9c-99d58987f9ab"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:09.990622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c7c16f15-4bcc-4974-bc78-2933ed9c8db6 req-e75d8f1a-33c8-44dd-8367-166bdbba6141 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:09.998264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c7c16f15-4bcc-4974-bc78-2933ed9c8db6 req-e75d8f1a-33c8-44dd-8367-166bdbba6141 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:10.001092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c7c16f15-4bcc-4974-bc78-2933ed9c8db6 req-e75d8f1a-33c8-44dd-8367-166bdbba6141 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:10.024688 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:10.070323 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c7c16f15-4bcc-4974-bc78-2933ed9c8db6 req-e75d8f1a-33c8-44dd-8367-166bdbba6141 service nova] Creating event network-vif-deleted:79579eac-5188-4f7e-bb9c-99d58987f9ab for instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 on n-h2-master-1 Sep 18 01:19:10.091346 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c7c16f15-4bcc-4974-bc78-2933ed9c8db6 req-e75d8f1a-33c8-44dd-8367-166bdbba6141 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150481 Sep 18 01:19:10.097262 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1873/3645] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:10.122774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:10.129683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:10.164840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:10.166141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:10.168064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:10.171905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:10.174505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:10.182256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:10.210448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:10.236441 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b48267c-9ecc-472f-a1e7-525a5253f702 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 200 len: 1302 microversion: 2.1 time: 0.458261 Sep 18 01:19:10.266588 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1773/3646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:09 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 1302 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:10.278757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:10.282323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:10.320833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:10.326383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:10.330176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:10.331669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:10.332785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:10.333672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:10.776208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:10.792542 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3bf653de-a01e-4326-8979-17c45bf0b22e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.692519 Sep 18 01:19:10.796006 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1874/3647] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:10 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:10.961239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:10.961737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:10.963002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:10.983053 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:10.998564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.001729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:11.003268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.008249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:11.009575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:11.013913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.015342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.016586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:11.028481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0a326d30-21f7-4da2-b58c-c914c4fc0e53 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.756736 Sep 18 01:19:11.030443 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1774/3648] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:10 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:11.276727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:11.276727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:11.333329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.334280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.348799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:11.351533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.352079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.356988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:11.414985 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 HTTP/1.1 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '83ed2e44-0f5a-4d0d-9870-2911d2dfaa88'} Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:11.421715 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:11.430876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:11.430876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:11.430876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:11.430876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:11.430876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:11.430876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:19:11.430876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:11.437219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:11.438802 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcfc0dc0-950a-440d-9177-fef9078978e1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 404 len: 111 microversion: 2.1 time: 0.176447 Sep 18 01:19:11.443370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1775/3649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:11 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:19:11.457692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:11.462801 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:11.482766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.486166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.487585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:11.489862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.497185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.499236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:11.530047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:11.557180 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad7d095b-5065-410d-b80a-9003f3603da9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1468 microversion: 2.1 time: 0.599868 Sep 18 01:19:11.588404 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1875/3650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:10 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1468 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:11.597355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:11.607241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:11.631145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.632495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.635527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:11.637958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:11.638660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:11.639273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:12.037058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:12.053368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-32acd4b9-26a5-486d-8252-42cd42727ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.606743 Sep 18 01:19:12.057084 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1776/3651] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:11 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:12.078506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:12.079538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:12.099525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:12.104040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:12.104886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:12.108912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:12.109733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:12.110515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:12.151725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:12.161736 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4303464b-bea7-4584-8fa1-2fd5da4c6973 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 200 len: 1466 microversion: 2.1 time: 0.572024 Sep 18 01:19:12.164353 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1876/3652] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:11 2022] GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 1466 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:12.190531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45b8e4ea-ff14-4b2d-9e5f-d626f345ea10 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:12.217161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45b8e4ea-ff14-4b2d-9e5f-d626f345ea10 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:12.218394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45b8e4ea-ff14-4b2d-9e5f-d626f345ea10 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:12.222198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45b8e4ea-ff14-4b2d-9e5f-d626f345ea10 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:12.354899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-45b8e4ea-ff14-4b2d-9e5f-d626f345ea10 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Going to try to stop instance {{(pid=122374) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:19:12.518785 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-45b8e4ea-ff14-4b2d-9e5f-d626f345ea10 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action" status: 202 len: 0 microversion: 2.1 time: 0.350507 Sep 18 01:19:12.519975 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1877/3653] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:12 2022] POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:19:12.548655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:12.560019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:12.601718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:12.607595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:12.607595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:12.607595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:12.608120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:12.636857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:12.658026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:12.667856 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82110a8e-383f-43df-af7e-bdb5859355a9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.605699 Sep 18 01:19:12.668451 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1777/3654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:12 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:12.686966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1404556126"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:12.715531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:12.733806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:12.734600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:12.735223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:12.736140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:12.736760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:12.737425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:13.103065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:13.120951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:13.124503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:13.126310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-47e437e2-43ed-4049-b35f-6c6724d46d68 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.602609 Sep 18 01:19:13.132111 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1878/3655] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:12 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:13.137104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2614b1ff-74e9-4617-a251-fc824d7689bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2614b1ff-74e9-4617-a251-fc824d7689bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 163 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": 12345, "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 12345 Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:19:13.148162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 18 01:19:13.154024 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:13.161435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2614b1ff-74e9-4617-a251-fc824d7689bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:13.165310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2614b1ff-74e9-4617-a251-fc824d7689bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.031989 Sep 18 01:19:13.166594 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1879/3656] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:13 2022] POST /compute/v2.1/servers => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:13.180284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:13.181513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:13.194833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:13.212081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:13.215343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:13.216954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:13.220229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:13.221303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:13.246249 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a405b5b1-6751-4a85-b7c5-3ed9daf6b3a5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "POST /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208/action" status: 202 len: 0 microversion: 2.1 time: 0.562173 Sep 18 01:19:13.255022 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1778/3657] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:12 2022] POST /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:19:13.273402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:13.274391 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:13.293618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:13.294443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:13.299467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:13.300387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:13.301012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:13.301585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:13.715828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:13.750787 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-752b50d4-b3a1-43ba-a1b7-6332d32d8807 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1675 microversion: 2.1 time: 0.582460 Sep 18 01:19:13.770802 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1880/3658] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:13 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1675 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:13.819837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b862c189-f18d-457d-8849-e77d4581b716 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006c25670>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:13.993683 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b862c189-f18d-457d-8849-e77d4581b716 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.215124 Sep 18 01:19:13.997010 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1881/3659] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:13 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:14.013204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:14.014542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:14.043689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:14.048893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:14.049852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:14.051092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:14.058602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:14.059485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:14.102193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:14.110553 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-504d436e-8d17-4a3a-9002-be8cc4ff0a77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.859994 Sep 18 01:19:14.111138 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1779/3660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:13 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:14.160030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:14.161021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:14.197930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:14.206963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:14.210875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:14.212470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:14.215879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:14.217177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:14.703902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:14.741533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:14.746997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:14.757754 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a2ee739d-0675-450c-aca9-f873ebf8a71b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.602431 Sep 18 01:19:14.769597 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1780/3661] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:14 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:14.785004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:14.786273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:14.800075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:14.810859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:14.812490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:14.814504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:14.815924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:14.817240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:14.884834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:14.920640 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-569d4461-5321-4ee7-af9b-cfd6b6957910 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.921337 Sep 18 01:19:14.958092 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1882/3662] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:13 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:14.988161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:14.999274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:15.030811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:15.032108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:15.033200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:15.034834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:15.035995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:15.037103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:15.477781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:15.486589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-44e5dd3c-8b2d-4c07-a9ff-5265333832d6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1675 microversion: 2.1 time: 0.522348 Sep 18 01:19:15.491233 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1883/3663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:14 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1675 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:15.496665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd426000-f57f-4c7f-9815-5acd7e887398 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005e9b3a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:15.593168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:15.609374 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88f59a0a-8fe7-4159-8f2f-9763928897f2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.848051 Sep 18 01:19:15.613575 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1781/3664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:14 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:15.660440 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dd426000-f57f-4c7f-9815-5acd7e887398 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.167037 Sep 18 01:19:15.670205 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1884/3665] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:15 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:15.796136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:15.798610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:15.831299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:15.837658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:15.840701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:15.862311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:15.863936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:15.882580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:15.985243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:15.986793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:16.008730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:16.009708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:16.010381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:16.011310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:16.015129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:16.015889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:16.437192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:16.453684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:16.477797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:16.484645 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-35a5a41e-5466-4d44-afde-8100ebe44064 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.699532 Sep 18 01:19:16.501442 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1782/3666] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:15 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:16.557151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:16.562340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:16.568077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:16.579415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:16.581022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:16.583051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:16.585121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:16.586006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:16.586244 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ab40a73-2f73-4878-8770-d03e6dc2d6ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.602409 Sep 18 01:19:16.587552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:16.601290 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1885/3667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:15 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:16.677341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-542828f5-cc84-4263-944a-46f02dd17bea tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005e9b700>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:16.864621 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-542828f5-cc84-4263-944a-46f02dd17bea tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.191171 Sep 18 01:19:16.908553 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1886/3668] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:16 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:16.931712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:16.942498 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e947dd91-8308-494e-a44b-4a24c29a76bb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1675 microversion: 2.1 time: 0.409641 Sep 18 01:19:16.946639 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1783/3669] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:16 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1675 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:17.516476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5950b512-82ea-4023-a751-aa8b00bdc478 req-652a654e-596c-417c-be91-f15b10631048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68599e5f-a57f-4820-b215-7ad064c4d1ad", "tag": "526a01a9-634f-4f06-bafc-d867b3f4007b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:17.539201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5950b512-82ea-4023-a751-aa8b00bdc478 req-652a654e-596c-417c-be91-f15b10631048 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:17.546888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:17.547869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:17.553956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5950b512-82ea-4023-a751-aa8b00bdc478 req-652a654e-596c-417c-be91-f15b10631048 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:17.554777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5950b512-82ea-4023-a751-aa8b00bdc478 req-652a654e-596c-417c-be91-f15b10631048 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:17.561365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:17.562406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:17.563105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:17.564104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:17.564801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:17.565473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:17.580004 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5950b512-82ea-4023-a751-aa8b00bdc478 req-652a654e-596c-417c-be91-f15b10631048 service nova] Creating event network-changed:526a01a9-634f-4f06-bafc-d867b3f4007b for instance 68599e5f-a57f-4820-b215-7ad064c4d1ad on n-h2-master-1 Sep 18 01:19:17.596713 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5950b512-82ea-4023-a751-aa8b00bdc478 req-652a654e-596c-417c-be91-f15b10631048 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086210 Sep 18 01:19:17.598110 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1887/3670] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:17.611472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:17.615884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:17.628291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:17.635211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:17.635957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:17.638164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:17.643042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:17.643789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:17.977087 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:17.989460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:17.994937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:18.000016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eb830c63-5e31-44ed-a5cd-b2b228398b57 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.456618 Sep 18 01:19:18.024305 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1784/3671] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:17 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:19:18.029896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1fa2b21d-f83b-403b-8644-2ccf2898e2db tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005352040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:18.064332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:18.083819 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee0a8bd1-df54-4652-9d8c-6314306bc9a7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 0.475060 Sep 18 01:19:18.086131 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1888/3672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:17 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:18.110561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:18.115481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:18.121471 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1fa2b21d-f83b-403b-8644-2ccf2898e2db tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.093104 Sep 18 01:19:18.122389 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1785/3673] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:18 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:18.127049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:18.128349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:18.128805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:18.129700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:18.130169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:18.130600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:18.442593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:18.457028 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-40fb0378-b573-4dd4-b711-c4881ab8d6df tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1675 microversion: 2.1 time: 0.367079 Sep 18 01:19:18.457467 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1889/3674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:18 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1675 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:19.029856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:19.031088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:19.050309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:19.054251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:19.054995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:19.057051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:19.060393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:19.061184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:19.126173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:19.128481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:19.139888 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:19.157336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:19.158074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:19.160042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:19.161518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:19.162550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:19.163083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:20.509903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:20.527160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:20.534038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:20.537996 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90717cff-7cd7-4142-9b01-aaa608909049 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 1.509607 Sep 18 01:19:20.539272 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1786/3675] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:19 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:20.554541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:20.560438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b048183-a9f8-46ab-b68f-42dfb605ed06 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005352ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:20.570926 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6115c7b1-6163-4504-8505-9858f79b244f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1511 microversion: 2.1 time: 1.456238 Sep 18 01:19:20.574662 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1890/3676] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:19 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1511 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:20.590300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:20.591134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:20.610647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:20.610647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:20.610647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:20.611255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:20.611722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:20.612151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:20.671072 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b048183-a9f8-46ab-b68f-42dfb605ed06 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.130383 Sep 18 01:19:20.671980 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1787/3677] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:20 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:20.689458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-41f2d956-276b-4c60-81a9-4597755efc78 req-ddfc95c7-3658-4b75-b953-151ea9455055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68599e5f-a57f-4820-b215-7ad064c4d1ad", "tag": "526a01a9-634f-4f06-bafc-d867b3f4007b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:20.724484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-41f2d956-276b-4c60-81a9-4597755efc78 req-ddfc95c7-3658-4b75-b953-151ea9455055 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:20.729696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-41f2d956-276b-4c60-81a9-4597755efc78 req-ddfc95c7-3658-4b75-b953-151ea9455055 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:20.730374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-41f2d956-276b-4c60-81a9-4597755efc78 req-ddfc95c7-3658-4b75-b953-151ea9455055 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:20.749442 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-41f2d956-276b-4c60-81a9-4597755efc78 req-ddfc95c7-3658-4b75-b953-151ea9455055 service nova] Creating event network-changed:526a01a9-634f-4f06-bafc-d867b3f4007b for instance 68599e5f-a57f-4820-b215-7ad064c4d1ad on n-h2-master-1 Sep 18 01:19:20.758783 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-41f2d956-276b-4c60-81a9-4597755efc78 req-ddfc95c7-3658-4b75-b953-151ea9455055 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084049 Sep 18 01:19:20.760867 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1788/3678] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:20.767295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6db207b2-6296-470e-828c-75c8090855da tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523844498", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c46008fa-8dcf-44f1-9e15-09397620e18c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:20.979989 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6db207b2-6296-470e-828c-75c8090855da tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Block Device c46008fa-8dcf-44f1-9e15-09397620e18c is not bootable. Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6db207b2-6296-470e-828c-75c8090855da tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 358 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523844498", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c46008fa-8dcf-44f1-9e15-09397620e18c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: exception: Block Device c46008fa-8dcf-44f1-9e15-09397620e18c is not bootable. Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1523844498', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c46008fa-8dcf-44f1-9e15-09397620e18c'}], 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c46008fa-8dcf-44f1-9e15-09397620e18c is not bootable. Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:20.992152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c46008fa-8dcf-44f1-9e15-09397620e18c is not bootable. Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c46008fa-8dcf-44f1-9e15-09397620e18c is not bootable. Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6db207b2-6296-470e-828c-75c8090855da tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Block Device c46008fa-8dcf-44f1-9e15-09397620e18c is not bootable. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6db207b2-6296-470e-828c-75c8090855da tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.237273 Sep 18 01:19:21.002368 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1789/3679] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:21.013734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:21.014972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:21.040452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:21.041203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:21.041816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:21.043439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:21.044382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:21.044934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:21.430623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:21.460215 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-892519eb-5e21-4b82-a561-e85997f3ea19 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1675 microversion: 2.1 time: 0.883878 Sep 18 01:19:21.490322 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1891/3680] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:20 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1675 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:21.580990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:21.582797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:21.614666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:21.618609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:21.619965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:21.623764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:21.625693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:21.626944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:21.772106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:21.782397 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47c1d6bd-0db7-42ba-bfa2-a24ae0c775f8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.776716 Sep 18 01:19:21.788864 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1790/3681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:21 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:21.812683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:21.813487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:21.833618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:21.834207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:21.835281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:21.836095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:21.836561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:21.836993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:22.758207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:22.792926 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-37318433-ceec-4e84-9668-e3ef71f88010 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1488 microversion: 2.1 time: 1.002559 Sep 18 01:19:22.830975 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1791/3682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:21 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1488 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:22.860018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f160b4c-353f-486c-8d3e-b84a275d4361 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052d2280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:22.871573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:22.889301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:22.893910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:22.899118 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bf6b70e7-c3ad-4c34-ad28-9b9407b6c22a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 1.320206 Sep 18 01:19:22.900033 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1892/3683] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:21 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:22.905029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:22.924900 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:22.932292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:22.932730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:22.933171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:22.933906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:22.934363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:22.936976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.038032 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f160b4c-353f-486c-8d3e-b84a275d4361 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.205335 Sep 18 01:19:23.039943 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1792/3684] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:22 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:23.058443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:23.060391 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:23.072776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.073489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.074327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.075178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.075783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.076481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.545317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:23.569867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:23.589521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8590a4a-9f3e-4aa4-9b16-70b48302f494 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1675 microversion: 2.1 time: 0.547138 Sep 18 01:19:23.591650 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-03c35d5c-85d5-4bde-8553-ac87c5e95c3d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.683995 Sep 18 01:19:23.593132 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1893/3685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:22 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:23.600667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1793/3686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:23 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1675 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:23.627882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:23.638020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:23.663560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.664658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.666236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.669799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.672541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.675480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.696994 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:23.838641 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e5dcc61-3f69-46ad-ac75-7c17fa4b36f1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 200 len: 161 microversion: 2.1 time: 0.234382 Sep 18 01:19:23.840392 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1894/3687] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:23 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 161 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:23.855432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:23.859763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:23.878632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.879741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.880418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.881427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.882960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.883878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.945030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:23.949145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:23.971067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.972496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.974256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:23.976683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:23.981129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:23.982866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:24.383827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:24.392547 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7784fcf2-2cb2-4539-bcf5-1402ed07e286 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.545612 Sep 18 01:19:24.421507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1794/3688] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:23 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:24.458570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bdfa21b-5ad0-40ba-b72e-89bcabe6c193 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052d2040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:24.594062 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bdfa21b-5ad0-40ba-b72e-89bcabe6c193 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.168284 Sep 18 01:19:24.597978 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1795/3689] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:24 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:24.608627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:24.611303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:24.627453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:24.628535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:24.629155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:24.630118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:24.633526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:24.635980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:25.188744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:25.216329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:25.237085 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-945df721-37da-4c2e-a456-2364557f48c4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.635637 Sep 18 01:19:25.248848 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:25.253493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:25.260307 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1796/3690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:24 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:25.263156 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9afe44af-191d-48d2-8057-3fd1edc763e5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 1.336646 Sep 18 01:19:25.277386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1895/3691] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:23 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:25.283241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:25.288354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:25.302034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:25.305880 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:25.317830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:25.330644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:25.332215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:25.337341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:25.340157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:25.345870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:25.351718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:25.352657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:25.353087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:25.359220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:25.360370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:25.361664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:26.127386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:26.147619 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff1a5dbb-1075-4396-a58a-4bf1a06511dd tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1652 microversion: 2.1 time: 0.879605 Sep 18 01:19:26.149806 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1797/3692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:25 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1652 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:26.161969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ad356f71-0f82-4f17-869a-bc469b63b590 req-80e18a8f-b397-429e-88fd-db0d00aa45a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa157-6b6f-48ef-9827-7e92ff6b9208", "name": "network-vif-plugged", "status": "completed", "tag": "2bcc5467-2ebf-408b-ad54-6161ef7e1e1f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:26.190427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ad356f71-0f82-4f17-869a-bc469b63b590 req-80e18a8f-b397-429e-88fd-db0d00aa45a8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:26.192651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ad356f71-0f82-4f17-869a-bc469b63b590 req-80e18a8f-b397-429e-88fd-db0d00aa45a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:26.193392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ad356f71-0f82-4f17-869a-bc469b63b590 req-80e18a8f-b397-429e-88fd-db0d00aa45a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:26.231671 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ad356f71-0f82-4f17-869a-bc469b63b590 req-80e18a8f-b397-429e-88fd-db0d00aa45a8 service nova] Creating event network-vif-plugged:2bcc5467-2ebf-408b-ad54-6161ef7e1e1f for instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 on n-h1-master-1 Sep 18 01:19:26.252052 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ad356f71-0f82-4f17-869a-bc469b63b590 req-80e18a8f-b397-429e-88fd-db0d00aa45a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097660 Sep 18 01:19:26.255309 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1798/3693] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:26.269386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-406975bc-30ce-4849-a9e0-7edbdc8bdc05 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70053c10d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:26.347210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:26.390683 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42c72adc-556d-489e-a11c-6f3551adc425 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.103777 Sep 18 01:19:26.392785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-406975bc-30ce-4849-a9e0-7edbdc8bdc05 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.135482 Sep 18 01:19:26.409581 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1896/3694] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:25 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:26.409917 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1799/3695] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:26 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:26.425598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:26.425598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:26.431257 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-492e3d97-faa2-4772-ab46-7e7901cd752b tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:26.467229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492e3d97-faa2-4772-ab46-7e7901cd752b tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:26.467941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:26.468297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492e3d97-faa2-4772-ab46-7e7901cd752b tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:26.469950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492e3d97-faa2-4772-ab46-7e7901cd752b tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:26.473004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:26.473519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:26.474314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:26.474823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:26.475464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:26.563102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-492e3d97-faa2-4772-ab46-7e7901cd752b tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Going to try to start instance {{(pid=122374) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 01:19:26.806195 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-492e3d97-faa2-4772-ab46-7e7901cd752b tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action" status: 202 len: 0 microversion: 2.1 time: 0.402451 Sep 18 01:19:26.809158 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1897/3696] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:26 2022] POST /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:19:26.825418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:26.828371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:26.898442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:26.899248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:26.902142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:26.903274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:26.904687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:26.906520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:27.243342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:27.259722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:27.262386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:27.264743 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3136ceb-272d-47cf-80f3-bbf92677dd49 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.853531 Sep 18 01:19:27.267965 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1800/3697] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:26 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:27.279741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:27.280659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:27.296640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:27.297416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:27.298141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:27.301072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:27.301821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:27.302495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:28.098921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:28.112959 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-398f2862-ac69-4a48-9167-2850273e6fb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1661 microversion: 2.1 time: 0.843505 Sep 18 01:19:28.114733 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1801/3698] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:27 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1661 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:28.121248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-97f78296-8b60-402d-a5c2-93663b9fa129 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70053b5d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:28.183429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-97f78296-8b60-402d-a5c2-93663b9fa129 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.066752 Sep 18 01:19:28.184354 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1802/3699] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:28 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:28.214502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e15ed0e2-57dc-4063-9b8a-09d507db35ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1920404168", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "destination_type": "local"}, {"source_type": "volume", "uuid": "0dea7da1-7318-4216-a0c5-ac87b291aa22", "destination_type": "invalid"}], "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e15ed0e2-57dc-4063-9b8a-09d507db35ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 495 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1920404168", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "destination_type": "local"}, {"source_type": "volume", "uuid": "0dea7da1-7318-4216-a0c5-ac87b291aa22", "destination_type": "invalid"}], "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1920404168', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0dea7da1-7318-4216-a0c5-ac87b291aa22', 'destination_type': 'invalid'}], 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'invalid' Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:28.219724 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e15ed0e2-57dc-4063-9b8a-09d507db35ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:28.238795 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e15ed0e2-57dc-4063-9b8a-09d507db35ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.016895 Sep 18 01:19:28.241200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:28.241755 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1803/3700] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:28 2022] POST /compute/v2.1/servers => generated 155 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:19:28.241865 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-67b13396-c652-4d72-92ce-71ba7c2d8af1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.426780 Sep 18 01:19:28.241865 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1898/3701] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:26 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:28.249937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:28.251711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:28.270071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:28.270071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:28.273538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:28.275656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:28.276289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:28.278166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:28.299438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:28.300246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:28.316114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:28.323212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:28.324920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:28.335149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:28.339625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:28.343212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:28.773207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:28.795628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:28.797483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:28.800056 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d72c7228-a516-42c4-b8c2-027491a5ae39 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.504884 Sep 18 01:19:28.801334 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1899/3702] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:28 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:28.809275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-139530058", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "65461795-2411-4531-b404-f7689b9c28a9"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:28.904608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] validate_networks() for [('65461795-2411-4531-b404-f7689b9c28a9', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:19:29.037310 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:29.046243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ef8eace-e1cc-4518-9728-4b93e60868f1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.805231 Sep 18 01:19:29.047316 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1804/3703] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:28 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:29.077341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:29.078171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:29.091038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:29.092291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:29.093230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:29.094607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:29.095273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:29.096000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:29.877140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:29.886345 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2fb52f8f-ac95-4037-9493-3276cb07c981 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.812745 Sep 18 01:19:29.910300 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1805/3704] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:29 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:29.938159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:29.942583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:29.955043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:29.958085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:29.959211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:29.963396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:29.964244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:29.964951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:30.678600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:30.702831 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee13307e-715a-4e11-adc0-83c35cd3091c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1665 microversion: 2.1 time: 0.791216 Sep 18 01:19:30.703434 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1806/3705] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:29 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1665 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:30.730332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:19:30.731393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:19:30.732094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:19:30.732681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:19:30.733757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:19:30.735702 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67ba2fb0-eb71-4327-826a-fecb90d62a07 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052bc040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:30.753163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:30.760031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:30.760764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:30.761795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:30.762475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:30.763474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:30.815467 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67ba2fb0-eb71-4327-826a-fecb90d62a07 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.101209 Sep 18 01:19:30.822042 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1807/3706] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:30 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:30.833210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:19:30.838276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:30.840894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for user 0212658356c1456ebe01dfe00dcd4fd2 and project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:19:30.842710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:30.851566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:30.853056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:30.853866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:30.855177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:30.856033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:30.856709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:30.870729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:19:30.873191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:19:30.979265 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f466468f-7107-4fd2-8b82-5b1a19b4d253 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.176524 Sep 18 01:19:30.980631 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1900/3707] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:19:30.987300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45aac74e-2eba-4ce9-b124-9bd857f49f99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1102693051", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45aac74e-2eba-4ce9-b124-9bd857f49f99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 492 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1102693051", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1102693051', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:30.996666 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 18 01:19:31.000988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:31.004494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45aac74e-2eba-4ce9-b124-9bd857f49f99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:31.005670 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-45aac74e-2eba-4ce9-b124-9bd857f49f99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.023773 Sep 18 01:19:31.006852 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1901/3708] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:30 2022] POST /compute/v2.1/servers => generated 624 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:31.016280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-054b7ba9-2758-42ea-a2c7-47ed6690d434 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:31.017256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-054b7ba9-2758-42ea-a2c7-47ed6690d434 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:31.158414 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-054b7ba9-2758-42ea-a2c7-47ed6690d434 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:31.169602 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-054b7ba9-2758-42ea-a2c7-47ed6690d434 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1214 microversion: 2.1 time: 0.161338 Sep 18 01:19:31.172336 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1902/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:31 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:31.183565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:31.189356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:31.210786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:31.211458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:31.213777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:31.217282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:31.218389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:31.219670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:31.705990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:31.720638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:31.734339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:31.739857 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ec79761-f25f-4d77-b049-1971dd010609 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.915799 Sep 18 01:19:31.759014 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1808/3710] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:30 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:31.844359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b8fb781-d8bb-45b9-82e0-2779308aed7a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052c8310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:31.932751 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b8fb781-d8bb-45b9-82e0-2779308aed7a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.093708 Sep 18 01:19:31.934849 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1809/3711] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:31 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:31.948176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:31.959644 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-44cd92e8-8e21-4df9-ba5a-76fdb5d10f64 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.785688 Sep 18 01:19:31.977584 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1903/3712] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:31 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:31.996764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:31.998724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:32.010135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.011252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.011901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:32.012811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.013504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.014687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:32.195338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:32.196062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:32.211354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.211948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.212514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:32.213303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.213880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.223752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:32.502051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:32.516179 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-627aea19-a12b-4e3a-bbb9-e0911260b15d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1210 microversion: 2.1 time: 0.324764 Sep 18 01:19:32.517324 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1904/3713] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:32 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1210 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:32.618492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:32.634034 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f0c8b07-ad92-458c-9d4f-758958db5103 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.646013 Sep 18 01:19:32.634946 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1810/3714] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:31 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:32.774880 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7330ebcd-1556-46d9-a1bf-93f1c9cb167b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:32.775933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:32.775933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:32.784422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.784906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.785662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:32.786568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.791009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7330ebcd-1556-46d9-a1bf-93f1c9cb167b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 416 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:32.791307 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7330ebcd-1556-46d9-a1bf-93f1c9cb167b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7330ebcd-1556-46d9-a1bf-93f1c9cb167b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.036106 Sep 18 01:19:32.801984 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1905/3715] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:32.808707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:32.818185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:32.820667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:32.837899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.840019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.842287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:32.843284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:32.846778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:32.847469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:33.328885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:33.355331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:33.359833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:33.372702 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68d04df9-df77-4cc3-8aa3-6620b7248712 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.605062 Sep 18 01:19:33.379009 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1811/3716] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:32 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:19:33.398018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-349c86ee-cc50-4bbe-9686-a4d1e8050d66 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005277310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:33.567594 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-349c86ee-cc50-4bbe-9686-a4d1e8050d66 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.186449 Sep 18 01:19:33.576128 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1812/3717] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:33 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:33.609923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:33.612527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:33.617416 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=74 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:33.636189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:33.637386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:33.638337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:33.650758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:33.652381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:33.653317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:33.713890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:33.748169 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c10feb18-2338-43bb-8027-9e7624b37951 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.947973 Sep 18 01:19:33.750668 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1906/3718] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:32 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:33.779702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:33.785775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:33.799150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:33.799797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:33.801408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:33.802673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:33.805262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:33.806275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:33.807152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:33.811586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a84b1378-68b4-4f31-ac45-c0e813ee4ee4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1272 microversion: 2.1 time: 0.231546 Sep 18 01:19:33.812698 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1813/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:33 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:34.186286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:34.195303 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-43f2cf48-7d23-4459-9c58-1c2eb00f5f11 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.424473 Sep 18 01:19:34.202813 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1907/3720] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:33 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:34.321860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac18d1a8-e9fb-4309-a90f-0d2dd4785c69 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-247577358", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": -1, "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:34.370416 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ac18d1a8-e9fb-4309-a90f-0d2dd4785c69 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Flavor -1 could not be found. Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac18d1a8-e9fb-4309-a90f-0d2dd4785c69 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 205 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-247577358", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": -1, "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: exception: Flavor -1 could not be found. Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-247577358', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': -1, 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:34.376634 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:34.382094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac18d1a8-e9fb-4309-a90f-0d2dd4785c69 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:34.388097 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac18d1a8-e9fb-4309-a90f-0d2dd4785c69 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.066740 Sep 18 01:19:34.392381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:34.393006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:34.399742 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1814/3721] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:34 2022] POST /compute/v2.1/servers => generated 73 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:19:34.413947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:34.414457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:34.414905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:34.415634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:34.428536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:34.429581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:34.432078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:34.441747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:34.488596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:34.503346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:34.505621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:34.506642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:34.510622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:34.511877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:34.523496 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:35.674466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:35.696048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:35.697997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:35.699448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f06a17bd-aca5-4a8e-82f8-993e06e251f1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 1.295359 Sep 18 01:19:35.700804 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1815/3722] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:34 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:35.716118 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-530c40da-f6e8-4ff0-bc25-faf8bbb26c4f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052814c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:35.759902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:35.772472 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d05ae871-2312-48f3-a5c0-83a9d9514df1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.384310 Sep 18 01:19:35.776374 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1908/3723] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:34 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:35.784702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:35.785324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:35.809995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:35.811316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:35.812667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:35.814182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:35.817263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:35.818182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:35.843662 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-530c40da-f6e8-4ff0-bc25-faf8bbb26c4f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.141181 Sep 18 01:19:35.849328 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1816/3724] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:35 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:35.884009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-81f534fd-cf40-4833-9acb-e4eca49d5bfe req-4c87525a-f436-4d68-a7cf-725e780d1088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "name": "network-vif-plugged", "status": "completed", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:35.906559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-81f534fd-cf40-4833-9acb-e4eca49d5bfe req-4c87525a-f436-4d68-a7cf-725e780d1088 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:35.907790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-81f534fd-cf40-4833-9acb-e4eca49d5bfe req-4c87525a-f436-4d68-a7cf-725e780d1088 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:35.909388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-81f534fd-cf40-4833-9acb-e4eca49d5bfe req-4c87525a-f436-4d68-a7cf-725e780d1088 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:35.934481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-81f534fd-cf40-4833-9acb-e4eca49d5bfe req-4c87525a-f436-4d68-a7cf-725e780d1088 service nova] Creating event network-vif-plugged:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h1-master-1 Sep 18 01:19:35.948271 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-81f534fd-cf40-4833-9acb-e4eca49d5bfe req-4c87525a-f436-4d68-a7cf-725e780d1088 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088861 Sep 18 01:19:35.953290 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1817/3725] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:35.972191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:35.974108 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:36.011156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:36.019932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:36.025876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:36.043240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:36.047511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:36.049206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:36.151578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:36.175870 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41b9cf6e-491c-4006-bb63-4801169d24b3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1272 microversion: 2.1 time: 0.397869 Sep 18 01:19:36.182640 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1909/3726] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:35 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:36.686059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:36.686059 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f445086-75f5-435c-ad7a-5adc93704bce tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.709469 Sep 18 01:19:36.686059 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1818/3727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:35 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:36.725853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:36.726623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:36.748887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:36.749425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:36.752649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:36.764424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:36.769462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:36.770404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:36.866564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-666c75af-8f41-4f48-80b8-f598d88a050a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005352ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:36.975883 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-666c75af-8f41-4f48-80b8-f598d88a050a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.115231 Sep 18 01:19:36.987833 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1819/3728] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:36 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:37.088083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-647d52e4-beca-482c-9421-074bbd96858b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-807697361", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-647d52e4-beca-482c-9421-074bbd96858b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 172 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-807697361", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-807697361', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi -1 Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:19:37.095794 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 18 01:19:37.101567 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:37.107608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-647d52e4-beca-482c-9421-074bbd96858b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:37.109002 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-647d52e4-beca-482c-9421-074bbd96858b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.027362 Sep 18 01:19:37.110489 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1820/3729] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:37 2022] POST /compute/v2.1/servers => generated 145 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:37.152534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:37.153466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:37.162700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:37.163366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:37.164125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:37.164980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:37.165654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:37.166221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:38.171005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:38.183218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:38.198009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:38.198368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d2d3caa-86af-4abf-affb-363007890258 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.065108 Sep 18 01:19:38.199797 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1821/3730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:37 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:38.209108 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:38.210111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:38.210945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:38.212405 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0af777d0-2bb5-4fc8-8902-03d6f4ae55f8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 1.491987 Sep 18 01:19:38.221932 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1910/3731] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:36 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:38.222862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:38.226713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:38.227737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:38.229343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:38.230436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:38.232097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:38.245485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb2dd450-25b6-4d46-9c14-b7a27840fd7f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70063d55e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:38.768416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:38.781880 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91ea3b31-ffa6-4014-a5c9-979f1e2420c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.580137 Sep 18 01:19:38.783520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1822/3732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:38 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:38.791181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:38.792900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:38.815175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:38.820008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:38.820819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:38.824872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:38.825432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:38.827467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:39.109159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:39.123455 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-451deb10-0ea5-4fcc-9f1e-6076062ec732 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.338334 Sep 18 01:19:39.124993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1823/3733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:38 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:39.251034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:39.251846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:39.264772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:39.266438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:39.267318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:39.268376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:39.269076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:39.269987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:39.791674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:39.816145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:39.819407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:39.821044 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07836c6b-c3ef-4d97-b28d-55f98f9c1ae1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1807 microversion: 2.20 time: 0.575298 Sep 18 01:19:39.822381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1824/3734] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:39 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1807 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:19:39.827967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8cbddd23-0122-4c29-bc88-db3dd8b652d8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-959755093", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:39.834544 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-8cbddd23-0122-4c29-bc88-db3dd8b652d8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8cbddd23-0122-4c29-bc88-db3dd8b652d8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 215 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-959755093", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-959755093', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:39.836608 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:39.841335 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:39.841335 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:39.841335 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:39.841335 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:39.841335 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:39.841335 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 18 01:19:39.841335 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:39.846134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8cbddd23-0122-4c29-bc88-db3dd8b652d8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:39.849074 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8cbddd23-0122-4c29-bc88-db3dd8b652d8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023988 Sep 18 01:19:39.856981 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1825/3735] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:39 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:39.890052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-3d019c76-a709-4e29-a441-1facac48061d req-65a2fe8c-a06e-441f-b925-0cf7e6c3fe8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e", "tag": "4c635477-f2c9-4742-bdfe-5c726303ec90"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:39.902418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3d019c76-a709-4e29-a441-1facac48061d req-65a2fe8c-a06e-441f-b925-0cf7e6c3fe8d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:39.903403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3d019c76-a709-4e29-a441-1facac48061d req-65a2fe8c-a06e-441f-b925-0cf7e6c3fe8d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:39.903945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3d019c76-a709-4e29-a441-1facac48061d req-65a2fe8c-a06e-441f-b925-0cf7e6c3fe8d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:39.917106 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-3d019c76-a709-4e29-a441-1facac48061d req-65a2fe8c-a06e-441f-b925-0cf7e6c3fe8d service nova] Creating event network-changed:4c635477-f2c9-4742-bdfe-5c726303ec90 for instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e on n-h2-master-1 Sep 18 01:19:39.931368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-3d019c76-a709-4e29-a441-1facac48061d req-65a2fe8c-a06e-441f-b925-0cf7e6c3fe8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075334 Sep 18 01:19:39.932546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1826/3736] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:39.940883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:39.943740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:39.953441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:39.954465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:39.955220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:39.957763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:39.958487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:39.960496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:40.166040 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb2dd450-25b6-4d46-9c14-b7a27840fd7f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 1.942848 Sep 18 01:19:40.184386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1911/3737] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:38 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:40.200053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:40.203506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:40.225250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:40.230604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:40.231527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:40.234882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:40.235713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:40.241998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:40.339418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:40.368108 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-109e849b-b22d-48e1-8475-10a7fa28c020 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.434047 Sep 18 01:19:40.374463 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1827/3738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:39 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:40.750484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:40.761888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ccb8d44-3686-4522-acb4-4795c6e3079e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.575703 Sep 18 01:19:40.771488 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1912/3739] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:40 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:40.807944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:40.808874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:40.820869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:40.826310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:40.827243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:40.828028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:40.828603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:40.829051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:40.856299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:40.857074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:40.879909 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:40.892614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:40.893119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:40.893580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:40.894314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:40.894779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:40.910824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:41.164251 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:41.269591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:41.290290 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a4906fb-7d91-4fdb-829b-64f16e8a83bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.487607 Sep 18 01:19:41.292098 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1828/3740] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:40 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:41.316218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e4651b4-4769-47f0-9a30-7146e3612ff1 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052bcf70>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:41.346665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:41.364065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:41.368840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:41.370203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d3b7561-4caa-4ae1-a242-e7b486e3560a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1794 microversion: 2.20 time: 0.519433 Sep 18 01:19:41.375737 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1913/3741] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:19:40 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1794 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:19:41.410630 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:41.413055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:41.415608 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:41.434365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:41.435248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:41.435889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:41.437009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:41.437703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:41.439680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:41.443124 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e4651b4-4769-47f0-9a30-7146e3612ff1 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.145621 Sep 18 01:19:41.451818 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1829/3742] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:41 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:41.457437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33668cbb-f2d7-4fea-9d35-4fcd72bf1f28 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-281549923", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-key-93809374", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:41.602515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-33668cbb-f2d7-4fea-9d35-4fcd72bf1f28 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] validate_networks() for [('443217fd-613c-4ff9-8148-2ed9e5504cb6', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:19:41.959767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:41.967066 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:41.969709 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b44cd46-0b84-4b0a-9296-1ed536501f6d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.565502 Sep 18 01:19:41.970317 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1914/3743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:41 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:42.270880 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-33668cbb-f2d7-4fea-9d35-4fcd72bf1f28 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Invalid key_name provided. Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33668cbb-f2d7-4fea-9d35-4fcd72bf1f28 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 244 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-281549923", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-key-93809374", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid key_name provided. Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-281549923', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'key_name': 'tempest-key-93809374', 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-93809374 not found for user 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:42.273804 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 18 01:19:42.279821 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:42.285630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33668cbb-f2d7-4fea-9d35-4fcd72bf1f28 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid key_name provided. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:42.289102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33668cbb-f2d7-4fea-9d35-4fcd72bf1f28 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.836101 Sep 18 01:19:42.291410 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1830/3744] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:41 2022] POST /compute/v2.1/servers => generated 70 bytes in 839 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 18 01:19:42.299913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:42.300720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:42.315885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:42.316488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:42.327360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:42.328638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:42.329420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:42.330050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:42.459140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d268bd07-d62b-4cfa-854c-f59a0c74fcbd tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052bcb80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:42.570815 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d268bd07-d62b-4cfa-854c-f59a0c74fcbd tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.115755 Sep 18 01:19:42.571325 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1831/3745] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:42 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:42.730211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:42.748703 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8380188-99b6-4a41-8d1f-d34634725138 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.452674 Sep 18 01:19:42.749999 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1915/3746] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:42 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:42.809371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:42.810037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:42.819847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:42.828530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:42.829428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:42.830527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:42.831362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:42.838713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:42.997182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:42.997831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:43.010490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:43.011823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:43.012642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:43.017575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:43.020066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:43.022807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:43.103851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:43.115354 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d72ba07f-d02e-4381-9996-e5c262eba7c7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.309475 Sep 18 01:19:43.116509 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1832/3747] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:42 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:43.239626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a14bbf26-2d56-412d-b03c-172b0745f9e2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1477452751", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:43.398642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:43.408065 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f13bad28-db22-4775-887b-cf349583ea8e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.414757 Sep 18 01:19:43.414147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1916/3748] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:42 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:43.480152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.security_group_api [None req-a14bbf26-2d56-412d-b03c-172b0745f9e2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Neutron security group does_not_exist not found {{(pid=122373) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 18 01:19:43.481406 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a14bbf26-2d56-412d-b03c-172b0745f9e2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a14bbf26-2d56-412d-b03c-172b0745f9e2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 258 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1477452751", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1477452751', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 18 01:19:43.500816 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:43.503706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a14bbf26-2d56-412d-b03c-172b0745f9e2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:43.513187 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a14bbf26-2d56-412d-b03c-172b0745f9e2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.268926 Sep 18 01:19:43.513187 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1833/3749] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:43 2022] POST /compute/v2.1/servers => generated 106 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:43.517175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:43.517840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:43.536412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:43.537604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:43.542742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:43.543713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:43.544277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:43.544770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:43.597546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-140d7b13-40bb-46e3-9d93-3ccba227571f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052fa670>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:43.682193 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-140d7b13-40bb-46e3-9d93-3ccba227571f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.088446 Sep 18 01:19:43.682909 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1834/3750] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:43 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:43.960217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:43.976510 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e65bae99-4308-4c65-af36-d33eaa8cb868 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.465144 Sep 18 01:19:43.977819 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1917/3751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:43 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:44.004108 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:44.004733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:44.018955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.019953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.022199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:44.024753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.026252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.026750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:44.255810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:44.268556 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-695d993e-a8f1-4a58-8667-f85be1a8faae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.267879 Sep 18 01:19:44.283028 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1835/3752] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:43 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:44.296498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e03171f5-3c10-4079-9367-ef7ebfb4548c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:44.297403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e03171f5-3c10-4079-9367-ef7ebfb4548c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 4bc461f2-6fdf-4e58-a383-06c4706eed5f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:44.312910 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e03171f5-3c10-4079-9367-ef7ebfb4548c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 4bc461f2-6fdf-4e58-a383-06c4706eed5f could not be found. Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e03171f5-3c10-4079-9367-ef7ebfb4548c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/4bc461f2-6fdf-4e58-a383-06c4706eed5f HTTP/1.1 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4bc461f2-6fdf-4e58-a383-06c4706eed5f could not be found. Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4bc461f2-6fdf-4e58-a383-06c4706eed5f'} Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc461f2-6fdf-4e58-a383-06c4706eed5f could not be found. Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc461f2-6fdf-4e58-a383-06c4706eed5f could not be found. Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:44.314918 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc461f2-6fdf-4e58-a383-06c4706eed5f could not be found. Sep 18 01:19:44.319350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:44.320781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e03171f5-3c10-4079-9367-ef7ebfb4548c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 4bc461f2-6fdf-4e58-a383-06c4706eed5f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:44.321940 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e03171f5-3c10-4079-9367-ef7ebfb4548c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4bc461f2-6fdf-4e58-a383-06c4706eed5f" status: 404 len: 111 microversion: 2.1 time: 0.029410 Sep 18 01:19:44.323076 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1918/3753] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:19:44 2022] DELETE /compute/v2.1/servers/4bc461f2-6fdf-4e58-a383-06c4706eed5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:19:44.339334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:44.340120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:44.352524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.353045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.353494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:44.354264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.354724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.355147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:44.440251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:44.440882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:44.454480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.455219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.459383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:44.461839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.464897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.465800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:44.804630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:44.879172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:44.880253 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c039e54-1e1b-47aa-9c83-337ede9c4c1c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.548845 Sep 18 01:19:44.889848 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1836/3754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:44 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:44.912128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd7ca4ee-5326-4380-8ed4-e7a3c2b985ec tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.461715 Sep 18 01:19:44.912128 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1919/3755] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:44 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:44.912290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc9fc1b6-b443-4449-9131-0bb44fcc34bb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005281d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:44.918605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:44.919690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:44.940019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.940580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.941032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:44.941793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:44.942258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:44.942836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:45.028547 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc9fc1b6-b443-4449-9131-0bb44fcc34bb tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.137875 Sep 18 01:19:45.030381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1837/3756] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:44 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:45.481455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:45.491484 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c36c5dce-4c67-4479-89a0-5eed6c2a020b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.576973 Sep 18 01:19:45.501934 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1920/3757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:44 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:45.521461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-300b2f29-7e33-4685-84e4-dfad58368046 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:45.522492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-300b2f29-7e33-4685-84e4-dfad58368046 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 01:19:45.523524 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-300b2f29-7e33-4685-84e4-dfad58368046 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-300b2f29-7e33-4685-84e4-dfad58368046 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 9223372036854775808 could not be found. Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '9223372036854775808'} Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:45.527159 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:45.531227 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:45.531227 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:45.531227 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:45.531227 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 18 01:19:45.531227 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:45.531827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-300b2f29-7e33-4685-84e4-dfad58368046 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:45.533028 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-300b2f29-7e33-4685-84e4-dfad58368046 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016517 Sep 18 01:19:45.539762 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1838/3758] 10.222.0.25 () {58 vars in 1188 bytes} [Sun Sep 18 01:19:45 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:19:45.548547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:45.550871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:45.559874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:45.560877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:45.561772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:45.562972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:45.563641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:45.564283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:45.864197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:45.917057 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4e7f256-ac03-437a-8b59-a981bcee0c66 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.373426 Sep 18 01:19:45.921348 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1921/3759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:45 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:45.947702 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:45.948692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:45.962357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:45.975959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:45.976838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:45.984070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:45.984862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:45.986470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:45.989130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:45.990272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:45.990951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:45.994195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:45.994994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:45.995953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:46.000112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:46.000880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:46.323914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:46.334334 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-81feacf2-e75a-48ed-b1bf-d1080b1fb349 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.392243 Sep 18 01:19:46.335700 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1839/3760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:45 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:46.340822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05370477-f003-456a-b872-1565939e44a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005281310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:46.348233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:46.359836 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5abe6d95-ba05-4c7a-b8e2-094962c6efc1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.389341 Sep 18 01:19:46.376653 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1922/3761] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:45 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:46.388064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03ec584c-392c-4cf2-a5ee-14f81bc1820e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:46.388622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03ec584c-392c-4cf2-a5ee-14f81bc1820e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Failed to fetch instance by id -1 {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 01:19:46.392737 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-03ec584c-392c-4cf2-a5ee-14f81bc1820e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance -1 could not be found. Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03ec584c-392c-4cf2-a5ee-14f81bc1820e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: exception: Instance -1 could not be found. Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '-1'} Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:46.397407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:46.401178 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:46.401178 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:46.401178 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 18 01:19:46.401178 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:46.401178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03ec584c-392c-4cf2-a5ee-14f81bc1820e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:46.401178 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-03ec584c-392c-4cf2-a5ee-14f81bc1820e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023311 Sep 18 01:19:46.405261 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1923/3762] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:19:46 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:19:46.414821 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05370477-f003-456a-b872-1565939e44a2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1455 microversion: 2.1 time: 0.077235 Sep 18 01:19:46.416319 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1840/3763] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:46 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:46.426245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:46.429458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:46.448025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:46.448536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:46.451512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:46.454120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:46.454687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:46.457821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:46.850206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:46.861956 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e51fdbaf-0025-4bf4-a6e6-021281231d99 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.454678 Sep 18 01:19:46.864414 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1924/3764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:46 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:46.897723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:46.898701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:46.910168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:46.910672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:46.911117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:46.911964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:46.912427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:46.912853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.282664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:47.310504 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7dca39ab-7fba-44a7-acf2-3d39963d71bc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.418098 Sep 18 01:19:47.313890 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1841/3765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:46 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:47.345509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8dfa636-f0fd-4434-b565-3c222c1f03d5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:47.346617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8dfa636-f0fd-4434-b565-3c222c1f03d5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 60d3e060-452f-4a53-823d-7d6b1edf9dbe] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:47.359696 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e8dfa636-f0fd-4434-b565-3c222c1f03d5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 60d3e060-452f-4a53-823d-7d6b1edf9dbe could not be found. Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8dfa636-f0fd-4434-b565-3c222c1f03d5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/60d3e060-452f-4a53-823d-7d6b1edf9dbe/action HTTP/1.1 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 19 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: {"forceDelete": {}} Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 60d3e060-452f-4a53-823d-7d6b1edf9dbe could not be found. Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '60d3e060-452f-4a53-823d-7d6b1edf9dbe', 'body': {'forceDelete': {}}} Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d3e060-452f-4a53-823d-7d6b1edf9dbe could not be found. Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d3e060-452f-4a53-823d-7d6b1edf9dbe could not be found. Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:47.372598 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:47.379401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:47.379401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:47.379401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d3e060-452f-4a53-823d-7d6b1edf9dbe could not be found. Sep 18 01:19:47.379401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:47.384180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8dfa636-f0fd-4434-b565-3c222c1f03d5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 60d3e060-452f-4a53-823d-7d6b1edf9dbe could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:47.385348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:47.386184 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:47.393436 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8dfa636-f0fd-4434-b565-3c222c1f03d5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/60d3e060-452f-4a53-823d-7d6b1edf9dbe/action" status: 404 len: 111 microversion: 2.1 time: 0.052101 Sep 18 01:19:47.399784 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1925/3766] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:47 2022] POST /compute/v2.1/servers/60d3e060-452f-4a53-823d-7d6b1edf9dbe/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:19:47.404634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.405376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.408837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.409456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:47.409668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.410134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.410582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.411144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:47.423282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.424509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.425376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.427236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.427975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.428801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.714946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:47.731193 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3fbc7bb0-a0da-443b-b267-c6231d9d47a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.329612 Sep 18 01:19:47.733788 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1926/3767] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:47 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:47.744268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-331ac6af-e2cf-4049-abc9-e171200998cd tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70061df160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:47.799226 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:47.827237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c4702d7-be80-483b-80f4-c8d764f3ee15 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.446915 Sep 18 01:19:47.830337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-331ac6af-e2cf-4049-abc9-e171200998cd tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1464 microversion: 2.1 time: 0.092830 Sep 18 01:19:47.841037 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1842/3768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:47 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:47.842788 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1927/3769] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:47 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1464 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:47.853418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48a69870-3e4e-4838-8adb-3e918bdafabe tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70062ec9d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:47.855032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:47.855661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:47.887950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.890238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.894233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.895417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.898447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.899225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.938565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48a69870-3e4e-4838-8adb-3e918bdafabe tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 200 len: 1464 microversion: 2.1 time: 0.093353 Sep 18 01:19:47.948470 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1928/3770] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:47 2022] GET /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 1464 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:47.958317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:47.959312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:47.966998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.967808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.970271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:47.971749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:47.973096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:47.974067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:48.309345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:48.324388 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78a045fa-3a73-4c6e-80b6-618818a27559 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 200 len: 1466 microversion: 2.1 time: 0.373050 Sep 18 01:19:48.326343 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1929/3771] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:47 2022] GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 1466 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:48.351815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-893699274"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:48.359076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:48.368818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:48.369329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:48.369804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:48.370520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:48.370979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:48.371903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:48.382973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:48.393928 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ab10b928-0a54-4c14-b0de-ae9f408d8a29 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.551414 Sep 18 01:19:48.398402 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1843/3772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:47 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:48.425595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-339d5b2e-82b4-497e-8e33-7fcd60ad254b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:48.434080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-339d5b2e-82b4-497e-8e33-7fcd60ad254b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 5e46ab4c-eb21-43d5-8566-8f93d873dace] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:48.440791 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-339d5b2e-82b4-497e-8e33-7fcd60ad254b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 5e46ab4c-eb21-43d5-8566-8f93d873dace could not be found. Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-339d5b2e-82b4-497e-8e33-7fcd60ad254b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/5e46ab4c-eb21-43d5-8566-8f93d873dace/action HTTP/1.1 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 39 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: {"os-getConsoleOutput": {"length": 10}} Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5e46ab4c-eb21-43d5-8566-8f93d873dace could not be found. Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5e46ab4c-eb21-43d5-8566-8f93d873dace', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e46ab4c-eb21-43d5-8566-8f93d873dace could not be found. Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e46ab4c-eb21-43d5-8566-8f93d873dace could not be found. Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:48.449897 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e46ab4c-eb21-43d5-8566-8f93d873dace could not be found. Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-339d5b2e-82b4-497e-8e33-7fcd60ad254b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 5e46ab4c-eb21-43d5-8566-8f93d873dace could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-339d5b2e-82b4-497e-8e33-7fcd60ad254b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/5e46ab4c-eb21-43d5-8566-8f93d873dace/action" status: 404 len: 111 microversion: 2.1 time: 0.030816 Sep 18 01:19:48.456632 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1844/3773] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:48 2022] POST /compute/v2.1/servers/5e46ab4c-eb21-43d5-8566-8f93d873dace/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:19:48.463910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:48.465389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:48.505694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:48.506825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:48.507645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:48.507999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:48.508462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:48.508986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:48.835685 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac86e1e0-d432-47b4-92c2-7309f49bc5d5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "POST /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8/action" status: 202 len: 0 microversion: 2.1 time: 0.487725 Sep 18 01:19:48.838225 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1930/3774] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:48 2022] POST /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:19:48.858798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e11c8da-de61-4c46-85a5-f347b336c41f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006d44ca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:48.922799 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e11c8da-de61-4c46-85a5-f347b336c41f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.070238 Sep 18 01:19:48.923603 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1931/3775] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:48 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:48.939851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-9df4b9bc-1d2e-48fd-b318-6f7949203b9e req-ac843747-2bd1-4514-a865-f41a08ea76dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e", "name": "network-vif-plugged", "status": "completed", "tag": "4c635477-f2c9-4742-bdfe-5c726303ec90"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:48.959947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9df4b9bc-1d2e-48fd-b318-6f7949203b9e req-ac843747-2bd1-4514-a865-f41a08ea76dd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:48.960323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9df4b9bc-1d2e-48fd-b318-6f7949203b9e req-ac843747-2bd1-4514-a865-f41a08ea76dd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:48.960758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9df4b9bc-1d2e-48fd-b318-6f7949203b9e req-ac843747-2bd1-4514-a865-f41a08ea76dd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:48.984900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:48.999715 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98de0acd-2698-4ee9-9373-3fdd18e3bd25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.540936 Sep 18 01:19:49.000897 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1845/3776] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:48 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:49.007721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:49.008345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:49.012329 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-9df4b9bc-1d2e-48fd-b318-6f7949203b9e req-ac843747-2bd1-4514-a865-f41a08ea76dd service nova] Creating event network-vif-plugged:4c635477-f2c9-4742-bdfe-5c726303ec90 for instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e on n-h2-master-1 Sep 18 01:19:49.025143 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-9df4b9bc-1d2e-48fd-b318-6f7949203b9e req-ac843747-2bd1-4514-a865-f41a08ea76dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098593 Sep 18 01:19:49.026654 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1932/3777] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:49.033606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:49.034126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:49.034576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:49.034949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:49.035390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:49.035887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:49.036456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:49.036731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:49.041658 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:49.052177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:49.053042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:49.053751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:49.054735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:49.056036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:49.056685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:49.522393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:49.539903 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ae2517d-5d0b-4d8e-b0da-f56f725db6b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.511045 Sep 18 01:19:49.540785 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1933/3778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:49 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:49.576274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2e25785-8916-4248-8aad-5e9155860029 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:49.581321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2e25785-8916-4248-8aad-5e9155860029 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 018d95a7-3466-49c7-bdf7-72a7b9c8b29d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:49.595854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b2e25785-8916-4248-8aad-5e9155860029 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 018d95a7-3466-49c7-bdf7-72a7b9c8b29d could not be found. Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2e25785-8916-4248-8aad-5e9155860029 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/018d95a7-3466-49c7-bdf7-72a7b9c8b29d HTTP/1.1 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 018d95a7-3466-49c7-bdf7-72a7b9c8b29d could not be found. Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '018d95a7-3466-49c7-bdf7-72a7b9c8b29d'} Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018d95a7-3466-49c7-bdf7-72a7b9c8b29d could not be found. Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018d95a7-3466-49c7-bdf7-72a7b9c8b29d could not be found. Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:49.599445 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:49.613086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:49.613086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:49.613086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:49.613086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018d95a7-3466-49c7-bdf7-72a7b9c8b29d could not be found. Sep 18 01:19:49.613086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:19:49.617196 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2e25785-8916-4248-8aad-5e9155860029 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 018d95a7-3466-49c7-bdf7-72a7b9c8b29d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:49.623755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:49.625508 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2e25785-8916-4248-8aad-5e9155860029 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/018d95a7-3466-49c7-bdf7-72a7b9c8b29d" status: 404 len: 111 microversion: 2.1 time: 0.055496 Sep 18 01:19:49.633686 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1934/3779] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:49 2022] GET /compute/v2.1/servers/018d95a7-3466-49c7-bdf7-72a7b9c8b29d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:19:49.636639 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52f9bce6-358a-4410-837b-f22353cbfbde tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.634401 Sep 18 01:19:49.646473 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1846/3780] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:49 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:49.675906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:49.684726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:49.714220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:49.715225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:49.716075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:49.721052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:49.722023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:49.722800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:49.942575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fadea82e-7d31-4418-870e-714c90861d4e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052bc040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:50.105092 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fadea82e-7d31-4418-870e-714c90861d4e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.159050 Sep 18 01:19:50.108155 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1847/3781] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:49 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:50.226821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:50.238471 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa0ae344-afd6-433d-bf4b-13bee7b97361 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.602429 Sep 18 01:19:50.250879 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1935/3782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:49 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:50.270928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:50.271806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:50.299178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:50.300459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:50.301721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:50.304027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:50.305145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:50.306104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:50.691215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:50.692220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:50.697273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:50.705375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:50.706306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:50.707096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:50.714525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:50.715166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:50.715767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:50.716872 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9843425d-fc99-4fba-a6de-040c7ae8f9ff tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.452007 Sep 18 01:19:50.719930 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1848/3783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:50 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:50.733371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:50.734134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:50.743005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:50.743796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:50.744465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:50.745936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:50.748430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:50.749252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:50.926134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lazy-loading 'services' on Instance uuid 68599e5f-a57f-4820-b215-7ad064c4d1ad {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:19:51.073111 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d5ec66fe-1ffe-4101-ac7d-1c5e3b04b534 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments/48f05b9a-2671-4de7-bc4f-ae76bf298eba" status: 202 len: 0 microversion: 2.1 time: 0.349038 Sep 18 01:19:51.074302 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1849/3784] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:19:50 2022] DELETE /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments/48f05b9a-2671-4de7-bc4f-ae76bf298eba => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:19:51.089420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d56ab2f-8b35-4af2-b2ef-ba0d7ef63cac tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1504399445", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d56ab2f-8b35-4af2-b2ef-ba0d7ef63cac tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 238 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1504399445", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1504399445', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.110939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 18 01:19:51.114120 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:51.117849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d56ab2f-8b35-4af2-b2ef-ba0d7ef63cac tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:51.119027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d56ab2f-8b35-4af2-b2ef-ba0d7ef63cac tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043056 Sep 18 01:19:51.125657 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1850/3785] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:51 2022] POST /compute/v2.1/servers => generated 139 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:51.136945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:51.143238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:51.146840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:51.164177 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b71ca50-6b57-431e-95b9-a060915f0a5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1314 microversion: 2.1 time: 0.487269 Sep 18 01:19:51.166099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:51.166650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:51.167106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:51.168032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:51.173189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:51.173687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:51.182888 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1936/3786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:50 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:51.215100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f848d70b-e996-4c1a-ab75-f67b19aa4ec2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006403790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:51.254485 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ddaf7033-5ab9-4cca-ad36-3f34e7e6dc8d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127120 Sep 18 01:19:51.260105 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1851/3787] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:19:51 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:51.265601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:51.276236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:51.290778 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f848d70b-e996-4c1a-ab75-f67b19aa4ec2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.093455 Sep 18 01:19:51.292412 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1937/3788] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:51 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:51.296574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:51.297282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:51.297951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:51.298893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:51.299557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:51.300202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:51.682458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:51.704775 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ff3c24d-1ed8-499f-bcde-0c195125d4c3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.443162 Sep 18 01:19:51.705805 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1852/3789] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:51 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:51.736446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:51.737126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:51.747996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:51.748856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:51.749851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:51.751614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:51.752252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:51.752796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:52.070821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:52.085570 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:52.089487 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f0471765-d6f7-4117-b6b8-e773faa4cfcc tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.357491 Sep 18 01:19:52.090820 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1938/3790] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:51 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:52.185675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7537a3f3-cc40-409e-8e28-8702d84a8a83 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1151585217", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7537a3f3-cc40-409e-8e28-8702d84a8a83 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 235 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1151585217", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1151585217', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.191954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 18 01:19:52.195974 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:52.198435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7537a3f3-cc40-409e-8e28-8702d84a8a83 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:52.199448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7537a3f3-cc40-409e-8e28-8702d84a8a83 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.017844 Sep 18 01:19:52.210438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:52.211303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:52.216764 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1853/3791] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:19:52 2022] POST /compute/v2.1/servers => generated 133 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:19:52.222320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:52.225748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:52.228471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:52.229254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:52.230242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:52.230992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:52.232332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:52.232677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:52.258886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:52.259481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:52.259996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:52.260955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:52.264548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:52.265447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:52.932742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:52.959529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:52.968232 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7b9eb1d-966f-40d9-83a5-07ef3514480c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.749547 Sep 18 01:19:52.975518 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1854/3792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:52 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:52.987260 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-57fb2237-c823-4225-bd15-5e24cecd6c6b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1499 microversion: 2.1 time: 0.781761 Sep 18 01:19:52.987823 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1939/3793] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:52 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1499 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:53.004832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-89f9173b-8443-4aa3-ae79-07c44dc4e929 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006403e50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:53.037591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:53.064455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:53.080903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:53.087243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:53.088753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:53.101392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:53.102035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:53.102700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:53.129816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-89f9173b-8443-4aa3-ae79-07c44dc4e929 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.140827 Sep 18 01:19:53.131770 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1940/3794] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:52 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:53.143968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ee6592bd-abb9-445c-a62d-0dce723890e2 req-fe247409-2489-4481-9076-b1ea5ade925b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa157-6b6f-48ef-9827-7e92ff6b9208", "name": "network-vif-unplugged", "status": "completed", "tag": "2bcc5467-2ebf-408b-ad54-6161ef7e1e1f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:53.183725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee6592bd-abb9-445c-a62d-0dce723890e2 req-fe247409-2489-4481-9076-b1ea5ade925b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:53.194853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee6592bd-abb9-445c-a62d-0dce723890e2 req-fe247409-2489-4481-9076-b1ea5ade925b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:53.196041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee6592bd-abb9-445c-a62d-0dce723890e2 req-fe247409-2489-4481-9076-b1ea5ade925b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:53.208693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5979bbf4-5ca0-430b-b6c6-933abb7adffe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227641 Sep 18 01:19:53.214798 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1855/3795] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:19:52 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:53.223757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:53.225170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:53.236310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ee6592bd-abb9-445c-a62d-0dce723890e2 req-fe247409-2489-4481-9076-b1ea5ade925b service nova] Creating event network-vif-unplugged:2bcc5467-2ebf-408b-ad54-6161ef7e1e1f for instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 on n-h1-master-1 Sep 18 01:19:53.247988 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ee6592bd-abb9-445c-a62d-0dce723890e2 req-fe247409-2489-4481-9076-b1ea5ade925b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114891 Sep 18 01:19:53.250313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1941/3796] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:53.264543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:53.265098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:53.265767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:53.266243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:53.267030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:53.267511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:53.267957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:53.276612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:53.304302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:53.311366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:53.312084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:53.312889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:53.313702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:53.314170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:53.468640 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7f39e099-9033-4ab4-a7e8-87e41b5c5734 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 0.216270 Sep 18 01:19:53.470646 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1942/3797] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:53 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:19:54.169852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-056335a2-d68f-43a4-810e-eaadc6068de9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006403820>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:54.366254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:54.386191 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-056335a2-d68f-43a4-810e-eaadc6068de9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.228550 Sep 18 01:19:54.390554 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1943/3798] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:54 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:54.403436 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-48dd9fa1-9141-4887-995e-2b58097d8592 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.192037 Sep 18 01:19:54.405146 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1856/3799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:53 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:54.423082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:54.446526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:54.448501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ee806ae-9221-4627-9da7-74c8a894611a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:54.449765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ee806ae-9221-4627-9da7-74c8a894611a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: bd547541-628f-4f46-a603-851d65b9e025] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:54.454047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:54.454955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:54.455623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:54.456564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:54.457234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:54.457950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:54.468238 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-2ee806ae-9221-4627-9da7-74c8a894611a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance bd547541-628f-4f46-a603-851d65b9e025 could not be found. Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ee806ae-9221-4627-9da7-74c8a894611a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/bd547541-628f-4f46-a603-851d65b9e025/action HTTP/1.1 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 13 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: {"pause": {}} Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: exception: Instance bd547541-628f-4f46-a603-851d65b9e025 could not be found. Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'bd547541-628f-4f46-a603-851d65b9e025', 'body': {'pause': {}}} Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd547541-628f-4f46-a603-851d65b9e025 could not be found. Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd547541-628f-4f46-a603-851d65b9e025 could not be found. Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:54.529802 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:54.537001 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:54.537001 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:54.537001 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd547541-628f-4f46-a603-851d65b9e025 could not be found. Sep 18 01:19:54.537001 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:54.537001 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ee806ae-9221-4627-9da7-74c8a894611a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance bd547541-628f-4f46-a603-851d65b9e025 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:54.537001 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ee806ae-9221-4627-9da7-74c8a894611a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/bd547541-628f-4f46-a603-851d65b9e025/action" status: 404 len: 111 microversion: 2.1 time: 0.087921 Sep 18 01:19:54.537001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1857/3800] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:54 2022] POST /compute/v2.1/servers/bd547541-628f-4f46-a603-851d65b9e025/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:19:54.543590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:54.546846 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7510aea9-d793-431d-aa0b-33ed0fc7c135 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153466 Sep 18 01:19:54.547091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:54.547572 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1944/3801] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:19:54 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:54.570701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:54.571961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:54.572713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:54.573474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:54.575897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:54.576420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:54.577126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:54.578323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:54.597630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:54.598244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:54.599406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:54.604078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:54.605296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:54.606010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:54.726454 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e1340252-df66-4ee0-a9f3-36820af3da85 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 0.191008 Sep 18 01:19:54.727323 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1858/3802] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:54 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:19:54.941178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:54.964434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19a75c69-25d8-4042-aa79-96575c95d953 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.412257 Sep 18 01:19:54.966080 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1945/3803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:54 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:54.998696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:54.999939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:55.011070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.012217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.013248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:55.015425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.016147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.016811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:55.384445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:55.407144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c918a261-ee87-493b-be6d-92790a07ae69 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006cba550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:55.412074 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-74a72955-0962-454a-af0c-c1009bd51b2e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.420038 Sep 18 01:19:55.436781 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1859/3804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:54 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:55.454363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:55.457769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:55.475208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.481051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.482457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:55.485332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.490392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.492530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:55.735324 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c918a261-ee87-493b-be6d-92790a07ae69 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.329511 Sep 18 01:19:55.749437 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1946/3805] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:55 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:55.764649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f5e6ba6a-317b-48d6-a17b-0426885b8df3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.314322 Sep 18 01:19:55.768996 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1860/3806] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:55 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:19:55.771150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:55.781499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:55.810015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.810973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.811657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:55.812625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.813623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.818933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:55.919239 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca2ecc2c-08af-4b23-881b-72b645ef594f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159381 Sep 18 01:19:55.920337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1947/3807] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:19:55 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:55.936139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:55.937074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:55.944428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.945100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.945753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:55.946867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:55.947732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:55.948309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:56.532093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:56.559965 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2a9f531-2bba-4c18-98df-aa1581124589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1510 microversion: 2.1 time: 0.637214 Sep 18 01:19:56.561062 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1948/3808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:55 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:19:56.769972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a242d73d-08cd-4ec2-8e0a-7b61175d3d9c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a77aaf0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:56.841862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:56.853782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:56.889234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:56.890103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:56.890839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:56.891955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:56.892710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:56.893372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:57.082690 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-24e6baa2-fdde-4bcd-a676-5c5707724953 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 1.314979 Sep 18 01:19:57.084128 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1861/3809] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:55 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:19:57.095040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:57.097629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:57.115814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:57.116657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:57.117308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:57.118265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:57.118942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:57.119599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:57.500017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-deee2cff-f77a-44c1-a839-588915e0b849 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.414486 Sep 18 01:19:57.500599 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1862/3810] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:19:57 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:57.584307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:57.584925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:57.601515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:57.605749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:57.606439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:57.608319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:57.608815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:57.609251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.144528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:58.169656 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a3623aa5-59f0-4729-b309-96f2719117ad tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1490 microversion: 2.1 time: 0.582028 Sep 18 01:19:58.173476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1863/3811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:57 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1490 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:19:58.199381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:58.209889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:58.234284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.234807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.239815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.240837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.241835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.244354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.391719 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a96079fc-4a47-45d0-96e2-64ba3050df94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 0.216159 Sep 18 01:19:58.392367 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1864/3812] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:58 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:19:58.399088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:58.402069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:58.441223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.441768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.442275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.443510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.444000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.444410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.577162 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Cannot 'pause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state paused Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action HTTP/1.1 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 13 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: {"pause": {}} Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot 'pause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state paused Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'pause': {}}} Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb in vm_state paused. Cannot pause while the instance is in this state. Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state paused Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:19:58.585229 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:19:58.588630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:19:58.588630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:19:58.588630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:19:58.588630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state paused Sep 18 01:19:58.588630 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:19:58.588630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 409 to user: Cannot 'pause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state paused {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:19:58.588630 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c0559869-1f2c-4741-b842-0eb9303b54a2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 409 len: 143 microversion: 2.1 time: 0.193585 Sep 18 01:19:58.595277 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1865/3813] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:58 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 143 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:19:58.607784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:58.614829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:58.642771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.643630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.645306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.651989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.656295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.656827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.771042 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:19:58.875981 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-93339931-0663-44f9-80f8-5735c6af996d tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.278705 Sep 18 01:19:58.876982 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1866/3814] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:19:58 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:58.899289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:58.900120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:58.919617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.920052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.920508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:58.921251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:58.921903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:58.922450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:59.151886 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f9cc3cf-dfee-443c-98e1-3e549bff9092 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.271430 Sep 18 01:19:59.155814 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1867/3815] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:58 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:19:59.185198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-37e60db2-1944-4099-9f27-77b213628dc6 req-26f5d1e6-551a-4305-90f4-8c4dd44ccb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e5cf62-23da-44ee-b6bf-7dcc733c98c8", "name": "network-vif-plugged", "status": "completed", "tag": "60f795cf-3fab-42b9-9683-a788a2d28e34"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:19:59.231342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-37e60db2-1944-4099-9f27-77b213628dc6 req-26f5d1e6-551a-4305-90f4-8c4dd44ccb5d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:59.234222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-37e60db2-1944-4099-9f27-77b213628dc6 req-26f5d1e6-551a-4305-90f4-8c4dd44ccb5d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:59.235097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-37e60db2-1944-4099-9f27-77b213628dc6 req-26f5d1e6-551a-4305-90f4-8c4dd44ccb5d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:59.271301 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-37e60db2-1944-4099-9f27-77b213628dc6 req-26f5d1e6-551a-4305-90f4-8c4dd44ccb5d service nova] Creating event network-vif-plugged:60f795cf-3fab-42b9-9683-a788a2d28e34 for instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 on n-h2-master-1 Sep 18 01:19:59.287296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-37e60db2-1944-4099-9f27-77b213628dc6 req-26f5d1e6-551a-4305-90f4-8c4dd44ccb5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117148 Sep 18 01:19:59.290139 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1868/3816] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:19:59.306014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:19:59.306807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:19:59.325215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:59.326274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:59.327306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:59.328359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:19:59.329574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:19:59.330912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:19:59.968614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:19:59.986472 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-27f27576-24ae-4fda-94d5-36bfe3cfd51c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1497 microversion: 2.1 time: 0.694670 Sep 18 01:19:59.987794 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1869/3817] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:19:59 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1497 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:00.009745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:00.020169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:00.043644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:00.049125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:00.049930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:00.054031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:00.054832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:00.055497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:00.232410 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-595985bd-dd82-456a-9789-b3756c1cf601 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 0.242686 Sep 18 01:20:00.233844 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1870/3818] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:19:59 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:20:00.243623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:00.248821 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:00.272445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:00.273307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:00.273874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:00.275537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:00.276822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:00.278423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:00.397808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0cfc5354-fb8f-4023-a9fd-2ff18ae5a06f tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140013 Sep 18 01:20:00.399145 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1871/3819] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:20:00 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:01.015050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:01.015777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:01.035561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.036555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.038219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:01.042510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.043411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.046626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:01.454636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:01.467962 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb6db23e-94ad-43bd-9032-256526cdd130 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.460672 Sep 18 01:20:01.484755 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1872/3820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:01 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:01.500674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:01.507360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:01.519174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.520134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.520776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:01.521842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.522573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.523223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:01.639898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0042360f-1012-4c93-be71-80e215b9fb4d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 0.153255 Sep 18 01:20:01.641507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1873/3821] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:01 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:20:01.657984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:01.666103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:01.691981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.693367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.696408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:01.699405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.702668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.704804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:01.809076 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ffe01b4-edbe-492f-b176-15cf9c88fefe tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165292 Sep 18 01:20:01.817360 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1874/3822] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:20:01 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:01.829389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:01.831316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:01.844515 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:01.847896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.848057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.850860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:01.852884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:01.854237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:01.855639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.143905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:02.159619 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00ac02fd-be95-442c-b8c6-14de546f043d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.340812 Sep 18 01:20:02.179989 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1875/3823] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:01 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:02.187852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:02.209218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:02.235809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.236307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.236744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.238564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.238564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.238564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.292454 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88/action HTTP/1.1 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 28 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: {"reboot": {"type": "SOFT"}} Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '83ed2e44-0f5a-4d0d-9870-2911d2dfaa88', 'body': {'reboot': {'type': 'SOFT'}}} Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:02.298986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:02.302698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:02.310151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:02.312199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-86bbe8dc-fb95-4fcf-9031-a31aa045bf21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88/action" status: 404 len: 111 microversion: 2.1 time: 0.129934 Sep 18 01:20:02.313627 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1876/3824] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:02 2022] POST /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88/action => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:02.326347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:02.335369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:02.360392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.367169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.369070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.370657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.371914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.373185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.728843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:02.741508 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5534801f-525e-42b3-8418-435961044e1d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.421982 Sep 18 01:20:02.743917 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1877/3825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:02 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:02.768976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:02.771805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:02.779177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.780177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.780616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.781807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.787388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.787388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.856578 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d56b4d18-8fe6-4183-9090-fad6c8765565 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 0.111321 Sep 18 01:20:02.860487 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1878/3826] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:02 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:20:02.866564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:02.867296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:02.886581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.887795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.889835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:02.890584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:02.891052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:02.894936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:03.230558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:03.255467 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-304262fd-9dc2-45de-841b-eec5863079fe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.395596 Sep 18 01:20:03.281426 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1879/3827] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:02 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:03.291512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:03.296891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:03.304725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:03.305454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:03.306418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:03.307296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:03.308172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:03.308760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:03.466120 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a856fc9b-4a37-4bec-a512-541a58921e86 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.182867 Sep 18 01:20:03.489792 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1880/3828] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:20:03 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad/os-volume_attachments => generated 25 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:20:03.501868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-106de3a2-1d91-4723-aabe-252d254cde04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:03.508105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-106de3a2-1d91-4723-aabe-252d254cde04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:03.530267 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-106de3a2-1d91-4723-aabe-252d254cde04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b could not be found. Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-106de3a2-1d91-4723-aabe-252d254cde04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b/action HTTP/1.1 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 28 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: {"reboot": {"type": "SOFT"}} Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b could not be found. Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b', 'body': {'reboot': {'type': 'SOFT'}}} Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b could not be found. Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b could not be found. Sep 18 01:20:03.534649 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b could not be found. Sep 18 01:20:03.541823 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:03.554519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-106de3a2-1d91-4723-aabe-252d254cde04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:03.556386 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-106de3a2-1d91-4723-aabe-252d254cde04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b/action" status: 404 len: 111 microversion: 2.1 time: 0.064162 Sep 18 01:20:03.562072 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1881/3829] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:03 2022] POST /compute/v2.1/servers/4ffc63da-ee34-48d9-a4f4-15aa4dc5d90b/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:03.569973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:03.574299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:03.613011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:03.613807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:03.614443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:03.615335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:03.616162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:03.616747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:03.926237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:03.943678 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-255e01aa-8bda-4878-bf68-d494251f0c1b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.378746 Sep 18 01:20:03.963136 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1882/3830] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:03 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:20:03.991792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:03.994167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:04.003453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.003954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.004776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.005802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.006961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.007419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.048875 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Cannot 'reboot' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action HTTP/1.1 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 28 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: {"reboot": {"type": "HARD"}} Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot 'reboot' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd9a09f58-2baa-476a-9155-f1016a25f44f', 'body': {'reboot': {'type': 'HARD'}}} Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9a09f58-2baa-476a-9155-f1016a25f44f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:20:04.051152 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.055975 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.056952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 409 to user: Cannot 'reboot' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:04.058750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-25a02f0a-6de1-47f2-94d2-b624dc6df8ec tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action" status: 409 len: 145 microversion: 2.1 time: 0.094663 Sep 18 01:20:04.060624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1883/3831] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:03 2022] POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action => generated 145 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:20:04.066934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:04.070950 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:04.078569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.079313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.079967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.081038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.081767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.082411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.170890 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3eaa7647-827a-4be1-a507-cd1bde1892ff tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 14 microversion: 2.1 time: 0.108151 Sep 18 01:20:04.172003 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1884/3832] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:04 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:20:04.182299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:04.183651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:04.212873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.223415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.225280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.227950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.230386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.233776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.448602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:04.482113 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e37b6a0-5164-4fe4-b1f4-334daa081e88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.304750 Sep 18 01:20:04.485730 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1885/3833] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:04 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:04.493865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:04.497296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:04.518480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.522633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.523023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.530267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.531692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.535946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.546226 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:04.617627 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Cannot 'rebuild' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action HTTP/1.1 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 65 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot 'rebuild' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd9a09f58-2baa-476a-9155-f1016a25f44f', 'body': {'rebuild': {'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368'}}} Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9a09f58-2baa-476a-9155-f1016a25f44f in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:04.620251 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued Sep 18 01:20:04.624398 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.625729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 409 to user: Cannot 'rebuild' instance d9a09f58-2baa-476a-9155-f1016a25f44f while it is in vm_state rescued {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:04.626716 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-834c8535-9359-4996-ae03-5e324bd29cc7 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action" status: 409 len: 146 microversion: 2.1 time: 0.138785 Sep 18 01:20:04.628015 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1886/3834] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:04 2022] POST /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f/action => generated 146 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:20:04.635116 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:04.637527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:04.644839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.646680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.648436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.652804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.653670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.654201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.725701 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d32f0d0a-6df2-4dc2-bcc6-bef97ac6fa7d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096431 Sep 18 01:20:04.731315 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1887/3835] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:20:04 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:20:04.750336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:04.769390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:04.801023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.803141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.805232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.808528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.809861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.810440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88/action HTTP/1.1 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 65 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '83ed2e44-0f5a-4d0d-9870-2911d2dfaa88', 'body': {'rebuild': {'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368'}}} Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:04.857651 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:04.862512 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a768f9ef-f202-4782-8414-e639eb5ca1ec tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88/action" status: 404 len: 111 microversion: 2.1 time: 0.125669 Sep 18 01:20:04.878347 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1888/3836] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:04 2022] POST /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88/action => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:04.889965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:04.892560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:04.904817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.905769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.906437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.907361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:04.908176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:04.908781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:04.977041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:20:05.177831 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1f6c65a3-8b4e-4713-b18d-a4cc2133e5da tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 204 len: 0 microversion: 2.1 time: 0.296556 Sep 18 01:20:05.182253 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1889/3837] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:20:04 2022] DELETE /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:20:05.188800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:05.203801 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:05.219831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:05.222907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:05.223953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:05.224885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:05.227243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:05.227243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:05.296644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:20:05.493244 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8843ee7-e17a-436d-892b-d83123773657 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 204 len: 0 microversion: 2.1 time: 0.309122 Sep 18 01:20:05.497938 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1890/3838] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:20:05 2022] DELETE /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:20:05.506017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:05.517685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:05.538980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:05.539892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:05.540708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:05.542291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:05.544514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:05.545275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:05.816910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:05.833685 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-542cd4e2-3516-4bdc-a5c8-d04b5eb8eab5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.331272 Sep 18 01:20:05.837158 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1891/3839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:05 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:05.846291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:05.850341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:05.857523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:05.858222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:05.858757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:05.859989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:05.860568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:05.861088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:05.945324 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=53 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:06.537022 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=36 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:09.655443 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aabab140-7ab8-4e94-99b9-65dfba3ffe95 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action" status: 200 len: 8199 microversion: 2.1 time: 3.813910 Sep 18 01:20:09.658365 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1892/3840] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:05 2022] POST /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e/action => generated 8199 bytes in 3819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:09.679996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:09.680831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:09.696907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:09.697983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:09.698654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:09.700579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:09.701539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:09.702494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:10.047835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:10.057647 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e5208d1f-2ebf-4b37-84c0-5b408d7d9453 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1690 microversion: 2.1 time: 0.388472 Sep 18 01:20:10.058245 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1893/3841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:09 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1690 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:10.078959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:10.080636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:10.102553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:10.104135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:10.106290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:10.108888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:10.109643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:10.110319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:10.377327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:10.388425 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a34014ff-d884-4c2b-b694-c44ef1d82ec3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 200 len: 1603 microversion: 2.1 time: 0.328967 Sep 18 01:20:10.389604 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1894/3842] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:10 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 1603 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:10.411749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:10.415222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:10.458084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:10.459098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:10.460217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:10.461346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:10.462269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:10.463142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:10.887815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:10.910518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c8fc0b73-06f1-4bc5-bab2-c09fa67d3ed1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.511394 Sep 18 01:20:10.925593 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1895/3843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:10 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:10.933738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:10.934404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:10.942877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:10.943367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:10.943805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:10.945192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:10.945955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:10.946436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:11.779488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:11.791397 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a473d490-d654-4294-ae7e-24bb319d9a41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.875632 Sep 18 01:20:11.829660 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1896/3844] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:10 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:11.839354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-678743d9-fa3f-4f24-b08e-8be864c27c6a req-60a1312b-3cb3-443b-9209-ab9188378758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dda0da1-d84d-460a-b22c-8cfed7d264ad", "name": "network-vif-deleted", "tag": "3c43219b-327e-4a80-a386-bb8f0ed5a108"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:11.861710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-678743d9-fa3f-4f24-b08e-8be864c27c6a req-60a1312b-3cb3-443b-9209-ab9188378758 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:11.886047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-678743d9-fa3f-4f24-b08e-8be864c27c6a req-60a1312b-3cb3-443b-9209-ab9188378758 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:11.887148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-678743d9-fa3f-4f24-b08e-8be864c27c6a req-60a1312b-3cb3-443b-9209-ab9188378758 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:11.915394 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-678743d9-fa3f-4f24-b08e-8be864c27c6a req-60a1312b-3cb3-443b-9209-ab9188378758 service nova] Creating event network-vif-deleted:3c43219b-327e-4a80-a386-bb8f0ed5a108 for instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad on n-h1-master-1 Sep 18 01:20:11.932374 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-678743d9-fa3f-4f24-b08e-8be864c27c6a req-60a1312b-3cb3-443b-9209-ab9188378758 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096153 Sep 18 01:20:11.938014 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1897/3845] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:11.952487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ae55d39-3b51-4a72-853e-dcbc659a9a00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:11.960318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ae55d39-3b51-4a72-853e-dcbc659a9a00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: d0e5abc3-07e6-471d-8fab-1609b3267e8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:11.976248 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-2ae55d39-3b51-4a72-853e-dcbc659a9a00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance d0e5abc3-07e6-471d-8fab-1609b3267e8f could not be found. Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ae55d39-3b51-4a72-853e-dcbc659a9a00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/d0e5abc3-07e6-471d-8fab-1609b3267e8f/action HTTP/1.1 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 65 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: exception: Instance d0e5abc3-07e6-471d-8fab-1609b3267e8f could not be found. Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd0e5abc3-07e6-471d-8fab-1609b3267e8f', 'body': {'rebuild': {'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368'}}} Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e5abc3-07e6-471d-8fab-1609b3267e8f could not be found. Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 18 01:20:11.981362 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e5abc3-07e6-471d-8fab-1609b3267e8f could not be found. Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e5abc3-07e6-471d-8fab-1609b3267e8f could not be found. Sep 18 01:20:11.984926 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:11.993810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ae55d39-3b51-4a72-853e-dcbc659a9a00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance d0e5abc3-07e6-471d-8fab-1609b3267e8f could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:11.996242 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ae55d39-3b51-4a72-853e-dcbc659a9a00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/d0e5abc3-07e6-471d-8fab-1609b3267e8f/action" status: 404 len: 111 microversion: 2.1 time: 0.056483 Sep 18 01:20:11.999783 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1898/3846] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:11 2022] POST /compute/v2.1/servers/d0e5abc3-07e6-471d-8fab-1609b3267e8f/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:12.010859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:12.013203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:12.035359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:12.053979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:12.056273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:12.064307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:12.065045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:12.066537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:12.291187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:12.327966 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-983292df-9183-4cdf-b0d0-65fbe922e6e8 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1622 microversion: 2.1 time: 0.317784 Sep 18 01:20:12.333955 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1899/3847] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:12 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1622 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:12.350106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:12.350769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:12.380213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:12.380777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:12.381233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:12.382008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:12.382467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:12.382893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:12.452382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] HTTP exception thrown: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Request method failure captured: Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad HTTP/1.1 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFf-aKM8SDXQnsyfN7fEvcVV7gYN_KaH7wDHW6jTcXlonOBCj45Xzi7kLkO5oVrzy8uK7Zv0mInk1ZOIsAfu5luFIS52ZWZWLr8FY9M82PtbbNUEuFh3Ce3fQzPFbXgE3NkD3ldRJWRqrI_tyAtPdOSvoG3axbOhPBsffcADOSkIIg Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 29c7d6ca88464aa29691e7ddfa5e5897 Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3dda0da1-d84d-460a-b22c-8cfed7d264ad'} Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:12.457420 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Returning 404 to user: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1e9cdfb-fd0f-4611-b292-4df4b36a4b82 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 404 len: 111 microversion: 2.1 time: 0.123883 Sep 18 01:20:12.466977 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1900/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:12 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:12.490230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:12.496592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:12.534799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:12.536293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:12.536964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:12.537754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:12.538235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:12.538672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:13.461280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:13.486733 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-867e4299-23b2-4459-8c25-c4afe0729b65 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.017197 Sep 18 01:20:13.493440 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1901/3849] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:12 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:13.509785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:13.510544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:13.527536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:13.531528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:13.532321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:13.533486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:13.534977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:13.538645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:13.929510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:13.942784 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ea3ae93-071e-486f-95d2-462699b3679f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.450752 Sep 18 01:20:13.963099 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1902/3850] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:13 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:13.977126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-06a84eae-b23d-4312-be86-577092ea1b70 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '.version_select at 0x7f7005416700>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:14.072199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-06a84eae-b23d-4312-be86-577092ea1b70 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-111454713" status: 202 len: 0 microversion: 2.1 time: 0.107309 Sep 18 01:20:14.105363 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1903/3851] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-111454713 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:14.121825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:14.132996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:14.147903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:14.148877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:14.150775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:14.150775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:14.151182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:14.151517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:14.209340 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:14.239767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:14.240313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:14.240809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:14.241355 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lazy-loading 'fault' on Instance uuid 68599e5f-a57f-4820-b215-7ad064c4d1ad {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:20:15.153220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:15.166399 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9470aa5d-1705-4e42-aba2-4a9a92fee57b tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 200 len: 1335 microversion: 2.1 time: 1.059078 Sep 18 01:20:15.184634 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1904/3852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:14 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 1335 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:15.198743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:15.200218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:15.222797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:15.224152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:15.225051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:15.226009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:15.226628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:15.227488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:15.814337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:15.825324 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4981dd3d-e75d-4de2-ad23-ac70b0118d9e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.639242 Sep 18 01:20:15.836246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1905/3853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:15 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:15.844356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:15.844356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:15.865102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:15.868663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:15.870225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:15.871852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:15.877522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:15.878249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.108256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:16.130897 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00d5667b-5a9e-42c6-bcc1-bf427ec0b822 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.296623 Sep 18 01:20:16.132131 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1906/3854] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:15 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:16.138936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-aacf4392-8fb4-4b56-886c-9909550814cc req-f951b4a3-8964-4646-87e4-22bd3a711912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68599e5f-a57f-4820-b215-7ad064c4d1ad", "name": "network-vif-deleted", "tag": "526a01a9-634f-4f06-bafc-d867b3f4007b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:16.152136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aacf4392-8fb4-4b56-886c-9909550814cc req-f951b4a3-8964-4646-87e4-22bd3a711912 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.152960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aacf4392-8fb4-4b56-886c-9909550814cc req-f951b4a3-8964-4646-87e4-22bd3a711912 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.154552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aacf4392-8fb4-4b56-886c-9909550814cc req-f951b4a3-8964-4646-87e4-22bd3a711912 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.178294 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-aacf4392-8fb4-4b56-886c-9909550814cc req-f951b4a3-8964-4646-87e4-22bd3a711912 service nova] Creating event network-vif-deleted:526a01a9-634f-4f06-bafc-d867b3f4007b for instance 68599e5f-a57f-4820-b215-7ad064c4d1ad on n-h2-master-1 Sep 18 01:20:16.185888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-aacf4392-8fb4-4b56-886c-9909550814cc req-f951b4a3-8964-4646-87e4-22bd3a711912 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051799 Sep 18 01:20:16.185888 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1907/3855] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:16.198470 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:16.199063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:16.206382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.207381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.208067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.209083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.210027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.210976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.271716 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67395a65-bd67-440e-b654-786b8fade8b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments/d16df657-3491-46cd-897f-82977fb8f859" status: 200 len: 194 microversion: 2.20 time: 0.082676 Sep 18 01:20:16.278814 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1908/3856] 10.222.0.25 () {60 vars in 1454 bytes} [Sun Sep 18 01:20:16 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments/d16df657-3491-46cd-897f-82977fb8f859 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:20:16.293723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:16.297288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:16.318286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.318970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.319849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.321825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.322528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.323229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.882007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:16.906820 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90e84914-811b-404a-b810-9f8f89947d57 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.630310 Sep 18 01:20:16.909072 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1909/3857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:16 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:16.914776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad9dca5a-5d64-41ff-9122-9aed702c8d85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:16.915331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ad9dca5a-5d64-41ff-9122-9aed702c8d85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:16.932915 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ad9dca5a-5d64-41ff-9122-9aed702c8d85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971 could not be found. Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad9dca5a-5d64-41ff-9122-9aed702c8d85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971/action HTTP/1.1 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 15 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: {"restore": {}} Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: exception: Instance ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971 could not be found. Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971', 'body': {'restore': {}}} Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971 could not be found. Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971 could not be found. Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:16.935212 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:16.939531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:16.939531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:16.939531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971 could not be found. Sep 18 01:20:16.939531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:16.948261 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a242d73d-08cd-4ec2-8e0a-7b61175d3d9c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 20.186437 Sep 18 01:20:16.956568 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1949/3858] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:19:56 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 20188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:16.956568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:16.956568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 68599e5f-a57f-4820-b215-7ad064c4d1ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:16.958751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad9dca5a-5d64-41ff-9122-9aed702c8d85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:16.959795 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ad9dca5a-5d64-41ff-9122-9aed702c8d85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971/action" status: 404 len: 111 microversion: 2.1 time: 0.049572 Sep 18 01:20:16.964290 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1910/3859] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:16 2022] POST /compute/v2.1/servers/ab7ba6ff-0ae3-4c15-abfa-a25b5d8af971/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:16.970145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:16.972475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:16.976794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.977319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.980143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.981852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.982352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.982473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.982793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.983507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:16.983975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.984482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:16.984608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:16.985832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.023805 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Instance 68599e5f-a57f-4820-b215-7ad064c4d1ad could not be found. Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad HTTP/1.1 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 68599e5f-a57f-4820-b215-7ad064c4d1ad could not be found. Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '68599e5f-a57f-4820-b215-7ad064c4d1ad'} Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68599e5f-a57f-4820-b215-7ad064c4d1ad could not be found. Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68599e5f-a57f-4820-b215-7ad064c4d1ad could not be found. Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:17.031014 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68599e5f-a57f-4820-b215-7ad064c4d1ad could not be found. Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:17.036997 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 404 to user: Instance 68599e5f-a57f-4820-b215-7ad064c4d1ad could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:17.040274 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee5c0a88-3bcc-41d1-a5ac-11174d30d9d4 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad" status: 404 len: 111 microversion: 2.1 time: 0.084859 Sep 18 01:20:17.042259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1950/3860] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:16 2022] GET /compute/v2.1/servers/68599e5f-a57f-4820-b215-7ad064c4d1ad => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:17.056816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92f92bcd-9ca5-4c6d-a12a-c338ff89a778 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'create', calling method: .version_select at 0x7f7006400160>, body: {"keypair": {"name": "tempest-keypair-579697600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTzZ+hVycfDnhl/iuWKzKhQ7Lcpz3jB9t0FwmnbOLUQEmq7soIkoeRki5U3eJlGFf9dNcyYTYe+mtJecKwu66dg9bhtaPXzWphz3vLzcJy8ZoUHwAi3Fq6WkcO+O2y5Rg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:17.112442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-92f92bcd-9ca5-4c6d-a12a-c338ff89a778 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for project ceb6afe234e1433eabf8eee5c780c799. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:20:17.127164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lazy-loading 'services' on Instance uuid 4eb07fa2-83c3-452e-9777-fd357c981454 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:20:17.131554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-92f92bcd-9ca5-4c6d-a12a-c338ff89a778 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for user 29c7d6ca88464aa29691e7ddfa5e5897 and project ceb6afe234e1433eabf8eee5c780c799. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:20:17.185365 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92f92bcd-9ca5-4c6d-a12a-c338ff89a778 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140710 Sep 18 01:20:17.190903 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1951/3861] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:20:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:17.237602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:17.239630 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:17.252803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.254826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.255777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.256730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.257424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.258150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.294585 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-81d01b03-8959-43bd-af70-85fd5ef4192b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments/d16df657-3491-46cd-897f-82977fb8f859" status: 202 len: 0 microversion: 2.20 time: 0.327137 Sep 18 01:20:17.300016 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1911/3862] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Sep 18 01:20:16 2022] DELETE /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments/d16df657-3491-46cd-897f-82977fb8f859 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:20:17.313854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:17.317734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:17.344757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.344757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.346272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.350051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.352157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.353746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.372643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Locking {{(pid=122374) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 18 01:20:17.588840 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0faf5589-3b05-4b74-99a0-6663b2901498 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.395283 Sep 18 01:20:17.589865 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1952/3863] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:17 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:17.603666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b35dd9fc-1003-4654-a5ec-c9e77c577e93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '.version_select at 0x7f70063c0670>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:17.640194 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b35dd9fc-1003-4654-a5ec-c9e77c577e93 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643136168" status: 202 len: 0 microversion: 2.1 time: 0.048774 Sep 18 01:20:17.640782 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1953/3864] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643136168 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:17.654987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:17.657257 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:17.674806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.681524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.682399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.683372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.683848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.684278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.793242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a075abeb-d531-4b4c-ae24-de72cac1ed2a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151030 Sep 18 01:20:17.795361 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1954/3865] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:17 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:20:17.806067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:17.809468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:17.824574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.825286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.825924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.826804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.827769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.830494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.888993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:17.903035 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b61981c6-50e2-42a1-8d56-a5613f4c598e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.602000 Sep 18 01:20:17.904974 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1912/3866] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:17 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:17.935430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:17.935998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:17.964378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.965275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.978346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:17.979693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:17.980333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:17.981115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.368172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:18.383491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c47669b2-f09e-49bd-ba23-ff7a93a7a5a1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.579824 Sep 18 01:20:18.394807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1955/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:17 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:18.423283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dfdf3a23-0b6d-4575-a1a0-e9b404ed6ee2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005e4fd30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:18.585150 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dfdf3a23-0b6d-4575-a1a0-e9b404ed6ee2 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.175821 Sep 18 01:20:18.585878 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1956/3868] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:18 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:18.601165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:18.611461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:18.611962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:18.614276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.651453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:18.666039 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72b92593-0a6d-47eb-a96a-1461dd102869 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.731935 Sep 18 01:20:18.667865 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1913/3869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:17 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:18.693755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:18.694707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:18.702662 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] HTTP exception thrown: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb is locked Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Request method failure captured: Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action HTTP/1.1 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 15 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEOgNEG5Yrkuy4LYnmsLkfjDIZyusPsSFQGENObC2s1nEDt9jGhykJ7VVZwz_UFe4gEuuEvbq_ta4QaCq8Wj7f-IzNmZzMlb91c410eNKmtgKuLNWs8KRq_IBfuJ6fmq03SKKrL5P0Ck-_8fcFW7J4qiyDPfVMZDrOaS3dWphw7WSw Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0212658356c1456ebe01dfe00dcd4fd2 Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: {"os-stop": {}} Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb is locked Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4085d846-e1d5-4d73-bea1-0ac4912d1cdb', 'body': {'os-stop': {}}} Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb is locked Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb is locked Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb is locked Sep 18 01:20:18.707534 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.715117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Returning 409 to user: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb is locked {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:18.716259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:18.717721 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a5b7abb-0885-4936-8a72-086466306144 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 409 len: 107 microversion: 2.1 time: 0.127188 Sep 18 01:20:18.718973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:18.720864 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1957/3870] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:18 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 107 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:20:18.725035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.726187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:18.728837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:18.731990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.738289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:18.739799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:18.799937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:18.800653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:18.810754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.814595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:18.817932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:18.821749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.833955 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Cannot 'restore' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action HTTP/1.1 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 15 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: {"restore": {}} Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: exception: Cannot 'restore' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'restore': {}}} Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb in vm_state active. Cannot restore while the instance is in this state. Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:18.837117 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:18.841284 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:18.841284 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:18.841284 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:18.841284 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:18.841284 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:18.844198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 409 to user: Cannot 'restore' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:18.845363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de849dbc-9ba7-4467-9ce3-fddc303bf978 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 409 len: 145 microversion: 2.1 time: 0.156768 Sep 18 01:20:18.852141 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1914/3871] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:18 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 145 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 18 01:20:18.858083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:18.861416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:18.869629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:18.870373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:18.870956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.871835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:18.872440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:18.875447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:18.971649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Unlocking {{(pid=122374) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 18 01:20:19.001349 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9cb17c40-345d-443d-b687-863669d75f56 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144780 Sep 18 01:20:19.004848 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1915/3872] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:18 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:20:19.018935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:19.021954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:19.038884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:19.041682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:19.042385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:19.043276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:19.044102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:19.044689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:19.154847 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61eef18e-8c65-4fde-98bc-c7d277bf5c90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.429147 Sep 18 01:20:19.155932 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1958/3873] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:18 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:19.175355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3869bc9b-0517-45ee-9101-6c59f7630bd3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:19.195439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3869bc9b-0517-45ee-9101-6c59f7630bd3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:19.196145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3869bc9b-0517-45ee-9101-6c59f7630bd3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:19.196803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3869bc9b-0517-45ee-9101-6c59f7630bd3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:19.261765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3869bc9b-0517-45ee-9101-6c59f7630bd3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Going to try to stop instance {{(pid=122374) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:20:19.415842 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3869bc9b-0517-45ee-9101-6c59f7630bd3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.248723 Sep 18 01:20:19.422972 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1959/3874] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:19 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:19.444805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:19.446488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:19.470664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:19.471346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:19.471944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:19.472679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:19.473175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:19.473638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:19.688915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:19.703363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1d8a2bfc-a63e-4e24-b0b6-5986d4244c61 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.697050 Sep 18 01:20:19.719243 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1916/3875] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:19 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:19.744445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d5ddac3c-7c7c-4a26-ac7d-9855d06cc70d tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052ae310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:19.824914 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d5ddac3c-7c7c-4a26-ac7d-9855d06cc70d tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.104216 Sep 18 01:20:19.828055 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1917/3876] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:19 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:19.849308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:19.857346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:19.859798 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:19.883375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:19.884112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:19.884357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:19.890138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:19.890654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:19.891232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:20.564393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:20.583527 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bbf29602-b61b-402b-a671-74de4f37ac07 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 1.158865 Sep 18 01:20:20.603791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1960/3877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:19 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:20.611797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:20.619025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:20.635057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:20.635890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:20.636492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:20.639789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:20.640567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:20.642113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:20.666623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:20.726891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a250b968-1d68-45f4-90ad-fb2c760eac3c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.881788 Sep 18 01:20:20.730189 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1918/3878] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:19 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:20.771476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f859126-5c84-4f24-897d-f0f9655518e3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:20.772311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f859126-5c84-4f24-897d-f0f9655518e3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 5e6eb095-7cb1-4cc8-b766-b7c52c937537] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:20.778704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-0f859126-5c84-4f24-897d-f0f9655518e3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 5e6eb095-7cb1-4cc8-b766-b7c52c937537 could not be found. Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f859126-5c84-4f24-897d-f0f9655518e3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/5e6eb095-7cb1-4cc8-b766-b7c52c937537/action HTTP/1.1 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 14 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: {"resume": {}} Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5e6eb095-7cb1-4cc8-b766-b7c52c937537 could not be found. Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5e6eb095-7cb1-4cc8-b766-b7c52c937537', 'body': {'resume': {}}} Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6eb095-7cb1-4cc8-b766-b7c52c937537 could not be found. Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6eb095-7cb1-4cc8-b766-b7c52c937537 could not be found. Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:20.786901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:20.791252 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:20.791252 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:20.791252 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6eb095-7cb1-4cc8-b766-b7c52c937537 could not be found. Sep 18 01:20:20.791252 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:20.793008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f859126-5c84-4f24-897d-f0f9655518e3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 5e6eb095-7cb1-4cc8-b766-b7c52c937537 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:20.794095 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f859126-5c84-4f24-897d-f0f9655518e3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/5e6eb095-7cb1-4cc8-b766-b7c52c937537/action" status: 404 len: 111 microversion: 2.1 time: 0.040265 Sep 18 01:20:20.806566 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1919/3879] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:20 2022] POST /compute/v2.1/servers/5e6eb095-7cb1-4cc8-b766-b7c52c937537/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:20:20.819522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dcd82256-0cec-42b3-81b2-7d60a68ae44c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.214188 Sep 18 01:20:20.830091 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1961/3880] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:20 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:20:20.832418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:20.833463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:20.845210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c8fed17c-5e18-4c60-a1da-66916694005b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006d11550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:20.847786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:20.848474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:20.849485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:20.850431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:20.851044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:20.851622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:20.927596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c8fed17c-5e18-4c60-a1da-66916694005b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.087445 Sep 18 01:20:20.945691 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1962/3881] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:20 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:21.202736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:21.217324 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36b93792-78c6-4476-8be1-6173870590b3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.397600 Sep 18 01:20:21.241312 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1920/3882] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:20 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:21.246973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:21.247866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:21.266645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.267607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.268203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.273103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.273871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.274814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.611339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:21.615223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:21.627955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.631550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.634153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.635309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.636007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.638119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.747730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:21.764695 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-451aa578-500a-4106-9060-1d30b97fee42 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.521824 Sep 18 01:20:21.765589 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1963/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:21 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:20:21.790119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:21.791000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:21.805862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.806706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.807280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.808266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.808981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.810506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.858583 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Cannot 'resume' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action HTTP/1.1 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 14 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: {"resume": {}} Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'resume' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'resume': {}}} Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb in vm_state active. Cannot resume while the instance is in this state. Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:21.860838 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:21.864189 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:21.864189 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:21.864189 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:21.864189 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:21.864189 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:21.864189 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:20:21.864189 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:21.869511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 409 to user: Cannot 'resume' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:21.870707 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-173c658f-9bb1-4f25-b7c6-4bb815fe4c21 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 409 len: 144 microversion: 2.1 time: 0.085813 Sep 18 01:20:21.871525 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1964/3884] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:21 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 144 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 18 01:20:21.881858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:21.884808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:21.893087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.893955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.895272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.896251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.897804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.899035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.938386 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:21.943301 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b85113a0-b3c2-44dc-a927-9ea1ab940845 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066654 Sep 18 01:20:21.944459 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1965/3885] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:21 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:20:21.951284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:21.954046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:21.962951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.963700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.964350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:21.965285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:21.966017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:21.966664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:22.423492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:22.442275 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c024e057-ebe9-42d2-b482-c50232366095 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.832656 Sep 18 01:20:22.442915 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1921/3886] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:21 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:22.460876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2017a84-d9c5-4334-ad9f-e33e434b3efe tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005572e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:22.495745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:22.512848 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7dacdc25-ba06-4e47-aae0-610aea203163 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.563210 Sep 18 01:20:22.525609 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1966/3887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:21 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:22.550514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:22.551612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:22.567189 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2017a84-d9c5-4334-ad9f-e33e434b3efe tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1454 microversion: 2.1 time: 0.114651 Sep 18 01:20:22.568088 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1922/3888] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:22 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:22.584043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:22.586554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:22.587261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:22.588593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:22.589255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:22.590056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:22.961212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:22.969213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:22.973724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:22.980061 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4ee7549-71cf-48b3-a0a7-3a2fd4235c4a tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.434862 Sep 18 01:20:22.998595 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1967/3889] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:22 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:20:23.006222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.007059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.007809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.008967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.009705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.010413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.058530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d41f5a0-16e3-4657-87a3-7d06f0fa2872 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d41f5a0-16e3-4657-87a3-7d06f0fa2872 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 160 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "443217fd-613c-4ff9-8148-2ed9e5504cb6"}]}} Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'server': {'name': '', 'imageRef': '6f723c18-9162-4fbf-98cf-c1c9072c0368', 'flavorRef': '452', 'networks': [{'uuid': '443217fd-613c-4ff9-8148-2ed9e5504cb6'}]}}} Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '' Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:20:23.063117 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:20:23.067958 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:23.072258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d41f5a0-16e3-4657-87a3-7d06f0fa2872 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:23.073590 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d41f5a0-16e3-4657-87a3-7d06f0fa2872 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019123 Sep 18 01:20:23.077809 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1968/3890] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:20:23 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:20:23.080939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-28cda197-bc62-4175-8664-c1c0c11bce7e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129030 Sep 18 01:20:23.081604 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1923/3891] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:22 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:20:23.084186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:23.085101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:23.093087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.094630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.095323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.096282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.096957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.097675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.389308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:23.402714 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7125d5c6-0187-4761-b971-cf81372b39bd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.323232 Sep 18 01:20:23.418683 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1969/3892] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:23 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:23.440619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:23.445748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:23.456727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.458218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.459448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.463254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.464450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.466573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.470261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:23.471147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:23.484736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.491469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.492324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.493299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:23.493974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:23.494665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:23.865509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:23.879125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14fe41ec-cc1a-4594-8dec-18f9b488edaa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.414501 Sep 18 01:20:23.886370 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1970/3893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:23 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:23.903780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e5701358-8c3f-42a5-9882-5e5ccffe4a08 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006247430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:23.912698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:23.915044 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:23.927412 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d8709bf-17e6-4180-bf95-761bca1ace2f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.494227 Sep 18 01:20:23.928560 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1924/3894] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:23 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:23.934295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-177813248", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39861c7c-66ab-4ccd-ba39-a41edf5a6ba2"}], "security_groups": [{"name": "tempest-securitygroup--1521213730"}], "key_name": "tempest-keypair-579697600", "user_data": "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:24.005118 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e5701358-8c3f-42a5-9882-5e5ccffe4a08 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1463 microversion: 2.1 time: 0.110660 Sep 18 01:20:24.007981 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1971/3895] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:23 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1463 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:24.023745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4674981d-2db6-4e81-a541-a1c46ef2acd5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:24.026511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4674981d-2db6-4e81-a541-a1c46ef2acd5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 0c818e05-4dc1-403f-9cc1-559cf7c220b1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:24.033708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4674981d-2db6-4e81-a541-a1c46ef2acd5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 0c818e05-4dc1-403f-9cc1-559cf7c220b1 could not be found. Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4674981d-2db6-4e81-a541-a1c46ef2acd5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/0c818e05-4dc1-403f-9cc1-559cf7c220b1/action HTTP/1.1 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 14 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: {"shelve": {}} Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0c818e05-4dc1-403f-9cc1-559cf7c220b1 could not be found. Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0c818e05-4dc1-403f-9cc1-559cf7c220b1', 'body': {'shelve': {}}} Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c818e05-4dc1-403f-9cc1-559cf7c220b1 could not be found. Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c818e05-4dc1-403f-9cc1-559cf7c220b1 could not be found. Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:24.043086 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:24.048375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:24.048375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:24.048375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c818e05-4dc1-403f-9cc1-559cf7c220b1 could not be found. Sep 18 01:20:24.048375 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:24.050664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4674981d-2db6-4e81-a541-a1c46ef2acd5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 0c818e05-4dc1-403f-9cc1-559cf7c220b1 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:24.051995 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4674981d-2db6-4e81-a541-a1c46ef2acd5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/0c818e05-4dc1-403f-9cc1-559cf7c220b1/action" status: 404 len: 111 microversion: 2.1 time: 0.042479 Sep 18 01:20:24.056129 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1972/3896] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:24 2022] POST /compute/v2.1/servers/0c818e05-4dc1-403f-9cc1-559cf7c220b1/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:24.062211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-661f62c0-67fa-4627-b94c-98b5d5c05415 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70063c0430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:24.132146 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-661f62c0-67fa-4627-b94c-98b5d5c05415 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 200 len: 1463 microversion: 2.1 time: 0.074451 Sep 18 01:20:24.134165 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1973/3897] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:24 2022] GET /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:24.150376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:24.152578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:24.164249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.164930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.165507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.166442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.167038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.167602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.175503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] validate_networks() for [('39861c7c-66ab-4ccd-ba39-a41edf5a6ba2', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:20:24.470235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:24.491506 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4cf3554b-f446-438e-8fd9-c95d687d34e8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.347082 Sep 18 01:20:24.492109 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1974/3898] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:24 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:24.500475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:24.508410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:24.524717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.534415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.534864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.535670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.536557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.537283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.602331 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60604f9a-0150-4053-ab10-bd2a5f7a86b1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107773 Sep 18 01:20:24.608331 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1975/3899] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:24 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:20:24.615143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:24.615902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:24.625709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.626368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.626917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.628538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.629861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.631992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.901026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:20:24.901534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:20:24.901639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:20:24.902041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:20:24.902654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:20:24.920638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:24.934366 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c724418-713f-42c3-a89f-e36cd09373b0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1468 microversion: 2.1 time: 0.324580 Sep 18 01:20:24.934963 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1976/3900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:24 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:24.939774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:24.943037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.943720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.944330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.946043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.946450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:24.948792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.949399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.960349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.960858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.961304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.962068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:24.962621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:24.963059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:24.977188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for project ceb6afe234e1433eabf8eee5c780c799. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:20:24.985079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Getting quotas for user 29c7d6ca88464aa29691e7ddfa5e5897 and project ceb6afe234e1433eabf8eee5c780c799. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:20:25.002654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:20:25.006209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:20:25.092618 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8813e425-fe8a-4749-8344-1d9349d5d8b3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.162720 Sep 18 01:20:25.093283 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1925/3901] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:20:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:20:25.133079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:25.135279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:25.161891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.162388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.162825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.163531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.163984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.164403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.288588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:25.311625 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c3f0f12-b224-4c11-9913-64abf6aea7b6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.374987 Sep 18 01:20:25.311851 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1977/3902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:24 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:25.316715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1975879549"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:25.319353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:25.340460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.342629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.346383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.347342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.348487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.354632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.519047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:25.536336 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d63c4bd5-37dc-4054-a943-d70f831f8394 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.440437 Sep 18 01:20:25.538577 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1926/3903] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:25 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:25.558353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8131dfcb-2681-4fd7-9f0b-1b90fd39aeb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:25.559348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8131dfcb-2681-4fd7-9f0b-1b90fd39aeb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:25.693223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8131dfcb-2681-4fd7-9f0b-1b90fd39aeb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:25.702000 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8131dfcb-2681-4fd7-9f0b-1b90fd39aeb6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1236 microversion: 2.1 time: 0.162102 Sep 18 01:20:25.706798 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1927/3904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:25 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1236 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:25.719692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:25.720510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:25.741787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.746076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.747655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.748844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.749716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.751704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.811221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lazy-loading 'flavor' on Instance uuid 057d513c-5711-41e5-9f2d-449b777ff7bb {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:20:25.859267 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc3acc4e-64e0-4a16-8a17-37b66648be50 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "POST /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208/action" status: 202 len: 0 microversion: 2.1 time: 0.544330 Sep 18 01:20:25.866455 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1978/3905] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:25 2022] POST /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:20:25.873107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:25.875996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:25.884937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.885433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.886091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.887228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:25.887721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:25.888815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:25.959140 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8401a087-b273-4580-9409-daa25b82bafe tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088482 Sep 18 01:20:25.961080 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1979/3906] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:25 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:20:25.974100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f10395a8-80c0-4186-bcfc-84ce0ac28e6e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a77a790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:26.095118 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f10395a8-80c0-4186-bcfc-84ce0ac28e6e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.132268 Sep 18 01:20:26.096071 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1980/3907] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:25 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:26.211884 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-17570970-5551-4c41-b377-374b954f34c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.497918 Sep 18 01:20:26.217024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1928/3908] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:25 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:26.232522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:26.233876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:26.253091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:26.256453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:26.257542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:26.259159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:26.259630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:26.260059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:26.515378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:26.570470 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d045401b-12de-419e-a0e2-0c4c0800cf0e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.345817 Sep 18 01:20:26.576177 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1981/3909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:26 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:26.579735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:26.580660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:26.589835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:26.590605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:26.591692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:26.592521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:26.593062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:26.593747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:26.756979 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:26.757961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:26.809905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:26.814032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:26.814848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:26.818222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:26.819368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:26.823859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:26.991657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:27.021272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:27.041385 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1975a5fe-40aa-435c-a6bd-af9b9dbe8c13 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.468721 Sep 18 01:20:27.044774 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9cbd5d7-c8b7-4cc6-b2f6-ecd001fc1e92 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1288 microversion: 2.1 time: 0.315390 Sep 18 01:20:27.045583 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1929/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:26 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:27.049755 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1982/3911] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:26 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1288 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:27.057852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:27.070200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:27.098953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.100818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.102829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.104917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.107236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.114549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b68525b3-33b8-4bb7-ac7f-ec839046d925 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006351040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:27.118890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.150402 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:27.223913 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b68525b3-33b8-4bb7-ac7f-ec839046d925 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.092051 Sep 18 01:20:27.229367 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1983/3912] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:27 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:27.261319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d516e7e9-8584-4b9c-8641-a4f041ead474 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.212817 Sep 18 01:20:27.270513 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1930/3913] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:20:27 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454/os-volume_attachments => generated 25 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:27.385925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:27.386434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:27.404233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.404896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.407317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.408378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.408952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.409604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.473719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:20:27.563406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b2fbe996-7fb8-42f5-8310-ef65fa2d11fe req-aef1fd67-4081-4d43-bbeb-a68c0818b191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e5cf62-23da-44ee-b6bf-7dcc733c98c8", "name": "network-vif-unplugged", "status": "completed", "tag": "60f795cf-3fab-42b9-9683-a788a2d28e34"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:27.585745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b2fbe996-7fb8-42f5-8310-ef65fa2d11fe req-aef1fd67-4081-4d43-bbeb-a68c0818b191 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.589476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b2fbe996-7fb8-42f5-8310-ef65fa2d11fe req-aef1fd67-4081-4d43-bbeb-a68c0818b191 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.590103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b2fbe996-7fb8-42f5-8310-ef65fa2d11fe req-aef1fd67-4081-4d43-bbeb-a68c0818b191 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.628156 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b2fbe996-7fb8-42f5-8310-ef65fa2d11fe req-aef1fd67-4081-4d43-bbeb-a68c0818b191 service nova] Creating event network-vif-unplugged:60f795cf-3fab-42b9-9683-a788a2d28e34 for instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 on n-h2-master-1 Sep 18 01:20:27.641952 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b2fbe996-7fb8-42f5-8310-ef65fa2d11fe req-aef1fd67-4081-4d43-bbeb-a68c0818b191 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081202 Sep 18 01:20:27.647241 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1931/3914] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:20:27.660518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:27.668427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:27.686016 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ed78e8d7-e66e-4629-94ff-678235c174a0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 204 len: 0 microversion: 2.20 time: 0.304319 Sep 18 01:20:27.693203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1984/3915] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:20:27 2022] DELETE /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:20:27.695014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.697257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.697879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.701054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.702353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.702353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.720115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:27.725106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:27.745851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.746508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.748097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.752530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:27.753401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:27.754993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:27.810292 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:27.994813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:28.003714 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a48cca3d-d824-4d7a-b8b3-dc92d45aad89 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.351814 Sep 18 01:20:28.021577 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1932/3916] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:27 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:28.078726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:28.079897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:28.095441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:28.098089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:28.099823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:28.103637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:28.107854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:28.109218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:28.132832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:28.153426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:28.154957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:28.156255 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-790339ec-b661-4324-b35c-137eb8738caa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 0.461547 Sep 18 01:20:28.157281 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1985/3917] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:27 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:20:28.163111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:28.163987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:28.171213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:28.171975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:28.172692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:28.174083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:28.175036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:28.175753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:28.310295 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:28.349485 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e0581696-055a-4b84-a033-9acd4a48388c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1294 microversion: 2.1 time: 0.190478 Sep 18 01:20:28.368577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1986/3918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:28 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1294 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:28.386000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d5d53c3-ff04-482e-a7ac-334a14b16c00 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005111af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:28.476021 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d5d53c3-ff04-482e-a7ac-334a14b16c00 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.094509 Sep 18 01:20:28.486341 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1987/3919] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:28 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:28.564037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:28.579745 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-337ccb0f-4b3c-4dad-94f0-42358df75001 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.506188 Sep 18 01:20:28.594347 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1933/3920] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:28 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:29.059211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:29.060648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:29.078871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.080817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.085839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.086913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.087554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.089124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.194681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:29.195427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:29.209333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.209934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.210452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.214112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.214613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.215088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.382341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:29.390990 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-349ede5b-5348-4565-a63a-5c62c2a7dfea tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.358664 Sep 18 01:20:29.402039 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1988/3921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:29 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:29.414299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:29.415125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:29.422283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.423178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.423764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.424650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.425256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.426432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.537083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:29.550459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:29.552718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:29.563966 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03dd8e5b-3232-4b6d-91da-f00b226c7dee tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 0.373801 Sep 18 01:20:29.564943 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1934/3922] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:29 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:20:29.572685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ab91dc55-af7f-462d-8f73-c78abbd536b8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70054165e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:29.663421 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ab91dc55-af7f-462d-8f73-c78abbd536b8 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.095792 Sep 18 01:20:29.676860 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1935/3923] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:29 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:29.690113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:29.690746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:29.723986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.724493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.724938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.743603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:29.746599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:29.748338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:29.924477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:29.938302 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-282f9661-c8ec-40cd-9ad7-2b2e32c5b1a0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 0.534696 Sep 18 01:20:29.941270 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1989/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:29 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:30.022259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:30.040413 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1ee9bee-2ac4-4f4b-bab3-fae747ef41f7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.362186 Sep 18 01:20:30.042365 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1936/3925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:29 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:30.424613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:30.425368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:30.437066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:30.437960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:30.439798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:30.441947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:30.443192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:30.444595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:30.606061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:30.608419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:30.647275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:30.651672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:30.655234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:30.657838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:30.659538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:30.660306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:30.942993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:30.956058 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d27a9396-b529-4d6d-91fe-13b2ed44f751 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.542576 Sep 18 01:20:30.972372 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1990/3926] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:30 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:30.987854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0206f547-406a-4a72-8522-200a126575de tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70050f3c10>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:31.122839 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0206f547-406a-4a72-8522-200a126575de tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.148269 Sep 18 01:20:31.126130 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1991/3927] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:30 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:31.139628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:31.146546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:31.168718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:31.174217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:31.174967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:31.176804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:31.179857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:31.180540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:31.271876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:31.303719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:31.305962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:31.307693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-62fa7626-25c4-490f-99ab-98857d3320e1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 0.708240 Sep 18 01:20:31.335337 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1937/3928] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:30 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:20:31.352725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:31.356029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:31.370417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:31.371978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:31.373510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:31.374981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:31.379010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:31.379778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:31.615079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:31.637253 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7c86c5d-6282-47c2-942a-0e59b9e3d448 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 0.508463 Sep 18 01:20:31.639115 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1992/3929] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:31 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:31.842212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:31.852306 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e14328b-c5c0-4ee0-8049-fc9607cf671e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1654 microversion: 2.1 time: 0.515524 Sep 18 01:20:31.857841 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1938/3930] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:31 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1654 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:31.889961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bdbeb13-9e9a-4921-bd7e-689f6c968c7d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:31.913152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bdbeb13-9e9a-4921-bd7e-689f6c968c7d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:31.914393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bdbeb13-9e9a-4921-bd7e-689f6c968c7d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:31.915424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bdbeb13-9e9a-4921-bd7e-689f6c968c7d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:31.990580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:31.991205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:32.006352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:32.013006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:32.013470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:32.014248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:32.028097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:32.028545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:32.057482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1bdbeb13-9e9a-4921-bd7e-689f6c968c7d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Going to try to start instance {{(pid=122374) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 01:20:32.155625 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1bdbeb13-9e9a-4921-bd7e-689f6c968c7d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.271657 Sep 18 01:20:32.173522 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1993/3931] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:31 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:32.190502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7fb7298f-e0ab-42a4-b0e4-24e65b4596f0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005e9b280>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:32.328593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7fb7298f-e0ab-42a4-b0e4-24e65b4596f0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.151906 Sep 18 01:20:32.331448 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1994/3932] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:32 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:32.343221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:32.355557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:32.401157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:32.401498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:32.412218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:32.417448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:32.421399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:32.421933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:32.460768 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:32.471274 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07d8be60-2239-4173-b37a-3c39d5ed8fbe tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.485378 Sep 18 01:20:32.472967 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1939/3933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:31 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:20:32.478758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:32.479676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:32.486330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:32.487022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:32.487657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:32.489938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:32.490671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:32.491251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:32.957902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:32.970278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:32.971756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:32.990436 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8014dd2-10d3-4bc4-9f09-503e07c5480f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1722 microversion: 2.20 time: 0.514887 Sep 18 01:20:32.994637 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1940/3934] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:32 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1722 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:20:33.008502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-19a0210e-64af-4a06-9b85-ed0bda376add req-405c3e1a-6797-4fa9-84d6-e1526485c628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc80631-d479-465c-b42f-e5d86bc3883b", "tag": "a8182fc4-91e4-431d-bc7e-5c023570e6dc"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:33.039155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-19a0210e-64af-4a06-9b85-ed0bda376add req-405c3e1a-6797-4fa9-84d6-e1526485c628 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:33.041891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-19a0210e-64af-4a06-9b85-ed0bda376add req-405c3e1a-6797-4fa9-84d6-e1526485c628 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:33.042347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-19a0210e-64af-4a06-9b85-ed0bda376add req-405c3e1a-6797-4fa9-84d6-e1526485c628 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:33.093911 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-19a0210e-64af-4a06-9b85-ed0bda376add req-405c3e1a-6797-4fa9-84d6-e1526485c628 service nova] Creating event network-changed:a8182fc4-91e4-431d-bc7e-5c023570e6dc for instance dbc80631-d479-465c-b42f-e5d86bc3883b on n-h2-master-1 Sep 18 01:20:33.111769 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-19a0210e-64af-4a06-9b85-ed0bda376add req-405c3e1a-6797-4fa9-84d6-e1526485c628 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111104 Sep 18 01:20:33.114258 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1941/3935] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:33.152638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0b80186d-6e7a-41e7-a71a-db387322b604 req-84e5f4d9-45ff-468c-b4f0-ce5a5ef432e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa157-6b6f-48ef-9827-7e92ff6b9208", "name": "network-vif-plugged", "status": "completed", "tag": "2bcc5467-2ebf-408b-ad54-6161ef7e1e1f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:33.190262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b80186d-6e7a-41e7-a71a-db387322b604 req-84e5f4d9-45ff-468c-b4f0-ce5a5ef432e3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:33.190746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b80186d-6e7a-41e7-a71a-db387322b604 req-84e5f4d9-45ff-468c-b4f0-ce5a5ef432e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:33.191712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0b80186d-6e7a-41e7-a71a-db387322b604 req-84e5f4d9-45ff-468c-b4f0-ce5a5ef432e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:33.248853 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0b80186d-6e7a-41e7-a71a-db387322b604 req-84e5f4d9-45ff-468c-b4f0-ce5a5ef432e3 service nova] Creating event network-vif-plugged:2bcc5467-2ebf-408b-ad54-6161ef7e1e1f for instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 on n-h1-master-1 Sep 18 01:20:33.263850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0b80186d-6e7a-41e7-a71a-db387322b604 req-84e5f4d9-45ff-468c-b4f0-ce5a5ef432e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141663 Sep 18 01:20:33.264643 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1942/3936] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:33.277827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:33.281137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:33.291947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:33.294088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:33.296352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:33.297729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:33.298695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:33.299388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:33.300045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:33.317758 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ddcff24a-246f-4ae7-a6d9-0800a0038ca5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1663 microversion: 2.1 time: 0.982810 Sep 18 01:20:33.332336 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1995/3937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:32 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1663 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:33.349193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1a38615d-c92a-470b-ad25-1ead3cbf2705 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70062f7af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:33.507449 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1a38615d-c92a-470b-ad25-1ead3cbf2705 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.162692 Sep 18 01:20:33.518639 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1996/3938] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:33 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:33.529331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:33.533264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:33.554762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:33.555251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:33.558473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:33.564880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:33.567767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:33.568564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:34.686114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:34.706704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f8db1b4-4e9b-489a-a650-df0f94c849eb tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 1.431587 Sep 18 01:20:34.721662 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1943/3939] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:33 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:34.728220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:34.728845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:34.746527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:34.747013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:34.747465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:34.748182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:34.748644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:34.749244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:34.752532 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:34.825193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:34.848165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a46f890-1998-4bb0-a6cc-2ff6a9f3993f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 1.325313 Sep 18 01:20:34.855592 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1997/3940] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:33 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:34.875194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:34.877504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:34.912552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:34.913110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:34.913485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:34.914226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:34.914849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:34.915911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:34.963389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:34.965980 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:34.976312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:34.983445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:34.987066 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07d7c4cd-0df8-47a4-908a-11e916b01374 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1654 microversion: 2.20 time: 0.263663 Sep 18 01:20:34.991319 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1944/3941] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:34 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1654 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:20:35.005909 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5cc9c129-9a06-4c9f-a502-c02293baba49 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005273e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:35.099333 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5cc9c129-9a06-4c9f-a502-c02293baba49 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.106357 Sep 18 01:20:35.105080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1945/3942] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:34 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:35.230540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:35.246679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2562fc7a-6ef8-49f5-b7f0-2b9c47a80cea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1663 microversion: 2.1 time: 0.386915 Sep 18 01:20:35.248335 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1998/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:34 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1663 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:35.741741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:35.742373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:35.745351 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:35.767432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:35.767939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:35.768377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:35.769091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:35.788166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:35.789818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:35.884965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:35.887170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:35.919305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:35.922366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:35.924343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:35.925282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:35.928065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:35.928671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:36.386738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:36.405047 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b021a46d-316f-43b3-be02-70cdc5968d0a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 0.667190 Sep 18 01:20:36.413731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:36.420700 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1946/3944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:35 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:36.442196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:36.443872 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-75616734-0d51-42ac-9f60-92451c53348f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.565331 Sep 18 01:20:36.444946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:36.462382 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 1999/3945] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:35 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:36.489182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83aab39f-9390-446c-b757-7b5fc5158ee0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7006b0d8b0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:36.507323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:36.512908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:36.513691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:36.523884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:36.525139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:36.526943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:36.602551 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83aab39f-9390-446c-b757-7b5fc5158ee0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.137700 Sep 18 01:20:36.603635 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2000/3946] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:36 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:36.651884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:36.653012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:36.681962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:36.682538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:36.683004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:36.683756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:36.691799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:36.692432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:36.732551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:36.749229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:36.776920 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:36.780392 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe412551-4df9-4c45-92fb-e2878755e506 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 200 len: 1366 microversion: 2.20 time: 0.356741 Sep 18 01:20:36.788180 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1947/3947] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:36 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:20:36.794894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f75bcbb7-9aa4-4a0b-9c15-22d3b3edc8dc req-aecb3612-ea5d-4ce8-a18b-771955786711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb07fa2-83c3-452e-9777-fd357c981454", "name": "network-vif-deleted", "tag": "2dc73f02-148f-43fb-8c42-ca81ca6680ae"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:36.841881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f75bcbb7-9aa4-4a0b-9c15-22d3b3edc8dc req-aecb3612-ea5d-4ce8-a18b-771955786711 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:36.843042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f75bcbb7-9aa4-4a0b-9c15-22d3b3edc8dc req-aecb3612-ea5d-4ce8-a18b-771955786711 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:36.849152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f75bcbb7-9aa4-4a0b-9c15-22d3b3edc8dc req-aecb3612-ea5d-4ce8-a18b-771955786711 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:36.889229 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f75bcbb7-9aa4-4a0b-9c15-22d3b3edc8dc req-aecb3612-ea5d-4ce8-a18b-771955786711 service nova] Creating event network-vif-deleted:2dc73f02-148f-43fb-8c42-ca81ca6680ae for instance 4eb07fa2-83c3-452e-9777-fd357c981454 on n-h1-master-1 Sep 18 01:20:36.913517 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f75bcbb7-9aa4-4a0b-9c15-22d3b3edc8dc req-aecb3612-ea5d-4ce8-a18b-771955786711 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123444 Sep 18 01:20:36.914915 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1948/3948] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:36.927527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:36.937693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:36.965320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:36.966634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:36.970192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:36.971671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:36.975955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:36.982939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:37.065174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:20:37.335576 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9243644d-d136-49b0-af05-531cad689f04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 204 len: 0 microversion: 2.1 time: 0.418378 Sep 18 01:20:37.338745 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1949/3949] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:20:36 2022] DELETE /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:20:37.349238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:37.350224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:37.357913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:37.360679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:37.361618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:37.362625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:37.363934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:37.364577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:37.720692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:37.732738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7642c09b-eba2-4f74-a797-b2d5bd640b61 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1663 microversion: 2.1 time: 1.113863 Sep 18 01:20:37.735089 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2001/3950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:36 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1663 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:37.748300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:37.749668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:37.763774 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:37.768100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:37.770949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:37.771656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:37.775505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:37.776230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:37.776837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:37.916815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:37.942005 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-650ac712-8def-4276-8536-e7c80c4d96aa tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1508 microversion: 2.1 time: 0.597618 Sep 18 01:20:37.944431 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1950/3951] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:37 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1508 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:37.950388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:37.951352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:37.958514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:37.961099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:37.961907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:37.966486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:37.967661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:37.968679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:38.492002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:38.502385 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0359af05-ac96-4e27-887c-a22f1c63cce8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.555678 Sep 18 01:20:38.504623 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1951/3952] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:37 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:38.531212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6af69184-0182-4afd-8a31-02e3bb18904c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a7b0670>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:38.563478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:38.578738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a41d41ce-b9eb-4370-bd3b-bdb424ee120d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 0.839830 Sep 18 01:20:38.579335 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2002/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:37 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:38.600834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:38.607319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:38.619922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:38.625859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:38.626691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:38.628016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:38.629193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:38.630453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:38.674215 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] HTTP exception thrown: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Request method failure captured: Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 HTTP/1.1 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnFNdJeD5-_tuJeCMgsjM497sVDpeQ2xJeGrYFiHpSysIUJCqQ-hpvzJK3ppnZpni5k-YBU0qC5k5ftmjG3TyH3kAXpLnFpdw6fiPpM8D2BzoFszzxPuHI45IUdcgJ5wVwP40rGqJKBsCgrvf5st2iOvbciUKV2H-XOG1ln-Yky-uqI Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 56d16d15d11b40e188f517d24819845b Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4eb07fa2-83c3-452e-9777-fd357c981454'} Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:38.676517 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Returning 404 to user: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c9831866-6b3d-460a-ab5c-375200a1a3f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 404 len: 111 microversion: 2.20 time: 0.090738 Sep 18 01:20:38.680828 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2003/3954] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:38 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:20:38.681583 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6af69184-0182-4afd-8a31-02e3bb18904c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.173284 Sep 18 01:20:38.691277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-418519d6-9486-49ad-b4d0-29fc38cc3a2b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '.version_select at 0x7f70051043a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:38.691632 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1952/3955] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:38 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:38.728714 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-418519d6-9486-49ad-b4d0-29fc38cc3a2b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868027593" status: 204 len: 0 microversion: 2.20 time: 0.041818 Sep 18 01:20:38.734506 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2004/3956] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:20:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868027593 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:20:38.780742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:38.784125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:38.804951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:38.808521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:38.809508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:38.812236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:38.816741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:38.817158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:38.969091 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:38.970379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:39.005889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:39.010889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:39.011839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:39.018398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:39.019966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:39.020853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:39.498578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:39.512098 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5876fb6d-e848-47a7-8d1b-34fb5a77fd54 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.750304 Sep 18 01:20:39.514620 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1953/3957] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:38 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:39.539020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:39.539984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:39.553273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:39.554551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:39.554994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:39.557236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:39.559451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:39.560210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:39.809724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:39.818635 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7325d107-40e2-440f-acf4-69ba06e468a2 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1508 microversion: 2.1 time: 0.855759 Sep 18 01:20:39.839826 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2005/3958] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:38 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1508 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:20:39.851556 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:39.857309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:39.871260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:39.873771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:39.874723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:39.876090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:39.877497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:39.879468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:40.452392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:40.461593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-914c57ed-6e4e-4455-b96e-fce5c3e99688 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.927850 Sep 18 01:20:40.466010 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1954/3959] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:39 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:40.484560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:40.485838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:40.502339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:40.506497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:40.507215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:40.508108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:40.508820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:40.509620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:40.749003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:40.766498 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f47bbd6-b8ba-4cac-9634-e543c5c217c2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.924870 Sep 18 01:20:40.767103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2006/3960] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:39 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:40.772452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d95a3dc-9d9e-49b5-b774-474c07cc7066 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70051044c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:40.864932 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d95a3dc-9d9e-49b5-b774-474c07cc7066 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.096354 Sep 18 01:20:40.873482 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2007/3961] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:40 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:40.897072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08a1ad76-cfa0-4bfd-be85-c6df0fa04015 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'create', calling method: .version_select at 0x7f70063c0430>, body: {"keypair": {"name": "tempest-keypair-358304058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7TGL0r9yg530qT8MoQZNoxiySf9FNKqUHMxEB4BR08rcius74tmaCEhh7WklMmMpEOtsVsLHVFnGgSJy9rAetkG9AmR7SSuz2A2uYs7HlJTXWwXwhKVSzD1RzZeqW1+w=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:40.945338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-08a1ad76-cfa0-4bfd-be85-c6df0fa04015 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:20:40.958969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-08a1ad76-cfa0-4bfd-be85-c6df0fa04015 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for user 56d16d15d11b40e188f517d24819845b and project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:20:41.019513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08a1ad76-cfa0-4bfd-be85-c6df0fa04015 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.152293 Sep 18 01:20:41.020326 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2008/3962] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:20:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:20:41.050703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:41.051477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:41.078800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.081421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.082080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.085288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.087630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.090177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.094688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:41.123916 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cfad9515-d997-41f3-9ba3-efc108fa236c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 0.651615 Sep 18 01:20:41.125075 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1955/3963] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:40 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:41.132617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:41.146988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:41.163632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.166960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.169032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.170157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.171876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.186034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.197261 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:41.236269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Unlocking {{(pid=122374) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 18 01:20:41.400335 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac7e94d9-502d-472b-bcd1-40e82f22a849 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.377686 Sep 18 01:20:41.402976 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2009/3964] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:41 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:41.689153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:41.699745 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9252d8ad-52bb-4d59-8400-d2a097e91693 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 200 len: 1293 microversion: 2.1 time: 0.573250 Sep 18 01:20:41.705013 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1956/3965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:41 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 1293 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:41.725205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:41.725880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:41.740400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.741069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.741523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.742593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.747131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.747850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.871183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a314f1f7-b7b5-4e9e-baf8-3d7e298d0024 req-addc8c99-ee8e-4556-9bbe-f4300ebdef6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a09f58-2baa-476a-9155-f1016a25f44f", "name": "network-vif-deleted", "tag": "70b262f8-ad73-4c17-9883-1a1098d51c7f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:41.891761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a314f1f7-b7b5-4e9e-baf8-3d7e298d0024 req-addc8c99-ee8e-4556-9bbe-f4300ebdef6b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.893792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a314f1f7-b7b5-4e9e-baf8-3d7e298d0024 req-addc8c99-ee8e-4556-9bbe-f4300ebdef6b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.895296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a314f1f7-b7b5-4e9e-baf8-3d7e298d0024 req-addc8c99-ee8e-4556-9bbe-f4300ebdef6b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.931520 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a314f1f7-b7b5-4e9e-baf8-3d7e298d0024 req-addc8c99-ee8e-4556-9bbe-f4300ebdef6b service nova] Creating event network-vif-deleted:70b262f8-ad73-4c17-9883-1a1098d51c7f for instance d9a09f58-2baa-476a-9155-f1016a25f44f on n-h2-master-1 Sep 18 01:20:41.946507 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a314f1f7-b7b5-4e9e-baf8-3d7e298d0024 req-addc8c99-ee8e-4556-9bbe-f4300ebdef6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.539172 Sep 18 01:20:41.950231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2010/3966] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:41.960574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:41.965846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:41.980573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.984750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.987998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:41.991858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:41.993923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:41.996355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:42.270386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:42.272898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:42.287604 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-79560302-9e5a-4d44-a7cb-588751836054 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.335996 Sep 18 01:20:42.290902 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2011/3967] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:41 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:42.293657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-81d8bcb1-ca99-41f1-9372-fe0b5c7d661a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.587130 Sep 18 01:20:42.295994 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1957/3968] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:41 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:42.301263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06bd0e75-bf1c-4ca4-87b0-5ef00473911a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70051049d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:42.323048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:42.324355 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:42.352929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:42.354031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:42.354757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:42.355852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:42.356781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:42.359675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:42.453847 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06bd0e75-bf1c-4ca4-87b0-5ef00473911a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.161288 Sep 18 01:20:42.455526 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2012/3969] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:42 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:42.476950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:42.479024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:42.514056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:42.514825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:42.515290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:42.527113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:42.527822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:42.528297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:43.319884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:43.329847 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c0ce1245-b2d9-488a-85ae-9794c7716510 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 1.030190 Sep 18 01:20:43.333024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1958/3970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:42 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:43.344383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:43.347406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: d9a09f58-2baa-476a-9155-f1016a25f44f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:43.364946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:43.378057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:43.381013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:43.381184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6036c7b4-d01b-4115-971c-6e0182246571 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.920524 Sep 18 01:20:43.381971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:43.382970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:43.384878 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2013/3971] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:42 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:43.385024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:43.388630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:43.405935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:43.406606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:43.420178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:43.422334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:43.423038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:43.426973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:43.427724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:43.428810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:43.428934 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Instance d9a09f58-2baa-476a-9155-f1016a25f44f could not be found. Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f HTTP/1.1 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: exception: Instance d9a09f58-2baa-476a-9155-f1016a25f44f could not be found. Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd9a09f58-2baa-476a-9155-f1016a25f44f'} Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a09f58-2baa-476a-9155-f1016a25f44f could not be found. Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a09f58-2baa-476a-9155-f1016a25f44f could not be found. Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:43.430620 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a09f58-2baa-476a-9155-f1016a25f44f could not be found. Sep 18 01:20:43.434661 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:43.438979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 404 to user: Instance d9a09f58-2baa-476a-9155-f1016a25f44f could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:43.440839 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d23dd264-7ad4-448b-aad0-dab76ab50405 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f" status: 404 len: 111 microversion: 2.1 time: 0.105192 Sep 18 01:20:43.446090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1959/3972] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:43 2022] GET /compute/v2.1/servers/d9a09f58-2baa-476a-9155-f1016a25f44f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:43.465240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:43.468366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:43.483467 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:43.493376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:43.495569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:43.496318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:43.498771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:43.499476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:43.502467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:44.919097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:44.931447 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2c0906a9-1c27-44fe-a091-d3414da2c270 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.483691 Sep 18 01:20:44.933940 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1960/3973] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:43 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:44.946353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:44.946860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:44.962884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:44.963386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:44.965491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:44.966866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:44.970077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:44.970833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.041736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:20:45.131473 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:45.183444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:45.212820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abe002f7-284a-4c33-9cde-228f8ed77ff8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1532 microversion: 2.1 time: 1.825810 Sep 18 01:20:45.235476 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2014/3974] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:43 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1532 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:45.247649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a808135f-93d9-4898-ac05-d640ac69dd04 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 204 len: 0 microversion: 2.1 time: 0.311033 Sep 18 01:20:45.247903 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1961/3975] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:20:44 2022] DELETE /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:20:45.253777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:45.254494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:45.273412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15990232-8539-48c0-8bae-d98c2cc52b1f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70054ec160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:45.273804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.274784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.276989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.281229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.286693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.291387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.412380 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15990232-8539-48c0-8bae-d98c2cc52b1f tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1455 microversion: 2.1 time: 0.172730 Sep 18 01:20:45.413250 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2015/3976] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:45 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:45.422133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:45.424579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:45.441007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.441981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.442640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.443867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.444532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.446072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.626382 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-25725a6c-1a89-4995-a86d-e9ee5d6d932a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.211622 Sep 18 01:20:45.627309 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2016/3977] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:45 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:45.637671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:45.646433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:45.662849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.663439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.664095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.665029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.668831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.669786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.747438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:45.762004 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d98e1f08-30f0-4cf1-9c0b-055e650c5d7a tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 0.512873 Sep 18 01:20:45.766694 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1962/3978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:45 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:45.792273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:45.792923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:45.811066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.811575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.812025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:45.812762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:45.813227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:45.813693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:46.517710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:46.531521 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bc6ebef1-00bc-400f-97db-f483c142633e tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.903055 Sep 18 01:20:46.550472 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2017/3979] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:45 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:46.557667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:46.559420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:46.570445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:46.571234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:46.571857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:46.572802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:46.573871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:46.574550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:46.785543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:46.802419 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4f1062be-1714-4b15-954d-15334f729b73 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1672 microversion: 2.1 time: 1.018584 Sep 18 01:20:46.804830 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1963/3980] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:45 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1672 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:46.817805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ec490fe-9911-40ae-86a0-9f9c642aa275 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005281ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:47.476603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:47.496849 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f12cfd9-3744-4975-a5be-167aa83a6e85 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1527 microversion: 2.1 time: 0.944062 Sep 18 01:20:47.508575 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2018/3981] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:46 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1527 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:47.546931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:47.548274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:47.579020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:47.586346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:47.587074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:47.589470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:47.592894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:47.593543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:48.239397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:48.254646 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83e155c2-3904-4cc4-8663-5a467bb9896d tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1362 microversion: 2.1 time: 0.735495 Sep 18 01:20:48.255621 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2019/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:47 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1362 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:48.269368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-56fafc4f-d4c4-4cb0-a0e3-4ce636ab25ae req-74a81a15-6057-4618-bdeb-cc9921e3aa3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc80631-d479-465c-b42f-e5d86bc3883b", "name": "network-vif-plugged", "status": "completed", "tag": "a8182fc4-91e4-431d-bc7e-5c023570e6dc"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:48.310163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-56fafc4f-d4c4-4cb0-a0e3-4ce636ab25ae req-74a81a15-6057-4618-bdeb-cc9921e3aa3d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:48.313995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-56fafc4f-d4c4-4cb0-a0e3-4ce636ab25ae req-74a81a15-6057-4618-bdeb-cc9921e3aa3d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:48.314574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-56fafc4f-d4c4-4cb0-a0e3-4ce636ab25ae req-74a81a15-6057-4618-bdeb-cc9921e3aa3d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:48.365652 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-56fafc4f-d4c4-4cb0-a0e3-4ce636ab25ae req-74a81a15-6057-4618-bdeb-cc9921e3aa3d service nova] Creating event network-vif-plugged:a8182fc4-91e4-431d-bc7e-5c023570e6dc for instance dbc80631-d479-465c-b42f-e5d86bc3883b on n-h2-master-1 Sep 18 01:20:48.418421 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-56fafc4f-d4c4-4cb0-a0e3-4ce636ab25ae req-74a81a15-6057-4618-bdeb-cc9921e3aa3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115346 Sep 18 01:20:48.419924 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2020/3983] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:48.427510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:48.428495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:48.440223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:48.441635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:48.442780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:48.444302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:48.445031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:48.445676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:48.828497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a53e55c3a684703a1ed5878f240f6c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f245a91fa4b078afc8047e827227e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:48.846537 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f5c56caa-ed0d-4134-8856-b7695839c7ac tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 200 len: 1523 microversion: 2.1 time: 0.419621 Sep 18 01:20:48.848440 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2021/3984] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:48 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:48.895600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:48.898115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:48.911987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:48.914800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:48.915582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:48.918813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:48.925191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:48.926062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:49.287792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:49.299787 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31d0a073-c0ae-41bb-ad30-7b591ab2b638 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1652 microversion: 2.1 time: 0.449981 Sep 18 01:20:49.327087 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2022/3985] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:48 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1652 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:49.333151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:49.334215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:49.341718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:49.342580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:49.343255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:49.344189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:49.344947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:49.345610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:50.975033 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:51.063696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:51.084993 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88782fb6-cf25-4508-8e26-bc9fad765ba9 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1527 microversion: 2.1 time: 1.756307 Sep 18 01:20:51.103111 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2023/3986] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:49 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1527 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:51.129626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1444143800", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "116170ea-5b23-4409-b3a0-d8364c6529b2"}], "security_groups": [{"name": "tempest-securitygroup--1848831815"}], "key_name": "tempest-keypair-358304058", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:55.796968 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:56.794362 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:20:56.899167 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ec490fe-9911-40ae-86a0-9f9c642aa275 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1464 microversion: 2.1 time: 10.091657 Sep 18 01:20:56.900670 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1964/3987] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:46 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1464 bytes in 10095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:56.927558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:56.928500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:56.937285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:56.938655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:56.939328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:56.940797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:56.941483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:56.942671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:57.193294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] validate_networks() for [('116170ea-5b23-4409-b3a0-d8364c6529b2', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:20:57.412493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:57.424334 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf29a33e-8cd8-436b-9c7a-ff25a46ebe4c tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1547 microversion: 2.1 time: 0.505626 Sep 18 01:20:57.436030 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1965/3988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:56 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1547 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:57.446096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:57.447004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:57.465045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:57.466228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:57.466896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:57.467632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:57.468086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:57.469305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:57.576129 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7eccc6d-0d0c-46cb-8d93-71f54836f2ef tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.137573 Sep 18 01:20:57.577504 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1966/3989] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:20:57 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:20:57.584907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:57.585987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] [instance: 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:57.594901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:57.596220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:57.597901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:57.600121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:57.602169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:57.602783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:57.632384 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] HTTP exception thrown: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 could not be found. Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Request method failure captured: Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 HTTP/1.1 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnDgscXIqYE_7x9KeTCLzF0Zjm7ekP8pAd_-sxSBIAUe0gZ7p50DzUt1avr-B6CsKLd-Die7KjuQyWID8lxy79ACklSUtJa99qEC4Y-oPsLok1k4mhR_AgTF1oPcALko1CRt6KuIhtV9GNsf6h9zHWRIAOop3Zzc-HwpjK3ksaWMoq4 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/941f245a91fa4b078afc8047e827227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_941f245a91fa4b078afc8047e827227e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/941f245a91fa4b078afc8047e827227e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 941f245a91fa4b078afc8047e827227e Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-919625907 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4a53e55c3a684703a1ed5878f240f6c4 Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-919625907-project Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 could not be found. Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07'} Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 could not be found. Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 could not be found. Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:57.640594 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 could not be found. Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] Returning 404 to user: Instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f39ff55d-2898-410e-ae6c-81c25f3f6738 tempest-ServerRescueNegativeTestJSON-919625907 tempest-ServerRescueNegativeTestJSON-919625907-project] 10.222.0.25 "GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07" status: 404 len: 111 microversion: 2.1 time: 0.062763 Sep 18 01:20:57.645796 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1967/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:57 2022] GET /compute/v2.1/servers/6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:20:57.652152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-571ec25b-24d0-4a76-97db-62574f7007db req-53eb8c23-095e-4c3f-9b0a-5ebcaacc38d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07", "name": "network-vif-deleted", "tag": "d6772adf-629a-4a86-8862-d5884609244c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:57.664089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-571ec25b-24d0-4a76-97db-62574f7007db req-53eb8c23-095e-4c3f-9b0a-5ebcaacc38d6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:57.664719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-571ec25b-24d0-4a76-97db-62574f7007db req-53eb8c23-095e-4c3f-9b0a-5ebcaacc38d6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:57.665453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-571ec25b-24d0-4a76-97db-62574f7007db req-53eb8c23-095e-4c3f-9b0a-5ebcaacc38d6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:57.680287 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-571ec25b-24d0-4a76-97db-62574f7007db req-53eb8c23-095e-4c3f-9b0a-5ebcaacc38d6 service nova] Creating event network-vif-deleted:d6772adf-629a-4a86-8862-d5884609244c for instance 6dbf6a0e-8696-4dcf-b4f0-cc3bbc3b8c07 on n-h1-master-1 Sep 18 01:20:57.690741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-571ec25b-24d0-4a76-97db-62574f7007db req-53eb8c23-095e-4c3f-9b0a-5ebcaacc38d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045753 Sep 18 01:20:57.693477 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1968/3991] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:57.703294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cd9a23e0-35a0-425c-9d83-0f4b21929766 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Action: 'create', calling method: .version_select at 0x7f700670caf0>, body: {"keypair": {"name": "tempest-keypair-1334996982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1FMgALlsnwf7rcrsHHFkcGT6xAc9Nn2z9Q7Icwy7g5hAOEQSkapVlRmDJkU+dFtF9XXB3NHY+aHaRh8jDXE8p5x1fHb1Oc3ciWSuIu6OvpdmWqrq6KhXT4NvP6H4Y74g=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:57.725980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cd9a23e0-35a0-425c-9d83-0f4b21929766 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Getting quotas for project 4554786105684c8caf0f6ee4e3eda683. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:20:57.732089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cd9a23e0-35a0-425c-9d83-0f4b21929766 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Getting quotas for user 452b12f97b654516abad84b18eaecc17 and project 4554786105684c8caf0f6ee4e3eda683. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:20:57.762868 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cd9a23e0-35a0-425c-9d83-0f4b21929766 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.067600 Sep 18 01:20:57.771730 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1969/3992] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:20:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:20:57.777939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:57.778933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:57.787949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:57.788737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:57.789321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:57.791008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:57.791668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:57.792428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:58.230530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:58.243076 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67f31dc0-6023-4482-ba03-ce0207c77f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1527 microversion: 2.1 time: 0.469938 Sep 18 01:20:58.243997 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1970/3993] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:57 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1527 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:58.377578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9c6ebca2-157e-445d-9fba-2bdc08cde65d req-6d00ee32-59a6-4d36-a962-9cf728c033ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057d513c-5711-41e5-9f2d-449b777ff7bb", "name": "network-vif-plugged", "status": "completed", "tag": "61754220-27e3-4058-a935-ba4ce524fd38"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:20:58.392841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9c6ebca2-157e-445d-9fba-2bdc08cde65d req-6d00ee32-59a6-4d36-a962-9cf728c033ac service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:58.398925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9c6ebca2-157e-445d-9fba-2bdc08cde65d req-6d00ee32-59a6-4d36-a962-9cf728c033ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:58.399924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9c6ebca2-157e-445d-9fba-2bdc08cde65d req-6d00ee32-59a6-4d36-a962-9cf728c033ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:58.416836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9c6ebca2-157e-445d-9fba-2bdc08cde65d req-6d00ee32-59a6-4d36-a962-9cf728c033ac service nova] Creating event network-vif-plugged:61754220-27e3-4058-a935-ba4ce524fd38 for instance 057d513c-5711-41e5-9f2d-449b777ff7bb on n-h2-master-1 Sep 18 01:20:58.436687 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9c6ebca2-157e-445d-9fba-2bdc08cde65d req-6d00ee32-59a6-4d36-a962-9cf728c033ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191415 Sep 18 01:20:58.438883 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1971/3994] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:58.451494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ffe56ae-d967-42ce-86ab-8229cb73335b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005eb7160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:58.478604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:20:58.479219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:20:58.479768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:20:58.480357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:20:58.480912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:20:58.508428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:58.512707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:58.513388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:58.516132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:58.516967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:58.521414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:58.579183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:20:58.596044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Getting quotas for user 56d16d15d11b40e188f517d24819845b and project 64b7dafe6d2840208386dc8a2c95006b. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:20:58.617329 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ffe56ae-d967-42ce-86ab-8229cb73335b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 200 len: 1464 microversion: 2.1 time: 0.176860 Sep 18 01:20:58.618324 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1972/3995] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:20:58 2022] GET /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:58.631167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:58.634321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:58.642419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:20:58.646705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:58.649847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:20:58.663546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:58.664266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:58.665250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:58.665998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:58.666646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:58.828578 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8fe549b7-ed97-482e-87cd-bc92d08164ac tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 7.722245 Sep 18 01:20:58.836090 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2024/3996] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:20:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 7732 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:20:58.844258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:58.849238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:58.861825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:58.866147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:58.866786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:58.867958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:58.868595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:58.869341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:59.216388 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2cf28664-8886-4ece-a392-2c1ca3a4d1ca tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.595863 Sep 18 01:20:59.217291 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1973/3997] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:20:58 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-interface => generated 285 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:20:59.224404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:59.226402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:59.242260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:59.244322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:59.246106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:59.250345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:20:59.251068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:20:59.251709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:20:59.729362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:59.755938 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0fcdad6c-82cc-4e7c-985e-89eb5dac519b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.918274 Sep 18 01:20:59.762475 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2025/3998] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:58 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:20:59.780687 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e210dc4-1e0a-4f6c-b64e-03d6aa324dad tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:20:59.781961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e210dc4-1e0a-4f6c-b64e-03d6aa324dad tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:20:59.977887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e210dc4-1e0a-4f6c-b64e-03d6aa324dad tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:59.989093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e210dc4-1e0a-4f6c-b64e-03d6aa324dad tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:59.991558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e210dc4-1e0a-4f6c-b64e-03d6aa324dad tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:20:59.993381 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e210dc4-1e0a-4f6c-b64e-03d6aa324dad tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1281 microversion: 2.20 time: 0.227842 Sep 18 01:20:59.994242 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2026/3999] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:20:59 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:00.012457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:00.017214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:00.023282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:00.036494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:00.037298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:00.037934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:00.038966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:00.039581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:00.040760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:00.048476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b395c467-e95b-4add-ba62-fa1d7dc97360 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 200 len: 1466 microversion: 2.1 time: 0.829825 Sep 18 01:21:00.052183 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1974/4000] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:59 2022] GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 1466 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:00.068143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:00.077189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:00.120754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:00.121736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:00.122523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:00.123496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:00.124462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:00.125177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:00.423129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:00.445116 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2fcfea55-3d21-437d-a00e-9613b874f626 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.388728 Sep 18 01:21:00.447110 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1975/4001] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:00 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:00.455195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-29b5b635-9dec-48a5-8998-76edb1e6b58d tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005e555e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:00.692016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-29b5b635-9dec-48a5-8998-76edb1e6b58d tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-09-18T01%3A18%3A39Z" status: 200 len: 1903 microversion: 2.1 time: 0.242076 Sep 18 01:21:00.693083 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1976/4002] 10.222.0.25 () {58 vars in 1199 bytes} [Sun Sep 18 01:21:00 2022] GET /compute/v2.1/images?changes-since=2022-09-18T01%3A18%3A39Z => generated 1903 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:00.701572 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:00.709026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:00.723058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:00.723567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:00.724041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:00.724768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:00.725242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:00.725743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:00.781741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:00.793886 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7b3b6fa6-9a0e-4f29-9ddd-f7d66957442e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1527 microversion: 2.1 time: 0.797442 Sep 18 01:21:00.810914 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2027/4003] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:20:59 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1527 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:00.818385 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d23bb77-a39a-48ac-aef2-2f5f5fcb4618 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70062f78b0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:00.915931 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d23bb77-a39a-48ac-aef2-2f5f5fcb4618 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1499115014" status: 200 len: 485 microversion: 2.1 time: 0.101187 Sep 18 01:21:00.916659 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2028/4004] 10.222.0.25 () {58 vars in 1231 bytes} [Sun Sep 18 01:21:00 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1499115014 => generated 485 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:00.945087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f68f480-130f-4bf4-b4d8-d6c115b6d3bd tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70050bbc10>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:01.068517 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f68f480-130f-4bf4-b4d8-d6c115b6d3bd tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?server=2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 200 len: 958 microversion: 2.1 time: 0.135152 Sep 18 01:21:01.070697 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2029/4005] 10.222.0.25 () {58 vars in 1209 bytes} [Sun Sep 18 01:21:00 2022] GET /compute/v2.1/images?server=2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 958 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:01.086461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:01.087510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:01.113054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:01.116168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:01.117053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:01.124463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:01.127613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:01.129162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:01.138124 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:01.699751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:01.717948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:01.722744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:01.725166 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9e99820-2635-45df-b750-7884bc026e28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1333 microversion: 2.20 time: 0.651428 Sep 18 01:21:01.727147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2030/4006] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:01 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1333 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:01.735962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02bfb687-f0b5-4a0c-b918-a27f209327b3 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a77adc0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:01.827464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:01.828996 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02bfb687-f0b5-4a0c-b918-a27f209327b3 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 484 microversion: 2.1 time: 0.099100 Sep 18 01:21:01.830655 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2031/4007] 10.222.0.25 () {58 vars in 1317 bytes} [Sun Sep 18 01:21:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 484 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:01.846341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:01.847807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:01.849836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f69e220-8942-44e0-92ce-8a7f34a48126 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.152029 Sep 18 01:21:01.850556 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1977/4008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:00 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:01.855337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac5477e8-1837-48f6-aa09-ad6fc3c99338 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700670cb80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:01.897099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:01.897622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:01.898258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:01.899580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:01.900197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:01.900797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:01.937758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac5477e8-1837-48f6-aa09-ad6fc3c99338 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 484 microversion: 2.1 time: 0.085857 Sep 18 01:21:01.939148 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1978/4009] 10.222.0.25 () {58 vars in 1303 bytes} [Sun Sep 18 01:21:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 484 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:01.944042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:01.946612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:01.954200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:01.955038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:01.955725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:01.957418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:01.958125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:01.958780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:02.600912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:02.626781 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-97da1189-a209-4d12-b01a-afffb6065bba tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.682965 Sep 18 01:21:02.629577 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1979/4010] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:01 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:02.651851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e6ae040f-235e-4b5b-b247-2af21e482cf3 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a78e820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:02.770169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:02.782209 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a433cf3-319b-4da7-993e-8faf3549ab43 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1527 microversion: 2.1 time: 0.950717 Sep 18 01:21:02.786002 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2032/4011] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:01 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1527 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:02.804668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-868564925", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "73df80c9-a77f-4c77-8c81-94697c8a36b9"}, {"port": "220001de-0a05-4cc5-b9ea-25a518baeb59", "tag": "port-1"}, {"port": "745d6228-c772-4a5f-b7a4-1a5cea379f6c", "tag": "port-2"}, {"uuid": "7a38a020-6ec5-4bf6-8681-7a39401f827d", "tag": "net-1"}, {"uuid": "7a38a020-6ec5-4bf6-8681-7a39401f827d"}, {"uuid": "bd5144ba-fae6-4d25-bfde-f9a3e5621f07", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bd5144ba-fae6-4d25-bfde-f9a3e5621f07", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ff9fbe1e-e278-4ea6-ab07-d14af046c12c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "40ff83d3-4313-4989-ba81-2a41ead2cdec", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3e7a4260-013e-4d9a-bcf9-7fc57fe16f4d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1453015521"}], "key_name": "tempest-keypair-1334996982", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:03.091195 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e6ae040f-235e-4b5b-b247-2af21e482cf3 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.460546 Sep 18 01:21:03.092499 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1980/4012] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:21:02 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:03.097962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5cd3cce7-c171-438d-b331-b8fcfec6e402 req-c568f4f9-10fd-4ffd-90ae-31ee21e82c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa157-6b6f-48ef-9827-7e92ff6b9208", "name": "network-vif-unplugged", "status": "completed", "tag": "2bcc5467-2ebf-408b-ad54-6161ef7e1e1f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:03.137986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5cd3cce7-c171-438d-b331-b8fcfec6e402 req-c568f4f9-10fd-4ffd-90ae-31ee21e82c4b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:03.138812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5cd3cce7-c171-438d-b331-b8fcfec6e402 req-c568f4f9-10fd-4ffd-90ae-31ee21e82c4b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:03.139486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5cd3cce7-c171-438d-b331-b8fcfec6e402 req-c568f4f9-10fd-4ffd-90ae-31ee21e82c4b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:03.163195 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5cd3cce7-c171-438d-b331-b8fcfec6e402 req-c568f4f9-10fd-4ffd-90ae-31ee21e82c4b service nova] Creating event network-vif-unplugged:2bcc5467-2ebf-408b-ad54-6161ef7e1e1f for instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 on n-h1-master-1 Sep 18 01:21:03.169854 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5cd3cce7-c171-438d-b331-b8fcfec6e402 req-c568f4f9-10fd-4ffd-90ae-31ee21e82c4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075978 Sep 18 01:21:03.171154 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1981/4013] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:03.180163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:03.181978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:03.191899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:03.192774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:03.193416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:03.194349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:03.195980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:03.196631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:03.346985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] validate_networks() for [('73df80c9-a77f-4c77-8c81-94697c8a36b9', None, None, None, None, None), (None, None, '220001de-0a05-4cc5-b9ea-25a518baeb59', None, None, None), (None, None, '745d6228-c772-4a5f-b7a4-1a5cea379f6c', None, None, None), ('7a38a020-6ec5-4bf6-8681-7a39401f827d', None, None, None, None, None), ('7a38a020-6ec5-4bf6-8681-7a39401f827d', None, None, None, None, None), ('bd5144ba-fae6-4d25-bfde-f9a3e5621f07', '10.2.2.100', None, None, None, None), ('bd5144ba-fae6-4d25-bfde-f9a3e5621f07', '10.2.2.200', None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:21:03.849930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:03.860901 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c24faf3-15ca-4502-a8d8-8ec9abee84e5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.687256 Sep 18 01:21:03.861423 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1982/4014] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:03 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:03.897360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:03.898112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:03.930646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:03.931428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:03.932035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:03.933309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:03.933991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:03.934585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:04.930551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:04.955951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:04.957771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:04.958985 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d91eb505-da2a-4ee5-aaa0-50216856647c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 1.082961 Sep 18 01:21:04.959581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1983/4015] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:03 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:04.979021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c411a55a-da93-4cc9-95ef-af96c649e782 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005572940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:05.134360 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c411a55a-da93-4cc9-95ef-af96c649e782 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.173420 Sep 18 01:21:05.137303 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1984/4016] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:21:04 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:05.171487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-14744739-cbd6-429d-ad59-746d5437d7b8 req-8414d98d-854b-4043-95a5-61d262da4497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc80631-d479-465c-b42f-e5d86bc3883b", "tag": "a8182fc4-91e4-431d-bc7e-5c023570e6dc"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:05.218567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-14744739-cbd6-429d-ad59-746d5437d7b8 req-8414d98d-854b-4043-95a5-61d262da4497 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:05.224540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-14744739-cbd6-429d-ad59-746d5437d7b8 req-8414d98d-854b-4043-95a5-61d262da4497 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:05.226835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-14744739-cbd6-429d-ad59-746d5437d7b8 req-8414d98d-854b-4043-95a5-61d262da4497 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:05.264953 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-14744739-cbd6-429d-ad59-746d5437d7b8 req-8414d98d-854b-4043-95a5-61d262da4497 service nova] Creating event network-changed:a8182fc4-91e4-431d-bc7e-5c023570e6dc for instance dbc80631-d479-465c-b42f-e5d86bc3883b on n-h2-master-1 Sep 18 01:21:05.280193 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-14744739-cbd6-429d-ad59-746d5437d7b8 req-8414d98d-854b-4043-95a5-61d262da4497 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140165 Sep 18 01:21:05.281987 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1985/4017] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:05.311715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:05.316532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:05.349951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:05.351061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:05.351673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:05.352585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:05.353249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:05.354032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:05.898673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:05.914547 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ea7c4b8-6ce8-4b13-88fa-2d02a64f32bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1527 microversion: 2.1 time: 0.621566 Sep 18 01:21:05.915941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1986/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:05 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1527 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:05.921428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:05.927039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:05.949983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:05.951896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:05.952808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:05.958582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:05.959414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:05.960035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:06.581217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:06.603402 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6244ac3f-8c09-476e-9371-b55073dfe384 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.684394 Sep 18 01:21:06.636596 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1987/4019] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:05 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:06.650332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d5a30ccb-93d7-48b1-9470-174bab6120dc tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a786940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:06.761588 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d5a30ccb-93d7-48b1-9470-174bab6120dc tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.123375 Sep 18 01:21:06.765219 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1988/4020] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:21:06 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:06.780796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:06.781636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:06.804112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:06.804516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:06.804847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:06.807351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:06.807351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:06.807351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:07.407864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:07.417172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:07.423157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:07.435092 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4fd7da87-630a-4388-a7b1-3976b27c2a3a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 0.668267 Sep 18 01:21:07.452797 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1989/4021] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:06 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:07.459979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1c160c4e-6ccb-43f8-a41f-e58349095739 req-f62b9994-9058-42eb-8c23-0c1acb470cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5551fce-fc60-40fe-aa37-d96f5af28e0c", "tag": "00b945c1-f1c2-4b42-8058-fe512412ca56"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:07.470901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1c160c4e-6ccb-43f8-a41f-e58349095739 req-f62b9994-9058-42eb-8c23-0c1acb470cc6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:07.472216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1c160c4e-6ccb-43f8-a41f-e58349095739 req-f62b9994-9058-42eb-8c23-0c1acb470cc6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:07.472839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1c160c4e-6ccb-43f8-a41f-e58349095739 req-f62b9994-9058-42eb-8c23-0c1acb470cc6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:07.485007 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1c160c4e-6ccb-43f8-a41f-e58349095739 req-f62b9994-9058-42eb-8c23-0c1acb470cc6 service nova] Creating event network-changed:00b945c1-f1c2-4b42-8058-fe512412ca56 for instance b5551fce-fc60-40fe-aa37-d96f5af28e0c on n-h1-master-1 Sep 18 01:21:07.491122 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1c160c4e-6ccb-43f8-a41f-e58349095739 req-f62b9994-9058-42eb-8c23-0c1acb470cc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035338 Sep 18 01:21:07.498007 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1990/4022] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:07.508104 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65b6aec5-9c3c-4c54-995e-b1a5edf336ef tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a819e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:07.686211 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65b6aec5-9c3c-4c54-995e-b1a5edf336ef tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-09-18T01%3A18%3A34Z" status: 200 len: 6334 microversion: 2.1 time: 0.185424 Sep 18 01:21:07.704160 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1991/4023] 10.222.0.25 () {58 vars in 1220 bytes} [Sun Sep 18 01:21:07 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-18T01%3A18%3A34Z => generated 6334 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:07.722377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:07.724508 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:07.744929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:07.745631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:07.751073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:07.752336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:07.753931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:07.755202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:07.756958 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:08.448986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:08.453111 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:08.459932 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12739c42-1a4c-4f1f-8323-9f8a4e4e9017 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1527 microversion: 2.1 time: 0.752825 Sep 18 01:21:08.460537 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1992/4024] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:07 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1527 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:08.471019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f6a08d8e-f173-4869-b047-f8ee2096b542 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a819160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:08.551251 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:08.553491 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f6a08d8e-f173-4869-b047-f8ee2096b542 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1499115014" status: 200 len: 665 microversion: 2.1 time: 0.088716 Sep 18 01:21:08.568171 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1993/4025] 10.222.0.25 () {58 vars in 1252 bytes} [Sun Sep 18 01:21:08 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1499115014 => generated 665 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:08.568171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:08.568171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:08.579587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:08.580526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:08.581276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:08.582813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:08.583892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:08.584772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:09.026290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:09.041002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:09.043398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:09.045806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65614e80-378e-4667-b081-1ed0cc27b836 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 0.489486 Sep 18 01:21:09.047468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1994/4026] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:08 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:09.054244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fc111e7-6db4-4495-b747-899f43682c2a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a78ee50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:09.152171 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fc111e7-6db4-4495-b747-899f43682c2a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1466 microversion: 2.1 time: 0.103251 Sep 18 01:21:09.152957 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1995/4027] 10.222.0.25 () {58 vars in 1338 bytes} [Sun Sep 18 01:21:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1466 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:09.171188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dbc0eb63-53d9-43bd-9f10-6b03c231bd4a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005e5a550>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:09.262036 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dbc0eb63-53d9-43bd-9f10-6b03c231bd4a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1466 microversion: 2.1 time: 0.094474 Sep 18 01:21:09.286485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1996/4028] 10.222.0.25 () {58 vars in 1324 bytes} [Sun Sep 18 01:21:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1466 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:09.292465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30b12c1b-9b50-4542-a01e-0328e83453ec tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700530c160>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:09.432427 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30b12c1b-9b50-4542-a01e-0328e83453ec tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.143765 Sep 18 01:21:09.445100 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1997/4029] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 18 01:21:09 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:09.454981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7874a5fb-f699-49c5-bf17-9e720352a2e0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70052ae670>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:09.550943 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7874a5fb-f699-49c5-bf17-9e720352a2e0 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.100094 Sep 18 01:21:09.552272 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1998/4030] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 18 01:21:09 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:09.565894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:09.570236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:09.581888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:09.583673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:09.584395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:09.585590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:09.587813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:09.588556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:09.987103 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:10.135586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:10.153904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09cee082-cfae-4163-8d7a-923479c5df07 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1509 microversion: 2.1 time: 0.600039 Sep 18 01:21:10.155637 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 1999/4031] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:09 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1509 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:10.160646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c7f02e41-d9a5-47d9-a494-257a4d840cc4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005273280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:10.238765 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c7f02e41-d9a5-47d9-a494-257a4d840cc4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/6f723c18-9162-4fbf-98cf-c1c9072c0368" status: 200 len: 784 microversion: 2.1 time: 0.081959 Sep 18 01:21:10.240564 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2000/4032] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Sep 18 01:21:10 2022] GET /compute/v2.1/images/6f723c18-9162-4fbf-98cf-c1c9072c0368 => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:10.445238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1710597393", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": "none"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:10.546263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:21:10.547415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:21:10.548202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:21:10.549038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:21:10.550713 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:21:10.563643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:10.564207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:10.565432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:10.566430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:10.566892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:10.567314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:10.606740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Getting quotas for project 93c87731678e4f6cbc9776f629a3ae70. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:21:10.614423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Getting quotas for user 580e705da2594276a67b34f4eefd8d7c and project 93c87731678e4f6cbc9776f629a3ae70. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:21:10.630655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:21:10.633269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: ab05bfae-26a0-4177-af2e-8191c64f9790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:21:10.710162 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b133f3a1-2c1a-45b5-b779-b898529ec3f8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.468198 Sep 18 01:21:10.711145 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2001/4033] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:21:10.717982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:10.718754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:10.728238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:10.728891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:10.729337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:10.730299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:10.730756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:10.731184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:11.136976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:11.151951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:11.156306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:11.157624 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03151322-5d15-4f22-a9fc-dac7f018436d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 0.445462 Sep 18 01:21:11.158535 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2002/4034] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:10 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:11.165072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f815bdb9-2122-42a9-9d84-b7dc85a3ac44 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a78e820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:11.253973 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f815bdb9-2122-42a9-9d84-b7dc85a3ac44 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.093700 Sep 18 01:21:11.254563 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2003/4035] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:21:11 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:11.260722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1747fb50-10f6-4c30-84c3-065fd41c5ea6 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:11.261918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1747fb50-10f6-4c30-84c3-065fd41c5ea6 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: ab05bfae-26a0-4177-af2e-8191c64f9790] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:11.354827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1747fb50-10f6-4c30-84c3-065fd41c5ea6 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:11.374370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1747fb50-10f6-4c30-84c3-065fd41c5ea6 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:11.376188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1747fb50-10f6-4c30-84c3-065fd41c5ea6 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:11.377768 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1747fb50-10f6-4c30-84c3-065fd41c5ea6 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790" status: 200 len: 1278 microversion: 2.47 time: 0.121327 Sep 18 01:21:11.378814 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2004/4036] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:11 2022] GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:11.383840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:11.384708 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:11.391620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:11.392534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:11.394015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:11.395071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:11.395733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:11.396474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:11.674022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:11.683759 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c946b47-50d9-4d49-99e7-3765b44b4b88 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1509 microversion: 2.1 time: 0.303677 Sep 18 01:21:11.684348 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2005/4037] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:11 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:11.690997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ddb3e2c1-edf5-412c-b675-002ca469b471 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700663aca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:11.714252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:21:11.714770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:21:11.715151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:21:11.715894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:21:11.718582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:21:11.721266 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:11.730213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:11.731277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:11.732759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:11.734062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:11.735313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:11.736247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:11.767322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Getting quotas for project 4554786105684c8caf0f6ee4e3eda683. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:21:11.774056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Getting quotas for user 452b12f97b654516abad84b18eaecc17 and project 4554786105684c8caf0f6ee4e3eda683. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:21:12.050946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:21:12.069391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ff9fbe1e-e278-4ea6-ab07-d14af046c12c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='40ff83d3-4313-4989-ba81-2a41ead2cdec',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e7a4260-013e-4d9a-bcf9-7fc57fe16f4d',volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:21:12.676384 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ddb3e2c1-edf5-412c-b675-002ca469b471 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2" status: 204 len: 0 microversion: 2.1 time: 0.990397 Sep 18 01:21:12.677755 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2006/4038] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:11 2022] DELETE /compute/v2.1/images/a3ca4aa0-bf45-4cb4-8ef1-9105648453b2 => generated 0 bytes in 992 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:12.694963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-930754458", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": "none"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:12.827255 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41e87f4c-3836-4641-9f26-da9c617ab9d5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 10.039945 Sep 18 01:21:12.829789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2033/4039] 10.222.0.25 () {62 vars in 1189 bytes} [Sun Sep 18 01:21:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 10043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:21:12.836448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:12.837624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:12.841486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:21:12.847222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:12.847931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:21:12.848475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:21:12.848892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:21:12.849229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:12.849399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:21:12.850737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:12.851791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:12.852495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:12.853356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:12.866412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:12.867483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:12.868197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:12.868981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:12.869442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:12.869921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:12.934014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Getting quotas for project 93c87731678e4f6cbc9776f629a3ae70. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:21:12.949478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Getting quotas for user 580e705da2594276a67b34f4eefd8d7c and project 93c87731678e4f6cbc9776f629a3ae70. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:21:13.001443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:21:13.006454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:21:13.175755 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5604c8e4-a45e-4db9-bff2-a55d07726765 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.496635 Sep 18 01:21:13.184897 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2007/4040] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:21:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:21:13.191198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-59caa4f9-9ada-4389-81d9-6a67d7457729 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005eb7430>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:13.243685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:13.259030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:13.263135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:13.266894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c8a6a20a-c2a0-4b13-b758-c981e11e6406 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 0.435410 Sep 18 01:21:13.267724 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2034/4041] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:12 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:13.275240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:13.279264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:13.290911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:13.294256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:13.294852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:13.297960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:13.300343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:13.301281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:13.725842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:13.735716 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-385e7bac-170d-4815-bcf0-bd421b9759a7 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1509 microversion: 2.1 time: 0.466704 Sep 18 01:21:13.740500 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2035/4042] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:13 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:13.751758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae338e74-06ce-4cee-91e1-bc5d492c43e3 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:13.753012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae338e74-06ce-4cee-91e1-bc5d492c43e3 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:13.863839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae338e74-06ce-4cee-91e1-bc5d492c43e3 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:13.890611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae338e74-06ce-4cee-91e1-bc5d492c43e3 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:13.892107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae338e74-06ce-4cee-91e1-bc5d492c43e3 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:13.896654 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae338e74-06ce-4cee-91e1-bc5d492c43e3 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1285 microversion: 2.32 time: 0.150903 Sep 18 01:21:13.903759 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2036/4043] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:13 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:13.911476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94921dc0-988f-4b38-9eee-4447b5f25e3b tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:13.918977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94921dc0-988f-4b38-9eee-4447b5f25e3b tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:14.036682 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-94921dc0-988f-4b38-9eee-4447b5f25e3b tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "PUT /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 991 microversion: 2.47 time: 0.131375 Sep 18 01:21:14.040264 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2037/4044] 10.222.0.25 () {62 vars in 1297 bytes} [Sun Sep 18 01:21:13 2022] PUT /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 991 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:21:14.046441 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-59caa4f9-9ada-4389-81d9-6a67d7457729 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb" status: 204 len: 0 microversion: 2.1 time: 0.859654 Sep 18 01:21:14.051485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2008/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:13 2022] DELETE /compute/v2.1/images/9bbc16b6-808f-47b0-b4f8-b703dbe09afb => generated 0 bytes in 861 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:14.065495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-631670b3-6293-453b-932f-066941d854c4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700a807310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:14.087650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a761968e-db1d-4857-992b-5e1d82c23424 req-9fd13300-4f0a-478a-a199-7774bf9ed87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057d513c-5711-41e5-9f2d-449b777ff7bb", "name": "network-vif-unplugged", "status": "completed", "tag": "61754220-27e3-4058-a935-ba4ce524fd38"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:14.111292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a761968e-db1d-4857-992b-5e1d82c23424 req-9fd13300-4f0a-478a-a199-7774bf9ed87c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:14.112545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a761968e-db1d-4857-992b-5e1d82c23424 req-9fd13300-4f0a-478a-a199-7774bf9ed87c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:14.113275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a761968e-db1d-4857-992b-5e1d82c23424 req-9fd13300-4f0a-478a-a199-7774bf9ed87c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:14.142427 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a761968e-db1d-4857-992b-5e1d82c23424 req-9fd13300-4f0a-478a-a199-7774bf9ed87c service nova] Creating event network-vif-unplugged:61754220-27e3-4058-a935-ba4ce524fd38 for instance 057d513c-5711-41e5-9f2d-449b777ff7bb on n-h2-master-1 Sep 18 01:21:14.162419 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a761968e-db1d-4857-992b-5e1d82c23424 req-9fd13300-4f0a-478a-a199-7774bf9ed87c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109503 Sep 18 01:21:14.168861 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2038/4046] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:14.182650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2fd4e105-3625-47ac-8fe2-00f7e14bce4d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:14.195286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2fd4e105-3625-47ac-8fe2-00f7e14bce4d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:14.404393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fd4e105-3625-47ac-8fe2-00f7e14bce4d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:14.416481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fd4e105-3625-47ac-8fe2-00f7e14bce4d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:14.419009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fd4e105-3625-47ac-8fe2-00f7e14bce4d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:14.421387 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2fd4e105-3625-47ac-8fe2-00f7e14bce4d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1277 microversion: 2.47 time: 0.249465 Sep 18 01:21:14.425014 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2039/4047] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:14 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:14.433651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:14.435085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:14.447245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:14.448495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:14.449634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:14.451294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:14.452968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:14.458416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:14.938155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-631670b3-6293-453b-932f-066941d854c4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035" status: 204 len: 0 microversion: 2.1 time: 0.884130 Sep 18 01:21:14.941931 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2009/4048] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:14 2022] DELETE /compute/v2.1/images/d420071e-0452-4f69-a3c8-d04e36a7a035 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:14.947913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:14.949774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:14.957771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:14.958811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:14.959407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:14.960285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:14.960907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:14.961667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.002102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.014713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.016792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.019491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-94ae2e30-dd76-40ba-bb40-865adc62c7ae tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 0.592990 Sep 18 01:21:15.035188 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2040/4049] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:14 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:15.045125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:15.045919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:15.056733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.057635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.058911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.060406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.061139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.061846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.216076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.230941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.239878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.243157 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4767f59d-2001-4883-a130-a4238d9d76dc tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1519 microversion: 2.32 time: 0.205479 Sep 18 01:21:15.244067 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2041/4050] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:15 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:15.256700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:15.258753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:15.272519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.278286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.278838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.279928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.281125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.281764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.337484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:21:15.402624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.414211 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-044fde6b-cda2-472e-8a7d-d4fd94c08fcf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1452 microversion: 2.1 time: 0.470642 Sep 18 01:21:15.422950 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2010/4051] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:14 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1452 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:15.458431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:15.464151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:15.467533 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:15.479349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.481356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.482010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.482923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.484153 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-316aba9d-c4e9-4197-9443-09ac8b83bfde tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 204 len: 0 microversion: 2.1 time: 0.236705 Sep 18 01:21:15.485344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.485881 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2042/4052] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:21:15 2022] DELETE /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:15.486518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.495735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:15.496793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:15.507530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.508305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.508909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.510106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.510732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.511380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.682849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.695578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.697708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.699176 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c57d77a3-174d-4dd8-bb7d-d6cc95f9ffe7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1329 microversion: 2.47 time: 0.211500 Sep 18 01:21:15.715504 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2043/4053] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:15 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1329 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:15.725843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:15.726921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:15.733757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.734505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.735374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.738187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:15.739007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:15.739620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:15.976275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:15.993174 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f4cc2f6-45fe-4a34-bfa3-4faa6a57bebd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1452 microversion: 2.1 time: 0.545601 Sep 18 01:21:16.008640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2011/4054] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:15 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1452 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:16.052380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:16.053032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:16.061496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.064282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.065377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.066262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.066741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.067180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.194139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:16.209537 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-383de8c1-90a5-48b1-973c-02be64e5e43a tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1474 microversion: 2.1 time: 0.492614 Sep 18 01:21:16.210848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2044/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:15 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1474 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:16.216470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:16.217357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:16.227687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.229308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.230064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.237507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.240434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.241669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.280706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lazy-loading 'flavor' on Instance uuid 057d513c-5711-41e5-9f2d-449b777ff7bb {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:21:16.297159 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Cannot 'shelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state shelved_offloaded Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action HTTP/1.1 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 14 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: {"shelve": {}} Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'shelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state shelved_offloaded Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'shelve': {}}} Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:21:16.300876 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state shelved_offloaded Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state shelved_offloaded Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:16.306184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 409 to user: Cannot 'shelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state shelved_offloaded {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:21:16.307736 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27b97d47-3062-4f58-a675-8ced3e72293e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 409 len: 155 microversion: 2.1 time: 0.095638 Sep 18 01:21:16.308857 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2045/4056] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:21:16 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 155 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:21:16.319621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1ba89c9d-99ed-43ec-8c79-e5aa6fdb9960 req-ab3b4313-755b-4737-bce9-eac7a062d61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551fce-fc60-40fe-aa37-d96f5af28e0c", "name": "network-vif-plugged", "status": "completed", "tag": "00b945c1-f1c2-4b42-8058-fe512412ca56"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:16.333012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1ba89c9d-99ed-43ec-8c79-e5aa6fdb9960 req-ab3b4313-755b-4737-bce9-eac7a062d61c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.333728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1ba89c9d-99ed-43ec-8c79-e5aa6fdb9960 req-ab3b4313-755b-4737-bce9-eac7a062d61c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.334261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1ba89c9d-99ed-43ec-8c79-e5aa6fdb9960 req-ab3b4313-755b-4737-bce9-eac7a062d61c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.349241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1ba89c9d-99ed-43ec-8c79-e5aa6fdb9960 req-ab3b4313-755b-4737-bce9-eac7a062d61c service nova] Creating event network-vif-plugged:00b945c1-f1c2-4b42-8058-fe512412ca56 for instance b5551fce-fc60-40fe-aa37-d96f5af28e0c on n-h1-master-1 Sep 18 01:21:16.360550 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1ba89c9d-99ed-43ec-8c79-e5aa6fdb9960 req-ab3b4313-755b-4737-bce9-eac7a062d61c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048592 Sep 18 01:21:16.362674 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2046/4057] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:16.374106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:16.374992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:16.388769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.390866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.391655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.393126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.394120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.394868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.588254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:16.642076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:16.665281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:16.668409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:16.671628 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cbc786cc-ca79-460e-b149-f0f15c39650d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1575 microversion: 2.32 time: 0.306144 Sep 18 01:21:16.673085 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2047/4058] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:16 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1575 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:16.679981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:16.681008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:16.682736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:16.685073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:16.689510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.690181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.690914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.691867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.692574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f55cd22-fd5a-492a-b551-1be8e988ea3c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 0.639211 Sep 18 01:21:16.692826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.693498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.700484 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2012/4059] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:16 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:16.734166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:16.734803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:16.743006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122374) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 01:21:16.750171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.752003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.752653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.753776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.755443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.757351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.844619 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-746598ba-cef3-4b97-9d54-1f3b49d7050f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.169177 Sep 18 01:21:16.853229 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2048/4060] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:21:16 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:21:16.859850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:16.861170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:16.876089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.876890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.879098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:16.879098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:16.879763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:16.879914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:17.238337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:17.256139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:17.259305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:17.261678 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0fcd627d-3960-44f2-aba3-180c3f030555 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1337 microversion: 2.47 time: 0.532189 Sep 18 01:21:17.263133 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2013/4061] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:16 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1337 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:17.268838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:17.269824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:17.277219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:17.278124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:17.278747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:17.279641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:17.280929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:17.281982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:17.534648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:17.585943 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-157cf60e-4cab-4605-aa72-15bebeeac195 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1460 microversion: 2.1 time: 0.729720 Sep 18 01:21:17.588072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2049/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:16 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1460 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:17.681907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:17.695285 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-412cb143-f8e7-474f-8abd-629512ae81b4 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1474 microversion: 2.1 time: 0.430800 Sep 18 01:21:17.698645 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2014/4063] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:17 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1474 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:17.710844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:17.714001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:17.725866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:17.726785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:17.737966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:17.739474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:17.739988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:17.740448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:17.740821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:17.741453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:17.743703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:17.744666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:17.745424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:17.746078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:17.750222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:17.750694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:17.840642 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:18.018132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.036391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.059150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.063240 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-47e0d0c9-6ffc-434b-a458-5c9ed3476735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1575 microversion: 2.32 time: 0.358609 Sep 18 01:21:18.086405 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2050/4064] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:17 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1575 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:18.293371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:18.294808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:18.302829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:18.303805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:18.304465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:18.305535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:18.306231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:18.306829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:18.350937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.368725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.370699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.371775 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ea0f2d6-1878-4442-be1d-071195f73d69 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1407 microversion: 2.20 time: 0.654255 Sep 18 01:21:18.372475 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2015/4065] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:17 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1407 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:18.410069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.419828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.421448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:18.422781 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0859176b-d611-4eb0-8ab5-a55cd6793da7 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1335 microversion: 2.47 time: 0.134269 Sep 18 01:21:18.423484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2051/4066] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:18 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:18.614483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:18.615178 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:18.622715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:18.623634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:18.624073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:18.624795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:18.625417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:18.626002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:18.737269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:18.738507 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:18.748331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:18.749270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:18.750134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:18.751394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:18.752300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:18.752707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.033447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.046158 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-202d7af8-c218-4e45-9508-55c8b90d5655 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1462 microversion: 2.1 time: 0.436618 Sep 18 01:21:19.047141 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2016/4067] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:18 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1462 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:19.099645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:19.100099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.101213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:19.109925 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d5fd2f9a-fb92-4875-b34c-a16e81198748 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1474 microversion: 2.1 time: 0.377901 Sep 18 01:21:19.111114 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2052/4068] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:18 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:19.118539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.119557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.120202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.121235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.121960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.122745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.233873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.244810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.246813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.248429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f90fef6f-89dd-489c-8c01-0d98806d0e4f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1575 microversion: 2.32 time: 0.157799 Sep 18 01:21:19.249378 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2017/4069] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:19 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:19.271021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1a57a25b-2295-448b-8ff2-9c5f878d8009 req-d4475007-dadf-4eb7-bbff-9e6601f81eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e5cf62-23da-44ee-b6bf-7dcc733c98c8", "name": "network-vif-deleted", "tag": "60f795cf-3fab-42b9-9683-a788a2d28e34"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:19.282896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a57a25b-2295-448b-8ff2-9c5f878d8009 req-d4475007-dadf-4eb7-bbff-9e6601f81eb2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.283424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a57a25b-2295-448b-8ff2-9c5f878d8009 req-d4475007-dadf-4eb7-bbff-9e6601f81eb2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.283864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a57a25b-2295-448b-8ff2-9c5f878d8009 req-d4475007-dadf-4eb7-bbff-9e6601f81eb2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.297163 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1a57a25b-2295-448b-8ff2-9c5f878d8009 req-d4475007-dadf-4eb7-bbff-9e6601f81eb2 service nova] Creating event network-vif-deleted:60f795cf-3fab-42b9-9683-a788a2d28e34 for instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 on n-h2-master-1 Sep 18 01:21:19.303165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1a57a25b-2295-448b-8ff2-9c5f878d8009 req-d4475007-dadf-4eb7-bbff-9e6601f81eb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036034 Sep 18 01:21:19.303896 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2053/4070] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:19.398596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:19.399787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:19.409871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.411203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.411393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.412626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.413449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.414222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.450012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:19.450728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:19.467608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.468105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.469213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.470122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.470900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.471497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.575542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.594127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.597340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.601626 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee928a6b-e2b0-45b6-b55e-c688328400f1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1335 microversion: 2.47 time: 0.155087 Sep 18 01:21:19.602712 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2054/4071] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:19 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1335 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:19.651686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.664656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.666409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:19.667786 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8859ca9-d785-42a4-ae47-d106f95d0092 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1599 microversion: 2.20 time: 0.275466 Sep 18 01:21:19.668456 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2018/4072] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:19 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1599 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:19.699924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:19.700421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:19.713446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.714312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.715000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.715746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:19.716201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:19.716705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:19.820786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a1b3a181-e034-4978-bb17-66a14369c793 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.124870 Sep 18 01:21:19.821430 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2055/4073] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 18 01:21:19 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:21:20.075363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:20.076115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:20.083337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.083842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.084311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.085064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.085520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.085983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.144847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:20.145619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:20.172085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.175180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.175821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.176584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.177048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.177671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.419993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:20.434710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48ae65e4-1c38-4066-b3d2-23e1875fb176 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1303 microversion: 2.1 time: 0.295554 Sep 18 01:21:20.452277 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2056/4074] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:20 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:20.460859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:20.461296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:20.461989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:20.472972 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b6b8f025-1c0d-4494-87ef-cba54e467d48 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1462 microversion: 2.1 time: 0.401641 Sep 18 01:21:20.474437 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2019/4075] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:20 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1462 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:20.478418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.479251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.479893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.481088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.481787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.482537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.631377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:20.632265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:20.639611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.640110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.640677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.641919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:20.643575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:20.644281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:20.941895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:20.952841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:20.954542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:20.956972 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1108cad7-d701-4ee9-80f0-222b23644518 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1593 microversion: 2.32 time: 0.503382 Sep 18 01:21:20.957584 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2057/4076] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:20 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1593 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:21.009045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:21.029871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:21.031368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:21.032537 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e8ee209b-d00a-4aa2-b6ce-e841161a5dcf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1335 microversion: 2.47 time: 0.406054 Sep 18 01:21:21.054512 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2020/4077] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:20 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1335 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:21.472733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:21.474446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:21.487001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:21.491400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:21.492439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:21.493926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:21.494931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:21.505399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:21.507039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:21.508381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:21.547137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:21.551209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:21.555299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:21.556887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:21.558011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:21.560940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:21.679312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:21.680447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:21.681973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:21.683110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lazy-loading 'fault' on Instance uuid b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:21:21.757583 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:21.866581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:21.905771 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0cfb8089-eb7f-4a28-8c6c-5a5f0c18a019 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1308 microversion: 2.1 time: 0.439546 Sep 18 01:21:21.927446 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2058/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:21 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:21.946354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:21.948605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:21.956715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:21.957444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:21.958050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:21.958910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:21.959551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:21.960142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.066047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-127fa17d-58a4-404a-b5d0-db3acaf7a682 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.134812 Sep 18 01:21:22.068948 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2059/4079] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:21:21 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:21:22.081470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:22.082796 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:22.102932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:22.108921 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:22.111676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.115165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.115962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.117840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.118963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.119890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.144171 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d2f9ad4c-77ea-45ea-9992-fa42c3f4418b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.645947 Sep 18 01:21:22.151108 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2021/4080] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:21 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:22.196897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:22.199311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:22.214952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.219157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.220825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.223836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.230179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.232289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.333711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:22.354618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:22.357689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:22.359674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6446bd9d-6883-436e-a619-e5fffbce18f9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1593 microversion: 2.32 time: 0.288664 Sep 18 01:21:22.360809 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2060/4081] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:22 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1593 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:22.369359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:22.370864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:22.381281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:22.412629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:22.415700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.419778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.425634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.427741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:22.428027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.428650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.430184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.432360 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac26d14c-1775-49e4-88d0-e0c1f2644fbf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1356 microversion: 2.47 time: 0.264775 Sep 18 01:21:22.434404 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2022/4082] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:22 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1356 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:22.472805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:22.488322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:22.504614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.505102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.507473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.509046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.511906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.512564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.663618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:21:22.664040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:21:22.665936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:21:22.666547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:21:22.667146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:21:22.766690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:22.773997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.775601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.776296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.777328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.778472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.778967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.817688 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-942960ba-62aa-4fd8-b0a3-677ec48fe4e8 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "POST /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086/action" status: 202 len: 1078 microversion: 2.47 time: 0.356380 Sep 18 01:21:22.829603 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2023/4083] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:21:22 2022] POST /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086/action => generated 1078 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 18 01:21:22.829603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-aa8f6699-040d-4ab7-bc33-223ac24c8bad req-0df3257a-1ae2-4cf6-9aa6-9c6197a75252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5551fce-fc60-40fe-aa37-d96f5af28e0c", "tag": "00b945c1-f1c2-4b42-8058-fe512412ca56"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:22.843095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aa8f6699-040d-4ab7-bc33-223ac24c8bad req-0df3257a-1ae2-4cf6-9aa6-9c6197a75252 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.843095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aa8f6699-040d-4ab7-bc33-223ac24c8bad req-0df3257a-1ae2-4cf6-9aa6-9c6197a75252 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.843449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-aa8f6699-040d-4ab7-bc33-223ac24c8bad req-0df3257a-1ae2-4cf6-9aa6-9c6197a75252 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.866882 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-aa8f6699-040d-4ab7-bc33-223ac24c8bad req-0df3257a-1ae2-4cf6-9aa6-9c6197a75252 service nova] Creating event network-changed:00b945c1-f1c2-4b42-8058-fe512412ca56 for instance b5551fce-fc60-40fe-aa37-d96f5af28e0c on n-h1-master-1 Sep 18 01:21:22.874052 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-aa8f6699-040d-4ab7-bc33-223ac24c8bad req-0df3257a-1ae2-4cf6-9aa6-9c6197a75252 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053493 Sep 18 01:21:22.875161 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2024/4084] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:22.886663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:22.888225 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:22.896599 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:22.900004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.900958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.901089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.901790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:22.902259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:22.902687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:22.977344 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=14 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:23.021378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.031023 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3462e18d-d789-4518-9f56-e34b92d5383e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1669 microversion: 2.1 time: 0.668194 Sep 18 01:21:23.031625 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2061/4085] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:22 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1669 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:23.055999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.061257 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:23.062142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:23.069007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:23.069821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:23.070415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:23.071287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:23.074921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.075748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:23.076394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.076665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:23.077686 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-894909e6-9fee-48bc-83f2-bd80a6b181ba tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.200960 Sep 18 01:21:23.078633 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2025/4086] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:22 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:23.163332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:23.164788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:23.165408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:23.166243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lazy-loading 'fault' on Instance uuid b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:21:23.178624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:23.179494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:23.198253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:23.198826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:23.201209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:23.202442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:23.202942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:23.203476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:23.622876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.660796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d577d1a2-f415-47ec-ab20-9a9e2fd2a66b tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 200 len: 1308 microversion: 2.1 time: 0.602763 Sep 18 01:21:23.662546 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2062/4087] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:23 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 1308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:23.683947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:23.684586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:23.701165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:23.701686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:23.702313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:23.703032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:23.704132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:23.704570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:23.841469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.866053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.869442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.870710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a303f44-a56e-4452-95b8-2ac5349d6579 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1593 microversion: 2.32 time: 0.203643 Sep 18 01:21:23.877743 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2063/4088] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:23 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1593 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:23.988914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:23.999484 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6bcc1ba1-361a-4fc6-828c-7e5a3719d422 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.826178 Sep 18 01:21:24.004977 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2026/4089] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:23 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:24.065893 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:24.066588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:24.085501 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:24.090908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.091668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.093632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.094475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.094955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.095393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.122453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:24.123487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:24.144490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.144997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.146633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.147406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.147888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.157672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.413870 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:24.415745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:24.432730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:24.434553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:24.446968 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b44c1b56-dd14-4d8d-ab0d-b48044f75c67 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.328779 Sep 18 01:21:24.448682 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2027/4090] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:24 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:24.513134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:24.528661 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2277ce38-264b-4f55-87ba-97ced52ad1a5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1669 microversion: 2.1 time: 0.466532 Sep 18 01:21:24.529483 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2064/4091] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:24 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:24.689016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:24.690043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: b2e5cf62-23da-44ee-b6bf-7dcc733c98c8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:24.702797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.707592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.708293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.709282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.711588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.713616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.767048 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] HTTP exception thrown: Instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 could not be found. Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Request method failure captured: Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 HTTP/1.1 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHp1Fe9SwvLmyQQibSkqt-OoPGO9BRGWrUfgAyTlrCLFw_x80wXbk0kdT3WFtDabyDYCeDrUZDfmkq0tKyrN80L9DuSdT9lbNb9lS1JK07a1M1wmgTZ9PeD_XZA2S5db-8yqlOY43s8LXKOPfgwuZOTUZlROLwe8q1xZqA6EB1gdf4 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: de2dce77d67f4a9d8bbd8cb478b128b4 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ListImageFiltersTestJSON-1931329602 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ListImageFiltersTestJSON-1931329602 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: de2dce77d67f4a9d8bbd8cb478b128b4 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1931329602 Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ListImageFiltersTestJSON-1931329602-project Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 8464cc4e11bd4e1d9a80f75e8d88eafd Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ListImageFiltersTestJSON-1931329602-project Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: exception: Instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 could not be found. Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b2e5cf62-23da-44ee-b6bf-7dcc733c98c8'} Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 could not be found. Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 could not be found. Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:21:24.779210 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 could not be found. Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:21:24.784169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Returning 404 to user: Instance b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:21:24.786963 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3209ec2-e459-4371-a645-8e999b9cd38e tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8" status: 404 len: 111 microversion: 2.1 time: 0.101148 Sep 18 01:21:24.793686 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2028/4092] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:24 2022] GET /compute/v2.1/servers/b2e5cf62-23da-44ee-b6bf-7dcc733c98c8 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:21:24.810407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:24.813835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:24.838178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.838715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.839601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.839916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.844312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.844920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.903780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:24.904616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:24.917729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.921105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.923771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.927306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:24.929661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:24.930585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:24.932749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:21:24.975237 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:25.128808 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92db4406-3614-46d8-b93f-165d3f0682be tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 204 len: 0 microversion: 2.1 time: 0.330669 Sep 18 01:21:25.129425 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2065/4093] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:21:24 2022] DELETE /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:25.134906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:25.135698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:25.151914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.152545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.152833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:25.153597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.154040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.154466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:25.225887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:25.238357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:25.248681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:25.250181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d52e6107-a721-414d-b30a-fd34a2c2a735 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1661 microversion: 2.32 time: 0.351002 Sep 18 01:21:25.251659 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2029/4094] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:24 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1661 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:25.279744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:25.281435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:25.292146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.292896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.293503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:25.295014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.295725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.296604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:25.727374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:25.746765 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a21e0fb0-2f70-4bab-886e-ed75db1a0df5 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 200 len: 1472 microversion: 2.1 time: 0.492653 Sep 18 01:21:25.747949 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2030/4095] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:25 2022] GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 1472 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:25.772117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:25.775877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:25.791901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:25.807983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.809460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.810991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:25.812143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.812836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.814758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:25.824940 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-483e24dd-1e1b-479b-82d8-d0f0dc0154bf tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.688651 Sep 18 01:21:25.836404 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2066/4096] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:25 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:25.839409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:25.847086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:25.890865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.892208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.892838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:25.896887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:25.898554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:25.900426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:26.189251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:26.218861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:26.225386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:26.228064 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0fb5f8c0-9eb9-4ec8-8e01-fa9073080028 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.467345 Sep 18 01:21:26.231072 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2031/4097] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:25 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:26.289866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:26.290864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:26.334336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:26.340384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:26.341629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:26.347921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:26.351529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:26.354538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:26.765104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:26.786925 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2bc1907-8556-4fc8-b763-c46589c74ec0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1669 microversion: 2.1 time: 0.957910 Sep 18 01:21:26.788319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2067/4098] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:25 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1669 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:26.807585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:26.815020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:26.836236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:26.837445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:26.838461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:26.840432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:26.841447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:26.842842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:27.260245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:27.284575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:27.287495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:27.295033 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c0715d6-b180-4503-8163-e119e62a0b5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1708 microversion: 2.32 time: 1.011456 Sep 18 01:21:27.297893 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2032/4099] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:26 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1708 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:27.303725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:27.316178 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:27.339020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:27.343053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:27.348244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:27.351436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:27.354796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:27.356680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:27.639206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:27.685802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-75646f83-055b-48f7-bc9b-6aef6641b893 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 200 len: 1472 microversion: 2.1 time: 0.893021 Sep 18 01:21:27.686876 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2068/4100] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:26 2022] GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 1472 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:27.707141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:27.714156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:27.734978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:27.737225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:27.737953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:27.739745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:27.744200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:27.745390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:28.007354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:28.050460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:28.063513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:28.070473 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61707ee5-fa01-416d-9992-7a785a5b7e23 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.371966 Sep 18 01:21:28.071539 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2069/4101] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:27 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:28.088198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:28.100480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:28.106970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:28.110185 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c0266df7-685c-4990-9b89-74987d7c7959 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.810789 Sep 18 01:21:28.114280 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2033/4102] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:27 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:28.128504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:28.130249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:28.131677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:28.133617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:28.135818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:28.138146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:28.330736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:28.332380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:28.347602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:28.353813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:28.354592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:28.358956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:28.364213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:28.366251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:29.327726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:29.357081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-77765885-47cf-4660-89cd-6dd543215a49 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.282008 Sep 18 01:21:29.361048 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2070/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:28 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:29.377397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:29.379921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:29.406308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:29.407470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:29.408936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:29.409998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:29.410677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:29.411375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:29.670575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:29.682858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:29.684337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:29.689362 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-43a2107f-8888-4463-b658-f5d7e7d87125 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1708 microversion: 2.32 time: 1.362861 Sep 18 01:21:29.697006 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2034/4104] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:28 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1708 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:29.713107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8464cc4e11bd4e1d9a80f75e8d88eafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2dce77d67f4a9d8bbd8cb478b128b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:29.732643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5ee2d8ad-19bb-4f9b-bab3-811bca0c39c9 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 200 len: 1430 microversion: 2.1 time: 0.369950 Sep 18 01:21:29.734607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:29.738256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:29.762046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:29.763495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:29.764500 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2071/4105] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:29 2022] GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 1430 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:29.772811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:29.778127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:29.779430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:29.781103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:29.784252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:29.784884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:29.812474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:29.813307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:29.813966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:29.814943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:29.820362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:29.821090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:30.544016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:30.566800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:30.572633 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:30.581761 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-914535f5-de9a-4741-93fc-afed13ebaf1f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.881853 Sep 18 01:21:30.584678 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2035/4106] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:29 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:30.902023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b27ef61f-3fd3-479a-90a9-f39492638e56 req-9b13ae7e-ce54-4439-a729-49c81b2e5a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa157-6b6f-48ef-9827-7e92ff6b9208", "name": "network-vif-deleted", "tag": "2bcc5467-2ebf-408b-ad54-6161ef7e1e1f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:30.942093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b27ef61f-3fd3-479a-90a9-f39492638e56 req-9b13ae7e-ce54-4439-a729-49c81b2e5a4d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:30.946413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b27ef61f-3fd3-479a-90a9-f39492638e56 req-9b13ae7e-ce54-4439-a729-49c81b2e5a4d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:30.951125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b27ef61f-3fd3-479a-90a9-f39492638e56 req-9b13ae7e-ce54-4439-a729-49c81b2e5a4d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:30.993861 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b27ef61f-3fd3-479a-90a9-f39492638e56 req-9b13ae7e-ce54-4439-a729-49c81b2e5a4d service nova] Creating event network-vif-deleted:2bcc5467-2ebf-408b-ad54-6161ef7e1e1f for instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 on n-h1-master-1 Sep 18 01:21:31.014605 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b27ef61f-3fd3-479a-90a9-f39492638e56 req-9b13ae7e-ce54-4439-a729-49c81b2e5a4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426323 Sep 18 01:21:31.015754 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2036/4107] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:31.053994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:31.057414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:31.093049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:31.098808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:31.101519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:31.103019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:31.108383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:31.110885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:31.188304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:31.223114 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c45929bb-b95a-43a8-866e-70dd1d5204af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 1.456744 Sep 18 01:21:31.224115 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2072/4108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:29 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:31.260743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:31.271021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] [instance: 2e5fa157-6b6f-48ef-9827-7e92ff6b9208] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:31.317287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:31.317836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:31.322542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:31.326332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:31.329228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:31.342768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:31.385514 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] HTTP exception thrown: Instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 could not be found. Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Request method failure captured: Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 HTTP/1.1 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHp1Fe9SwvLmyQQibSkqt-OoPGO9BRGWrUfgAyTlrCLFw_x80wXbk0kdT3WFtDabyDYCeDrUZDfmkq0tKyrN80L9DuSdT9lbNb9lS1JK07a1M1wmgTZ9PeD_XZA2S5db-8yqlOY43s8LXKOPfgwuZOTUZlROLwe8q1xZqA6EB1gdf4 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: de2dce77d67f4a9d8bbd8cb478b128b4 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ListImageFiltersTestJSON-1931329602 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de2dce77d67f4a9d8bbd8cb478b128b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ListImageFiltersTestJSON-1931329602 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: de2dce77d67f4a9d8bbd8cb478b128b4 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1931329602 Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ListImageFiltersTestJSON-1931329602-project Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 8464cc4e11bd4e1d9a80f75e8d88eafd Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ListImageFiltersTestJSON-1931329602-project Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 could not be found. Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2e5fa157-6b6f-48ef-9827-7e92ff6b9208'} Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 could not be found. Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 could not be found. Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:21:31.391437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 could not be found. Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Returning 404 to user: Instance 2e5fa157-6b6f-48ef-9827-7e92ff6b9208 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fd2049e-29d0-4837-967a-fcb5ea2b0697 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208" status: 404 len: 111 microversion: 2.1 time: 0.162765 Sep 18 01:21:31.403882 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2073/4109] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:31 2022] GET /compute/v2.1/servers/2e5fa157-6b6f-48ef-9827-7e92ff6b9208 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:21:31.412040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7ef6880-a02a-48ef-90a9-3bdffefbbf2c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f700506e550>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:32.174523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7ef6880-a02a-48ef-90a9-3bdffefbbf2c tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/images/5f827ceb-ffc7-4123-a6db-0f8c17c2fb67" status: 204 len: 0 microversion: 2.1 time: 0.770341 Sep 18 01:21:32.181032 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2074/4110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:31 2022] DELETE /compute/v2.1/images/5f827ceb-ffc7-4123-a6db-0f8c17c2fb67 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:32.190570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:32.210277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:32.233654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:32.248424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:32.249191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:32.254912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:32.255759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:32.256528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:32.483676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:32.525113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:32.528336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:32.550243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0ae1714-8259-4606-a9ce-c8ea65c78891 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1755 microversion: 2.32 time: 1.529404 Sep 18 01:21:32.566526 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2037/4111] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:31 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1755 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:32.604060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea72b53c-e928-42cf-9975-2c1c4bd468d6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f70065920d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:32.690819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:32.707602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:32.715401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:32.717881 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d87b8f95-9c59-4c37-948b-ed75d7a9c778 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.534715 Sep 18 01:21:32.727933 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2075/4112] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:32 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:32.748143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:32.748769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:32.780053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:32.784540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:32.786891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:32.788015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:32.790333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:32.791049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:33.354156 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea72b53c-e928-42cf-9975-2c1c4bd468d6 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/images/a30046a3-fd32-4e2d-8769-7ee87f68a1d9" status: 204 len: 0 microversion: 2.1 time: 0.785294 Sep 18 01:21:33.362591 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2038/4113] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:32 2022] DELETE /compute/v2.1/images/a30046a3-fd32-4e2d-8769-7ee87f68a1d9 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:33.371676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-404e91dc-8040-4e3d-8ebf-166c34904c01 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] Calling method '.version_select at 0x7f7005f67e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:33.461532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:33.480650 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee3475f9-e6f6-48dc-8272-acd63e47ac8e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.750612 Sep 18 01:21:33.486589 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2076/4114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:32 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:33.595835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:33.596799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:33.609317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:33.614123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:33.614598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:33.615510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:33.616117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:33.619257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:34.028125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:34.074799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:34.081320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:34.085000 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e10b4b10-89cf-4e0e-8747-73dcad297e65 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1802 microversion: 2.32 time: 0.493529 Sep 18 01:21:34.088599 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2077/4115] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:33 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1802 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:34.113034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:34.121754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:34.136866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:34.144887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:34.146195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:34.147765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:34.148832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:34.155351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:34.280846 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-404e91dc-8040-4e3d-8ebf-166c34904c01 tempest-ListImageFiltersTestJSON-1931329602 tempest-ListImageFiltersTestJSON-1931329602-project] 10.222.0.25 "DELETE /compute/v2.1/images/17623fe6-8e05-41e2-9655-87a544676291" status: 204 len: 0 microversion: 2.1 time: 0.915859 Sep 18 01:21:34.281971 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2039/4116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:33 2022] DELETE /compute/v2.1/images/17623fe6-8e05-41e2-9655-87a544676291 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:21:34.452299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:34.466975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:34.474829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:34.482217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d6f4f6a-7607-4f3a-b41c-cbb189768630 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.391623 Sep 18 01:21:34.497596 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2078/4117] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:34 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:34.527399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:34.528284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:34.552736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:34.554218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:34.556777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:34.561031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:34.563018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:34.563655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:34.632655 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:35.137944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:35.139027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:35.156127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:35.162652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:35.163770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:35.167435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:35.168648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:35.170211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:35.822651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:35.843431 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6bab807-45b9-4752-94bc-02bffdaa15e5 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 1.316350 Sep 18 01:21:35.847111 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2040/4118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:34 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:35.859093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:35.865497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:35.903838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:35.919935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:35.920650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:35.922789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:35.924092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:35.924950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:36.132816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:36.142524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:36.144031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:36.163893 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2db46ec4-6956-4f65-bbf8-2746ded9451a tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.296872 Sep 18 01:21:36.164838 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2041/4119] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:35 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:36.396303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:36.422422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:36.429325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:36.440956 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab2cdb9d-012c-411d-9a57-4cbbfb27e55d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1849 microversion: 2.32 time: 1.307091 Sep 18 01:21:36.469705 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2079/4120] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:35 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1849 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:36.872259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:36.872881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:36.889891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:36.897286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:36.897286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:36.913774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:36.914727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:36.915631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:37.152372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:37.155492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:37.198663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:37.199709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:37.203604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:37.205232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:37.206348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:37.207220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:37.392916 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6467d97a-2034-490a-8571-a76064c7c269 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/ips" status: 200 len: 145 microversion: 2.1 time: 0.833743 Sep 18 01:21:37.409606 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2042/4121] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:21:36 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/ips => generated 145 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:37.447738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:37.450456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:37.477095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:37.486640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:37.495050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:37.503100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:37.506831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:37.507450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:38.162583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:38.166545 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:38.172651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:38.187654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:38.190751 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9de1a4eb-3e5c-4979-9a22-b2b01251e257 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.777380 Sep 18 01:21:38.194500 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2043/4122] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:37 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:38.212542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:38.216020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:38.251389 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6de8a778-7646-4969-85b1-3e96f52bfe00 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 1.382848 Sep 18 01:21:38.254988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:38.259211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:38.260547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:38.263733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:38.265513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:38.269387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:38.273837 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2080/4123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:36 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:39.256396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:39.258912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:39.297943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:39.299293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:39.304539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:39.307020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:39.311113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:39.315713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:39.373601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:39.422651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:39.426243 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:39.428563 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d3ac584b-d605-47bf-9b8a-f9d643b8e478 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1849 microversion: 2.32 time: 1.232324 Sep 18 01:21:39.481923 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2044/4124] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:38 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1849 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:39.510583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:39.511547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:39.534967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:39.537470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:39.538351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:39.540285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:39.546323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:39.547030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:39.666872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:39.677942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:39.688126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:39.689948 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b1b6e91-7279-4358-8de9-4f7553282a6c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.444791 Sep 18 01:21:39.691713 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2081/4125] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:39 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:39.886361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1b19d122-a8eb-4793-9b8d-a6552a721755 req-e5326563-c1f6-4c24-acc4-eec332d88609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "08b14aba-a44c-4681-97f9-cbd1abf709fa"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:39.922367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1b19d122-a8eb-4793-9b8d-a6552a721755 req-e5326563-c1f6-4c24-acc4-eec332d88609 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:39.930325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1b19d122-a8eb-4793-9b8d-a6552a721755 req-e5326563-c1f6-4c24-acc4-eec332d88609 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:39.931707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1b19d122-a8eb-4793-9b8d-a6552a721755 req-e5326563-c1f6-4c24-acc4-eec332d88609 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:39.993247 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1b19d122-a8eb-4793-9b8d-a6552a721755 req-e5326563-c1f6-4c24-acc4-eec332d88609 service nova] Creating event network-changed:08b14aba-a44c-4681-97f9-cbd1abf709fa for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:21:40.022605 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1b19d122-a8eb-4793-9b8d-a6552a721755 req-e5326563-c1f6-4c24-acc4-eec332d88609 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148144 Sep 18 01:21:40.025144 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2082/4126] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:40.161261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:40.193627 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b69405e-abda-46d1-9a20-e1bde68834c8 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.708034 Sep 18 01:21:40.197151 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2045/4127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:39 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:40.491743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:40.493166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:40.544870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:40.549642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:40.554000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:40.561386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:40.565340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:40.570485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:40.652270 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:40.724186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:40.724808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:40.752605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:40.754290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:40.755504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:40.757247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:40.758331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:40.770397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:40.992019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:41.018090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:41.032400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:41.035790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4fa2e3b2-cf96-4206-95f1-21d18331bfbb tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.317016 Sep 18 01:21:41.040280 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2046/4128] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:40 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:41.240147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:41.247519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:41.278210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:41.281825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:41.287302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:41.289680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:41.292990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:41.296744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:41.578479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:41.616340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:41.627475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:41.634294 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-47776b16-fc99-4cd9-8929-c223ed7098f0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1849 microversion: 2.32 time: 1.153872 Sep 18 01:21:41.636384 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2083/4129] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:40 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1849 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:41.863191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca0aecf4-b683-433b-bbd2-6715f6cdd7e5"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:41.868506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:41.883842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:41.886455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:41.887692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:41.890302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:41.891304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:41.893132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:42.531198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:42.554858 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0531d31f-eff9-4c43-97f1-ba5b24e79b97 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 1.322120 Sep 18 01:21:42.559829 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2047/4130] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:41 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:42.566991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:42.568813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:42.579200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:42.580068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:42.580633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:42.581484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:42.582091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:42.583920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:42.809954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:42.837132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:42.840786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:42.843487 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26588242-3556-403b-b27e-d1141b07ab0c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.282320 Sep 18 01:21:42.856067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2048/4131] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:42 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:42.882476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:42.890772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:42.898866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:42.899629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:42.900126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:42.900777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:42.901249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:42.901682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:42.932721 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8e4c17d-1e98-4b40-a5b1-2c2c2fa9b29f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.073885 Sep 18 01:21:42.951243 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2084/4132] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:21:41 2022] POST /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments => generated 194 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:43.393827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-44f1cc52-7178-4892-aca8-7ea86957453b req-593f7f63-0429-4d3c-a54a-9327f3a2baec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "220001de-0a05-4cc5-b9ea-25a518baeb59"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:43.415790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-44f1cc52-7178-4892-aca8-7ea86957453b req-593f7f63-0429-4d3c-a54a-9327f3a2baec service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:43.416690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-44f1cc52-7178-4892-aca8-7ea86957453b req-593f7f63-0429-4d3c-a54a-9327f3a2baec service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:43.417966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-44f1cc52-7178-4892-aca8-7ea86957453b req-593f7f63-0429-4d3c-a54a-9327f3a2baec service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:43.454344 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-44f1cc52-7178-4892-aca8-7ea86957453b req-593f7f63-0429-4d3c-a54a-9327f3a2baec service nova] Creating event network-changed:220001de-0a05-4cc5-b9ea-25a518baeb59 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:21:43.467036 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-44f1cc52-7178-4892-aca8-7ea86957453b req-593f7f63-0429-4d3c-a54a-9327f3a2baec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080524 Sep 18 01:21:43.473455 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2085/4133] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:43.584024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:43.584943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:43.594812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:43.595731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:43.596425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:43.598394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:43.599103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:43.599918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:43.641244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:43.657406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:43.659036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:43.660213 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0be23947-62fc-4f45-93e8-dfba3e66f29d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1870 microversion: 2.32 time: 0.801786 Sep 18 01:21:43.662387 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2049/4134] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:42 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1870 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:43.881013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:43.881917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:43.903042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:43.904886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:43.905896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:43.906887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:43.907605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:43.908632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:43.921924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:43.948090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9fc84de5-9e5f-4ae8-a0a6-86188dde579d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.370761 Sep 18 01:21:43.969583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2086/4135] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:43 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:44.092731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:44.108059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:44.109737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:44.114344 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f61a0526-a8a2-4af7-beb1-b186d0fd5619 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.238634 Sep 18 01:21:44.134032 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2050/4136] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:43 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:44.689117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:44.689927 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:44.710351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:44.711294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:44.711988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:44.712875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:44.715918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:44.716646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:44.984284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:44.985011 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:44.993416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:44.994052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:44.994583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:44.995549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:44.996208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:44.996836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:45.886559 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:45.900006 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dfc738a9-8304-49c4-8714-bd4e6577d273 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.922223 Sep 18 01:21:45.900883 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2051/4137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:44 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:45.911958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:45.925170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:45.928577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:45.936360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:45.943805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:45.944105 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=81 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:45.949135 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af719ee6-9478-4073-83ff-7f5aaa78599e tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1870 microversion: 2.32 time: 1.264266 Sep 18 01:21:45.974044 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2087/4138] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:44 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1870 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:45.975183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:45.975879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:45.976490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:45.977408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:45.978037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:45.979700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:46.099550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:46.114439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:46.120006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:46.122828 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2a412b48-5214-433d-bd6c-2456fe8c7bde tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.220194 Sep 18 01:21:46.126584 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2052/4139] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:45 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:46.922523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c8bec9d5-c5eb-4a35-8c15-cdebd5f03006 req-b136e2a6-4128-43e5-9308-88f27f3dcc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "745d6228-c772-4a5f-b7a4-1a5cea379f6c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:46.929532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:46.930440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:46.950947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:46.952739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:46.954905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:46.955836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:46.968441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:46.970646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c8bec9d5-c5eb-4a35-8c15-cdebd5f03006 req-b136e2a6-4128-43e5-9308-88f27f3dcc89 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:46.971275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:46.976422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c8bec9d5-c5eb-4a35-8c15-cdebd5f03006 req-b136e2a6-4128-43e5-9308-88f27f3dcc89 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:46.978604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c8bec9d5-c5eb-4a35-8c15-cdebd5f03006 req-b136e2a6-4128-43e5-9308-88f27f3dcc89 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:47.013986 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c8bec9d5-c5eb-4a35-8c15-cdebd5f03006 req-b136e2a6-4128-43e5-9308-88f27f3dcc89 service nova] Creating event network-changed:745d6228-c772-4a5f-b7a4-1a5cea379f6c for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:21:47.031140 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c8bec9d5-c5eb-4a35-8c15-cdebd5f03006 req-b136e2a6-4128-43e5-9308-88f27f3dcc89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114838 Sep 18 01:21:47.031566 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2088/4140] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:47.056984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:47.066781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:47.088734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:47.091346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:47.092351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:47.102120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:47.102855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:47.103489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:47.567547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:47.586171 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3891ad22-4f4f-44e3-8894-69661383f908 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.658412 Sep 18 01:21:47.589762 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2053/4141] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:46 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:47.612760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:47.614567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:47.635987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:47.652646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:47.653630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:47.655691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:47.660006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:47.661201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:47.724570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:47.740464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:47.741817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:47.743047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c65fa764-f2f6-4724-9753-9e112d3b2d7b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 0.702416 Sep 18 01:21:47.771419 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2089/4142] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:47 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:47.998527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:48.015128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:48.016910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:48.018208 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0146bcbf-2e4e-4c80-899e-ca5f3d4152bf tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.425337 Sep 18 01:21:48.046231 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2054/4143] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:47 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:48.616810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:48.622356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:48.656714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:48.670382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:48.671240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:48.672181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:48.672801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:48.673793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:48.798808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:48.799434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:48.814238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:48.814742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:48.815182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:48.815897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:48.817937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:48.820504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:49.557897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:49.584640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:49.587910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:49.589936 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6e9e806c-d846-4a2f-bef8-9561c27b9756 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 0.795610 Sep 18 01:21:49.595558 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2055/4144] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:48 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:49.611249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-287bfe21-16e6-4a8a-ad5a-74b910e1d259 req-3a2881a9-26a1-444f-af86-a3e3cbf3bcc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057d513c-5711-41e5-9f2d-449b777ff7bb", "name": "network-vif-plugged", "status": "completed", "tag": "61754220-27e3-4058-a935-ba4ce524fd38"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:49.621317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:49.635120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-287bfe21-16e6-4a8a-ad5a-74b910e1d259 req-3a2881a9-26a1-444f-af86-a3e3cbf3bcc3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:49.635827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-287bfe21-16e6-4a8a-ad5a-74b910e1d259 req-3a2881a9-26a1-444f-af86-a3e3cbf3bcc3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:49.636402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-287bfe21-16e6-4a8a-ad5a-74b910e1d259 req-3a2881a9-26a1-444f-af86-a3e3cbf3bcc3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:49.638537 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-991e74b9-0588-4127-811c-a9aca1ae2c25 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 1.029660 Sep 18 01:21:49.642901 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2090/4145] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:48 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:49.654243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:49.655139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:49.672651 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-287bfe21-16e6-4a8a-ad5a-74b910e1d259 req-3a2881a9-26a1-444f-af86-a3e3cbf3bcc3 service nova] Creating event network-vif-plugged:61754220-27e3-4058-a935-ba4ce524fd38 for instance 057d513c-5711-41e5-9f2d-449b777ff7bb on n-h2-master-1 Sep 18 01:21:49.678183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:49.680189 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-287bfe21-16e6-4a8a-ad5a-74b910e1d259 req-3a2881a9-26a1-444f-af86-a3e3cbf3bcc3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082914 Sep 18 01:21:49.680541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:49.684285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:49.685279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:49.685524 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2056/4146] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:49.686274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:49.687738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:49.702332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-24e4b154-8f69-4baa-b44a-e7cf40bf7c53 req-9415115a-6277-4c76-824c-8a84a01ed3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "1e42e3f5-ed85-419a-a645-24442370ad64"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:49.723893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-24e4b154-8f69-4baa-b44a-e7cf40bf7c53 req-9415115a-6277-4c76-824c-8a84a01ed3e4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:49.724369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-24e4b154-8f69-4baa-b44a-e7cf40bf7c53 req-9415115a-6277-4c76-824c-8a84a01ed3e4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:49.725597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-24e4b154-8f69-4baa-b44a-e7cf40bf7c53 req-9415115a-6277-4c76-824c-8a84a01ed3e4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:49.743991 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-24e4b154-8f69-4baa-b44a-e7cf40bf7c53 req-9415115a-6277-4c76-824c-8a84a01ed3e4 service nova] Creating event network-changed:1e42e3f5-ed85-419a-a645-24442370ad64 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:21:49.763803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-24e4b154-8f69-4baa-b44a-e7cf40bf7c53 req-9415115a-6277-4c76-824c-8a84a01ed3e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076694 Sep 18 01:21:49.764780 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2057/4147] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:49.787413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:49.808541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:49.811600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:49.814120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b677d81e-12da-4077-b600-9e51bdd5722e tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1365 microversion: 2.47 time: 0.169401 Sep 18 01:21:49.815353 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2091/4148] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:49 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:50.624681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:50.626175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:50.637343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:50.638383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:50.639086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:50.640036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:50.640721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:50.641366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:50.684820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:50.686214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:50.704057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:50.712993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:50.713858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:50.714685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:50.715233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:50.715749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:51.417329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:51.424411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:51.428025 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:51.432381 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-265e7944-46bd-4e5e-ba7e-04058575ac73 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.764119 Sep 18 01:21:51.440885 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2092/4149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:50 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:51.447825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:51.448876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:51.452414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:51.454843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:51.456297 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8705a819-65aa-4a95-9161-d7a4dc38766d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 0.837433 Sep 18 01:21:51.456876 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2058/4150] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:50 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:51.471930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:51.472473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:51.472929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:51.473695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:51.474162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:51.474592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:51.747258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:51.769180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:51.770691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:51.771909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-720bf0f3-42f0-44bc-be72-21eb9691341c tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1371 microversion: 2.47 time: 0.329570 Sep 18 01:21:51.772486 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2093/4151] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:51 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:52.340202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-293fccf3-5a48-43b3-8c9c-b43f6f9fdd1d req-a9e302a1-7e07-424a-9bfb-96ee1134f16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "e1294bdc-7b69-46bd-a170-84a4cbbd005e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:52.362326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-293fccf3-5a48-43b3-8c9c-b43f6f9fdd1d req-a9e302a1-7e07-424a-9bfb-96ee1134f16f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:52.363047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-293fccf3-5a48-43b3-8c9c-b43f6f9fdd1d req-a9e302a1-7e07-424a-9bfb-96ee1134f16f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:52.363492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-293fccf3-5a48-43b3-8c9c-b43f6f9fdd1d req-a9e302a1-7e07-424a-9bfb-96ee1134f16f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:52.396094 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-293fccf3-5a48-43b3-8c9c-b43f6f9fdd1d req-a9e302a1-7e07-424a-9bfb-96ee1134f16f service nova] Creating event network-changed:e1294bdc-7b69-46bd-a170-84a4cbbd005e for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:21:52.401415 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-293fccf3-5a48-43b3-8c9c-b43f6f9fdd1d req-a9e302a1-7e07-424a-9bfb-96ee1134f16f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064874 Sep 18 01:21:52.402517 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2059/4152] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:52.464615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:52.470607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:52.481995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:52.482720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:52.483326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:52.484189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:52.484793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:52.485389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:52.485508 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:52.492636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:52.508258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:52.508740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:52.509210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:52.517670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:52.518775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:52.521401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:53.075460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:53.092927 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e2727d5-45d0-443d-a21e-fab5483a3454 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.640234 Sep 18 01:21:53.096310 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2094/4153] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:52 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:53.111280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:53.114296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:53.128011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:53.128690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:53.129478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:53.130710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:53.132510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:53.133237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:53.198538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:53.212501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:53.217037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:53.219107 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ffaa5f17-33b1-4ffd-a77c-38a69e675f94 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 0.738046 Sep 18 01:21:53.220927 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2060/4154] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:52 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:53.343682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:53.368633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:53.372879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:53.374589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-992741a2-f5ed-408d-b52a-38f8c469a9ca tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1371 microversion: 2.47 time: 0.276940 Sep 18 01:21:53.379025 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2095/4155] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:53 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:54.123597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:54.124623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:54.149546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:54.150089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:54.150532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:54.151275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:54.151737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:54.160597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:54.244484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:54.245315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:54.248418 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:54.270864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:54.271688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:54.278934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:54.280374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:54.284682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:54.288319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:54.868840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:54.918790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f9bfb787-954b-4e3d-a73a-191490557626 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1518 microversion: 2.1 time: 0.796250 Sep 18 01:21:54.923142 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2061/4156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:54 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1518 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:21:54.940439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:54.941738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:54.974168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:54.974737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:54.975201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:54.975957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:54.976419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:54.987440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:55.363966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.389924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.395341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.399095 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7adb7bf9-47f5-469d-b866-3cdfbbfe4b6f tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1356 microversion: 2.47 time: 0.472517 Sep 18 01:21:55.405760 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2062/4157] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:54 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1356 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:55.443354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:55.452314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.453235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Searching by: {'deleted': False, 'project_id': '93c87731678e4f6cbc9776f629a3ae70'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:21:55.475365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:55.495242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:55.498366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:55.503014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:55.505125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:55.506708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:55.725659 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.747495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:21:55.747722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.757139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.765816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b109a73e-a864-46e1-8075-836922599ea1 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 1.525203 Sep 18 01:21:55.787459 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2096/4158] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:54 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:55.802114 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:55.804483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:55.822636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:55.823599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:55.824574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:55.827953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:55.830279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:55.831101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:55.904399 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8b3cc7f-60d2-45a6-8331-44807548bda8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/ips" status: 200 len: 152 microversion: 2.20 time: 0.115050 Sep 18 01:21:55.906765 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2097/4159] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Sep 18 01:21:55 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/ips => generated 152 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:21:55.944835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:55.945661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:55.962866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:55.963733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:55.964794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:55.967464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:55.971791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:55.975030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:55.977448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:55.978241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:55.979247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:55.985046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:56.013794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:56.018001 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:56.121071 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f9b95289-6040-457e-9223-984a466b0eef tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.683105 Sep 18 01:21:56.121807 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2063/4160] 10.222.0.25 () {60 vars in 1187 bytes} [Sun Sep 18 01:21:55 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:21:56.144881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-702177755", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "305de6c5-580a-46f9-8617-4ce01786283b"}, {"uuid": "a41462e9-b7ba-4122-96ce-245db6cf29ee"}, {"uuid": "305de6c5-580a-46f9-8617-4ce01786283b"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:56.272981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] validate_networks() for [('305de6c5-580a-46f9-8617-4ce01786283b', None, None, None, None, None), ('a41462e9-b7ba-4122-96ce-245db6cf29ee', None, None, None, None, None), ('305de6c5-580a-46f9-8617-4ce01786283b', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:21:57.051844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:57.068365 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68cbce97-c2ea-4846-8c7f-23aa72b5924c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.125250 Sep 18 01:21:57.068947 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2098/4161] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:55 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:21:57.089776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:57.092471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:57.114733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:57.121940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:57.122628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:57.123568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:57.124342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:57.124934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:57.187259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:21:57.246238 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:21:57.376688 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e61de84f-31a2-4b89-9117-28f29969b3c1 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "DELETE /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 204 len: 0 microversion: 2.47 time: 0.304593 Sep 18 01:21:57.382201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2099/4162] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:21:57 2022] DELETE /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:21:57.394149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0ff0ecdb-4e11-4d5e-b235-1c9846d64402 req-127d210d-adff-4b7a-a490-9802c798d7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "aa06682e-2b23-41ed-a2d7-e5c411718453"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:21:57.424742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0ff0ecdb-4e11-4d5e-b235-1c9846d64402 req-127d210d-adff-4b7a-a490-9802c798d7b9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:57.425568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0ff0ecdb-4e11-4d5e-b235-1c9846d64402 req-127d210d-adff-4b7a-a490-9802c798d7b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:57.426173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0ff0ecdb-4e11-4d5e-b235-1c9846d64402 req-127d210d-adff-4b7a-a490-9802c798d7b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:57.458759 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0ff0ecdb-4e11-4d5e-b235-1c9846d64402 req-127d210d-adff-4b7a-a490-9802c798d7b9 service nova] Creating event network-changed:aa06682e-2b23-41ed-a2d7-e5c411718453 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:21:57.474285 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0ff0ecdb-4e11-4d5e-b235-1c9846d64402 req-127d210d-adff-4b7a-a490-9802c798d7b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090343 Sep 18 01:21:57.477854 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2100/4163] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:21:57.490459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:57.491178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:57.517872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:57.520425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:57.524634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:57.525688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:57.528404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:57.529044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:58.951679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:58.976891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:58.993361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:58.998271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-030cd6c6-f043-4e03-9e77-daf1993211a9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 1.518457 Sep 18 01:21:58.999357 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2101/4164] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:57 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:21:59.005935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:21:59.018577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:21:59.039756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:59.039756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:59.040361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:59.043032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:21:59.043864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:21:59.046174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:21:59.973246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:21:59.986982 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f58fa28-e3e9-49aa-a3d4-05fa07126333 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.986342 Sep 18 01:21:59.994380 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2102/4165] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:21:58 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:00.000209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:00.005937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:00.020045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:00.027060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:00.028478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:00.029832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:00.031195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:00.032645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:00.166258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:00.183695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:00.187648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:00.190881 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-30fa58f1-1012-4c15-873a-5a6dff553acd tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1362 microversion: 2.47 time: 0.195055 Sep 18 01:22:00.193665 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2103/4166] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:21:59 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:00.209671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:00.210735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:00.222086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:00.222974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:00.223663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:00.254198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:00.255983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:00.264453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.049878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:22:01.050373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:22:01.051346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:22:01.051764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:22:01.052181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:22:01.077722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.078130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.083222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:01.094137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.095632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.096136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.096586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.108171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:01.110034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:01.111851 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-18849628-312b-4f80-ba69-a12ca59dd2b8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 0.914878 Sep 18 01:22:01.122656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Getting quotas for project d8ed34e8b9574a3c82538941c839cbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:22:01.129217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Getting quotas for user fe3e323f16e84023b3654df87c4cc55c and project d8ed34e8b9574a3c82538941c839cbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:22:01.140882 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2104/4167] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:00 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:01.144851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:22:01.145878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:01.146519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:01.147245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:22:01.173661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.174077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.174517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.179388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.186571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.187153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.230064 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a7aa2dd-dfda-4722-9569-cd2b43cfacbf tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.090065 Sep 18 01:22:01.239776 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2064/4168] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:21:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 5103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:22:01.272034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8b284736-6399-4448-a413-4c501343bf7b req-49174e26-b7f0-45c8-91d5-d54aec30ea99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "21aaa75b-4e49-4512-a81f-a1352471c4d4"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:01.307359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8b284736-6399-4448-a413-4c501343bf7b req-49174e26-b7f0-45c8-91d5-d54aec30ea99 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.308204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8b284736-6399-4448-a413-4c501343bf7b req-49174e26-b7f0-45c8-91d5-d54aec30ea99 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.308862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8b284736-6399-4448-a413-4c501343bf7b req-49174e26-b7f0-45c8-91d5-d54aec30ea99 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.342288 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8b284736-6399-4448-a413-4c501343bf7b req-49174e26-b7f0-45c8-91d5-d54aec30ea99 service nova] Creating event network-changed:21aaa75b-4e49-4512-a81f-a1352471c4d4 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:22:01.351017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8b284736-6399-4448-a413-4c501343bf7b req-49174e26-b7f0-45c8-91d5-d54aec30ea99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109665 Sep 18 01:22:01.354122 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2065/4169] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:01.366959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:01.370227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:01.389887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.390747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.394030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.395315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.396005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.396680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.510641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.514003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.514729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.516867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lazy-loading 'fault' on Instance uuid 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:22:01.609494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:01.618542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:01.620077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:01.631584 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3aa3ac17-6f77-4578-ab6f-1ce5ddce02ad tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 200 len: 1367 microversion: 2.47 time: 0.272584 Sep 18 01:22:01.632528 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2066/4170] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:01 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:01.640009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb98a345-77ec-487b-8ea4-689f898d21e6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:01.644923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb98a345-77ec-487b-8ea4-689f898d21e6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:01.881435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb98a345-77ec-487b-8ea4-689f898d21e6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:01.898720 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb98a345-77ec-487b-8ea4-689f898d21e6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1212 microversion: 2.1 time: 0.260780 Sep 18 01:22:01.914471 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2067/4171] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:01 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1212 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:01.952705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:01.960968 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:01.991774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.992555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:01.994309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:01.996512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:01.997842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:02.000546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:02.231207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:02.259679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c29f3873-910a-4a13-803a-91c404129085 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.117529 Sep 18 01:22:02.260540 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2105/4172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:01 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:02.307360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:02.310764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:02.339560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:02.340374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:02.341003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:02.342259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:02.342879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:02.354826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:02.717192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:02.728499 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b4238a4-546f-43ef-b39e-f29897e83d6a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.812781 Sep 18 01:22:02.736095 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2068/4173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:01 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:02.741804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-902b54af-2c81-4203-bb4e-772bf897fb8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:02.770372 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-902b54af-2c81-4203-bb4e-772bf897fb8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 64abe041-2882-4dd2-bd4f-8ff5170ffa42 has no mapping to a cell. Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-902b54af-2c81-4203-bb4e-772bf897fb8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/64abe041-2882-4dd2-bd4f-8ff5170ffa42/action HTTP/1.1 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 15 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: {"os-stop": {}} Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 64abe041-2882-4dd2-bd4f-8ff5170ffa42 has no mapping to a cell. Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '64abe041-2882-4dd2-bd4f-8ff5170ffa42', 'body': {'os-stop': {}}} Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 64abe041-2882-4dd2-bd4f-8ff5170ffa42 has no mapping to a cell. Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:22:02.780885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64abe041-2882-4dd2-bd4f-8ff5170ffa42 has no mapping to a cell. Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64abe041-2882-4dd2-bd4f-8ff5170ffa42 has no mapping to a cell. Sep 18 01:22:02.785995 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.786883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-902b54af-2c81-4203-bb4e-772bf897fb8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 64abe041-2882-4dd2-bd4f-8ff5170ffa42 has no mapping to a cell. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:02.788692 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-902b54af-2c81-4203-bb4e-772bf897fb8c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/64abe041-2882-4dd2-bd4f-8ff5170ffa42/action" status: 404 len: 117 microversion: 2.1 time: 0.050633 Sep 18 01:22:02.789868 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2069/4174] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:02 2022] POST /compute/v2.1/servers/64abe041-2882-4dd2-bd4f-8ff5170ffa42/action => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:22:02.795572 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:02.797841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:02.821197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:02.831527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:02.832263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:02.833150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:02.845347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:02.846678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:02.909521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] HTTP exception thrown: Instance 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 could not be found. Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Request method failure captured: Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 HTTP/1.1 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnKFItoO4MLY9aLyG8iJJufa2r4iuoVnWgdqcmPeqXX3Lisz3z8UXg4RLpaVc49x28bqJn9Ge-tzA1CCriyNSv4Hhyn4CkElEUlcBqKM0SWBw_76WDDJoFa72BYOdnMtW24aHun2s8wwp4LUXHgByGWVZ_0LJ69ksswDQYV8WtQ5Yj4 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.47 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 93c87731678e4f6cbc9776f629a3ae70 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerShowV247Test-689658718 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerShowV247Test-689658718 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 93c87731678e4f6cbc9776f629a3ae70 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerShowV247Test-689658718 Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerShowV247Test-689658718-project Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 580e705da2594276a67b34f4eefd8d7c Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerShowV247Test-689658718-project Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 could not be found. Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086'} Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 could not be found. Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 could not be found. Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:02.911373 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.918718 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:02.918718 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:02.918718 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:02.918718 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:02.918718 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:02.918718 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 could not be found. Sep 18 01:22:02.918718 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:02.921258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Returning 404 to user: Instance 644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:02.922336 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47886e4f-80a3-4a8c-beba-1d123f8bee29 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086" status: 404 len: 111 microversion: 2.47 time: 0.131128 Sep 18 01:22:02.929709 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2070/4175] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:02 2022] GET /compute/v2.1/servers/644a2bd6-9d3f-4c2c-ba01-e5ec7cab3086 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:22:02.935084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:02.935709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:02.965524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:02.966063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:02.966514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:02.970813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:02.971328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:02.971783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.026619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:03.049241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:03.054161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:03.060081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f006d944-782d-49ea-a103-1aeed1755e18 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1891 microversion: 2.32 time: 0.784275 Sep 18 01:22:03.064046 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2106/4176] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:02 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1891 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:03.082041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:03.082916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:03.090393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.091140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.091771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.092660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.093386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.094010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.404941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:03.415033 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91260f77-53b8-49d7-a37c-5be66978a4b5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.483755 Sep 18 01:22:03.416879 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2071/4177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:02 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:03.422025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:03.425395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:03.446719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.447272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.447716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.448805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.449278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.449744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.455985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:03.466910 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-257583e3-a5bc-4bc7-a4fb-cbf824a00f04 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.389390 Sep 18 01:22:03.468592 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2107/4178] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:03 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:03.476044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:03.477199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: ab05bfae-26a0-4177-af2e-8191c64f9790] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:03.505816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.506403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.506765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.507816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.508988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.509450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.539539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: ab05bfae-26a0-4177-af2e-8191c64f9790] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:22:03.612626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:03.640591 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3aa48619-00b7-4714-a456-8217833cbbe1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1264 microversion: 2.1 time: 0.217876 Sep 18 01:22:03.647703 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2072/4179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:03 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:03.661016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:03.663733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:03.687972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.694858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.695362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.696212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.700640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.704603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.746463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e913395-0c61-4f8e-bf36-7421d1cd8f54 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790" status: 204 len: 0 microversion: 2.47 time: 0.272188 Sep 18 01:22:03.755147 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2108/4180] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:22:03 2022] DELETE /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:22:03.776560 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:03.777343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:03.789592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lazy-loading 'flavor' on Instance uuid b5551fce-fc60-40fe-aa37-d96f5af28e0c {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:22:03.795296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.795884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.800324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:03.801371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:03.803781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:03.808336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.288310 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-695ccbb3-de91-4601-b161-1dfff6624e1e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/action" status: 202 len: 0 microversion: 2.20 time: 0.632582 Sep 18 01:22:04.289448 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2073/4181] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:22:03 2022] POST /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:22:04.299930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:04.301124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:04.312469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.313274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.314168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.315121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.315766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.316601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.622166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:04.639039 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7dfaa705-7007-436a-8ae9-37008a229be5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.881597 Sep 18 01:22:04.640030 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2109/4182] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:03 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:04.648045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:04.648892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: ab05bfae-26a0-4177-af2e-8191c64f9790] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:04.663726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.664464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.665415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.666330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.666953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.667393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.854065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:04.869058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:04.878313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:04.882656 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-17cdb704-31a1-4b36-8b66-2fd138b4ed62 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790" status: 200 len: 1363 microversion: 2.47 time: 0.239105 Sep 18 01:22:04.884336 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2110/4183] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:04 2022] GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:04.890082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:04.891077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:04.913532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.914098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.914541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.915273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.915731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.916155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.932938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:04.944348 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7354cebd-4615-407b-97c2-337d7511f52e tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.649199 Sep 18 01:22:04.946209 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2074/4184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:04 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:04.951533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:04.952655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:04.966799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.967582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.968184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:04.969069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:04.969800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:04.970457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:05.850648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:05.860491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:05.862212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:05.863644 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f8b8693-4038-4d68-9cf3-94c65d17a780 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1724 microversion: 2.20 time: 0.916473 Sep 18 01:22:05.864441 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2075/4185] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:04 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1724 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:05.887681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:05.888552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:05.900253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:05.901538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:05.902020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:05.902835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:05.903298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:05.903728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:05.962980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:05.975318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:05.976961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:05.978245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-58b5b849-f966-4750-90a9-8a0143bee6d6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.092430 Sep 18 01:22:05.991941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2111/4186] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:04 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:06.000177 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:06.003086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:06.014605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.015392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.016067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.017781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.018398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.019956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.179360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:06.189197 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b6b67187-506c-4db0-9f9b-473efd0ce9f3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1270 microversion: 2.1 time: 0.195148 Sep 18 01:22:06.190386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2112/4187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:05 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:06.198483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2cf938b1-0fe8-4056-bb99-4337e88d4f82 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:06.199257 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2cf938b1-0fe8-4056-bb99-4337e88d4f82 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 2fc332c4-7a17-4815-ae61-7e82fdcb69ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:06.206508 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-2cf938b1-0fe8-4056-bb99-4337e88d4f82 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 2fc332c4-7a17-4815-ae61-7e82fdcb69ad could not be found. Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2cf938b1-0fe8-4056-bb99-4337e88d4f82 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/2fc332c4-7a17-4815-ae61-7e82fdcb69ad/action HTTP/1.1 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 15 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: {"suspend": {}} Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 2fc332c4-7a17-4815-ae61-7e82fdcb69ad could not be found. Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2fc332c4-7a17-4815-ae61-7e82fdcb69ad', 'body': {'suspend': {}}} Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc332c4-7a17-4815-ae61-7e82fdcb69ad could not be found. Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc332c4-7a17-4815-ae61-7e82fdcb69ad could not be found. Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:06.208727 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:06.212291 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:06.212291 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:06.212291 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc332c4-7a17-4815-ae61-7e82fdcb69ad could not be found. Sep 18 01:22:06.212291 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:06.212291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2cf938b1-0fe8-4056-bb99-4337e88d4f82 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 2fc332c4-7a17-4815-ae61-7e82fdcb69ad could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:06.212291 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2cf938b1-0fe8-4056-bb99-4337e88d4f82 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/2fc332c4-7a17-4815-ae61-7e82fdcb69ad/action" status: 404 len: 111 microversion: 2.1 time: 0.019605 Sep 18 01:22:06.212291 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2113/4188] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:06 2022] POST /compute/v2.1/servers/2fc332c4-7a17-4815-ae61-7e82fdcb69ad/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:22:06.219774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:06.220614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: ab05bfae-26a0-4177-af2e-8191c64f9790] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:06.227916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.228819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.229527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.231240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.231723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.232800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.276585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.277076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.277734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.278276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lazy-loading 'fault' on Instance uuid ab05bfae-26a0-4177-af2e-8191c64f9790 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:22:06.342874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:06.352847 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff9b55ea-0fcd-4a81-a26c-bc4935c93e75 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.486958 Sep 18 01:22:06.362835 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2076/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:05 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:06.362835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:06.362835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:06.366806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.367309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.367917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.368632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.369258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.369932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.374811 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:06.380280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:06.389029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:06.390580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '580e705da2594276a67b34f4eefd8d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87731678e4f6cbc9776f629a3ae70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:06.392761 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2790ed77-5af2-432c-b100-b74e8bade13d tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790" status: 200 len: 1368 microversion: 2.47 time: 0.179734 Sep 18 01:22:06.394600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2114/4190] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:06 2022] GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:06.413123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:06.416329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:06.424411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.425452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.425923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.426636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.427098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.427526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.432540 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:06.466841 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f2e24f9c-c859-426a-b832-d3577e0ebcf6 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070898 Sep 18 01:22:06.467678 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2115/4191] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:22:06 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:06.478734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:06.479234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:06.485938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.486422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.486853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.487539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:06.487989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:06.488410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:06.518259 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c63b5eb-dece-4e98-b526-08519129af67 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/ca0aecf4-b683-433b-bbd2-6715f6cdd7e5" status: 200 len: 194 microversion: 2.1 time: 0.043612 Sep 18 01:22:06.519057 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2116/4192] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Sep 18 01:22:06 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/ca0aecf4-b683-433b-bbd2-6715f6cdd7e5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:22:06.525303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-953206732", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "65461795-2411-4531-b404-f7689b9c28a9"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:06.590359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] validate_networks() for [('65461795-2411-4531-b404-f7689b9c28a9', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:22:06.963683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:06.973206 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c93f80bb-f83a-4f72-9298-459baf320686 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.618179 Sep 18 01:22:06.986259 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2077/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:06 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:06.998096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:07.000061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:07.007472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:07.008443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:07.009170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:07.010160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:07.010928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:07.011590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:07.659644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:07.668408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:07.670773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:07.672053 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7c85bd2-8d65-40ad-93a0-28707384eeb2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1724 microversion: 2.20 time: 0.684531 Sep 18 01:22:07.673195 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2078/4194] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:06 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1724 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:07.677966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:07.678747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:07.685283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:07.686145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:07.686726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:07.687737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:07.688893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:07.689458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:08.542821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:22:08.543925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:22:08.544617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:22:08.545234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:22:08.545922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:22:08.558558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:08.559557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:08.560497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:08.561785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:08.563953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:08.564419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:08.585156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:22:08.591008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for user 0212658356c1456ebe01dfe00dcd4fd2 and project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:22:08.611173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:22:08.613690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:22:08.635886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:08.651893 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ab9ef7a-5816-48e7-9f9d-d33a306adf78 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.976783 Sep 18 01:22:08.653999 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2079/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:07 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:08.660193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:08.661661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:08.670591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:08.671496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:08.672389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:08.673769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28ef00f6-f15d-41c2-bd2b-14c294009483 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.152830 Sep 18 01:22:08.674415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:08.675983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:08.676639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:08.684999 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2117/4196] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:22:08.693135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:08.698607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:08.716567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:08.722507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:08.722507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:08.723291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:08.723772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:08.724205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.349313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:09.359267 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-29bb8dca-4325-492a-b176-b0192851c2d5 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1312 microversion: 2.1 time: 0.672359 Sep 18 01:22:09.360005 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2118/4197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:08 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1312 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:09.379634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:09.380519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] [instance: ab05bfae-26a0-4177-af2e-8191c64f9790] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:09.387468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.387468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.387916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.388809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.389274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.389745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.405877 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] HTTP exception thrown: Instance ab05bfae-26a0-4177-af2e-8191c64f9790 could not be found. Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Request method failure captured: Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790 HTTP/1.1 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnKFItoO4MLY9aLyG8iJJufa2r4iuoVnWgdqcmPeqXX3Lisz3z8UXg4RLpaVc49x28bqJn9Ge-tzA1CCriyNSv4Hhyn4CkElEUlcBqKM0SWBw_76WDDJoFa72BYOdnMtW24aHun2s8wwp4LUXHgByGWVZ_0LJ69ksswDQYV8WtQ5Yj4 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.47 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 93c87731678e4f6cbc9776f629a3ae70 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerShowV247Test-689658718 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93c87731678e4f6cbc9776f629a3ae70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerShowV247Test-689658718 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 93c87731678e4f6cbc9776f629a3ae70 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerShowV247Test-689658718 Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerShowV247Test-689658718-project Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 580e705da2594276a67b34f4eefd8d7c Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerShowV247Test-689658718-project Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ab05bfae-26a0-4177-af2e-8191c64f9790 could not be found. Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'ab05bfae-26a0-4177-af2e-8191c64f9790'} Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab05bfae-26a0-4177-af2e-8191c64f9790 could not be found. Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab05bfae-26a0-4177-af2e-8191c64f9790 could not be found. Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:09.407574 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab05bfae-26a0-4177-af2e-8191c64f9790 could not be found. Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] Returning 404 to user: Instance ab05bfae-26a0-4177-af2e-8191c64f9790 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-076c70d4-33c7-49f9-84e7-b28b228db8f5 tempest-ServerShowV247Test-689658718 tempest-ServerShowV247Test-689658718-project] 10.222.0.25 "GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790" status: 404 len: 111 microversion: 2.47 time: 0.033928 Sep 18 01:22:09.416009 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2119/4198] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:09 2022] GET /compute/v2.1/servers/ab05bfae-26a0-4177-af2e-8191c64f9790 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:22:09.416729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:09.417365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:09.417365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:09.420918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.421414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.421895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.423118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.423580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.424012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.431259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:09.432725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:09.433956 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6cfebd88-0f03-40c9-adce-39159840556f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.778515 Sep 18 01:22:09.434533 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2080/4199] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:08 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:09.439633 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:09.440203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:09.450459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lazy-loading 'flavor' on Instance uuid 057d513c-5711-41e5-9f2d-449b777ff7bb {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:22:09.461603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.463169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.464152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.465401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.466107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.466749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.538954 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-81ca9137-34e8-42d7-9610-ecb5f06fc589 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.126807 Sep 18 01:22:09.539741 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2120/4200] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:09 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:22:09.549736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:09.550455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:09.560068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.561124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.561801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.562714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.563954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.564547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.715643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:09.742847 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bfaca13e-0b2c-4e43-a5a9-6ff3f0fa532f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1266 microversion: 2.1 time: 0.305593 Sep 18 01:22:09.744568 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2081/4201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:09 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:09.764756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98752177-9852-4201-bc50-397d7deb55cd"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:09.768494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:09.776527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.777144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.777702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:09.778612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:09.779090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:09.779585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:10.362477 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bafbea7c-8d31-4c33-b342-4372e2f584c0 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "POST /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615672 Sep 18 01:22:10.364190 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2082/4202] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:22:09 2022] POST /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:10.380685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:10.382264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:10.384976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:10.393433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:10.397164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:10.401781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:10.403451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:10.404414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:10.405870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:10.406680 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1825ab9f-4b1e-47c3-b4c9-eb0f025196c8 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1724 microversion: 2.20 time: 0.865168 Sep 18 01:22:10.407042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:10.407746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:10.408323 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2121/4203] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:09 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1724 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:10.433286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:10.434183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:10.456599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:10.457118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:10.457595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:10.458303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:10.458761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:10.459184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:11.110250 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:11.436229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:11.447469 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5fee4202-7c54-4f4f-a9bf-11c9f583e804 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1333 microversion: 2.1 time: 1.037069 Sep 18 01:22:11.448069 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2122/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:10 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1333 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:11.460513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:11.461404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:11.467840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:11.468049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:11.468825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:11.469503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:11.470438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:11.471115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:11.471747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:11.475979 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dff73cad-9c7f-41af-87bd-707c65d75ac2 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1513 microversion: 2.1 time: 1.109978 Sep 18 01:22:11.476568 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2083/4205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:10 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1513 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:11.488392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:11.494424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:11.505010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:11.507325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:11.507939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:11.514711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:11.515361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:11.515995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:11.773571 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:11.784977 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc884ef4-c36e-4bf9-acb6-0296fc09c874 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1272 microversion: 2.1 time: 0.302998 Sep 18 01:22:11.785587 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2084/4206] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:11 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:11.791672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:11.792280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:11.799444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:11.800076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:11.800647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:11.801381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:11.801876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:11.802634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:11.901880 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:12.502007 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:12.514565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:12.523585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:12.526568 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6f50fe8-f13c-4808-9006-196cb8661785 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.077533 Sep 18 01:22:12.528815 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2123/4207] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:11 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:12.535237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:12.536379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:12.544088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:12.544903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:12.545585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:12.558625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:12.559489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:12.561408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:12.864283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:12.886120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:12.889204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:12.892984 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bcbb2327-7413-4fba-902e-1b784e29a13b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1724 microversion: 2.20 time: 1.105368 Sep 18 01:22:12.896349 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2085/4208] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:11 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1724 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:12.908005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:12.912926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:12.934207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:12.935056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:12.935682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:12.936635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:12.937308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:12.938540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:13.504674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:13.518243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8d933528-5fd5-4239-b97b-df9b48f8da6f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1496 microversion: 2.1 time: 0.620385 Sep 18 01:22:13.519485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2086/4209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:12 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1496 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:13.525282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:13.533869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:13.544166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:13.546540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:13.551812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:13.552801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:13.553459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:13.554080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:13.653968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:13.674067 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2fdbe9c9-4ce8-40a2-b9d6-86e20f2b5b5f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1333 microversion: 2.1 time: 1.142359 Sep 18 01:22:13.676361 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2124/4210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:12 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1333 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:13.683289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:13.684334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:13.698305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:13.699510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:13.700404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:13.701667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:13.713767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:13.714632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:13.766268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lazy-loading 'flavor' on Instance uuid 057d513c-5711-41e5-9f2d-449b777ff7bb {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:22:13.811218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Cannot 'suspend' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state suspended Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action HTTP/1.1 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 15 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: {"suspend": {}} Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'suspend' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state suspended Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'suspend': {}}} Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb in vm_state suspended. Cannot suspend while the instance is in this state. Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 18 01:22:13.815087 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state suspended Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state suspended Sep 18 01:22:13.820688 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:13.827979 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 409 to user: Cannot 'suspend' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state suspended {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:13.829225 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9af694fc-2f2d-4ac8-b7f8-626c81d10af4 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 409 len: 148 microversion: 2.1 time: 0.151671 Sep 18 01:22:13.832024 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2125/4211] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:13 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 148 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:22:13.841050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:13.848371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:13.865125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:13.866615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:13.867859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:13.870378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:13.871005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:13.871789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:14.005603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:14.029382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46d9826c-482c-425d-bf41-9a7ee8dad763 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1314 microversion: 2.1 time: 0.499359 Sep 18 01:22:14.032538 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2087/4212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:13 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:14.051135 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:14.052046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:14.068479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:14.071946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:14.072442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:14.073196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:14.077852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:14.079093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:14.212000 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30df0a11-ec83-4de7-9a2d-938aa0f255dd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.176612 Sep 18 01:22:14.215279 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2088/4213] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:14 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:22:14.228452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-341ee711-5e22-439f-a580-f095382ca625 req-ab6445fb-b567-4b3c-95ad-5f844106dabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c963839-4902-4588-a336-b34fe7be811a", "tag": "6d6361a7-5108-4299-a411-43d3e7b1ec74"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:14.254932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-341ee711-5e22-439f-a580-f095382ca625 req-ab6445fb-b567-4b3c-95ad-5f844106dabf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:14.255882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-341ee711-5e22-439f-a580-f095382ca625 req-ab6445fb-b567-4b3c-95ad-5f844106dabf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:14.256583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-341ee711-5e22-439f-a580-f095382ca625 req-ab6445fb-b567-4b3c-95ad-5f844106dabf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:14.286323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-341ee711-5e22-439f-a580-f095382ca625 req-ab6445fb-b567-4b3c-95ad-5f844106dabf service nova] Creating event network-changed:6d6361a7-5108-4299-a411-43d3e7b1ec74 for instance 5c963839-4902-4588-a336-b34fe7be811a on n-h1-master-1 Sep 18 01:22:14.303632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-341ee711-5e22-439f-a580-f095382ca625 req-ab6445fb-b567-4b3c-95ad-5f844106dabf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085922 Sep 18 01:22:14.305693 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2089/4214] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:14.318089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:14.319201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:14.328364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:14.330087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:14.330900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:14.331883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:14.332646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:14.333981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:14.635690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:14.676429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:14.679948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:14.682419 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0fcdbbb8-0d24-4aab-b974-9e3d253721fe tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.844252 Sep 18 01:22:14.705571 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2126/4215] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:13 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:14.715074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:14.715717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:14.730457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:14.731987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:14.732944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:14.734136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:14.737013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:14.738098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:15.025024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:15.040915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:15.046459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:15.053934 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c168ca2-c33d-4041-b7d6-c396e2633de2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1724 microversion: 2.20 time: 0.740888 Sep 18 01:22:15.055076 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2090/4216] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:14 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1724 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:15.064821 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:15.065771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:15.098890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:15.099645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:15.100339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:15.103194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:15.103895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:15.104507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:15.651255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:15.664640 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-54ae0d8c-bee2-4741-a4fb-68fccd84b807 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1502 microversion: 2.1 time: 0.957575 Sep 18 01:22:15.665544 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2127/4217] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:14 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1502 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:15.673644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:15.674811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:15.685390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:15.686788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:15.687381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:15.693755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:15.694928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:15.702733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:16.145980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:16.161111 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0ab76b0-5067-4d5d-977a-4037b96b788f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.104668 Sep 18 01:22:16.174152 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2091/4218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:15 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:16.182304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:16.200189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:16.220988 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:16.227656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:16.228240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:16.232154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:16.233210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:16.233751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:16.234192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:16.250175 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:16.318973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:16.334447 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fde238d9-ff6f-45ab-aa09-5d0c8c684e0c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1314 microversion: 2.1 time: 0.665915 Sep 18 01:22:16.338149 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2128/4219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:15 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:16.350412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:16.351287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:16.372565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:16.374430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:16.375091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:16.378542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:16.379185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:16.379773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:17.886133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:17.899691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:17.905287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:17.911032 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6158abd-6143-4dfe-984c-cc56e362557e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1745 microversion: 2.20 time: 1.570150 Sep 18 01:22:17.911912 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2129/4220] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:16 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1745 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:17.931095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:17.934682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:17.948749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:17.949255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:17.949735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:17.950529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:17.970640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:17.971096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:18.171336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:18.184715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:18.186284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:18.187556 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-59fd2f74-847c-4470-9306-e4a83559cb23 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 2.012166 Sep 18 01:22:18.205675 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2092/4221] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:16 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:18.205675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:18.206257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:18.233040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:18.233535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:18.234227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:18.236164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:18.237138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:18.237802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:18.259745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:18.270092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f5670e3c-c253-4555-ab8b-2dc78eabdcae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.356954 Sep 18 01:22:18.285368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2130/4222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:17 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:18.322274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:18.322903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:18.353700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:18.354210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:18.354737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:18.359073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:18.360283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:18.360740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:18.440439 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:18.581015 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:18.600952 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:18.667120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:18.680119 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ef5708e2-91b3-418d-a77b-b833a4412245 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1314 microversion: 2.1 time: 0.380454 Sep 18 01:22:18.700766 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2131/4223] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:18 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:18.715793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:18.716528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:18.730598 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:18.736257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:18.737290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:18.743567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:18.744733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:18.746406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:18.747068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:19.114957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:19.131408 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e7826ce8-8253-45e7-9b68-13e250aa25fc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.937794 Sep 18 01:22:19.135025 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2093/4224] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:18 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:19.148967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:19.150221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:19.168549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:19.169449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:19.178448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:19.180230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:19.180959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:19.181675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:19.280548 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:19.310195 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07f73011-608c-44ce-85f9-640ac50bc09c tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.607940 Sep 18 01:22:19.321482 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2132/4225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:18 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:19.348236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:19.348989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:19.365333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:19.366158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:19.366762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:19.368722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:19.369376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:19.370152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:20.036689 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:20.063682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:20.066323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:20.068867 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7375ddfd-1320-4680-bc99-a82539c08b37 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 0.931700 Sep 18 01:22:20.071662 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2094/4226] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:19 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:20.088725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8cb8b4c-f89c-4c9e-ae48-6e1f8d644985 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:20.095317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8cb8b4c-f89c-4c9e-ae48-6e1f8d644985 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 0c0ba0ff-a031-4864-88a5-31783da5a7dd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:20.110593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d8cb8b4c-f89c-4c9e-ae48-6e1f8d644985 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 0c0ba0ff-a031-4864-88a5-31783da5a7dd could not be found. Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8cb8b4c-f89c-4c9e-ae48-6e1f8d644985 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/0c0ba0ff-a031-4864-88a5-31783da5a7dd/action HTTP/1.1 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 15 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: {"unpause": {}} Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 0c0ba0ff-a031-4864-88a5-31783da5a7dd could not be found. Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '0c0ba0ff-a031-4864-88a5-31783da5a7dd', 'body': {'unpause': {}}} Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0ba0ff-a031-4864-88a5-31783da5a7dd could not be found. Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0ba0ff-a031-4864-88a5-31783da5a7dd could not be found. Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:20.117025 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:20.124553 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:20.124553 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:20.124553 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0ba0ff-a031-4864-88a5-31783da5a7dd could not be found. Sep 18 01:22:20.124553 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:20.127662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8cb8b4c-f89c-4c9e-ae48-6e1f8d644985 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 0c0ba0ff-a031-4864-88a5-31783da5a7dd could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:20.129298 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8cb8b4c-f89c-4c9e-ae48-6e1f8d644985 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/0c0ba0ff-a031-4864-88a5-31783da5a7dd/action" status: 404 len: 111 microversion: 2.1 time: 0.056219 Sep 18 01:22:20.130897 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2095/4227] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:20 2022] POST /compute/v2.1/servers/0c0ba0ff-a031-4864-88a5-31783da5a7dd/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:22:20.140410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:20.141898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:20.163634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:20.164671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:20.165798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:20.169068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:20.170485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:20.171547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:20.459079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:20.472115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:20.473519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:20.480611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-309fb12e-82a0-4d4c-bdad-c496d97a0573 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.154128 Sep 18 01:22:20.496053 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2133/4228] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:19 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:20.502824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-99a0ae75-8951-4daf-8082-80abfb9d3856 req-0bfc8abd-a371-484a-a7a8-f96873df446b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "tag": "22f9548d-cd1e-4c15-ad15-718266ac7541"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:20.527983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-99a0ae75-8951-4daf-8082-80abfb9d3856 req-0bfc8abd-a371-484a-a7a8-f96873df446b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:20.528478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-99a0ae75-8951-4daf-8082-80abfb9d3856 req-0bfc8abd-a371-484a-a7a8-f96873df446b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:20.528907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-99a0ae75-8951-4daf-8082-80abfb9d3856 req-0bfc8abd-a371-484a-a7a8-f96873df446b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:20.561893 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-99a0ae75-8951-4daf-8082-80abfb9d3856 req-0bfc8abd-a371-484a-a7a8-f96873df446b service nova] Creating event network-changed:22f9548d-cd1e-4c15-ad15-718266ac7541 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:22:20.573081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-99a0ae75-8951-4daf-8082-80abfb9d3856 req-0bfc8abd-a371-484a-a7a8-f96873df446b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088651 Sep 18 01:22:20.577517 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2134/4229] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:20.591279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:20.592030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:20.614546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:20.615047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:20.615490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:20.616218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:20.616678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:20.617107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:20.651524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:20.660858 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-afae385d-0e38-4541-9426-90d80e7bc38c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1314 microversion: 2.1 time: 0.528326 Sep 18 01:22:20.661454 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2096/4230] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:20 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:20.709058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:20.710248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:20.731002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:20.733935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:20.734705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:20.738101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:20.738832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:20.739528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.037208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:21.045397 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa1c725f-d721-4ce1-b5a3-708597537014 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.466581 Sep 18 01:22:21.049139 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2135/4231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:20 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:21.084184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:21.085175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:21.096516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.097425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.098266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.099910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.105306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.106014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.254510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:21.270671 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07cec748-26c5-4308-9320-5f6a9ee7378a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.580119 Sep 18 01:22:21.272070 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2097/4232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:20 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:21.285435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:21.286371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:21.298867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.299728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.303501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.304334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.309028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.309785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.390615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:21.404171 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-66586a5f-14e3-4b97-868d-bcd3c9ce29af tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.322784 Sep 18 01:22:21.420340 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2136/4233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:21 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:22:21.440367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:21.442036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:21.460089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.461997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.462659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.463593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.465137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.466390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.529496 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Cannot 'unpause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action HTTP/1.1 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 15 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: {"unpause": {}} Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'unpause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'unpause': {}}} Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb in vm_state active. Cannot unpause while the instance is in this state. Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:21.537469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:21.541803 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:21.541803 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:21.541803 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:21.541803 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:21.541803 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:21.547677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 409 to user: Cannot 'unpause' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:21.550013 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65e1c57b-b843-4209-b352-9c12582f3ad3 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 409 len: 145 microversion: 2.1 time: 0.113736 Sep 18 01:22:21.576487 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2137/4234] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:21 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 145 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 18 01:22:21.599574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:21.600528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:21.617213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.623620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.624477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:21.625830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:21.626672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:21.627368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:22.337782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:22.358151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:22.366731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:22.372653 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0b78d51-f074-40d1-9e06-e16c53df2440 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 1.099475 Sep 18 01:22:22.375849 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2098/4235] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:21 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:22.385431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:22.386642 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:22.399042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:22.400412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:22.401085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:22.402530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:22.403250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:22.404035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:22.550191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:22.575799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:22.584119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:22.588170 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f9f3970e-5b2c-49e8-b0cf-797396c0ef48 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.003431 Sep 18 01:22:22.599231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2138/4236] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:21 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:22.618387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:22.619564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:22.640295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:22.645381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:22.649455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:22.651731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:22.652490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:22.653685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:22.730502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:22.745836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c8443a9-a0b1-44d0-a936-f2c1e8516d92 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.368238 Sep 18 01:22:22.749448 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2099/4237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:22 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:22.759742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:22.762503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:22.776711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:22.782806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:22.783514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:22.784474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:22.784942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:22.785370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:23.434059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:23.461114 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3dec1603-6b87-4262-a586-7d9a07a8cf3f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1314 microversion: 2.1 time: 0.858285 Sep 18 01:22:23.461746 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2139/4238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:22 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:23.472178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-7b833dc1-10ff-41b3-83ef-cd3dd2165872 req-748a9a24-dd62-4515-9ceb-b4c882696597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c963839-4902-4588-a336-b34fe7be811a", "name": "network-vif-plugged", "status": "completed", "tag": "6d6361a7-5108-4299-a411-43d3e7b1ec74"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:23.497627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7b833dc1-10ff-41b3-83ef-cd3dd2165872 req-748a9a24-dd62-4515-9ceb-b4c882696597 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:23.498118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7b833dc1-10ff-41b3-83ef-cd3dd2165872 req-748a9a24-dd62-4515-9ceb-b4c882696597 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:23.498557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7b833dc1-10ff-41b3-83ef-cd3dd2165872 req-748a9a24-dd62-4515-9ceb-b4c882696597 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:23.528846 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-7b833dc1-10ff-41b3-83ef-cd3dd2165872 req-748a9a24-dd62-4515-9ceb-b4c882696597 service nova] Creating event network-vif-plugged:6d6361a7-5108-4299-a411-43d3e7b1ec74 for instance 5c963839-4902-4588-a336-b34fe7be811a on n-h1-master-1 Sep 18 01:22:23.530632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:23.538837 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-7b833dc1-10ff-41b3-83ef-cd3dd2165872 req-748a9a24-dd62-4515-9ceb-b4c882696597 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075562 Sep 18 01:22:23.541301 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2140/4239] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:23.548676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-01b4b3c1-2517-4678-a253-d15596769409 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.793819 Sep 18 01:22:23.549340 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2100/4240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:22 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:23.565595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:23.568786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:23.575414 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:23.576855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:23.584413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:23.585138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:23.587558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:23.588324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:23.591899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:23.592354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:23.612850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:23.613855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:23.614783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:23.616085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:23.616840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:23.617534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:24.930049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:24.945125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:24.947864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:24.951436 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-488f92a2-53a1-4c2c-8607-c87e2e3d1463 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 1.398595 Sep 18 01:22:24.956621 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2101/4241] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:23 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:24.967967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:24.969968 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:24.984146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:24.988053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:24.988755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:24.992420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:24.993679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:24.996452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:25.040088 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:25.050932 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a4dcf45-96b7-4908-ab3d-034a9a09fdae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.508013 Sep 18 01:22:25.056535 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2141/4242] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:23 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:25.068022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1da92583-ac45-452e-a31c-36ed87e2b521 req-a4f10555-3cfb-4248-9e19-f440480b4a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "tag": "6d5e19d4-f4d5-444a-be0c-845b81c55b7f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:25.108086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1da92583-ac45-452e-a31c-36ed87e2b521 req-a4f10555-3cfb-4248-9e19-f440480b4a39 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:25.118779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1da92583-ac45-452e-a31c-36ed87e2b521 req-a4f10555-3cfb-4248-9e19-f440480b4a39 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:25.120038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1da92583-ac45-452e-a31c-36ed87e2b521 req-a4f10555-3cfb-4248-9e19-f440480b4a39 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:25.149883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1da92583-ac45-452e-a31c-36ed87e2b521 req-a4f10555-3cfb-4248-9e19-f440480b4a39 service nova] Creating event network-changed:6d5e19d4-f4d5-444a-be0c-845b81c55b7f for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:22:25.159923 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1da92583-ac45-452e-a31c-36ed87e2b521 req-a4f10555-3cfb-4248-9e19-f440480b4a39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098742 Sep 18 01:22:25.162156 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2142/4243] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:25.180669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:25.182017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:25.197718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:25.202362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:25.205492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:25.208191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:25.208949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:25.210273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:25.998421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:26.012244 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83e49484-7e13-4835-b9f2-29f5a10e2573 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1314 microversion: 2.1 time: 0.848485 Sep 18 01:22:26.026116 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2143/4244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:25 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:26.039829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:26.046641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:26.050373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:26.067493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:26.068240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:26.068999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:26.069997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:26.070638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:26.071405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:26.115754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:26.130461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:26.141078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a621ac3d-178c-47b5-8784-6e3f4d21182c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.174282 Sep 18 01:22:26.170038 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2102/4245] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:24 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:26.178426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-41b8f35f-8280-42c9-92e8-7381e25423a6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:26.179322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-41b8f35f-8280-42c9-92e8-7381e25423a6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: ba1b036d-fedd-4ec3-8d57-eb1db95a6aef] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:26.186791 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-41b8f35f-8280-42c9-92e8-7381e25423a6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance ba1b036d-fedd-4ec3-8d57-eb1db95a6aef could not be found. Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-41b8f35f-8280-42c9-92e8-7381e25423a6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/ba1b036d-fedd-4ec3-8d57-eb1db95a6aef/action HTTP/1.1 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 18 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: {"unshelve": null} Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: exception: Instance ba1b036d-fedd-4ec3-8d57-eb1db95a6aef could not be found. Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'ba1b036d-fedd-4ec3-8d57-eb1db95a6aef', 'body': {'unshelve': None}} Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1b036d-fedd-4ec3-8d57-eb1db95a6aef could not be found. Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1b036d-fedd-4ec3-8d57-eb1db95a6aef could not be found. Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:26.190769 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1b036d-fedd-4ec3-8d57-eb1db95a6aef could not be found. Sep 18 01:22:26.195394 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:26.199528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-41b8f35f-8280-42c9-92e8-7381e25423a6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance ba1b036d-fedd-4ec3-8d57-eb1db95a6aef could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:26.201178 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-41b8f35f-8280-42c9-92e8-7381e25423a6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/ba1b036d-fedd-4ec3-8d57-eb1db95a6aef/action" status: 404 len: 111 microversion: 2.1 time: 0.029689 Sep 18 01:22:26.202961 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2103/4246] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:26 2022] POST /compute/v2.1/servers/ba1b036d-fedd-4ec3-8d57-eb1db95a6aef/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:22:26.208905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:26.213357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:26.231704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:26.232470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:26.233084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:26.234094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:26.235365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:26.236952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:26.340563 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b743531-c020-4569-ab15-f6b829705fa9 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.136106 Sep 18 01:22:26.349177 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2104/4247] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:22:26 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:26.362987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c1cd35ba-56b0-4deb-bd2a-295c14a02f6d req-ec51c0e8-9ecb-429c-b93b-a5197bce301b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551fce-fc60-40fe-aa37-d96f5af28e0c", "name": "network-vif-plugged", "status": "completed", "tag": "00b945c1-f1c2-4b42-8058-fe512412ca56"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:26.428268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c1cd35ba-56b0-4deb-bd2a-295c14a02f6d req-ec51c0e8-9ecb-429c-b93b-a5197bce301b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:26.428759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c1cd35ba-56b0-4deb-bd2a-295c14a02f6d req-ec51c0e8-9ecb-429c-b93b-a5197bce301b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:26.429193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c1cd35ba-56b0-4deb-bd2a-295c14a02f6d req-ec51c0e8-9ecb-429c-b93b-a5197bce301b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:26.462820 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c1cd35ba-56b0-4deb-bd2a-295c14a02f6d req-ec51c0e8-9ecb-429c-b93b-a5197bce301b service nova] Creating event network-vif-plugged:00b945c1-f1c2-4b42-8058-fe512412ca56 for instance b5551fce-fc60-40fe-aa37-d96f5af28e0c on n-h1-master-1 Sep 18 01:22:26.490839 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c1cd35ba-56b0-4deb-bd2a-295c14a02f6d req-ec51c0e8-9ecb-429c-b93b-a5197bce301b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139111 Sep 18 01:22:26.491918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2105/4248] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:26.501719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:26.506917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:26.539882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:26.545799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:26.548599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:26.549814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:26.553361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:26.555153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:27.067276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:27.082580 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9fcf5b23-a2ec-411b-8ab8-a1d0278d808e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.055079 Sep 18 01:22:27.083626 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2144/4249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:26 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:27.099521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:27.100335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:27.118556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:27.119323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:27.119941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:27.120849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:27.121451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:27.122043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:27.434438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:27.477109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:27.483244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:27.485541 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2fe0027-3f5f-469d-9209-e932939002d1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 0.992132 Sep 18 01:22:27.487940 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2106/4250] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:26 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:27.494649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:27.496673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:27.520732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:27.521769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:27.523064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:27.524507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:27.541371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:27.542262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:27.589853 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ab3a434-7788-4421-bf19-6ab8cb66d019 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/ca0aecf4-b683-433b-bbd2-6715f6cdd7e5" status: 200 len: 194 microversion: 2.1 time: 0.099312 Sep 18 01:22:27.595813 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2107/4251] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Sep 18 01:22:27 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/ca0aecf4-b683-433b-bbd2-6715f6cdd7e5 => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:27.596995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:27.597772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:27.604495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:27.605716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:27.606411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:27.607534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:27.608268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:27.608993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:28.482569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:28.494095 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5bf821d-03b4-4690-97ec-7d2dc642a77b tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.409765 Sep 18 01:22:28.497776 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2145/4252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:27 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:28.503648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:28.504676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:28.514551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:28.515931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:28.516865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:28.518565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:28.519298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:28.519956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:28.563591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:28.577543 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5f6cb85-d270-4e1a-93af-8b14a05228e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1500 microversion: 2.1 time: 0.985423 Sep 18 01:22:28.596044 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2108/4253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:27 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1500 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:28.621628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:28.622513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:28.638538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:28.639760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:28.643598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:28.647441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:28.648594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:28.653908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:28.963846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lazy-loading 'services' on Instance uuid dbc80631-d479-465c-b42f-e5d86bc3883b {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:22:29.144554 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0daba809-b4fe-4380-8e1a-d98e3a6d1030 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/ca0aecf4-b683-433b-bbd2-6715f6cdd7e5" status: 202 len: 0 microversion: 2.1 time: 0.547102 Sep 18 01:22:29.145640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2109/4254] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:22:28 2022] DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/ca0aecf4-b683-433b-bbd2-6715f6cdd7e5 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:22:29.159415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:29.160755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:29.172473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:29.173329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:29.174225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:29.175210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:29.175894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:29.176535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:30.004585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:30.034920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:30.039960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:30.046400 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e13b2cf2-570a-4612-822c-1bc7c3ab895a tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.545276 Sep 18 01:22:30.050863 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2146/4255] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:28 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:30.059773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:30.060787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:30.070473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:30.071557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:30.072268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:30.073228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:30.074035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:30.074694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:30.294500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:30.303666 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:30.316873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ba6de71-17fe-4cae-a6d1-f034a4e6e768 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.169158 Sep 18 01:22:30.317504 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2110/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:29 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:30.329853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:30.329853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:30.362336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:30.362759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:30.363200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:30.365234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:30.366265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:30.367852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:31.037607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:31.060239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:31.062118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:31.064049 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d74b12a-e369-4ee9-9b04-a81a5254a299 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 1.011723 Sep 18 01:22:31.070708 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2147/4257] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:30 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:31.086561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:31.087019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:31.116680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:31.117187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:31.122485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:31.129679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:31.134335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:31.134911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:32.357831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:32.371676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a4b2dbb-bea0-4dc8-8117-6326e7c4bb9d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 2.048134 Sep 18 01:22:32.380562 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2111/4258] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:30 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:32.386709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-983d3542-2766-4d46-88c8-593d7c3cfa4f req-2bec4bad-1071-4542-abd8-8b4033e69d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "tag": "ac5579b6-da92-4d84-be97-2357c891b933"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:32.417651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-983d3542-2766-4d46-88c8-593d7c3cfa4f req-2bec4bad-1071-4542-abd8-8b4033e69d0b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:32.418638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-983d3542-2766-4d46-88c8-593d7c3cfa4f req-2bec4bad-1071-4542-abd8-8b4033e69d0b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:32.419279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-983d3542-2766-4d46-88c8-593d7c3cfa4f req-2bec4bad-1071-4542-abd8-8b4033e69d0b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:32.451852 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-983d3542-2766-4d46-88c8-593d7c3cfa4f req-2bec4bad-1071-4542-abd8-8b4033e69d0b service nova] Creating event network-changed:ac5579b6-da92-4d84-be97-2357c891b933 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:22:32.469089 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-983d3542-2766-4d46-88c8-593d7c3cfa4f req-2bec4bad-1071-4542-abd8-8b4033e69d0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086149 Sep 18 01:22:32.471801 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2112/4259] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:32.484914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:32.485969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:32.487810 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Removing security group 09aaf868-0a2f-471e-9712-b9db06467572 from port 6d6361a7-5108-4299-a411-43d3e7b1ec74 Sep 18 01:22:32.512333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:32.513041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:32.513647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:32.514530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:32.515315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:32.520082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:33.297301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:33.328906 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:33.331740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:33.333259 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e32ef54f-4448-457f-868d-11885310c369 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.859886 Sep 18 01:22:33.340613 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2113/4260] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:32 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:33.351838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:33.353169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:33.369286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:33.373894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:33.375285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:33.376325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:33.382271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:33.384976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:34.594029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:34.627489 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-39859aab-d2d4-4ee7-a55b-0445f119f3da tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.285106 Sep 18 01:22:34.639347 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2114/4261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:33 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:34.651538 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:34.662738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1a31530d-5b8f-4838-b52f-6e9a9b19bdfb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a/action" status: 202 len: 0 microversion: 2.1 time: 3.585390 Sep 18 01:22:34.665023 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2148/4262] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:31 2022] POST /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a/action => generated 0 bytes in 3594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:22:34.672536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:34.672992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:34.674799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:34.697260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:34.700268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:34.701761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:34.702970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:34.705892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:34.710499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:34.715719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:34.716226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:34.716836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:34.726430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:34.727444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:34.729062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:34.843957 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Cannot 'unshelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action HTTP/1.1 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 18 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: {"unshelve": null} Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: exception: Cannot 'unshelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'unshelve': None}} Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb in vm_state active. Cannot unshelve while the instance is in this state. Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:22:34.851721 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:34.856438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 409 to user: Cannot 'unshelve' instance 057d513c-5711-41e5-9f2d-449b777ff7bb while it is in vm_state active {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:34.857383 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action" status: 409 len: 146 microversion: 2.1 time: 0.187135 Sep 18 01:22:34.861849 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2149/4263] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:22:34 2022] POST /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb/action => generated 146 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:22:34.866061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:34.870869 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab12d0f5-5eae-4a51-ad28-2570e21736a1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007559 Sep 18 01:22:34.885644 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2150/4264] 10.222.0.25 () {56 vars in 886 bytes} [Sun Sep 18 01:22:34 2022] GET /compute/ => generated 377 bytes in 23 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 18 01:22:34.907366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:34.908139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:34.929371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:34.929922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:34.930972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:34.931729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:34.936907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:34.937659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:36.967732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:36.973404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:36.987935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:36.993021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:37.003741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:37.005404 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-70041261-1858-4b9e-a316-0bd8ae06bfdd tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 2.363504 Sep 18 01:22:37.006652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:37.027403 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48dbfc51-da9a-4cf7-aac7-6cc385befcc8 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 2.140481 Sep 18 01:22:37.027946 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2115/4265] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:34 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 2386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:37.037677 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2151/4266] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:34 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:37.039112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:37.039884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:37.046775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:37.047501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:37.048097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:37.048241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b10046d4-c074-4099-8508-8d8456067675 req-921e4cb8-e270-4385-b36a-90461f60b1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c963839-4902-4588-a336-b34fe7be811a", "tag": "6d6361a7-5108-4299-a411-43d3e7b1ec74"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:37.049122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:37.050378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:37.050970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:37.095170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b10046d4-c074-4099-8508-8d8456067675 req-921e4cb8-e270-4385-b36a-90461f60b1ea service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:37.095827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b10046d4-c074-4099-8508-8d8456067675 req-921e4cb8-e270-4385-b36a-90461f60b1ea service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:37.096280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b10046d4-c074-4099-8508-8d8456067675 req-921e4cb8-e270-4385-b36a-90461f60b1ea service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:37.128324 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:37.131367 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b10046d4-c074-4099-8508-8d8456067675 req-921e4cb8-e270-4385-b36a-90461f60b1ea service nova] Creating event network-changed:6d6361a7-5108-4299-a411-43d3e7b1ec74 for instance 5c963839-4902-4588-a336-b34fe7be811a on n-h1-master-1 Sep 18 01:22:37.142540 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b10046d4-c074-4099-8508-8d8456067675 req-921e4cb8-e270-4385-b36a-90461f60b1ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098882 Sep 18 01:22:37.144923 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2152/4267] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:37.151350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:37.152342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:37.168464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:37.169400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:37.170689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:37.172149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:37.172808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:37.173411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:37.442943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:37.460261 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2631f59-7b34-49d9-b022-1900b240c8f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1458 microversion: 2.1 time: 0.430968 Sep 18 01:22:37.497733 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2116/4268] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:37 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1458 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:37.541167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:37.548572 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:37.574719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:37.575468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:37.576134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:37.577567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:37.582324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:37.582966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:38.230773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:38.324610 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9584326b-8806-4aed-aac3-cdf919d4030f tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.165186 Sep 18 01:22:38.332389 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2153/4269] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:37 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:38.388793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:38.393292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:38.421740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:38.424362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:38.425268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:38.429961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:38.434207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:38.436771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:38.790691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:38.799821 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a08b91d9-7c1d-4419-9a73-51d22228a09f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.302916 Sep 18 01:22:38.800419 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2117/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:37 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:38.846782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:38.847403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:38.878734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:38.879716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:38.880314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:38.882019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:38.882668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:38.888114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:40.016136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:40.031990 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-25d4eb91-e3f6-4865-85fe-3e4449cdf79a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.692912 Sep 18 01:22:40.033363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2154/4271] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:38 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:40.046355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:40.050248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:40.069132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:40.070137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:40.071213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:40.072671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:40.073774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:40.079500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:41.148876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:41.182281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:41.185652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:41.194237 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e87d5be9-c50b-407a-a2cf-5610cfb2c696 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.155942 Sep 18 01:22:41.210606 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2155/4272] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:40 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:41.210815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:41.226852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:41.235048 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:41.236976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:41.248826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:41.249308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:41.250487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:41.251293 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a9055c15-0e87-4d33-b876-59c4070d0afc tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 2.417098 Sep 18 01:22:41.252137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:41.254218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:41.254994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:41.255614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:41.267118 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2118/4273] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:38 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:41.295511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:41.298148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:41.319297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:41.328134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:41.329148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:41.331378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:41.332718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:41.333777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:42.981154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:43.013168 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-873ea1ca-6e3c-45b7-a636-eef197ead7dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.739722 Sep 18 01:22:43.020830 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2119/4274] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:41 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:43.035150 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:43.038371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:43.064061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:43.065360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:43.066210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:43.067195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:43.067904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:43.068560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:43.156301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:43.198984 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c6fab630-a1ff-4850-a4d9-7a28fd9bb486 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 1.986377 Sep 18 01:22:43.200008 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2156/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:41 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:43.244048 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:43.254852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:43.306849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:43.307668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:43.308413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:43.315724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:43.316731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:43.324932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:43.549034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:43.586943 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f42ef5c3-6c1f-4786-b2b2-78d65278cf5c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.564158 Sep 18 01:22:43.588267 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2120/4276] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:43 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:43.593294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:43.594209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:43.606361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:43.607555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:43.609154 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:43.616485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:43.617922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:43.618940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:44.490988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:44.516513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:44.528608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:44.529935 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9105740e-ac2c-4e61-a31b-67a4e967ddd5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.322599 Sep 18 01:22:44.530518 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2157/4277] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:43 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:44.580194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:44.586972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:44.603055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:44.604233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:44.605221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:44.606787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:44.607842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:44.608599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:44.668385 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36cb2b36-4aad-4a92-9767-51348444f204 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/98752177-9852-4201-bc50-397d7deb55cd" status: 200 len: 194 microversion: 2.1 time: 0.110156 Sep 18 01:22:44.670222 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2158/4278] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Sep 18 01:22:44 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/98752177-9852-4201-bc50-397d7deb55cd => generated 194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:22:44.677144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b979a824-061a-496d-8958-ed646169d0c1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-710947812_updated"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:44.687615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b979a824-061a-496d-8958-ed646169d0c1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 0ebd0872-23c1-4b6f-9b49-454a820de458] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:44.699550 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b979a824-061a-496d-8958-ed646169d0c1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 0ebd0872-23c1-4b6f-9b49-454a820de458 could not be found. Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b979a824-061a-496d-8958-ed646169d0c1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/servers/0ebd0872-23c1-4b6f-9b49-454a820de458 HTTP/1.1 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 80 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-710947812_updated"}} Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0ebd0872-23c1-4b6f-9b49-454a820de458 could not be found. Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0ebd0872-23c1-4b6f-9b49-454a820de458', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-710947812_updated'}}} Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ebd0872-23c1-4b6f-9b49-454a820de458 could not be found. Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 18 01:22:44.710401 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ebd0872-23c1-4b6f-9b49-454a820de458 could not be found. Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ebd0872-23c1-4b6f-9b49-454a820de458 could not be found. Sep 18 01:22:44.716978 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:44.720366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b979a824-061a-496d-8958-ed646169d0c1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 0ebd0872-23c1-4b6f-9b49-454a820de458 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:44.721731 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b979a824-061a-496d-8958-ed646169d0c1 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "PUT /compute/v2.1/servers/0ebd0872-23c1-4b6f-9b49-454a820de458" status: 404 len: 111 microversion: 2.1 time: 0.049306 Sep 18 01:22:44.725093 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2159/4279] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:22:44 2022] PUT /compute/v2.1/servers/0ebd0872-23c1-4b6f-9b49-454a820de458 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:22:44.754869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:44.756182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:44.804450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:44.804957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:44.805401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:44.807912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:44.808410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:44.818267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:44.949126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:44.986727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:44.994663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:44.996009 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f800a4bb-6e72-4149-8406-2956491aa04f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 1.406412 Sep 18 01:22:45.000088 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2121/4280] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:43 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:45.014729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:45.016333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:45.028837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:45.031252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:45.034667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:45.036046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:45.038170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:45.040647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:45.760760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:45.777054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:45.793016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c90c30c-f2f5-405f-99bf-035f159f653a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.789699 Sep 18 01:22:45.793702 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cccf0cdf-655b-4755-8e32-4951938525d6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.066843 Sep 18 01:22:45.794702 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2160/4281] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:44 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:45.810912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:45.811416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:45.815275 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2122/4282] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:45 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:45.829419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:45.830249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:45.832651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:45.833907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:45.837429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:45.838393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:45.839054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:45.839665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:45.850499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:45.851430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:45.852101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:45.854222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:45.856246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:45.858080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:46.170758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lazy-loading 'services' on Instance uuid dbc80631-d479-465c-b42f-e5d86bc3883b {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:22:46.369241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c8c22cb6-61b0-48c4-b500-2a0b8e32f3f4 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/98752177-9852-4201-bc50-397d7deb55cd" status: 202 len: 0 microversion: 2.1 time: 0.569002 Sep 18 01:22:46.376319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2161/4283] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:22:45 2022] DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments/98752177-9852-4201-bc50-397d7deb55cd => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:22:46.396303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:46.397076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:46.446857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:46.447361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:46.447809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:46.469604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:46.470129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:46.470587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:46.651469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:46.685903 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c24cdc2f-0d97-4f52-b58a-cf6fefcef6cd tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.868195 Sep 18 01:22:46.687250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2123/4284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:45 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:46.694922 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:46.696021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:46.704414 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=64 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:46.707328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:46.711777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:46.712908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:46.714448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:46.716219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:46.718096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:47.923866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:47.937536 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5982e76f-9520-445b-92a6-3f00c1e6a4f9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 1.246411 Sep 18 01:22:47.944713 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2124/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:46 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:47.950633 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:47.955409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:47.989182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:47.989985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:47.990590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:47.991556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:47.994574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:47.995243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:48.550081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:48.567154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:48.571825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:48.576043 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4cfa4b39-136d-4c13-adca-df677fc9c875 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 2.192206 Sep 18 01:22:48.581116 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2162/4286] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:46 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:48.588050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:48.592176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:48.609055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:48.614480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:48.615402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:48.617707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:48.621437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:48.622259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:49.020924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:49.049456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:49.057073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:49.064294 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-664c3026-4eed-480a-9ff3-3550f6e4852b tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 1.117294 Sep 18 01:22:49.068176 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2125/4287] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:47 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:49.081399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:49.088208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:49.118991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:49.120133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:49.120785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:49.121711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:49.122330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:49.122914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:49.174792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:49.189392 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f52058bd-1b05-45c8-a8b9-d8fd67285f12 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.603224 Sep 18 01:22:49.201731 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2163/4288] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:48 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:49.234769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1217022387", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "65461795-2411-4531-b404-f7689b9c28a9"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:49.305530 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=62 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:49.388102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] validate_networks() for [('65461795-2411-4531-b404-f7689b9c28a9', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:22:50.146536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:50.157325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed30d0ef-ce9a-4950-927d-073ad4601c1e tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.086619 Sep 18 01:22:50.163971 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2126/4289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:49 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:50.173215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ec8e29c-7557-430e-986b-4f63699541ca tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ec8e29c-7557-430e-986b-4f63699541ca tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: request: PUT /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb HTTP/1.1 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 280 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:50.183121 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 18 01:22:50.186885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:22:50.200753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ec8e29c-7557-430e-986b-4f63699541ca tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:50.202035 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ec8e29c-7557-430e-986b-4f63699541ca tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "PUT /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 400 len: 619 microversion: 2.1 time: 0.036720 Sep 18 01:22:50.206990 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2127/4290] 10.222.0.25 () {60 vars in 1257 bytes} [Sun Sep 18 01:22:50 2022] PUT /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:22:50.214245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:50.219096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:50.242427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:50.243258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:50.243899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:50.244838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:50.245576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:50.246216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:50.846440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:22:50.846979 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:22:50.847372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:22:50.847790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:22:50.848211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:22:50.899890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:50.900507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:50.900967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:50.903572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:50.907293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:50.908064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:50.971110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:22:50.987083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Getting quotas for user 0212658356c1456ebe01dfe00dcd4fd2 and project faf8394fe0f148b8b5794af678f368b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:22:51.001408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.018434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.026002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.029575 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-709adc5a-7428-4752-b394-2912f5e96a97 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.819255 Sep 18 01:22:51.045584 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2128/4291] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:50 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:51.046042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:22:51.046042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:22:51.071246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:51.072578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:51.102206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:51.103752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:51.107508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:51.113605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:51.123996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:51.125432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:51.206044 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-de2ff0ff-5a03-4606-9984-18a12601dca0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992661 Sep 18 01:22:51.207689 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2164/4292] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:22:51.216528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:51.219505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:51.229463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:51.230353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:51.231210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:51.232156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:51.232839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:51.233418 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:51.234789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:51.663873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.675546 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2d95cdcc-0474-4aac-8c8e-9bc2b6c2682d tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.466387 Sep 18 01:22:51.678976 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2165/4293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:51 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:51.697811 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.712617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:51.714339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:51.715234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.723468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.727843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e10f729f-1847-4124-82d8-b2c14fd6626c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 0.689471 Sep 18 01:22:51.728560 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2129/4294] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:51 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:51.747481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:51.756637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3297440-c2b6-4f82-ae64-2a57ff0a6f24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:51.757270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3297440-c2b6-4f82-ae64-2a57ff0a6f24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:51.758359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:51.758814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:51.759556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:51.760014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:51.760437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:51.932449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3297440-c2b6-4f82-ae64-2a57ff0a6f24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:51.941613 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3297440-c2b6-4f82-ae64-2a57ff0a6f24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1215 microversion: 2.1 time: 0.197594 Sep 18 01:22:51.966031 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2130/4295] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:51 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:52.023846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:52.033388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:52.059328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:52.063333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:52.064327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:52.072452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:52.072908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:52.074504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:52.721413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:52.733044 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9dca984a-d1d7-4bdc-a427-e785cdff9280 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.052696 Sep 18 01:22:52.735894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2166/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:51 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:52.751639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:52.757506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:52.775430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:52.782025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:52.787600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:52.789861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:52.791734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:52.792901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:52.794823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:52.797374 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2048292-7b6d-4c07-935c-b3c3d2bfc8ae tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.826925 Sep 18 01:22:52.812525 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2131/4297] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:51 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:52.829316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:52.830063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:52.856406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:52.856924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:52.857376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:52.858147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:52.859145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:52.866576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:53.160107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.172143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.181764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.183218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01452204-1e55-4726-9a0c-40ebfcbb59de tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.446048 Sep 18 01:22:53.184144 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2167/4298] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:52 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:53.188924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87b48668-ab39-41a1-a4e7-72e5ad079164 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87b48668-ab39-41a1-a4e7-72e5ad079164 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: request: PUT /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb HTTP/1.1 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 24 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: {"server": {"name": ""}} Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb', 'body': {'server': {'name': ''}}} Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '' Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:22:53.199582 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 18 01:22:53.204896 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:22:53.206328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-87b48668-ab39-41a1-a4e7-72e5ad079164 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:22:53.212149 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-87b48668-ab39-41a1-a4e7-72e5ad079164 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "PUT /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 400 len: 108 microversion: 2.1 time: 0.026921 Sep 18 01:22:53.213460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2168/4299] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:22:53 2022] PUT /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:22:53.227759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:53.228491 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:53.234256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.243338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.244782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.246029 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a84b73a-85b9-42e7-894e-15c2cc138d61 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 0.432465 Sep 18 01:22:53.246605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2132/4300] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:52 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:53.271277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:53.271790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:53.272235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:53.277949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:53.278566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:53.280117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:53.281176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:53.281645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:53.293801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:53.294304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:53.294746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:53.298803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:53.299295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:53.299729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:53.407684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.417376 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a603675-6cfd-45c7-bb75-a5c58b437047 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1267 microversion: 2.1 time: 0.202520 Sep 18 01:22:53.437256 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2169/4301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:53 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:53.690062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:53.714772 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-579a6bb0-2bff-4064-8d93-b071e82d3628 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1505 microversion: 2.1 time: 0.440880 Sep 18 01:22:53.717984 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2133/4302] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:53 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:53.761566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:53.762644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:53.783707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:53.789857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:53.790490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:53.791529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:53.793619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:53.795122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:54.220726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:54.221696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:54.224969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:54.234104 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e0cc66a0-2914-4cf8-b300-b49a22e0dc7f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.476819 Sep 18 01:22:54.239777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:54.240653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:54.241328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:54.243108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:54.246107 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2170/4303] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:53 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:54.254291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:54.254974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:54.277223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:54.277957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:54.299438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:54.299951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:54.300403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:54.301133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:54.301628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:54.312657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:54.402323 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:22:54.909919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:54.920610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:54.926781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:54.929317 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b035d404-e0c7-4fbc-983c-3537e7890325 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1740 microversion: 2.20 time: 0.656885 Sep 18 01:22:54.947678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:54.951162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2171/4304] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:54 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1740 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:54.957569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:54.958636 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:54.965411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:54.966005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:54.966401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:54.967007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:54.968455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:54.968911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:54.969335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:54.975021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:54.978528 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-975ff2b5-fbfa-4eec-b9d6-fcc9494bfba9 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.764053 Sep 18 01:22:54.980452 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2134/4305] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:54 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:22:55.133670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:55.148095 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1273 microversion: 2.1 time: 0.195439 Sep 18 01:22:55.151461 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2172/4306] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:54 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:55.262183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:55.263157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:55.285516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:55.286363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:55.286872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:55.288546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:55.289081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:55.289519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:55.669746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:55.671854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:55.675076 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-240adb38-27e4-495d-80e5-42d1dfa3a0b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001937 Sep 18 01:22:55.676034 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2173/4307] 10.222.0.25 () {56 vars in 886 bytes} [Sun Sep 18 01:22:55 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 18 01:22:55.682328 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-37054d0b-be7d-4baa-afa2-8824e79876d4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.425677 Sep 18 01:22:55.699880 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2135/4308] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:55 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:55.963522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:55.965465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:55.982160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:55.984791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:55.985571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:55.988879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:55.989587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:55.992772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:56.011965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:56.012517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:56.033921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:56.034422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:56.034862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:56.042998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:56.043507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:56.058275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:56.601731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:56.648629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:56.664165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:56.667732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50213a0b-e24e-499b-ad2a-570920ec1e21 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1722 microversion: 2.20 time: 0.712707 Sep 18 01:22:56.670099 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2174/4309] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:55 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1722 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:56.689830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:56.701968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:56.725544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:56.727123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:56.729904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:56.731540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:56.736465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:56.737572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:56.783649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:56.793813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:56.795268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:56.796995 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c032af99-3285-4775-aaa2-84243cea7f5d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.790581 Sep 18 01:22:56.797590 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2136/4310] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:56 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:22:56.818065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:56.819177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:56.831315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:56.833055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:56.839024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:56.840637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:56.841453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:56.842070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:56.928475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:56.946638 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-25df7603-ef0e-4b48-b59c-3b515d89f2fa tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1273 microversion: 2.1 time: 0.266701 Sep 18 01:22:56.965777 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2175/4311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:56 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:57.203212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:57.216243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61340b85-ab9f-4475-a941-ef9c0c1a921b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.407390 Sep 18 01:22:57.240826 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2137/4312] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:56 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:57.724270 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:57.725329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:57.747500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:57.748225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:57.748836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:57.756140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:57.758431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:57.760587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:57.829374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:57.830043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:57.840821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:57.841321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:57.848707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:57.853407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:57.853941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:57.857466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:58.515470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:58.542564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:58.549497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:58.552310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd5268ec-dbe1-453d-8f73-e19a8547be28 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1722 microversion: 2.20 time: 0.833133 Sep 18 01:22:58.557970 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2176/4313] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:57 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1722 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:22:58.561780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:58.573063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:58.574796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:58.576041 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-406b6672-5c2e-4e47-b667-aef1a39ad187 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.751660 Sep 18 01:22:58.578895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:58.584069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:58.602756 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2138/4314] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:57 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:22:58.605106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:58.608267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:58.611900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:58.617199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:58.618455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:58.622394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:58.633745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:58.634497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:58.650439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:58.651383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:58.653387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:58.654507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:58.655841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:58.656495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:59.354706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:59.377443 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-16b63940-1019-491a-be95-e8fb99b5e9fe tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.772899 Sep 18 01:22:59.397935 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2139/4315] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:58 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:59.417067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:59.419549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:59.441930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:59.442430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:59.446397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:59.447149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:59.447709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:59.448049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:59.549886 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ad43e93-847d-45a3-adf6-5d4823ea1636 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150716 Sep 18 01:22:59.557863 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2140/4316] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:22:59 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:22:59.606931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:59.607550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:59.615034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:59.615526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:59.615967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:59.616675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:59.617135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:59.617572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:59.854913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:22:59.910922 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1e38499-51a7-4fed-8bb0-6cd5a6bd7d06 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1315 microversion: 2.1 time: 1.351273 Sep 18 01:22:59.911610 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2177/4317] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:22:58 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1315 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:22:59.937486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:22:59.941085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:22:59.960905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:59.964813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:59.969040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:22:59.973357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:22:59.973983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:22:59.975852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:00.180661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:00.192374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:00.203755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:00.205320 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5099e78d-9a75-48a4-b6cd-75aeb5350b06 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1725 microversion: 2.20 time: 0.603400 Sep 18 01:23:00.218910 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2141/4318] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:59 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1725 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:00.232753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:00.241385 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:00.253599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:00.255824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:00.258080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:00.259010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:00.261772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:00.262441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:00.333403 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75097afd-dc11-4516-9c4a-cd04e0399ce5 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113094 Sep 18 01:23:00.334585 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2142/4319] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:23:00 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:23:00.346867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eb0327e-f898-4d2a-90d2-b169a36d73e3"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:00.349566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:00.367105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:00.368391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:00.369304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:00.370928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:00.371690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:00.372325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:00.623180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:00.656764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:00.658797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:00.663041 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3fb426ac-4e1d-4c13-8441-babe076d8240 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.749369 Sep 18 01:23:00.686977 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2178/4320] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:22:59 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:00.707662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:00.722101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:00.742546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:00.743043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:00.760089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:00.761345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:00.762095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:00.762709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:00.936959 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:01.011056 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:01.094797 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-014ac1bd-2fd1-426e-86df-f9ffd1004ea1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.757955 Sep 18 01:23:01.102162 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2143/4321] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Sep 18 01:23:00 2022] POST /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-volume_attachments => generated 188 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:23:01.125782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:01.126461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:01.139093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:01.161471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:01.161948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:01.162712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:01.163180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:01.163612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:01.190758 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:01.275493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:23:01.521299 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff45520b-b5c8-439a-b8bd-54e0d6e47bb3 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 204 len: 0 microversion: 2.1 time: 0.413988 Sep 18 01:23:01.523021 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2144/4322] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:23:01 2022] DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:23:01.534185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1ee597d2-fa54-4d37-bc12-e366d1146a0e req-b38017e1-47e0-45d9-936e-f7f81d73c167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6453f292-44d8-48e4-881a-10a4c29cf384", "tag": "bfb94a07-ef40-4dc0-9b1d-711c880f6915"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:01.558579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1ee597d2-fa54-4d37-bc12-e366d1146a0e req-b38017e1-47e0-45d9-936e-f7f81d73c167 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:01.560316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1ee597d2-fa54-4d37-bc12-e366d1146a0e req-b38017e1-47e0-45d9-936e-f7f81d73c167 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:01.563111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1ee597d2-fa54-4d37-bc12-e366d1146a0e req-b38017e1-47e0-45d9-936e-f7f81d73c167 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:01.597885 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1ee597d2-fa54-4d37-bc12-e366d1146a0e req-b38017e1-47e0-45d9-936e-f7f81d73c167 service nova] Creating event network-changed:bfb94a07-ef40-4dc0-9b1d-711c880f6915 for instance 6453f292-44d8-48e4-881a-10a4c29cf384 on n-h1-master-1 Sep 18 01:23:01.613458 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1ee597d2-fa54-4d37-bc12-e366d1146a0e req-b38017e1-47e0-45d9-936e-f7f81d73c167 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088751 Sep 18 01:23:01.614123 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2145/4323] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:01.619666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:01.620378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:01.635636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:01.636140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:01.636582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:01.637308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:01.637804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:01.638233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:01.669232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:01.686327 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3bed4430-9398-417e-a0c0-0982a2694a61 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.995400 Sep 18 01:23:01.686948 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2179/4324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:00 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:01.701127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:01.701515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:01.713935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:01.714571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:01.715020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:01.716011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:01.717038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:01.719173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:01.944284 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:02.151672 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4daa4019-ce85-42af-9454-433ebaff88a9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-volume_attachments/6eb0327e-f898-4d2a-90d2-b169a36d73e3" status: 202 len: 0 microversion: 2.20 time: 0.463605 Sep 18 01:23:02.153040 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2180/4325] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Sep 18 01:23:01 2022] DELETE /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-volume_attachments/6eb0327e-f898-4d2a-90d2-b169a36d73e3 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:23:02.188043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:02.188364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:02.218408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:02.219211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:02.219883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:02.220827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:02.221486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:02.222155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:02.253039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:02.262424 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4f7d7004-77ac-4db6-996e-04831c72213b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1315 microversion: 2.1 time: 0.646935 Sep 18 01:23:02.266459 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2146/4326] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:01 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:02.272819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:02.277808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:02.285755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:02.286493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:02.287101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:02.287971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:02.288569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:02.289328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:03.339015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:03.353064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21694e92-d31d-4c54-a30d-3505b34e9566 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1672 microversion: 2.1 time: 1.198490 Sep 18 01:23:03.353735 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2181/4327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:02 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1672 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:03.364562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-2e885fb9-93a3-44d1-9b22-ddcd50179ea5 req-ff4f36c9-e28d-44f4-97bc-6770b70bb0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-plugged", "status": "completed", "tag": "e1294bdc-7b69-46bd-a170-84a4cbbd005e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:03.384529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2e885fb9-93a3-44d1-9b22-ddcd50179ea5 req-ff4f36c9-e28d-44f4-97bc-6770b70bb0bc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:03.385008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2e885fb9-93a3-44d1-9b22-ddcd50179ea5 req-ff4f36c9-e28d-44f4-97bc-6770b70bb0bc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:03.385440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2e885fb9-93a3-44d1-9b22-ddcd50179ea5 req-ff4f36c9-e28d-44f4-97bc-6770b70bb0bc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:03.422935 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-2e885fb9-93a3-44d1-9b22-ddcd50179ea5 req-ff4f36c9-e28d-44f4-97bc-6770b70bb0bc service nova] Creating event network-vif-plugged:e1294bdc-7b69-46bd-a170-84a4cbbd005e for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:03.441007 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-2e885fb9-93a3-44d1-9b22-ddcd50179ea5 req-ff4f36c9-e28d-44f4-97bc-6770b70bb0bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085645 Sep 18 01:23:03.444288 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2182/4328] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:03.452931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:03.454000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:03.463743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:03.464896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:03.466132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:03.467146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:03.467878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:03.468448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:03.543217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:03.559562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:03.563888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:03.567116 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69bd2a32-c6dd-435d-b60b-961217c220f6 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.297610 Sep 18 01:23:03.583349 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2147/4329] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:02 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:03.588661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:03.589281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:03.613225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:03.615330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:03.616961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:03.618166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:03.620350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:03.621836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:03.704633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122374) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 01:23:04.019165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dfde1167-429d-4260-b7db-0b8cdc85563a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "POST /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/action" status: 202 len: 0 microversion: 2.20 time: 0.572081 Sep 18 01:23:04.020738 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2183/4330] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:23:03 2022] POST /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:23:04.040160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:04.051343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:04.081185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:04.082573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:04.083610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:04.085032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:04.086126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:04.086888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:04.190372 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 HTTP/1.1 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '83ed2e44-0f5a-4d0d-9870-2911d2dfaa88'} Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:04.193128 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:04.201337 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:04.214380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:04.218558 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e98e6e4-cdb9-43d6-8382-bd8bafb86808 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "DELETE /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 404 len: 111 microversion: 2.1 time: 0.191110 Sep 18 01:23:04.219448 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2184/4331] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:23:04 2022] DELETE /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:04.228117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:04.253865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:04.255311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:04.261850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-549514ac-06d0-499c-a180-5086db06694d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.673954 Sep 18 01:23:04.265213 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2148/4332] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:03 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:04.283557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:04.291787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:04.316554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:04.319461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:04.321312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:04.322500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:04.323651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:04.332075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:04.332382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:04.335406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:04.337584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:04.338382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:04.339575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:04.347289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:05.998625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:06.028808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:06.029438 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-69758977-eb99-45af-ab8a-00a105022c26 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1315 microversion: 2.1 time: 1.800534 Sep 18 01:23:06.037993 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2185/4333] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:04 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1315 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:06.048900 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:06.052720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:06.054350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:06.055672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5c23bc0-6293-4bb6-8c7b-f916a135cef9 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1673 microversion: 2.20 time: 1.788607 Sep 18 01:23:06.056278 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2149/4334] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:04 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1673 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:06.074289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:06.081810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:06.082453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:06.096980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.103579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.104083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:06.104901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.106014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.106319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.106470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:06.106852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.107319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:06.108142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.108632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.109191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:06.161409 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 HTTP/1.1 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '83ed2e44-0f5a-4d0d-9870-2911d2dfaa88'} Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:06.170824 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:06.175868 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:06.175868 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:06.175868 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:06.175868 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:06.175868 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:06.175868 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. Sep 18 01:23:06.175868 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:06.177946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:06.189813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2ddcd51-ea87-42f7-b502-5b5d4512cc62 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88" status: 404 len: 111 microversion: 2.1 time: 0.150240 Sep 18 01:23:06.191553 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2186/4335] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:06 2022] GET /compute/v2.1/servers/83ed2e44-0f5a-4d0d-9870-2911d2dfaa88 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:06.207154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:06.218073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:06.252833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.257031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.261162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:06.267750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.275636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.279688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:06.348233 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:06.438747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:06.477253 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-35082c68-999a-4e21-94e0-5e0010a7aa06 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1604 microversion: 2.1 time: 0.414549 Sep 18 01:23:06.498718 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2150/4336] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:06 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1604 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:06.514984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:06.516257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:06.535437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.537225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.538026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:06.539047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:06.539761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:06.540559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.121139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:07.128581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:07.140985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:07.148519 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e0ca98d-0e45-449f-bc26-46d53a4268dc tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.647587 Sep 18 01:23:07.152855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:07.154472 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88934a49-3e95-4e44-86a6-4c1dbf7a51d0 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.959773 Sep 18 01:23:07.157326 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2187/4337] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:06 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:07.162842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551fce-fc60-40fe-aa37-d96f5af28e0c", "name": "network-vif-unplugged", "status": "completed", "tag": "00b945c1-f1c2-4b42-8058-fe512412ca56"}, {"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-plugged", "status": "completed", "tag": "1e42e3f5-ed85-419a-a645-24442370ad64"}, {"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-plugged", "status": "completed", "tag": "21aaa75b-4e49-4512-a81f-a1352471c4d4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:07.171401 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2151/4338] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:06 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:07.187088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.187894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:07.188407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:07.191963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.193023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.204865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.205373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.205850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.206593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.207138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.207534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.219094 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] Creating event network-vif-unplugged:00b945c1-f1c2-4b42-8058-fe512412ca56 for instance b5551fce-fc60-40fe-aa37-d96f5af28e0c on n-h1-master-1 Sep 18 01:23:07.220065 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] Creating event network-vif-plugged:1e42e3f5-ed85-419a-a645-24442370ad64 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:07.221728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] Creating event network-vif-plugged:21aaa75b-4e49-4512-a81f-a1352471c4d4 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:07.241382 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0ae1b492-9ef5-4952-aa42-098fe5a64bf6 req-e1deb8e1-16da-42ce-abbc-cb9b8b267ae4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.082392 Sep 18 01:23:07.243797 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2188/4339] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:07.251005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:07.252306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:07.261072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.262127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.263135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.264590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.265467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.266297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.299662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:23:07.551459 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c9004fd-e55b-46cd-a013-14cdc9b24e54 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "DELETE /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 204 len: 0 microversion: 2.1 time: 0.378199 Sep 18 01:23:07.552086 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2152/4340] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:23:07 2022] DELETE /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:23:07.572893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:07.575836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:07.582208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:07.585956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.586810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.587368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.589318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.590682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.591570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.600255 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d1b7806-adfc-470b-92d3-ae534238a9c7 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1315 microversion: 2.1 time: 0.354348 Sep 18 01:23:07.601487 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2189/4341] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:07 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:07.608780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-34c6cf98-24df-462f-8fe2-69389c0bfb43 req-046521b8-0afc-4baa-a548-73bacd16db09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc80631-d479-465c-b42f-e5d86bc3883b", "name": "network-vif-deleted", "tag": "a8182fc4-91e4-431d-bc7e-5c023570e6dc"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:07.621384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34c6cf98-24df-462f-8fe2-69389c0bfb43 req-046521b8-0afc-4baa-a548-73bacd16db09 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.622307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34c6cf98-24df-462f-8fe2-69389c0bfb43 req-046521b8-0afc-4baa-a548-73bacd16db09 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.622918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34c6cf98-24df-462f-8fe2-69389c0bfb43 req-046521b8-0afc-4baa-a548-73bacd16db09 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.650174 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-34c6cf98-24df-462f-8fe2-69389c0bfb43 req-046521b8-0afc-4baa-a548-73bacd16db09 service nova] Creating event network-vif-deleted:a8182fc4-91e4-431d-bc7e-5c023570e6dc for instance dbc80631-d479-465c-b42f-e5d86bc3883b on n-h2-master-1 Sep 18 01:23:07.667564 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-34c6cf98-24df-462f-8fe2-69389c0bfb43 req-046521b8-0afc-4baa-a548-73bacd16db09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063268 Sep 18 01:23:07.668516 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2190/4342] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:07.688105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:07.689307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:07.699730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.700438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.701049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.702067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.702940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.703991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.784574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.786378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:07.791366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:07.792668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lazy-loading 'fault' on Instance uuid dbc80631-d479-465c-b42f-e5d86bc3883b {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:23:07.947635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:07.970646 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b7ecb96-7b23-41f1-bc79-f17f7f2d6375 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1326 microversion: 2.1 time: 0.298412 Sep 18 01:23:07.972683 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2191/4343] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:07 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1326 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:07.978347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:07.979251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:07.998099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:07.999506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:08.000161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:08.001764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:08.002524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:08.003168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:08.070391 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:08.080623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:08.087080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:08.093283 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f82dd303-d61a-4e9c-9856-cfe86e506ca5 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 0.536277 Sep 18 01:23:08.096459 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2153/4344] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:07 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:08.182042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:08.183384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:08.195412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:08.201253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:08.202240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:08.203253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:08.204054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:08.204731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:08.701035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:08.711106 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c79b7db-fa34-4601-8aec-4cf77120f98b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.534422 Sep 18 01:23:08.730646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2154/4345] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:08 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:08.738140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:08.739002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:08.745955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:08.746744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:08.747381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:08.748267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:08.748946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:08.749590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.089747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:09.102970 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba8c3860-00ed-4a9a-9d50-925b8d150e77 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 1.124653 Sep 18 01:23:09.105889 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2192/4346] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:07 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:09.113024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:09.126467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:09.137427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.137953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.138387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.147439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.147544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.147992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.458777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:09.470041 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-526cf2e6-9956-4f2a-bb86-ab87a7f7fd70 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1315 microversion: 2.1 time: 0.362855 Sep 18 01:23:09.470633 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2193/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:09 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:09.477897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:09.502288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:09.502912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:09.504330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:09.509936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:09.511631 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-296dcab7-b6ec-45fa-8f9a-25d037028029 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 0.779637 Sep 18 01:23:09.512223 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2155/4348] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:08 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:09.517846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.522228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.523719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.525510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:09.526539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.527221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.528091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:09.528698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.540171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.543517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.544829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.547727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.548952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.558958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.644182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.644976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.650664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.651221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lazy-loading 'fault' on Instance uuid dbc80631-d479-465c-b42f-e5d86bc3883b {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:23:09.816429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7d6ca88464aa29691e7ddfa5e5897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb6afe234e1433eabf8eee5c780c799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:09.829018 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5dc61236-2e7e-4f2a-915e-3c7078186961 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 200 len: 1326 microversion: 2.1 time: 0.339564 Sep 18 01:23:09.842123 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2194/4349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:09 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 1326 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:09.842123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a49ddec9-eb7d-4599-80f5-397138a89f58 req-e9ef75a1-3cb1-4eb4-bc6c-7954a82a3350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-plugged", "status": "completed", "tag": "08b14aba-a44c-4681-97f9-cbd1abf709fa"}, {"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-plugged", "status": "completed", "tag": "220001de-0a05-4cc5-b9ea-25a518baeb59"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:09.873212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a49ddec9-eb7d-4599-80f5-397138a89f58 req-e9ef75a1-3cb1-4eb4-bc6c-7954a82a3350 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.873868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a49ddec9-eb7d-4599-80f5-397138a89f58 req-e9ef75a1-3cb1-4eb4-bc6c-7954a82a3350 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.874541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a49ddec9-eb7d-4599-80f5-397138a89f58 req-e9ef75a1-3cb1-4eb4-bc6c-7954a82a3350 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.907463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a49ddec9-eb7d-4599-80f5-397138a89f58 req-e9ef75a1-3cb1-4eb4-bc6c-7954a82a3350 service nova] Creating event network-vif-plugged:08b14aba-a44c-4681-97f9-cbd1abf709fa for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:09.908030 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a49ddec9-eb7d-4599-80f5-397138a89f58 req-e9ef75a1-3cb1-4eb4-bc6c-7954a82a3350 service nova] Creating event network-vif-plugged:220001de-0a05-4cc5-b9ea-25a518baeb59 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:09.923341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a49ddec9-eb7d-4599-80f5-397138a89f58 req-e9ef75a1-3cb1-4eb4-bc6c-7954a82a3350 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091923 Sep 18 01:23:09.924090 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2195/4350] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:09.960826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:09.962046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:09.982172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.982677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:09.994169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:09.998787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:09.999384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:10.015432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:10.073729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:10.089640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:10.093339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:10.109296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4db63b4c-e5bf-4f15-bcff-d4e9f16f576a tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 0.589941 Sep 18 01:23:10.109983 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2156/4351] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:09 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:10.138807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:10.142410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:10.159989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:10.161728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:10.163125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:10.164821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:10.169220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:10.172220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:10.570693 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:10.588681 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd5f121c-75f9-4a2c-a9e5-90624e9b4217 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.654275 Sep 18 01:23:10.615365 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2196/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:09 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:10.638951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:10.642933 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:10.664121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:10.669030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:10.669966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:10.674104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:10.678062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:10.678917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:10.680277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:10.690309 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0583e54f-0041-434d-89e2-4d8c1c819fe6 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1511 microversion: 2.1 time: 0.556362 Sep 18 01:23:10.690903 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2157/4353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:10 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:10.714405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:10.715140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:10.731286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:10.735321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:10.735981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:10.737069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:10.737715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:10.739869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:10.753810 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:11.640124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:11.649014 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0c17864c-5483-4459-9db6-0de8de09bdd9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1315 microversion: 2.1 time: 1.029162 Sep 18 01:23:11.650129 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2197/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:10 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:11.655459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:11.667728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:11.690339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:11.691694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:11.692364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:11.693792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:11.694508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:11.695168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:11.727037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] HTTP exception thrown: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Request method failure captured: Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b HTTP/1.1 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnFf-aKM8SDXQnsyfN7fEvcVV7gYN_KaH7wDHW6jTcXlonOBCj45Xzi7kLkO5oVrzy8uK7Zv0mInk1ZOIsAfu5luFIS52ZWZWLr8FY9M82PtbbNUEuFh3Ce3fQzPFbXgE3NkD3ldRJWRqrI_tyAtPdOSvoG3axbOhPBsffcADOSkIIg Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 29c7d6ca88464aa29691e7ddfa5e5897 Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: exception: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'dbc80631-d479-465c-b42f-e5d86bc3883b'} Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:11.742260 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:11.746518 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:11.746518 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:11.746518 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:11.746518 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:11.746518 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:11.746518 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:11.746518 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:11.748866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Returning 404 to user: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:11.750105 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d40ddcb-c542-4c45-a5b6-ad0c8861c362 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 404 len: 111 microversion: 2.1 time: 0.098699 Sep 18 01:23:11.751250 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2198/4355] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:11 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:11.758297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:11.766343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:11.770179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:11.781411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:11.782290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:11.782950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:11.785671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:11.786425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:11.787469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:11.791442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:11.801320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:11.805184 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-62507215-81ea-4b9f-b6f0-f688cf6303a5 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.104047 Sep 18 01:23:11.807476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2158/4356] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:10 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:11.822911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:11.823539 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:11.850943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:11.851454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:11.852038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:11.852768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:11.853231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:11.856014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:13.413095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:13.428766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:13.433672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:13.435258 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0f7bc7d8-5282-4a6d-ab0c-2ddd9af52974 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 1.682727 Sep 18 01:23:13.437639 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2199/4357] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:11 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:13.449361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:13.455036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:13.463267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:13.467693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:13.468512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:13.469188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:13.472550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:13.473016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15eda586-171b-4ab7-ace0-5030169d31b1 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 1.663274 Sep 18 01:23:13.473643 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2159/4358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:11 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:13.487246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:13.487986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:13.496638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc0e4216-15f4-4f2a-9e4a-1def71657984 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '.version_select at 0x7f700539c4c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:13.507348 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc0e4216-15f4-4f2a-9e4a-1def71657984 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [292fe416-926f-427d-95a6-8883ad845304] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 01:23:13.696570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b90a04b7e9e424e93f3642f1b8f48b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4436dd8d4d8e4a1d8c0e1948b7d767bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:13.720741 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a6cc801-3bde-4f6c-88f4-7466cac39c38 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 200 len: 1469 microversion: 2.1 time: 0.272622 Sep 18 01:23:13.746229 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2200/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:13 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:13.763308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-plugged", "status": "completed", "tag": "745d6228-c772-4a5f-b7a4-1a5cea379f6c"}, {"server_uuid": "6453f292-44d8-48e4-881a-10a4c29cf384", "name": "network-vif-plugged", "status": "completed", "tag": "bfb94a07-ef40-4dc0-9b1d-711c880f6915"}, {"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-plugged", "status": "completed", "tag": "aa06682e-2b23-41ed-a2d7-e5c411718453"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:13.789239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:13.789743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:13.790172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:13.850750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] Creating event network-vif-plugged:745d6228-c772-4a5f-b7a4-1a5cea379f6c for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:13.854658 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] Creating event network-vif-plugged:bfb94a07-ef40-4dc0-9b1d-711c880f6915 for instance 6453f292-44d8-48e4-881a-10a4c29cf384 on n-h1-master-1 Sep 18 01:23:13.855295 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] Creating event network-vif-plugged:aa06682e-2b23-41ed-a2d7-e5c411718453 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:13.895469 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a78e252e-dea6-464b-890d-1dd2975218c1 req-14babf41-8328-4c5a-b96c-525f2d4b791b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.147506 Sep 18 01:23:13.902024 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2201/4360] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:13.922193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:13.923164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:13.943916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:13.952758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:13.953593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:13.954588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:13.956719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:13.957368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:14.519584 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc0e4216-15f4-4f2a-9e4a-1def71657984 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [292fe416-926f-427d-95a6-8883ad845304] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55342. Sep 18 01:23:14.551887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:14.566949 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d8ecb25-ee63-47da-b0fa-c4336cf8de30 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1315 microversion: 2.1 time: 0.663120 Sep 18 01:23:14.574940 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc0e4216-15f4-4f2a-9e4a-1def71657984 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579697600" status: 202 len: 0 microversion: 2.1 time: 1.092127 Sep 18 01:23:14.578684 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2160/4361] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579697600 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:23:14.587331 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2202/4362] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:13 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:14.597299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:14.598582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e6106e0b-16aa-4f89-8b8f-9fd004de76e9 req-fabc5cc3-3d3b-4f71-a8bc-6d1723337ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057d513c-5711-41e5-9f2d-449b777ff7bb", "name": "network-vif-deleted", "tag": "61754220-27e3-4058-a935-ba4ce524fd38"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:14.598959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:14.627598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:14.630753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:14.632601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:14.634199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e6106e0b-16aa-4f89-8b8f-9fd004de76e9 req-fabc5cc3-3d3b-4f71-a8bc-6d1723337ee7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:14.635053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e6106e0b-16aa-4f89-8b8f-9fd004de76e9 req-fabc5cc3-3d3b-4f71-a8bc-6d1723337ee7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:14.635285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:14.635818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e6106e0b-16aa-4f89-8b8f-9fd004de76e9 req-fabc5cc3-3d3b-4f71-a8bc-6d1723337ee7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:14.637247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:14.638673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:14.662004 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e6106e0b-16aa-4f89-8b8f-9fd004de76e9 req-fabc5cc3-3d3b-4f71-a8bc-6d1723337ee7 service nova] Creating event network-vif-deleted:61754220-27e3-4058-a935-ba4ce524fd38 for instance 057d513c-5711-41e5-9f2d-449b777ff7bb on n-h2-master-1 Sep 18 01:23:14.678904 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e6106e0b-16aa-4f89-8b8f-9fd004de76e9 req-fabc5cc3-3d3b-4f71-a8bc-6d1723337ee7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090182 Sep 18 01:23:14.680040 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2203/4363] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:14.685494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:14.696661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:14.703789 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:14.705428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:14.705954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:14.706388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:14.707095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:14.707535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:14.707955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:15.700320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:15.726674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:15.732220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:15.734435 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a4a40fb-a859-464d-bd8a-00ae86c8a6ca tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 1.053076 Sep 18 01:23:15.741158 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2204/4364] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:14 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:15.746581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:15.749796 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:15.763418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:15.764367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:15.766343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:15.767322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:15.768832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:15.769462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:15.770533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:15.823514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:15.835320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:15.840996 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bbe27267-d62d-404a-83a3-41dab91297df tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1879 microversion: 2.32 time: 1.260360 Sep 18 01:23:15.845696 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2161/4365] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:14 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1879 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:16.367558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:16.369478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] [instance: 057d513c-5711-41e5-9f2d-449b777ff7bb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:16.380891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:16.385399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:16.386136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:16.389435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:16.391062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:16.398077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:16.403322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:16.434344 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a35b6a6a-309a-4dc7-8e61-49f31b290684 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 0.688675 Sep 18 01:23:16.440490 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2205/4366] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:15 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:16.456580 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] HTTP exception thrown: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb could not be found. Sep 18 01:23:16.464995 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:16.469449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Request method failure captured: Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb HTTP/1.1 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnHY3ZPxHJYWcb8lN_-B2gvMXw7LX1DGJXxU0Z3VQisIyL-NPs4Qh7cUWHGFxXnykf9pPu14XMAdbwcbnxYNcx564gFtOBThwW0AHHw4cJ-I8AIkTk7IV6m0LfCQyAo0igBK2k2yxT7B-yK0Xt_ftnrFXERqBMVmG86SjH6ALEo8cg8 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4436dd8d4d8e4a1d8c0e1948b7d767bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4436dd8d4d8e4a1d8c0e1948b7d767bd Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-813813728 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9b90a04b7e9e424e93f3642f1b8f48b1 Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-813813728-project Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb could not be found. Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '057d513c-5711-41e5-9f2d-449b777ff7bb'} Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb could not be found. Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb could not be found. Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:16.484401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:16.488423 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:16.488423 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:16.488423 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:16.488423 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:16.488423 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:16.488423 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb could not be found. Sep 18 01:23:16.488423 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:16.491792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] Returning 404 to user: Instance 057d513c-5711-41e5-9f2d-449b777ff7bb could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:16.500042 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a2b5b64-f9c8-4dfb-a97f-84fbf8e5f104 tempest-ServersNegativeTestJSON-813813728 tempest-ServersNegativeTestJSON-813813728-project] 10.222.0.25 "GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb" status: 404 len: 111 microversion: 2.1 time: 0.648674 Sep 18 01:23:16.503544 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2162/4367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:15 2022] GET /compute/v2.1/servers/057d513c-5711-41e5-9f2d-449b777ff7bb => generated 111 bytes in 657 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:16.522078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-plugged", "status": "completed", "tag": "22f9548d-cd1e-4c15-ad15-718266ac7541"}, {"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-plugged", "status": "completed", "tag": "6d5e19d4-f4d5-444a-be0c-845b81c55b7f"}, {"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-plugged", "status": "completed", "tag": "ac5579b6-da92-4d84-be97-2357c891b933"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:16.573893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:16.579870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:16.583506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:16.587545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:16.589494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:16.597016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:16.605334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:16.615752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:16.617256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:16.646646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] Creating event network-vif-plugged:22f9548d-cd1e-4c15-ad15-718266ac7541 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:16.647201 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] Creating event network-vif-plugged:6d5e19d4-f4d5-444a-be0c-845b81c55b7f for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:16.647648 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] Creating event network-vif-plugged:ac5579b6-da92-4d84-be97-2357c891b933 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:16.674548 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8cd8088b-2504-45be-aa79-78a2d919697c req-92bf57e7-3c1f-49eb-817d-c7da4569fb7f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.169147 Sep 18 01:23:16.683102 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2163/4368] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:16.778449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:16.782194 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:16.792236 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:16.829692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:16.830536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:16.833137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:16.838471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:16.839453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:16.840319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:17.920836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:17.930246 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee4e9889-4d71-4e5f-85ff-09679370bf71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1500 microversion: 2.1 time: 1.486251 Sep 18 01:23:17.962411 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2206/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:16 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1500 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:17.971497 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:23:17.972973 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:23:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 (ip 10.222.0.25) !!! Sep 18 01:23:17.978166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:17.990892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:18.004649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:18.005949 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-409df89a-2e79-4c7e-81d4-8f7049eab935 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 1.237127 Sep 18 01:23:18.010896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:18.012657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:18.025533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:18.030635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:18.031209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:18.032421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:18.032996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:18.034429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:18.037465 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2164/4370] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:16 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:23:18.068126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:18.071647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:18.124283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:18.125428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:18.128388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:18.131501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:18.140316 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:18.140659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:18.141377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:19.350572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:19.367120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:19.371600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:19.385125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e3f3dde1-b4a9-44c4-9c31-ddf816bb9c4c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2832 microversion: 2.32 time: 1.420746 Sep 18 01:23:19.390350 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2207/4371] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:17 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2832 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:19.409881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:19.410731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:19.431763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:19.448979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:19.450166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:19.451974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:19.457687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:19.459775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:19.631203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e491acb2-469f-4fbb-99eb-58fbec77a903 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384/action" status: 202 len: 0 microversion: 2.1 time: 0.237278 Sep 18 01:23:19.632276 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2208/4372] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:23:19 2022] POST /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:23:19.642954 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:19.645233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:19.661236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:19.663171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:19.666484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:19.667604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:19.668337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:19.669906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:20.812113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:20.829389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9b2e1021-fdd4-41f8-a491-2eb572abba8f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1354 microversion: 2.1 time: 2.790610 Sep 18 01:23:20.849766 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2165/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:18 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1354 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:20.861246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:20.862384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:20.873688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:20.875056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:20.876089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:20.877247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:20.878035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:20.878912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:20.985392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:20.997405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:21.000776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:21.002915 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a57514f6-3b0e-417e-962b-7bcc85b183b6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 1.369252 Sep 18 01:23:21.029300 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2209/4374] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:19 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:21.038309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:21.040082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:21.056882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:21.060305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:21.061817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:21.063983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:21.067069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:21.069767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:21.314124 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f37f548e-5244-4286-a3cb-0cb315d74387 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.458761 Sep 18 01:23:21.315246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2166/4375] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 18 01:23:20 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74/os-interface => generated 1831 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:21.881947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:21.882707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:21.906253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:21.910675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:21.911879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:21.915097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:21.916877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:21.918945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:22.597104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:22.606118 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-675deccf-f522-4f8d-b1ab-c475f2b13216 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1485 microversion: 2.1 time: 1.573157 Sep 18 01:23:22.612003 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2210/4376] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:21 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1485 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:22.627892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:22.630871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:22.659534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:22.661513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:22.664328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:22.669173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:22.670203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:22.672726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:23.040846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:23.132563 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a2798467-ad6e-445a-a009-d3d496a74930 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1804 microversion: 2.1 time: 1.264757 Sep 18 01:23:23.147808 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2167/4377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:21 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1804 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:23.203827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:23.205710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:23.247512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:23.254569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:23.255897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:23.259576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:23.266484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:23.271635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:23.349431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lazy-loading 'flavor' on Instance uuid 6453f292-44d8-48e4-881a-10a4c29cf384 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:23:23.445418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:23.481676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:23.491694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:23.495022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5371fd83-1691-4d9d-859a-b31cb8711bc3 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 0.881433 Sep 18 01:23:23.503573 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2211/4378] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:22 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:23.524315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:23.535549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:23.566458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:23.571492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:23.574154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:23.577572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:23.579467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:23.582360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:23.761970 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-22157497-c865-487c-9897-f1812d44d80d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974/ips" status: 200 len: 218 microversion: 2.1 time: 0.253054 Sep 18 01:23:23.770874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2212/4379] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:23:23 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974/ips => generated 218 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:23.800332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:23.802249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:23.824834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:23.826187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:23.827375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:23.829438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:23.831898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:23.832942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:23.961226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:23:24.032268 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d404602a-701c-4a1c-bb11-43a01d1ac1ea tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384/action" status: 202 len: 0 microversion: 2.1 time: 0.881064 Sep 18 01:23:24.039891 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2168/4380] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:23:23 2022] POST /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:23:24.080191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:24.088687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:24.176876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:24.188926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:24.191595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:24.200231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:24.201946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:24.203418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:24.355638 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56ab6886-2906-4955-9628-7f79ba4d0064 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 204 len: 0 microversion: 2.1 time: 0.566212 Sep 18 01:23:24.362466 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2213/4381] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:23:23 2022] DELETE /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:23:24.412212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:24.415304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:24.451996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:24.454665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:24.462658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:24.468235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:24.470812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:24.477344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:25.626125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:25.646719 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-083d1c19-87d9-49dc-99e1-5a1c643605db tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1491 microversion: 2.1 time: 1.602440 Sep 18 01:23:25.652058 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2169/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:24 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1491 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:25.657429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:25.659037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:25.675241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:25.695516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:25.696504 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc13729a-769d-4b10-ad65-45752893af2f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1810 microversion: 2.1 time: 1.323730 Sep 18 01:23:25.698346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:25.698573 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2214/4383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:24 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1810 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:25.710186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-87ec321b-afa4-4578-9226-b9f2c031eba6 req-f05b5128-c06a-4def-96e3-3ebe15d483c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "tag": "08b14aba-a44c-4681-97f9-cbd1abf709fa"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:25.718412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:25.719520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:25.720276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:25.720957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:25.741536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-87ec321b-afa4-4578-9226-b9f2c031eba6 req-f05b5128-c06a-4def-96e3-3ebe15d483c3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:25.745175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-87ec321b-afa4-4578-9226-b9f2c031eba6 req-f05b5128-c06a-4def-96e3-3ebe15d483c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:25.746162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-87ec321b-afa4-4578-9226-b9f2c031eba6 req-f05b5128-c06a-4def-96e3-3ebe15d483c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:25.786060 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-87ec321b-afa4-4578-9226-b9f2c031eba6 req-f05b5128-c06a-4def-96e3-3ebe15d483c3 service nova] Creating event network-changed:08b14aba-a44c-4681-97f9-cbd1abf709fa for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:23:25.828350 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-87ec321b-afa4-4578-9226-b9f2c031eba6 req-f05b5128-c06a-4def-96e3-3ebe15d483c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127362 Sep 18 01:23:25.829647 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2215/4384] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:26.233094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:26.256660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:26.256660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:26.257181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2c4f7e03-4699-420b-a4f9-b323e7f1763e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 0.603702 Sep 18 01:23:26.258051 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2170/4385] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:25 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:26.702135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:26.708619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:26.746838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:26.747907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:26.780236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:26.785690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:26.786537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:26.789197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:26.799727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:26.800773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:26.804298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:26.811536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:26.815085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:26.816444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:26.817255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:26.818031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:28.996389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:29.011256 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-86874d6f-c6ad-4f12-833f-7ce68dcaacdb tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1512 microversion: 2.1 time: 2.317293 Sep 18 01:23:29.014485 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2216/4386] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:26 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1512 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:29.026755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:29.030511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:29.053235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:29.053788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:29.054240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:29.055024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:29.066874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:29.067117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:29.492695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:29.503636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-14c076f6-adfa-46d6-b9eb-cc2c61ca338f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1810 microversion: 2.1 time: 2.761590 Sep 18 01:23:29.522111 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2171/4387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:26 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1810 bytes in 2780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:23:29.990668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-699981cd-c7dd-4680-953e-75c89dbee5b2 req-a6f9432a-d8f7-433a-ab20-5ae484b67701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6453f292-44d8-48e4-881a-10a4c29cf384", "name": "network-vif-plugged", "status": "completed", "tag": "bfb94a07-ef40-4dc0-9b1d-711c880f6915"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:30.066184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-699981cd-c7dd-4680-953e-75c89dbee5b2 req-a6f9432a-d8f7-433a-ab20-5ae484b67701 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:30.070292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-699981cd-c7dd-4680-953e-75c89dbee5b2 req-a6f9432a-d8f7-433a-ab20-5ae484b67701 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:30.071655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-699981cd-c7dd-4680-953e-75c89dbee5b2 req-a6f9432a-d8f7-433a-ab20-5ae484b67701 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:30.132457 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-699981cd-c7dd-4680-953e-75c89dbee5b2 req-a6f9432a-d8f7-433a-ab20-5ae484b67701 service nova] Creating event network-vif-plugged:bfb94a07-ef40-4dc0-9b1d-711c880f6915 for instance 6453f292-44d8-48e4-881a-10a4c29cf384 on n-h1-master-1 Sep 18 01:23:30.143212 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-699981cd-c7dd-4680-953e-75c89dbee5b2 req-a6f9432a-d8f7-433a-ab20-5ae484b67701 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157220 Sep 18 01:23:30.146539 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2172/4388] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:23:30.169177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:30.172040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:30.205294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:30.205837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:30.206289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:30.207175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:30.207462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:30.218825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:30.628374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:30.640698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:30.652931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:30.657691 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dca0349d-b0cf-4ab6-a6b1-d073cc871825 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 1.640680 Sep 18 01:23:30.676050 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2217/4389] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:29 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:30.703034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ca624ebe-81db-4f27-8f94-2a604c84aec7 req-7071765e-b812-4f66-bdbd-122a3fce0e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-deleted", "tag": "6d5e19d4-f4d5-444a-be0c-845b81c55b7f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:30.736996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ca624ebe-81db-4f27-8f94-2a604c84aec7 req-7071765e-b812-4f66-bdbd-122a3fce0e7e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:30.737506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ca624ebe-81db-4f27-8f94-2a604c84aec7 req-7071765e-b812-4f66-bdbd-122a3fce0e7e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:30.742193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ca624ebe-81db-4f27-8f94-2a604c84aec7 req-7071765e-b812-4f66-bdbd-122a3fce0e7e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:30.768392 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ca624ebe-81db-4f27-8f94-2a604c84aec7 req-7071765e-b812-4f66-bdbd-122a3fce0e7e service nova] Creating event network-vif-deleted:6d5e19d4-f4d5-444a-be0c-845b81c55b7f for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:30.796232 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ca624ebe-81db-4f27-8f94-2a604c84aec7 req-7071765e-b812-4f66-bdbd-122a3fce0e7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108426 Sep 18 01:23:30.807530 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2218/4390] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:30.831171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:30.835822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:30.854101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:30.854619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:30.859579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:30.860454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:30.860960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:30.861415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:32.291879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:32.312204 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d43c0a1-f3de-4c2c-b91f-ee97e6c0d23d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1630 microversion: 2.1 time: 1.499789 Sep 18 01:23:32.313436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2219/4391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:30 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1630 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:32.324031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:32.325439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:32.339250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:32.341192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:32.342053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:32.347622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:32.348587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:32.349211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:32.484814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:32.505501 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-73c680a8-409d-4b3d-8081-a5ad8c788584 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 2.356850 Sep 18 01:23:32.507001 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2173/4392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:30 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:32.512235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-865e79ed-e381-4fff-8ea9-2b825d58510e req-bccb3631-c11e-47cf-8d8b-6a070a8e87db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-unplugged", "status": "completed", "tag": "22f9548d-cd1e-4c15-ad15-718266ac7541"}, {"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-unplugged", "status": "completed", "tag": "ac5579b6-da92-4d84-be97-2357c891b933"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:32.529975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-865e79ed-e381-4fff-8ea9-2b825d58510e req-bccb3631-c11e-47cf-8d8b-6a070a8e87db service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:32.530787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-865e79ed-e381-4fff-8ea9-2b825d58510e req-bccb3631-c11e-47cf-8d8b-6a070a8e87db service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:32.531556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-865e79ed-e381-4fff-8ea9-2b825d58510e req-bccb3631-c11e-47cf-8d8b-6a070a8e87db service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:32.547688 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-865e79ed-e381-4fff-8ea9-2b825d58510e req-bccb3631-c11e-47cf-8d8b-6a070a8e87db service nova] Creating event network-vif-unplugged:22f9548d-cd1e-4c15-ad15-718266ac7541 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:32.548671 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-865e79ed-e381-4fff-8ea9-2b825d58510e req-bccb3631-c11e-47cf-8d8b-6a070a8e87db service nova] Creating event network-vif-unplugged:ac5579b6-da92-4d84-be97-2357c891b933 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:32.555074 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-865e79ed-e381-4fff-8ea9-2b825d58510e req-bccb3631-c11e-47cf-8d8b-6a070a8e87db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.046053 Sep 18 01:23:32.556468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2174/4393] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:33.348711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:33.349938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:33.362856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:33.366022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:33.368080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:33.369118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:33.374452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:33.376302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:33.487713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:33.502006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:33.503858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:33.507870 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-662134b4-ca19-487f-a6a9-8718a28a2080 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 1.190854 Sep 18 01:23:33.530098 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2220/4394] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:32 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:33.540498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:33.541135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:33.562450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:33.563074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:33.566061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:33.566939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:33.568885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:33.570632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:34.337024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:34.359619 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1846f529-162f-4adb-ac84-5f3a65b6932d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1630 microversion: 2.1 time: 1.016937 Sep 18 01:23:34.367791 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2175/4395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:33 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1630 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:23:34.392751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9f2cfd6b-25d5-44ff-957b-bc90091087d7 req-bc3511a6-47a0-48e5-94ec-87b1db8c3d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-deleted", "tag": "22f9548d-cd1e-4c15-ad15-718266ac7541"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:34.450062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f2cfd6b-25d5-44ff-957b-bc90091087d7 req-bc3511a6-47a0-48e5-94ec-87b1db8c3d9f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:34.450911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f2cfd6b-25d5-44ff-957b-bc90091087d7 req-bc3511a6-47a0-48e5-94ec-87b1db8c3d9f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:34.451551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f2cfd6b-25d5-44ff-957b-bc90091087d7 req-bc3511a6-47a0-48e5-94ec-87b1db8c3d9f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:34.504991 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9f2cfd6b-25d5-44ff-957b-bc90091087d7 req-bc3511a6-47a0-48e5-94ec-87b1db8c3d9f service nova] Creating event network-vif-deleted:22f9548d-cd1e-4c15-ad15-718266ac7541 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:34.528900 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9f2cfd6b-25d5-44ff-957b-bc90091087d7 req-bc3511a6-47a0-48e5-94ec-87b1db8c3d9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158070 Sep 18 01:23:34.531177 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2176/4396] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:34.571044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:34.598223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:34.599219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:34.636139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:34.636637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:34.637075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:34.641576 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c3cb464-8a93-4680-b5e5-030bc896529f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 1.104743 Sep 18 01:23:34.641973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:34.644506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:34.644927 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2221/4397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:33 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:34.648834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:34.763147 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:34.961685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:34.962409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:34.986396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:34.990995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:34.994944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:34.996129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:34.997533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:35.000602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:35.040071 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] HTTP exception thrown: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Request method failure captured: Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b HTTP/1.1 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnFf-aKM8SDXQnsyfN7fEvcVV7gYN_KaH7wDHW6jTcXlonOBCj45Xzi7kLkO5oVrzy8uK7Zv0mInk1ZOIsAfu5luFIS52ZWZWLr8FY9M82PtbbNUEuFh3Ce3fQzPFbXgE3NkD3ldRJWRqrI_tyAtPdOSvoG3axbOhPBsffcADOSkIIg Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 29c7d6ca88464aa29691e7ddfa5e5897 Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: exception: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'dbc80631-d479-465c-b42f-e5d86bc3883b'} Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:35.041999 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.046779 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.047952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Returning 404 to user: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:35.049450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b5131bec-5725-4fd8-9e93-1bd5c7158319 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 404 len: 111 microversion: 2.1 time: 0.094548 Sep 18 01:23:35.053016 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2222/4398] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:23:34 2022] DELETE /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:35.056486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8b8cab45-5c1c-49ff-889e-26d0735909e6 req-a1dff6b5-fac8-4dab-80c4-2ff2202322f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551fce-fc60-40fe-aa37-d96f5af28e0c", "name": "network-vif-plugged", "status": "completed", "tag": "00b945c1-f1c2-4b42-8058-fe512412ca56"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:35.074181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8b8cab45-5c1c-49ff-889e-26d0735909e6 req-a1dff6b5-fac8-4dab-80c4-2ff2202322f4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:35.075084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8b8cab45-5c1c-49ff-889e-26d0735909e6 req-a1dff6b5-fac8-4dab-80c4-2ff2202322f4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:35.075651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8b8cab45-5c1c-49ff-889e-26d0735909e6 req-a1dff6b5-fac8-4dab-80c4-2ff2202322f4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:35.095672 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8b8cab45-5c1c-49ff-889e-26d0735909e6 req-a1dff6b5-fac8-4dab-80c4-2ff2202322f4 service nova] Creating event network-vif-plugged:00b945c1-f1c2-4b42-8058-fe512412ca56 for instance b5551fce-fc60-40fe-aa37-d96f5af28e0c on n-h1-master-1 Sep 18 01:23:35.103756 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8b8cab45-5c1c-49ff-889e-26d0735909e6 req-a1dff6b5-fac8-4dab-80c4-2ff2202322f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052014 Sep 18 01:23:35.104896 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2223/4399] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:35.124605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:35.129051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: dbc80631-d479-465c-b42f-e5d86bc3883b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:35.143458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:35.144139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:35.144715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:35.149389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:35.150191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:35.150913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:35.186596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] HTTP exception thrown: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Request method failure captured: Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b HTTP/1.1 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnFf-aKM8SDXQnsyfN7fEvcVV7gYN_KaH7wDHW6jTcXlonOBCj45Xzi7kLkO5oVrzy8uK7Zv0mInk1ZOIsAfu5luFIS52ZWZWLr8FY9M82PtbbNUEuFh3Ce3fQzPFbXgE3NkD3ldRJWRqrI_tyAtPdOSvoG3axbOhPBsffcADOSkIIg Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 29c7d6ca88464aa29691e7ddfa5e5897 Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: exception: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'dbc80631-d479-465c-b42f-e5d86bc3883b'} Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:35.191705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.198231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:35.198231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:35.198231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:35.198231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:35.198231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:35.198231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. Sep 18 01:23:35.198231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:35.202597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Returning 404 to user: Instance dbc80631-d479-465c-b42f-e5d86bc3883b could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:35.205790 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08e014ab-0472-48c3-b380-5ede293ba6b7 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b" status: 404 len: 111 microversion: 2.1 time: 0.099401 Sep 18 01:23:35.210932 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2224/4400] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:35 2022] GET /compute/v2.1/servers/dbc80631-d479-465c-b42f-e5d86bc3883b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:35.398183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:35.399834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:35.431236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:35.431749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:35.432198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:35.440284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:35.441239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:35.448555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:35.485828 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:36.822078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:36.843631 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-848264e3-78ea-460e-856f-053b777279d3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1452 microversion: 2.1 time: 1.449367 Sep 18 01:23:36.850909 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2225/4401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:35 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1452 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:36.856781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:36.863919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:36.884582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:36.885335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:36.886182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:36.887911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:36.889123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:36.889758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:37.472610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:37.482789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:37.484244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:37.485462 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8fbdcf8c-f631-41eb-b070-83acf99fd026 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 2.938086 Sep 18 01:23:37.506913 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2177/4402] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:34 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 2963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:37.531232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f8b13857-96f3-4bf7-a456-3d4f5061fe22 req-8ef6852f-5c13-4714-93fa-f01560fed58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecbea90-06d3-4936-be5c-54d9b42bc974", "name": "network-vif-deleted", "tag": "ac5579b6-da92-4d84-be97-2357c891b933"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:37.583830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f8b13857-96f3-4bf7-a456-3d4f5061fe22 req-8ef6852f-5c13-4714-93fa-f01560fed58b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:37.592444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f8b13857-96f3-4bf7-a456-3d4f5061fe22 req-8ef6852f-5c13-4714-93fa-f01560fed58b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:37.593193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f8b13857-96f3-4bf7-a456-3d4f5061fe22 req-8ef6852f-5c13-4714-93fa-f01560fed58b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:37.653431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:37.661595 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f8b13857-96f3-4bf7-a456-3d4f5061fe22 req-8ef6852f-5c13-4714-93fa-f01560fed58b service nova] Creating event network-vif-deleted:ac5579b6-da92-4d84-be97-2357c891b933 for instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 on n-h2-master-1 Sep 18 01:23:37.663197 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50f61537-91e7-4e52-a31f-aca9479381c2 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 0.810561 Sep 18 01:23:37.664021 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2226/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:36 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:37.690823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f8b13857-96f3-4bf7-a456-3d4f5061fe22 req-8ef6852f-5c13-4714-93fa-f01560fed58b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181203 Sep 18 01:23:37.699824 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2178/4404] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:23:37.881140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:37.881876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:37.914478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:37.918273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:37.918746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:37.935521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:37.942111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:37.942526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:38.083785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:38.085227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:38.087319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:38.088718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lazy-loading 'fault' on Instance uuid 1ecbea90-06d3-4936-be5c-54d9b42bc974 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:23:38.284194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:38.297676 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1210c05-062a-4d7b-ad85-ab83d00ae778 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 200 len: 1302 microversion: 2.1 time: 0.421982 Sep 18 01:23:38.298630 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2227/4405] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:37 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 1302 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:38.537398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:38.538857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:38.558759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:38.561940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:38.564216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:38.566357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:38.567939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:38.573671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:38.691528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:38.692387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:38.725596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:38.732710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:38.737954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:38.739223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:38.740019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:38.740733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:40.147585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:40.157738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1a6e7cb7-5644-4e25-82a7-1fba16919d24 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 1.471076 Sep 18 01:23:40.168328 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2228/4406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:38 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:40.195285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:40.195496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:40.202943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:40.205316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:40.211476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:40.216476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f5e97984-a378-4e5c-b29c-aeb2524b3570 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1731 microversion: 2.20 time: 1.682019 Sep 18 01:23:40.232956 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2179/4407] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:38 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1731 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:40.250646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:40.254866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:40.257453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:40.262388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:40.264836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:40.270073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:40.323035 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] HTTP exception thrown: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Request method failure captured: Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 HTTP/1.1 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnKuUIc9iVfoz5Qkn5jlHXsP4Ah5bOpI84_Crn-dNFi2xI7XrqVbFyI56c7YNIczY3cUJ1k8Ia7yxROYtkEUXfFnv2knmBudEXOfDTJSAmmmO1qEUtGgzGeiBaioBS_3TrmHe2e41ppfbPSqSGkhweU13v0FXxs0rQmrm1ryksfmt3I Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestMultiNic-244433142 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestMultiNic-244433142-project Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe3e323f16e84023b3654df87c4cc55c Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestMultiNic-244433142-project Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1ecbea90-06d3-4936-be5c-54d9b42bc974'} Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:40.328098 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:40.332369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:40.332369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:40.332369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:40.332369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:40.332369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:40.332369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:23:40.332369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:23:40.337669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Returning 404 to user: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:40.338873 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-20a280be-6e70-45ae-96c3-530668fb6f7b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 404 len: 111 microversion: 2.1 time: 0.163723 Sep 18 01:23:40.339773 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2229/4408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:40 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:41.198221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:41.199125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:41.227641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:41.228604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:41.230181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:41.232368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:41.232858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:41.233303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:41.252389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:41.259696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:41.288040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:41.290247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:41.292448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:41.295896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:41.298059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:41.298453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:42.258713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:42.296474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:42.309378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:42.317087 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd45ac4e-ec41-4bf8-99b2-a718fa0d02f2 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1718 microversion: 2.20 time: 1.069779 Sep 18 01:23:42.344381 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2230/4409] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:23:41 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1718 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:23:42.459100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:42.473805 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dee31c93-8b3a-4ad1-9ee6-f8168d423d71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 1.276089 Sep 18 01:23:42.486296 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2180/4410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:41 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:43.508375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:43.538167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:43.558056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:43.559350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:43.565039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:43.566620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:43.568373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:43.569739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:43.686764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:43.688200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:43.717744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:43.725819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:43.726899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:43.735314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:43.736322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:43.741401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:43.793474 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] HTTP exception thrown: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Request method failure captured: Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad HTTP/1.1 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFf-aKM8SDXQnsyfN7fEvcVV7gYN_KaH7wDHW6jTcXlonOBCj45Xzi7kLkO5oVrzy8uK7Zv0mInk1ZOIsAfu5luFIS52ZWZWLr8FY9M82PtbbNUEuFh3Ce3fQzPFbXgE3NkD3ldRJWRqrI_tyAtPdOSvoG3axbOhPBsffcADOSkIIg Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 29c7d6ca88464aa29691e7ddfa5e5897 Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3dda0da1-d84d-460a-b22c-8cfed7d264ad'} Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:43.797273 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.801123 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.809003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Returning 404 to user: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:43.816397 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75fe33af-40cc-4d3d-ba31-25248bcc2b9f tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 404 len: 111 microversion: 2.1 time: 0.133864 Sep 18 01:23:43.819067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2181/4411] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:23:43 2022] DELETE /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:23:43.828107 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:43.829340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] [instance: 3dda0da1-d84d-460a-b22c-8cfed7d264ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:43.849346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:43.850703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:43.851767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:43.856841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:43.859919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:43.860814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:43.920069 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] HTTP exception thrown: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Request method failure captured: Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad HTTP/1.1 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFf-aKM8SDXQnsyfN7fEvcVV7gYN_KaH7wDHW6jTcXlonOBCj45Xzi7kLkO5oVrzy8uK7Zv0mInk1ZOIsAfu5luFIS52ZWZWLr8FY9M82PtbbNUEuFh3Ce3fQzPFbXgE3NkD3ldRJWRqrI_tyAtPdOSvoG3axbOhPBsffcADOSkIIg Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ceb6afe234e1433eabf8eee5c780c799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ceb6afe234e1433eabf8eee5c780c799 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651531170 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 29c7d6ca88464aa29691e7ddfa5e5897 Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeTestJSON-1651531170-project Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3dda0da1-d84d-460a-b22c-8cfed7d264ad'} Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:23:43.923614 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.927935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:23:43.927935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:23:43.927935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:23:43.927935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:23:43.927935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:23:43.927935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. Sep 18 01:23:43.927935 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:23:43.929624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] Returning 404 to user: Instance 3dda0da1-d84d-460a-b22c-8cfed7d264ad could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:23:43.935002 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6616508b-79ef-4336-89d4-6f7031c6e804 tempest-AttachVolumeTestJSON-1651531170 tempest-AttachVolumeTestJSON-1651531170-project] 10.222.0.25 "GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad" status: 404 len: 111 microversion: 2.1 time: 0.112402 Sep 18 01:23:43.942623 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2182/4412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:43 2022] GET /compute/v2.1/servers/3dda0da1-d84d-460a-b22c-8cfed7d264ad => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:23:44.177755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:44.191712 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27505edc-efda-459e-b077-f313e0342df9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 0.689610 Sep 18 01:23:44.197421 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2231/4413] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:43 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:45.224179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:45.225497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:45.239935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:45.240786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:45.241420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:45.242362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:45.243379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:45.245799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:47.502460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:47.517289 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b04ace2b-6a83-4664-9880-dc1e5d105b17 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 2.296884 Sep 18 01:23:47.521878 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2183/4414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:45 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:48.565257 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:48.567868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:48.646576 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:48.646576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:48.646576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:48.646576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:48.646576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:48.646576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:48.646576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:49.130579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:49.152487 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96a749a1-628e-4bf3-a17d-388041c9c27e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 0.594435 Sep 18 01:23:49.166692 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2232/4415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:48 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:50.181305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:50.183474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:50.200910 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=40 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:23:50.206166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:50.206953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:50.207354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:50.214708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:50.214952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:50.216266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:51.030823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:51.046689 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-39f3d205-0359-46b6-9fa1-27ebda905a5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 0.869992 Sep 18 01:23:51.049200 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2184/4416] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:50 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:52.073943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:52.074580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:52.102708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:52.108825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:52.110743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:52.116293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:52.118351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:52.120890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:53.431424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:53.458102 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9dcf3e2b-9bd6-46bc-aafc-75646997b082 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 1.390538 Sep 18 01:23:53.460131 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2233/4417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:52 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:54.510223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:54.511375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:54.542604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:54.545322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:54.550615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:54.558164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:54.562709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:54.563946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:55.425269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:55.458785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-53926758-63da-4bcc-a0f8-5ef6daf481e3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 0.964079 Sep 18 01:23:55.460723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2185/4418] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:54 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:55.922611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-606581694", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "d3bdcd2b-46f5-4efc-9e12-2421bf31ca40"}, {"uuid": "b6fed3ae-103c-421c-92cd-59d6e7b0d49b"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:23:56.161583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] validate_networks() for [('d3bdcd2b-46f5-4efc-9e12-2421bf31ca40', None, None, None, None, None), ('b6fed3ae-103c-421c-92cd-59d6e7b0d49b', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:23:56.486388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:56.487088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:56.502570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:56.505263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:56.506450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:56.509847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:56.510360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:56.511668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:58.237785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:58.250389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60e90bed-6c52-49ce-9050-e992741db80f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 1.768729 Sep 18 01:23:58.251370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2186/4419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:56 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:23:59.300213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:23:59.302956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:23:59.324846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:59.326879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:59.327341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:59.329083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:23:59.330965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:23:59.332461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:23:59.960223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:23:59.976758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b321cae-b09c-405b-b21f-ba3e9bf4dd9d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1507 microversion: 2.1 time: 0.677759 Sep 18 01:23:59.994787 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2187/4420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:23:59 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:00.171226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:24:00.171735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:24:00.172402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:24:00.173160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:24:00.173526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:24:00.197267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:00.202558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:00.204555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:00.208021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:00.208991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:00.213208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:00.294261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Getting quotas for project d8ed34e8b9574a3c82538941c839cbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:24:00.316781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Getting quotas for user fe3e323f16e84023b3654df87c4cc55c and project d8ed34e8b9574a3c82538941c839cbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:24:00.353348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:24:00.356845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:24:00.472912 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c7c5c63d-67be-49ca-8cce-8977ac6cb6ee tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.555921 Sep 18 01:24:00.476980 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2234/4421] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:24:00.490153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e78d4b3f-d2be-4976-8bf5-31e8b4ca2287 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:00.491841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e78d4b3f-d2be-4976-8bf5-31e8b4ca2287 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:00.652129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e78d4b3f-d2be-4976-8bf5-31e8b4ca2287 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:00.663805 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e78d4b3f-d2be-4976-8bf5-31e8b4ca2287 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1212 microversion: 2.1 time: 0.178534 Sep 18 01:24:00.689909 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2188/4422] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:00 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1212 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:01.019595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:01.020626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:01.041513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:01.042292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:01.042819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:01.045012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:01.045012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:01.045162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:01.569621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:01.589047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59dfdee5-f24f-4f6d-bc18-1569ac6d7b08 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1504 microversion: 2.1 time: 0.589018 Sep 18 01:24:01.591928 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2235/4423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:00 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1504 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:01.694705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:01.695683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:01.726672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:01.731038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:01.735800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:01.745261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:01.745261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:01.747308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:02.517755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:02.526609 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b4aedddd-da3a-465c-8e10-66f105914ed3 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1216 microversion: 2.1 time: 0.836948 Sep 18 01:24:02.532229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2189/4424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:01 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1216 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:02.615396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:02.616566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:02.648619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:02.651004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:02.654039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:02.655494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:02.658091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:02.659832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:03.273083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:03.292085 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4def70d-c21a-4fa7-84d8-f7c31b71efa5 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1504 microversion: 2.1 time: 0.681967 Sep 18 01:24:03.293251 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2236/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:02 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:03.566146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:03.567167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:03.620040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:03.620812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:03.628966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:03.630077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:03.630788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:03.631422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:03.834616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:03.874406 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a146d50-3c0c-4556-a9b8-92d772ee5ae2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1270 microversion: 2.1 time: 0.314382 Sep 18 01:24:03.879465 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2190/4426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:03 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:04.327131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:04.328817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:04.348036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:04.348976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:04.349764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:04.350829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:04.351760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:04.353110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:04.907208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:04.907876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:04.925647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:04.926403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:04.927016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:04.927953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:04.928626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:04.929271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:04.932871 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=63 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:05.130647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:05.145518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-df8c1ef9-7c7c-40e4-83e1-7c1a2e377db0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1270 microversion: 2.1 time: 0.241632 Sep 18 01:24:05.146384 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2191/4427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:04 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:05.368439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:05.383422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca9b232c-fd46-4835-a93e-b6ce5e823c41 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1504 microversion: 2.1 time: 1.063547 Sep 18 01:24:05.385388 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2237/4428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:04 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1504 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:05.393882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2f72abdc-fab3-4a44-9d10-47c1f3b1c1c9 req-dcfc6e70-020e-4e88-819a-4a7398964e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6453f292-44d8-48e4-881a-10a4c29cf384", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb94a07-ef40-4dc0-9b1d-711c880f6915"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:05.407915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2f72abdc-fab3-4a44-9d10-47c1f3b1c1c9 req-dcfc6e70-020e-4e88-819a-4a7398964e0c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:05.408619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2f72abdc-fab3-4a44-9d10-47c1f3b1c1c9 req-dcfc6e70-020e-4e88-819a-4a7398964e0c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:05.409160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2f72abdc-fab3-4a44-9d10-47c1f3b1c1c9 req-dcfc6e70-020e-4e88-819a-4a7398964e0c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:05.424097 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2f72abdc-fab3-4a44-9d10-47c1f3b1c1c9 req-dcfc6e70-020e-4e88-819a-4a7398964e0c service nova] Creating event network-vif-unplugged:bfb94a07-ef40-4dc0-9b1d-711c880f6915 for instance 6453f292-44d8-48e4-881a-10a4c29cf384 on n-h1-master-1 Sep 18 01:24:05.434709 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2f72abdc-fab3-4a44-9d10-47c1f3b1c1c9 req-dcfc6e70-020e-4e88-819a-4a7398964e0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042235 Sep 18 01:24:05.438810 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2192/4429] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:06.179726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:06.180357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:06.206884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:06.206884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:06.206884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:06.206884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:06.206884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:06.206884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:06.261615 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=71 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:06.411398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:06.413049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:06.422898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:06.427217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:06.427891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:06.429139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:06.436328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:06.439370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:06.973299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:06.991323 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:06.997311 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-18ab2717-e576-4c4f-bb10-a99a0dc88dd8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 200 len: 1447 microversion: 2.1 time: 0.580933 Sep 18 01:24:07.000028 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2193/4430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:06 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 1447 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:07.008494 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ab5b5ff-e0b8-4199-8de8-0f196618f18c tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1312 microversion: 2.1 time: 0.832804 Sep 18 01:24:07.033956 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2238/4431] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:06 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1312 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:07.034360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:07.038039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:07.053120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:07.054056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:07.054768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:07.055881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:07.056701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:07.057385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:07.523481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:07.536066 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-270d42b5-e368-4fe3-af80-1a30273600e1 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.512354 Sep 18 01:24:07.537342 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2194/4432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:07 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:07.580437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:07.581660 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:07.595186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:07.596489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:07.597319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:07.598386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:07.599232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:07.599889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:07.985390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:08.011978 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c70338f1-1c1a-45f3-b0b9-05e0b8f5b9f8 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.437026 Sep 18 01:24:08.017489 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2239/4433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:07 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:08.038475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:08.040918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:08.045107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:08.050014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:08.060011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:08.065772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:08.068224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:08.072021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:08.075824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:08.078189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:08.082223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:08.087103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:08.089591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:08.090950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:08.099950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:08.100861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:08.602022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:08.607936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:08.629565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41fb6d6b-1c47-4c58-a260-2ebdd6f2f89c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.592725 Sep 18 01:24:08.632566 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2240/4434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:08 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:08.636224 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-afacbd6f-d905-4bba-bd09-f85d9469d662 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.601946 Sep 18 01:24:08.638812 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2195/4435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:08 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:08.656675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:08.657725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:08.670430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:08.674247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:08.674801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:08.675941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:08.677963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:08.678824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:08.958657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:08.974171 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-095ce0c4-5469-4e86-b9ff-0f4056830a90 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.322706 Sep 18 01:24:08.980801 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2241/4436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:08 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:09.011553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5d6dc290-d1da-4f5b-8744-e5297a0fc74d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:09.024021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d6dc290-d1da-4f5b-8744-e5297a0fc74d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:09.030804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d6dc290-d1da-4f5b-8744-e5297a0fc74d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:09.036075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d6dc290-d1da-4f5b-8744-e5297a0fc74d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:09.109329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5d6dc290-d1da-4f5b-8744-e5297a0fc74d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Going to try to stop instance {{(pid=122373) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:24:09.206047 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5d6dc290-d1da-4f5b-8744-e5297a0fc74d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.200063 Sep 18 01:24:09.209447 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2196/4437] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:24:09 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:24:09.220039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:09.221229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:09.250863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:09.252684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:09.253150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:09.255500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:09.258182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:09.258660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:09.549314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:09.558114 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3372a34-0aa1-42aa-aa1d-5a6622bb0f58 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.344617 Sep 18 01:24:09.569990 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2242/4438] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:09 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:09.666165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:09.671516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:09.686567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:09.687283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:09.687901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:09.690313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:09.695073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:09.696908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:09.904652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b99fcdd0-5ded-4434-97f5-886b30416ab6 req-2ce9dcc2-1e3f-4dae-ba8b-ea448d84b884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6324c5-5c5c-4cb8-a8dc-873146ce7307", "tag": "c40caccf-4b1d-4150-ade3-6140c15ecdb0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:09.930262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b99fcdd0-5ded-4434-97f5-886b30416ab6 req-2ce9dcc2-1e3f-4dae-ba8b-ea448d84b884 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:09.931255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b99fcdd0-5ded-4434-97f5-886b30416ab6 req-2ce9dcc2-1e3f-4dae-ba8b-ea448d84b884 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:09.932933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b99fcdd0-5ded-4434-97f5-886b30416ab6 req-2ce9dcc2-1e3f-4dae-ba8b-ea448d84b884 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:09.963844 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b99fcdd0-5ded-4434-97f5-886b30416ab6 req-2ce9dcc2-1e3f-4dae-ba8b-ea448d84b884 service nova] Creating event network-changed:c40caccf-4b1d-4150-ade3-6140c15ecdb0 for instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 on n-h2-master-1 Sep 18 01:24:09.976058 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b99fcdd0-5ded-4434-97f5-886b30416ab6 req-2ce9dcc2-1e3f-4dae-ba8b-ea448d84b884 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076299 Sep 18 01:24:09.978075 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2243/4439] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 18 01:24:10.416147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:10.431693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c8ceb95b-e979-4c42-a88c-f6c4e869be1b tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.770902 Sep 18 01:24:10.433003 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2197/4440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:09 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:10.590099 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:10.592187 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:10.598068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:10.598598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:10.615671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:10.619180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:10.619774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:10.620638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:10.621222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:10.623172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:11.456020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:11.456647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:11.462255 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:11.465283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:11.465809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:11.466254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:11.466978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:11.467441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:11.467865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:11.679240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:11.697710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cae56ab4-b5dd-45c0-8436-36c20119ffe0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 1.100698 Sep 18 01:24:11.699921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2244/4441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:10 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:11.929440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:11.947958 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d417e9a3-549d-4116-921e-af993f9d78f6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.492340 Sep 18 01:24:11.970345 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2198/4442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:11 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:12.468081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-41809517", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "7ec041d8-94c7-412d-af92-a6d442207667"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:12.565876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] validate_networks() for [('7ec041d8-94c7-412d-af92-a6d442207667', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:24:12.722574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:12.726691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:12.741098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:12.741405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:12.742032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:12.743209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:12.743821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:12.745217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:13.218168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:13.226887 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5d06a65b-6a95-4ff5-84db-1b1984c665a4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.509133 Sep 18 01:24:13.239851 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2199/4443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:12 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:13.245593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:13.245951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:13.273369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:13.273900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:13.274608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:13.279684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:13.280296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:13.280750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:13.372813 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c201952f-22c1-44ce-bf67-431a7123083c tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.143763 Sep 18 01:24:13.373423 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2200/4444] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 18 01:24:13 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:13.393471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:13.398018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:13.413518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:13.419920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:13.420699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:13.421738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:13.422375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:13.422965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:13.816843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:13.827200 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-123fe3e5-1d61-46c5-8d60-06accfbe2396 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.446710 Sep 18 01:24:13.833990 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2201/4445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:13 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:13.850761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2f01014c-1cc5-42d1-8cd3-a2acfde3fbf8 req-2cc1d20f-a7f8-4730-bcf7-7b1dfd907b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6324c5-5c5c-4cb8-a8dc-873146ce7307", "tag": "78496cbc-d32e-4b35-a6cb-c987fb4eeb40"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:13.897431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2f01014c-1cc5-42d1-8cd3-a2acfde3fbf8 req-2cc1d20f-a7f8-4730-bcf7-7b1dfd907b79 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:13.898829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2f01014c-1cc5-42d1-8cd3-a2acfde3fbf8 req-2cc1d20f-a7f8-4730-bcf7-7b1dfd907b79 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:13.900098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2f01014c-1cc5-42d1-8cd3-a2acfde3fbf8 req-2cc1d20f-a7f8-4730-bcf7-7b1dfd907b79 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:13.938082 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2f01014c-1cc5-42d1-8cd3-a2acfde3fbf8 req-2cc1d20f-a7f8-4730-bcf7-7b1dfd907b79 service nova] Creating event network-changed:78496cbc-d32e-4b35-a6cb-c987fb4eeb40 for instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 on n-h2-master-1 Sep 18 01:24:13.964749 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2f01014c-1cc5-42d1-8cd3-a2acfde3fbf8 req-2cc1d20f-a7f8-4730-bcf7-7b1dfd907b79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128369 Sep 18 01:24:13.966758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2202/4446] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:13.987118 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:13.991269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:14.007754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.009159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.011598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.014986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.015627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.017665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.082776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:14.238463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:24:14.239495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:24:14.240153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:24:14.240749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:24:14.241305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:24:14.264088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.265044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.265762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.267673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.269982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.270619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.297153 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-39ac979e-bd35-441b-a7bc-ce66812f7d78 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 204 len: 0 microversion: 2.20 time: 0.321341 Sep 18 01:24:14.302018 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2203/4447] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:24:13 2022] DELETE /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:24:14.315567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:14.316363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Getting quotas for project 17e38310791d4e0d8517a308c5f2cf07. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:24:14.323079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:14.334566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.337673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.342131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.344062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Getting quotas for user 6dfddeaf8ab0495586cf33756f51ecdd and project 17e38310791d4e0d8517a308c5f2cf07. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:24:14.344359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.345074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.345786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.376807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:24:14.383793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:24:14.541054 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c5c9fe8-b744-42db-bb4e-822fb56b6099 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.346613 Sep 18 01:24:14.542608 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2245/4448] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:24:14.556971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:14.560680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:14.577119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.579700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.580340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.582364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:14.584208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:14.584876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:14.962187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:14.978460 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f649d93b-a764-4d0f-9692-97b4d5214ec4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.674784 Sep 18 01:24:14.979374 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2204/4449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:14 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:14.984670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e85f456b-0dc6-40e8-b4e7-afd67fc92fa0 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:14.998511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e85f456b-0dc6-40e8-b4e7-afd67fc92fa0 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:15.096119 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e85f456b-0dc6-40e8-b4e7-afd67fc92fa0 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:15.104043 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e85f456b-0dc6-40e8-b4e7-afd67fc92fa0 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1226 microversion: 2.1 time: 0.123421 Sep 18 01:24:15.124769 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2205/4450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:14 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:15.140961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:15.141889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:15.158663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:15.159553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:15.160190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:15.161116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:15.161829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:15.162462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:15.196241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:15.229515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:15.238963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:15.247653 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4bef59ef-e17c-41b1-aa53-a8d5f338694e tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1724 microversion: 2.20 time: 0.697580 Sep 18 01:24:15.251086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2246/4451] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:14 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1724 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:24:15.469933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:15.480898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bbe0f548-cb50-4989-80c2-8741102e2b43 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.354725 Sep 18 01:24:15.482124 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2206/4452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:15 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:16.004963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:16.005686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:16.023816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.024980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.025789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:16.030422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.030926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.031405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:16.135282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:16.135912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:16.148815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.156391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.157334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:16.159982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.161245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.165093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:16.211071 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:16.399601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:16.426139 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4aca3e1b-9928-4b49-a5f2-c30318b2a08c tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1278 microversion: 2.1 time: 0.298217 Sep 18 01:24:16.427085 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2207/4453] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:16 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1278 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:16.450396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:16.451012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:16.470560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.474646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.475405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:16.481221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.482141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.482914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:16.643838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:16.658964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f422d4c-188a-4e30-932a-7d22408b3c5b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.654519 Sep 18 01:24:16.681313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2247/4454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:15 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:16.691117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:16.691745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:16.743711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.747314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.747861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:16.748633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:16.749110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:16.749539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:17.088055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:17.103739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:17.105496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:17.106773 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c03c022-cc3c-4fb1-a048-ffe8cb6d6ca0 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1724 microversion: 2.20 time: 0.663642 Sep 18 01:24:17.115211 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2208/4455] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:16 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1724 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:24:17.455995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:17.456826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:17.480898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:17.491722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:17.492633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:17.493961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:17.494882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:17.500136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:17.829244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:17.847231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:17.859649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77793999-5003-4222-b00e-d22a095cea05 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1284 microversion: 2.1 time: 0.409770 Sep 18 01:24:17.862682 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d17802b5-87bc-4bc4-8531-20b33c13b954 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 1.174932 Sep 18 01:24:17.863277 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2209/4456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:17 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1284 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:17.866968 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2248/4457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:16 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:17.887336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:17.888018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:17.923404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:17.924498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:17.928724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:17.930745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:17.933125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:17.935005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:18.141857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:18.143195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:18.165648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:18.166499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:18.171398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:18.172538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:18.174238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:18.175271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:18.409107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:18.453254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:18.464073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:18.470909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28dd6d24-059a-4c83-bfdd-a4dc6e3d9dd1 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1656 microversion: 2.20 time: 0.329085 Sep 18 01:24:18.477634 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2249/4458] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:18 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1656 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:24:18.505619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f1b79597-3e48-407b-a484-4bbd5587b329 req-ab11d556-3310-4a44-9062-f56463078c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551fce-fc60-40fe-aa37-d96f5af28e0c", "name": "network-vif-deleted", "tag": "00b945c1-f1c2-4b42-8058-fe512412ca56"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:18.542106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1b79597-3e48-407b-a484-4bbd5587b329 req-ab11d556-3310-4a44-9062-f56463078c80 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:18.543573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1b79597-3e48-407b-a484-4bbd5587b329 req-ab11d556-3310-4a44-9062-f56463078c80 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:18.544386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1b79597-3e48-407b-a484-4bbd5587b329 req-ab11d556-3310-4a44-9062-f56463078c80 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:18.585413 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f1b79597-3e48-407b-a484-4bbd5587b329 req-ab11d556-3310-4a44-9062-f56463078c80 service nova] Creating event network-vif-deleted:00b945c1-f1c2-4b42-8058-fe512412ca56 for instance b5551fce-fc60-40fe-aa37-d96f5af28e0c on n-h1-master-1 Sep 18 01:24:18.626194 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f1b79597-3e48-407b-a484-4bbd5587b329 req-ab11d556-3310-4a44-9062-f56463078c80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126626 Sep 18 01:24:18.637477 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2250/4459] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:18.782461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:18.801941 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-698ae474-1799-4b88-88da-cd9c5af34955 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1677 microversion: 2.1 time: 0.937052 Sep 18 01:24:18.810449 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2210/4460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:17 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1677 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:18.894857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:18.895516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:18.904731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:18.908632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:18.909480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:18.911760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:18.912526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:18.913067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:18.913502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:18.913982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:18.942562 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:18.955130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:18.957580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:18.958286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:18.960130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:18.960804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:18.961466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:19.522761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:19.543125 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1233c20-7365-4178-9706-7ec7709ae6d6 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.649901 Sep 18 01:24:19.558659 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2211/4461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:18 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:19.588182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:19.589499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:19.598492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:19.599229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:19.599872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:19.600894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:19.602530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:19.603203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:19.638777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:19.678195 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2914e2f4-8160-431f-b1b6-e501ca0368e3 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 0.786341 Sep 18 01:24:19.680169 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2251/4462] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:18 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:19.688568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:19.698298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:19.710219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:19.711014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:19.711932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:19.712896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:19.713453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:19.714824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lazy-loading 'fault' on Instance uuid b5551fce-fc60-40fe-aa37-d96f5af28e0c {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:24:19.717393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:19.722063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:19.724903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:19.725702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:19.798232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:19.815364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:19.820871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56d16d15d11b40e188f517d24819845b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b7dafe6d2840208386dc8a2c95006b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:19.823150 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3081797a-73d0-4183-b2cc-2e6f5c837ae6 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 200 len: 1371 microversion: 2.20 time: 0.263268 Sep 18 01:24:19.827403 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2212/4463] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:19 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:24:19.836483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:19.839441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:19.860785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:19.861066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:19.861644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:19.866276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:19.866794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:19.868656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:20.205911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:20.221180 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-22994780-aebf-416f-b372-103a39678135 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1654 microversion: 2.1 time: 0.387782 Sep 18 01:24:20.222463 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2213/4464] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:19 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1654 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:20.247937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-55ba814a-52b8-4819-a385-171a2e4fe01c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:20.259155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55ba814a-52b8-4819-a385-171a2e4fe01c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:20.261045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55ba814a-52b8-4819-a385-171a2e4fe01c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:20.263780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55ba814a-52b8-4819-a385-171a2e4fe01c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:20.326219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:20.341717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-55ba814a-52b8-4819-a385-171a2e4fe01c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Going to try to start instance {{(pid=122373) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 01:24:20.347249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:20.350383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:20.360450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b531d0f3-99ff-4c52-a9f8-5d25c6fc4978 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2951 microversion: 2.32 time: 0.676301 Sep 18 01:24:20.362614 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2252/4465] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:19 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2951 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:24:20.399981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:20.400700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:20.415081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:20.419019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:20.419931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:20.423528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:20.426010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:20.430716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:20.449473 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-55ba814a-52b8-4819-a385-171a2e4fe01c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.201753 Sep 18 01:24:20.456461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2214/4466] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:24:20 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:24:20.485484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:20.491638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:20.509379 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:20.516306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:20.518813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:20.519357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:20.526559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:20.531902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:20.532951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:20.890290 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9323ee09-57f9-4815-9f23-f4e499f5cf02 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.497941 Sep 18 01:24:20.890886 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2253/4467] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 18 01:24:20 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74/os-interface => generated 1831 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:24:20.906957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:20.908277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:20.915555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:20.916060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:20.916507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:20.917467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:20.917983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:20.919287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:21.086078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:21.103702 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4a5b489d-256b-4fbd-8115-af3436189e10 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1663 microversion: 2.1 time: 0.645075 Sep 18 01:24:21.108735 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2215/4468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:20 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1663 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:21.133665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:21.135543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:21.158100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:21.160633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:21.162169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:21.165589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:21.166627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:21.170088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:21.431582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:21.444987 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3b86d3c-c5b1-4030-8d08-ae35f7ebc1e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.552040 Sep 18 01:24:21.445945 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2254/4469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:20 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:21.459685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:21.460587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:21.471187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:21.475772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:21.479247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:21.480249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:21.481434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:21.483642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:21.526743 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] HTTP exception thrown: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Request method failure captured: Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c HTTP/1.1 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnFNdJeD5-_tuJeCMgsjM497sVDpeQ2xJeGrYFiHpSysIUJCqQ-hpvzJK3ppnZpni5k-YBU0qC5k5ftmjG3TyH3kAXpLnFpdw6fiPpM8D2BzoFszzxPuHI45IUdcgJ5wVwP40rGqJKBsCgrvf5st2iOvbciUKV2H-XOG1ln-Yky-uqI Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 56d16d15d11b40e188f517d24819845b Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: exception: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'b5551fce-fc60-40fe-aa37-d96f5af28e0c'} Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:21.533313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:21.541073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Returning 404 to user: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:21.546193 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1bb6b9e9-589f-414b-924a-d5bd91ead84f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 404 len: 111 microversion: 2.20 time: 0.094419 Sep 18 01:24:21.550303 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2255/4470] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:21 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:24:21.561186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c41e512-2385-44dd-bfe3-4780542f06fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '.version_select at 0x7f70062f7040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:21.624358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:21.625378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c41e512-2385-44dd-bfe3-4780542f06fa tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-358304058" status: 204 len: 0 microversion: 2.20 time: 0.073154 Sep 18 01:24:21.627432 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2256/4471] 10.222.0.25 () {60 vars in 1259 bytes} [Sun Sep 18 01:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-358304058 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:24:21.646972 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7f397863-9904-49be-b470-5be955f05425 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 0.536613 Sep 18 01:24:21.647946 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2216/4472] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:21 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:22.131207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:22.132155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:22.158182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:22.162123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:22.162799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:22.164872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:22.167803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:22.169020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:22.476312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:22.477151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:22.485183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:22.485699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:22.486133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:22.501507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:22.502187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:22.504895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:22.569467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:22.580936 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-32ea09a9-ef5d-45c6-a742-b9533f5b2231 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1663 microversion: 2.1 time: 0.454202 Sep 18 01:24:22.594805 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2257/4473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:22 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1663 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:22.676693 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:22.678797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:22.695638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:22.700711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:22.701624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:22.703467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:22.704031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:22.704388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:23.673939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:23.695662 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b31f0a5c-b8f7-44e9-8b71-2e61169b3fd7 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 1.225202 Sep 18 01:24:23.697448 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2217/4474] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:22 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:23.703316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a01242a2-3705-4004-a5b8-fe1ce7639bb3 req-4724a33e-ff39-4615-8a52-45a84cbfe54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f22267-7e4b-43ed-ac39-2c46cbb65801", "tag": "236ef0d1-2eb0-43f6-af0d-a396fa2cebc3"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:23.728303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a01242a2-3705-4004-a5b8-fe1ce7639bb3 req-4724a33e-ff39-4615-8a52-45a84cbfe54c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:23.728891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a01242a2-3705-4004-a5b8-fe1ce7639bb3 req-4724a33e-ff39-4615-8a52-45a84cbfe54c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:23.729343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a01242a2-3705-4004-a5b8-fe1ce7639bb3 req-4724a33e-ff39-4615-8a52-45a84cbfe54c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:23.733065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:23.735391 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:23.749186 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ec36e3f-6019-4ded-806d-2e7c3d81f06b tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 1.076632 Sep 18 01:24:23.754191 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a01242a2-3705-4004-a5b8-fe1ce7639bb3 req-4724a33e-ff39-4615-8a52-45a84cbfe54c service nova] Creating event network-changed:236ef0d1-2eb0-43f6-af0d-a396fa2cebc3 for instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 on n-h1-master-1 Sep 18 01:24:23.760808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a01242a2-3705-4004-a5b8-fe1ce7639bb3 req-4724a33e-ff39-4615-8a52-45a84cbfe54c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060929 Sep 18 01:24:23.762135 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2218/4475] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:23.768511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:23.769451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:23.772671 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2258/4476] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:22 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:23.777673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:23.778471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:23.779063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:23.780301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:23.780984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:23.781687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:24.659574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:24.673785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c71950f-588a-47d5-8b74-b9d9d3c636b4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.907686 Sep 18 01:24:24.689964 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2219/4477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:23 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:24.697740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:24.698375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:24.702681 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:24.703596 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:24.709135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:24.709864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:24.710469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:24.711504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:24.712131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:24.712748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:24.730629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:24.731262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:24.746724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:24.748325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:24.750718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:24.751780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:24.753599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:24.765691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:25.105012 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:25.317706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:25.327751 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d97e867-731d-41b8-8b99-80a0220bf44f tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.634017 Sep 18 01:24:25.351096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2259/4478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:24 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:25.364137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:25.365393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:25.395031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:25.397192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:25.401846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:25.403509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:25.404153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:25.404756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:25.488634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:25.500991 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0467f858-4a42-4677-b3d0-4f0669acb0b0 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.781956 Sep 18 01:24:25.504542 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2220/4479] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:24 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:25.520545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:25.521413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:25.529388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:25.535920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:25.536636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:25.537636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:25.538469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:25.539057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:25.978714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:25.989138 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aaf616b7-53f6-4654-83a0-55bdfcc681da tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 0.636392 Sep 18 01:24:26.013588 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2260/4480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:25 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:26.027151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4277ab51-d2d9-4c56-b26f-52b37ac5060c req-9257d8eb-a4d9-4527-ba90-8e3f9fc50057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6324c5-5c5c-4cb8-a8dc-873146ce7307", "name": "network-vif-plugged", "status": "completed", "tag": "78496cbc-d32e-4b35-a6cb-c987fb4eeb40"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:26.036432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:26.051797 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47f44702-7ed2-4b85-b308-f750e4a805b0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.545962 Sep 18 01:24:26.065689 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2221/4481] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:25 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:26.065924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4277ab51-d2d9-4c56-b26f-52b37ac5060c req-9257d8eb-a4d9-4527-ba90-8e3f9fc50057 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:26.065924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4277ab51-d2d9-4c56-b26f-52b37ac5060c req-9257d8eb-a4d9-4527-ba90-8e3f9fc50057 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:26.065924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4277ab51-d2d9-4c56-b26f-52b37ac5060c req-9257d8eb-a4d9-4527-ba90-8e3f9fc50057 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:26.082409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:26.082947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:26.095040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:26.095901 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4277ab51-d2d9-4c56-b26f-52b37ac5060c req-9257d8eb-a4d9-4527-ba90-8e3f9fc50057 service nova] Creating event network-vif-plugged:78496cbc-d32e-4b35-a6cb-c987fb4eeb40 for instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 on n-h2-master-1 Sep 18 01:24:26.096587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:26.096805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:26.097538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:26.098013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:26.098437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:26.108805 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4277ab51-d2d9-4c56-b26f-52b37ac5060c req-9257d8eb-a4d9-4527-ba90-8e3f9fc50057 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092313 Sep 18 01:24:26.109945 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2261/4482] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:26.541871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:26.543942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:26.566418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:26.571054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:26.571720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:26.572613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:26.573433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:26.574047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:26.751092 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:26.762307 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d46adfc-bf28-4b57-8047-e03d95fe34fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.683041 Sep 18 01:24:26.766501 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2222/4483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:26 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:26.790046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:26.790769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:26.797286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:26.797877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:26.798532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:26.799489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:26.800168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:26.800707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:26.821467 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:27.095418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:27.106737 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34913b54-7b76-4aef-be2b-5894bcf3ae93 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.580667 Sep 18 01:24:27.121695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2262/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:26 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:27.121695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:27.121695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:27.127446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.128414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.129086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.130277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.131895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.132510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.243316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:27.264039 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c298e53e-a897-4a93-bafd-3dff511357d9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.477928 Sep 18 01:24:27.277592 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2223/4485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:26 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:27.293615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:27.294319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:27.303902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.304962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.305672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.306823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.307791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.309419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.342972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lazy-loading 'flavor' on Instance uuid 4085d846-e1d5-4d73-bea1-0ac4912d1cdb {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:24:27.458169 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11148692-0963-45a7-a5ae-ada5e8fd5f66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.171442 Sep 18 01:24:27.462746 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2224/4486] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:24:27 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:24:27.498228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:27.504911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:27.511623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.518239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.518763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.520030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.520136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.520584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.565454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:27.566284 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] HTTP exception thrown: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Request method failure captured: Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c HTTP/1.1 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFNdJeD5-_tuJeCMgsjM497sVDpeQ2xJeGrYFiHpSysIUJCqQ-hpvzJK3ppnZpni5k-YBU0qC5k5ftmjG3TyH3kAXpLnFpdw6fiPpM8D2BzoFszzxPuHI45IUdcgJ5wVwP40rGqJKBsCgrvf5st2iOvbciUKV2H-XOG1ln-Yky-uqI Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 56d16d15d11b40e188f517d24819845b Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: exception: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b5551fce-fc60-40fe-aa37-d96f5af28e0c'} Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:27.568304 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.577065 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.579337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-df9db7d9-f7e3-420e-8710-e2b3caf56f11 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 0.465845 Sep 18 01:24:27.579337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2263/4487] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:27 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:27.580445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Returning 404 to user: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:27.581533 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-492407ac-7875-4883-b8f4-a4751547a33d tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 404 len: 111 microversion: 2.20 time: 0.119902 Sep 18 01:24:27.582352 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2225/4488] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:24:27 2022] DELETE /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:24:27.591393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:27.592249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: b5551fce-fc60-40fe-aa37-d96f5af28e0c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:27.595172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:27.595753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:27.605188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.606091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.606715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.610424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.611093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.611685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.624171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.624770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.625230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.625986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:27.626450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:27.626883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:27.650050 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] HTTP exception thrown: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Request method failure captured: Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c HTTP/1.1 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFNdJeD5-_tuJeCMgsjM497sVDpeQ2xJeGrYFiHpSysIUJCqQ-hpvzJK3ppnZpni5k-YBU0qC5k5ftmjG3TyH3kAXpLnFpdw6fiPpM8D2BzoFszzxPuHI45IUdcgJ5wVwP40rGqJKBsCgrvf5st2iOvbciUKV2H-XOG1ln-Yky-uqI Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 56d16d15d11b40e188f517d24819845b Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: exception: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b5551fce-fc60-40fe-aa37-d96f5af28e0c'} Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.652313 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. Sep 18 01:24:27.657033 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:27.660177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Returning 404 to user: Instance b5551fce-fc60-40fe-aa37-d96f5af28e0c could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:27.661246 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3bbce8b3-cf8f-49c3-8485-bb154443dd60 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c" status: 404 len: 111 microversion: 2.20 time: 0.074681 Sep 18 01:24:27.662023 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2226/4489] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:27 2022] GET /compute/v2.1/servers/b5551fce-fc60-40fe-aa37-d96f5af28e0c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:24:28.140053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:28.140995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:28.151278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:28.152178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:28.153150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:28.154738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:28.155451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:28.156861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:28.176401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:28.196054 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-906f9617-3b92-4750-a647-062ee1e0550b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1675 microversion: 2.1 time: 0.618705 Sep 18 01:24:28.210004 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2264/4490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:27 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1675 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:28.232511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-08aaeba1-778f-4264-9782-0d29b3bbf92e req-573c2e20-6c08-449c-b1b7-43ac1f437276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6324c5-5c5c-4cb8-a8dc-873146ce7307", "name": "network-vif-plugged", "status": "completed", "tag": "c40caccf-4b1d-4150-ade3-6140c15ecdb0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:28.246518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08aaeba1-778f-4264-9782-0d29b3bbf92e req-573c2e20-6c08-449c-b1b7-43ac1f437276 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:28.246981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08aaeba1-778f-4264-9782-0d29b3bbf92e req-573c2e20-6c08-449c-b1b7-43ac1f437276 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:28.251272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-08aaeba1-778f-4264-9782-0d29b3bbf92e req-573c2e20-6c08-449c-b1b7-43ac1f437276 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:28.270523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-08aaeba1-778f-4264-9782-0d29b3bbf92e req-573c2e20-6c08-449c-b1b7-43ac1f437276 service nova] Creating event network-vif-plugged:c40caccf-4b1d-4150-ade3-6140c15ecdb0 for instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 on n-h2-master-1 Sep 18 01:24:28.277303 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-08aaeba1-778f-4264-9782-0d29b3bbf92e req-573c2e20-6c08-449c-b1b7-43ac1f437276 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065685 Sep 18 01:24:28.278728 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2265/4491] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:28.604092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:28.604668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:28.624415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:28.627966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:28.628464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:28.632476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:28.633014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:28.634967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:28.638122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:28.654541 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7147c080-9bc6-4a16-b6c0-cc20ceffd13f tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.516587 Sep 18 01:24:28.670647 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2227/4492] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:28 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:29.050735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:29.082375 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e6225d0a-55ee-4774-bd32-63314a8e086d tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 0.464027 Sep 18 01:24:29.098498 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2266/4493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:28 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:29.234786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:29.235905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:29.247816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.249084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.250107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.254787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.256256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.256938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.614821 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:29.628612 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-63404a85-70ea-471a-9bd0-732b5fe21fcd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1658 microversion: 2.1 time: 0.406461 Sep 18 01:24:29.631052 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2228/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:29 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1658 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:29.663813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:29.666682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:29.685490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:29.686660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:29.699780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.700358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.700818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.701585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.702040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.702165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.702936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.703633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.704615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.707467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.709003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.710067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.906034 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1a530bc-1c5b-424a-97a0-86bbb71b46f4 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.250675 Sep 18 01:24:29.913428 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2267/4495] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:24:29 2022] POST /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:24:29.934069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:29.935330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:29.950394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.951241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.951909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.954038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:29.955265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:29.955975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:29.976534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:29.987812 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6b3f2f60-b3a1-46e8-a249-07e4914ee8e4 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1333 microversion: 2.1 time: 0.307823 Sep 18 01:24:29.988912 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2229/4496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:29 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1333 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:30.122437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:30.123739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:30.149319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:30.156837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:30.157417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:30.161318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:30.162159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:30.163462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:30.989725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:30.998956 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15013518-18aa-47e9-928e-73863001bc71 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1664 microversion: 2.1 time: 1.083177 Sep 18 01:24:30.999545 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2268/4497] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:29 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1664 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:31.015498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-58b1de58-5224-4ccd-86d5-d02451d26593 req-625cb305-95de-45fb-8c57-b32f8cc79f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f22267-7e4b-43ed-ac39-2c46cbb65801", "name": "network-vif-plugged", "status": "completed", "tag": "236ef0d1-2eb0-43f6-af0d-a396fa2cebc3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:31.026651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-58b1de58-5224-4ccd-86d5-d02451d26593 req-625cb305-95de-45fb-8c57-b32f8cc79f70 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:31.027918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-58b1de58-5224-4ccd-86d5-d02451d26593 req-625cb305-95de-45fb-8c57-b32f8cc79f70 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:31.028506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-58b1de58-5224-4ccd-86d5-d02451d26593 req-625cb305-95de-45fb-8c57-b32f8cc79f70 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:31.062030 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-58b1de58-5224-4ccd-86d5-d02451d26593 req-625cb305-95de-45fb-8c57-b32f8cc79f70 service nova] Creating event network-vif-plugged:236ef0d1-2eb0-43f6-af0d-a396fa2cebc3 for instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 on n-h1-master-1 Sep 18 01:24:31.086741 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-58b1de58-5224-4ccd-86d5-d02451d26593 req-625cb305-95de-45fb-8c57-b32f8cc79f70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078320 Sep 18 01:24:31.087360 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2269/4498] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:31.088930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:31.095036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:31.095755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:31.102008 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d23eface-2e27-4aba-b21c-7e551e48962f tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 0.985905 Sep 18 01:24:31.104816 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2230/4499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:30 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:31.109942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:31.110448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:31.110888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:31.111599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:31.112062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:31.112488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:31.548153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:31.558198 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28b334bb-786c-4fc4-b43b-304b57c536e2 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1666 microversion: 2.1 time: 0.469636 Sep 18 01:24:31.586545 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2270/4500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:31 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1666 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:31.592696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:31.593288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:31.602213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:31.607518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:31.607886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:31.608629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:31.609091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:31.609513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:31.682909 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4fd945b8-59db-4163-97fe-7f7ca8c2a882 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307/ips" status: 200 len: 177 microversion: 2.1 time: 0.094581 Sep 18 01:24:31.686340 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2231/4501] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:24:31 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307/ips => generated 177 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:31.697445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:31.697982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:31.715805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:31.716302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:31.717262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:31.717428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:31.717918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:31.718345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:31.784421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:31.990944 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-44d6374d-8ca2-4e1c-8301-8bd871126c01 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 204 len: 0 microversion: 2.1 time: 0.295515 Sep 18 01:24:31.994839 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2271/4502] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:31 2022] DELETE /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:24:32.004914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:32.005534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:32.015606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:32.016363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:32.017007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:32.018380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:32.019556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:32.020988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:32.028326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:32.028753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:32.052027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:32.052858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:32.057545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:32.059160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:32.063023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:32.068132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:32.312038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:32.320299 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c79007f-3b2b-4316-9c6d-a4e3fa3d6b1e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1664 microversion: 2.1 time: 0.297610 Sep 18 01:24:32.320894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2272/4503] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:32 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1664 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:32.330309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:32.343570 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd0c0027-aac1-4420-82db-ccee0517f816 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1672 microversion: 2.1 time: 0.339360 Sep 18 01:24:32.344329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:32.344991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:32.358489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:32.361014 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2232/4504] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:31 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1672 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:32.361311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:32.362125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:32.367603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:32.368099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:32.368546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:32.562036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:32.570608 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e5c7771-8a79-485c-bb71-c8fe021fe2aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1326 microversion: 2.1 time: 0.248529 Sep 18 01:24:32.571211 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2273/4505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:32 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1326 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:33.351851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:33.352718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:33.360838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.361616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.366238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.373666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:33.376850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:33.384062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.387861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.388313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.400668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.404367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.406716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.410364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.410974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.411442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.817621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:33.843055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:33.846196 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:33.846533 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3eafd4d2-fea0-4a97-82a7-8a089766ca1a tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.496850 Sep 18 01:24:33.847623 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2233/4506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:33 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:33.854980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:33.856980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:33.866986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.867847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.868530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.870964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.871773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.872517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.872884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b00af6ea-80f3-4e6e-938e-03d9fb79af4a tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1672 microversion: 2.1 time: 0.504834 Sep 18 01:24:33.873495 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2274/4507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:33 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1672 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:33.892701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:33.893330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:33.900156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.900657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.901168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.901835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.902859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.903225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.904890 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] HTTP exception thrown: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Request method failure captured: Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 HTTP/1.1 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnFNdJeD5-_tuJeCMgsjM497sVDpeQ2xJeGrYFiHpSysIUJCqQ-hpvzJK3ppnZpni5k-YBU0qC5k5ftmjG3TyH3kAXpLnFpdw6fiPpM8D2BzoFszzxPuHI45IUdcgJ5wVwP40rGqJKBsCgrvf5st2iOvbciUKV2H-XOG1ln-Yky-uqI Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 56d16d15d11b40e188f517d24819845b Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4eb07fa2-83c3-452e-9777-fd357c981454'} Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:33.908215 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:33.915762 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:33.920547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Returning 404 to user: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:33.925138 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-02cea319-5f7c-4a69-b11f-24edefd1100f tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 404 len: 111 microversion: 2.20 time: 0.074214 Sep 18 01:24:33.933423 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2234/4508] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:24:33 2022] DELETE /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:24:33.941109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:33.942009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:33.950215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.951172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.951995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:33.953160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:33.954347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:33.954931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:34.306662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:34.316996 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ffee6822-5ac7-4eff-8695-b13c6ad31786 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1526 microversion: 2.1 time: 0.442424 Sep 18 01:24:34.317810 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2275/4509] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:33 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1526 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:34.332540 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:34.334317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:34.335204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] [instance: 4eb07fa2-83c3-452e-9777-fd357c981454] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:34.345840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:34.346883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:34.352514 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d4dad19d-795c-4239-949c-ddc2922b6e04 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1667 microversion: 2.1 time: 0.421147 Sep 18 01:24:34.353104 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2235/4510] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:33 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1667 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:34.353741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:34.354755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:34.355514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:34.356198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:34.363961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:34.368533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:34.388721 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] HTTP exception thrown: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Request method failure captured: Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 HTTP/1.1 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnFNdJeD5-_tuJeCMgsjM497sVDpeQ2xJeGrYFiHpSysIUJCqQ-hpvzJK3ppnZpni5k-YBU0qC5k5ftmjG3TyH3kAXpLnFpdw6fiPpM8D2BzoFszzxPuHI45IUdcgJ5wVwP40rGqJKBsCgrvf5st2iOvbciUKV2H-XOG1ln-Yky-uqI Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b7dafe6d2840208386dc8a2c95006b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 64b7dafe6d2840208386dc8a2c95006b Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1364779061 Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 56d16d15d11b40e188f517d24819845b Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1364779061-project Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4eb07fa2-83c3-452e-9777-fd357c981454'} Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:34.395619 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. Sep 18 01:24:34.400870 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:34.401465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:34.401465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:34.401465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:34.402760 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] Returning 404 to user: Instance 4eb07fa2-83c3-452e-9777-fd357c981454 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:34.402859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:34.402859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:34.402859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:34.403120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9ceb8948-4421-4a86-b08d-161381acb351 tempest-AttachVolumeShelveTestJSON-1364779061 tempest-AttachVolumeShelveTestJSON-1364779061-project] 10.222.0.25 "GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454" status: 404 len: 111 microversion: 2.20 time: 0.083505 Sep 18 01:24:34.404371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2276/4511] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:24:34 2022] GET /compute/v2.1/servers/4eb07fa2-83c3-452e-9777-fd357c981454 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:24:34.408306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:34.408852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:34.424828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:34.425332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:34.425819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:34.426536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:34.427182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:34.427912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:34.491133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:34.500170 n-d-master-1 devstack@n-api.service[122374]: INFO nova.compute.api [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Working on deleting snapshot 9428818a-806b-400b-a715-0200dfd97fe5 from shelved instance... Sep 18 01:24:34.638437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:34.646274 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d7dd317-1c0f-407f-9953-2612ab24e271 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1526 microversion: 2.1 time: 0.287318 Sep 18 01:24:34.658333 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2236/4512] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:34 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1526 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:35.325835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:35.326621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:35.339743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:35.342629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:35.343284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:35.347046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:35.348172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:35.348939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:35.398982 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] HTTP exception thrown: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Request method failure captured: Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 HTTP/1.1 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnM7ZeOxBuCMmmGSm5IMsbytkvZhBZqUNXOJXtce5CjWxYRmXwfwpPjhc5bQq77tDJVMtiPHZfzQrzbwnygySAr98iJpkY56J8VDqXqyslNRGPuFmEOfiP-2gOG4rn3S9bhDRgwRobFrTz11N-5L4T35Q-b51dC-rTbGJSJ03bT7f8s Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fcf2392ea6d8452c9902d389bb826a86 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1772773413 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1772773413 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fcf2392ea6d8452c9902d389bb826a86 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1772773413 Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1772773413-project Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 08af1c09d16b42be8a0c354ed5a6f18d Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1772773413-project Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '23f22267-7e4b-43ed-ac39-2c46cbb65801'} Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:35.400819 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:35.405522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Returning 404 to user: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:35.406439 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a3e645c7-b9ae-435f-ad17-54dc63d9af06 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 404 len: 111 microversion: 2.1 time: 0.722532 Sep 18 01:24:35.417944 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2237/4513] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:34 2022] DELETE /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 111 bytes in 737 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:35.422826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:35.423461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:35.446515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:35.447025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:35.447477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:35.448196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:35.448660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:35.463279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:35.801127 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:35.816422 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7ceb6bab-c5c1-416d-a749-3bb2b1cdd2ae tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1651 microversion: 2.1 time: 0.396899 Sep 18 01:24:35.835165 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2238/4514] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:35 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1651 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:35.858382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b77dc63c-637e-49ed-b78f-5aeeed2475ad req-3e6a3ba2-6f53-45f5-abae-c7d0c69be902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6324c5-5c5c-4cb8-a8dc-873146ce7307", "name": "network-vif-deleted", "tag": "c40caccf-4b1d-4150-ade3-6140c15ecdb0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:35.884170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b77dc63c-637e-49ed-b78f-5aeeed2475ad req-3e6a3ba2-6f53-45f5-abae-c7d0c69be902 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:35.886972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b77dc63c-637e-49ed-b78f-5aeeed2475ad req-3e6a3ba2-6f53-45f5-abae-c7d0c69be902 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:35.887462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b77dc63c-637e-49ed-b78f-5aeeed2475ad req-3e6a3ba2-6f53-45f5-abae-c7d0c69be902 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:35.926987 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b77dc63c-637e-49ed-b78f-5aeeed2475ad req-3e6a3ba2-6f53-45f5-abae-c7d0c69be902 service nova] Creating event network-vif-deleted:c40caccf-4b1d-4150-ade3-6140c15ecdb0 for instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 on n-h2-master-1 Sep 18 01:24:35.961324 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b77dc63c-637e-49ed-b78f-5aeeed2475ad req-3e6a3ba2-6f53-45f5-abae-c7d0c69be902 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108025 Sep 18 01:24:35.963510 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2239/4515] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:35.988926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:35.991861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:36.018606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:36.022641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:36.023142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:36.023902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:36.031932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Doing local delete in cell bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) {{(pid=122374) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 18 01:24:36.032676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:36.033736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:36.035159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:36.038162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:36.038809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:36.041022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.compute.api [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 18 01:24:36.060782 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] deallocate_for_instance() {{(pid=122374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 18 01:24:36.762541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:36.772414 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ce8d0cf-6dff-451a-8ae9-4501ffdf76aa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1526 microversion: 2.1 time: 0.806042 Sep 18 01:24:36.773222 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2240/4516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:35 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1526 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:36.803732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Action: 'update', calling method: >, body: {"server": {"name": "23f22267-7e4b-43ed-ac39-2c46cbb65801_new"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:36.806575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:36.818810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:36.819597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:36.823932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:36.825128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:36.825802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:36.826418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:36.853250 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] HTTP exception thrown: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Request method failure captured: Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: request: PUT /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 HTTP/1.1 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 64 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnM7ZeOxBuCMmmGSm5IMsbytkvZhBZqUNXOJXtce5CjWxYRmXwfwpPjhc5bQq77tDJVMtiPHZfzQrzbwnygySAr98iJpkY56J8VDqXqyslNRGPuFmEOfiP-2gOG4rn3S9bhDRgwRobFrTz11N-5L4T35Q-b51dC-rTbGJSJ03bT7f8s Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fcf2392ea6d8452c9902d389bb826a86 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1772773413 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fcf2392ea6d8452c9902d389bb826a86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1772773413 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fcf2392ea6d8452c9902d389bb826a86 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1772773413 Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1772773413-project Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 08af1c09d16b42be8a0c354ed5a6f18d Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1772773413-project Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: {"server": {"name": "23f22267-7e4b-43ed-ac39-2c46cbb65801_new"}} Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '23f22267-7e4b-43ed-ac39-2c46cbb65801', 'body': {'server': {'name': '23f22267-7e4b-43ed-ac39-2c46cbb65801_new'}}} Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:24:36.859055 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:36.864727 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:36.887394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] Returning 404 to user: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:36.888305 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-138b7b37-6eda-42e5-bc0a-4590e549ba49 tempest-ServersNegativeTestMultiTenantJSON-1772773413 tempest-ServersNegativeTestMultiTenantJSON-1772773413-project] 10.222.0.25 "PUT /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 404 len: 111 microversion: 2.1 time: 0.088552 Sep 18 01:24:36.888918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2241/4517] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:24:36 2022] PUT /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:24:36.900493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:36.904473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:36.917704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:36.921921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:36.922571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:36.923492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:36.924109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:36.925046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:37.004141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:37.004826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:37.005416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:37.007010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lazy-loading 'fault' on Instance uuid 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:24:37.012824 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:37.183560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e323f16e84023b3654df87c4cc55c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed34e8b9574a3c82538941c839cbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:37.191324 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6f41f4d-206e-4f0a-b777-8ff7a3d737e9 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 200 len: 1302 microversion: 2.1 time: 0.294901 Sep 18 01:24:37.199622 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2242/4518] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:36 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 1302 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:37.204646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:37.220628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:37.239048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:37.240384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:37.245702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:37.246969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:37.247670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:37.248354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:37.329786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:37.512850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-653b2676-b5d8-4a8b-b532-bfee22c8c5fa tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 204 len: 0 microversion: 2.1 time: 0.311687 Sep 18 01:24:37.514206 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2243/4519] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:37 2022] DELETE /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:24:37.523709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:37.525313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:37.536744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:37.546093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:37.546840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:37.547848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:37.549832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:37.550577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.025232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Updating instance_info_cache with network_info: [] {{(pid=122374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 18 01:24:38.142480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:38.158516 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb715fb7-a8a0-41e0-94a0-a013772cf31a tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1532 microversion: 2.1 time: 0.639402 Sep 18 01:24:38.174602 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2244/4520] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:37 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1532 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:38.182311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-05bc2661-ce67-46d6-a748-4ac571ebebd3 req-1bf29ca5-c3e7-43da-ba84-b89c2cf000f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6324c5-5c5c-4cb8-a8dc-873146ce7307", "name": "network-vif-deleted", "tag": "78496cbc-d32e-4b35-a6cb-c987fb4eeb40"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:38.217867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-05bc2661-ce67-46d6-a748-4ac571ebebd3 req-1bf29ca5-c3e7-43da-ba84-b89c2cf000f3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:38.218637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-05bc2661-ce67-46d6-a748-4ac571ebebd3 req-1bf29ca5-c3e7-43da-ba84-b89c2cf000f3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:38.219238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-05bc2661-ce67-46d6-a748-4ac571ebebd3 req-1bf29ca5-c3e7-43da-ba84-b89c2cf000f3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.234284 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-05bc2661-ce67-46d6-a748-4ac571ebebd3 req-1bf29ca5-c3e7-43da-ba84-b89c2cf000f3 service nova] Creating event network-vif-deleted:78496cbc-d32e-4b35-a6cb-c987fb4eeb40 for instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 on n-h2-master-1 Sep 18 01:24:38.239576 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-05bc2661-ce67-46d6-a748-4ac571ebebd3 req-1bf29ca5-c3e7-43da-ba84-b89c2cf000f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063427 Sep 18 01:24:38.241149 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2245/4521] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:38.247240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:38.248189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:38.254943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:38.255666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:38.256506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.257659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:38.258275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:38.258857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.277803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] HTTP exception thrown: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Request method failure captured: Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 HTTP/1.1 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnKuUIc9iVfoz5Qkn5jlHXsP4Ah5bOpI84_Crn-dNFi2xI7XrqVbFyI56c7YNIczY3cUJ1k8Ia7yxROYtkEUXfFnv2knmBudEXOfDTJSAmmmO1qEUtGgzGeiBaioBS_3TrmHe2e41ppfbPSqSGkhweU13v0FXxs0rQmrm1ryksfmt3I Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fe3e323f16e84023b3654df87c4cc55c Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6d6324c5-5c5c-4cb8-a8dc-873146ce7307'} Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:38.279699 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.283876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:38.283876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:38.283876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:38.283876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:38.283876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:38.283876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:38.283876 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.285763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Returning 404 to user: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:38.287126 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1eb2a8fc-e5ed-4041-ac4b-972712a472cd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 404 len: 111 microversion: 2.1 time: 0.044543 Sep 18 01:24:38.288220 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2246/4522] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:38 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:38.662078 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0de586ba-ab0f-4b99-9eea-d3dff8ab5b9c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 204 len: 0 microversion: 2.1 time: 4.254740 Sep 18 01:24:38.666349 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2277/4523] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:34 2022] DELETE /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 0 bytes in 4262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:24:38.675734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:38.676957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 6453f292-44d8-48e4-881a-10a4c29cf384] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:38.697254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:38.700075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:38.702901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.703842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:38.709534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:38.711911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.769902 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] HTTP exception thrown: Instance 6453f292-44d8-48e4-881a-10a4c29cf384 could not be found. Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Request method failure captured: Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 HTTP/1.1 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEOgNEG5Yrkuy4LYnmsLkfjDIZyusPsSFQGENObC2s1nEDt9jGhykJ7VVZwz_UFe4gEuuEvbq_ta4QaCq8Wj7f-IzNmZzMlb91c410eNKmtgKuLNWs8KRq_IBfuJ6fmq03SKKrL5P0Ck-_8fcFW7J4qiyDPfVMZDrOaS3dWphw7WSw Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 0212658356c1456ebe01dfe00dcd4fd2 Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6453f292-44d8-48e4-881a-10a4c29cf384 could not be found. Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6453f292-44d8-48e4-881a-10a4c29cf384'} Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6453f292-44d8-48e4-881a-10a4c29cf384 could not be found. Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6453f292-44d8-48e4-881a-10a4c29cf384 could not be found. Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:38.780732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6453f292-44d8-48e4-881a-10a4c29cf384 could not be found. Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Returning 404 to user: Instance 6453f292-44d8-48e4-881a-10a4c29cf384 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:38.785417 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-db5427b8-e567-4684-8c0e-4a751e87d7d0 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384" status: 404 len: 111 microversion: 2.1 time: 0.111634 Sep 18 01:24:38.788672 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2247/4524] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:38 2022] GET /compute/v2.1/servers/6453f292-44d8-48e4-881a-10a4c29cf384 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:38.798784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:38.799528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:38.827334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:38.828709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:38.829494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.830862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:38.831507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:38.832107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:38.894061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:39.039183 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bcece53b-c9e4-4426-b9e3-9407abc03b1c tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 204 len: 0 microversion: 2.1 time: 0.244568 Sep 18 01:24:39.040140 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2278/4525] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:38 2022] DELETE /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:24:39.049940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:39.050713 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:39.061935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:39.063500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:39.064972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:39.067149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:39.068828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:39.069384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:39.187391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:39.188786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:39.206213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:39.206917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:39.207719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:39.208951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:39.209699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:39.210290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:39.419926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:39.429080 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eea74a94-7ac1-4d9b-ab23-4cdb8b4886fd tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1464 microversion: 2.1 time: 0.383473 Sep 18 01:24:39.429697 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2248/4526] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:39 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1464 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:39.584476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:39.594716 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f1d9841-ea84-4712-bb37-34391481d9d5 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1532 microversion: 2.1 time: 0.413793 Sep 18 01:24:39.602549 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2279/4527] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:39 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1532 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:40.293845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b86ca6f1-97b3-4917-abe4-52d1112014ee req-61a4c2ff-1935-4433-8124-af171b995b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6453f292-44d8-48e4-881a-10a4c29cf384", "name": "network-vif-deleted", "tag": "bfb94a07-ef40-4dc0-9b1d-711c880f6915"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:40.309228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b86ca6f1-97b3-4917-abe4-52d1112014ee req-61a4c2ff-1935-4433-8124-af171b995b98 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:40.309748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b86ca6f1-97b3-4917-abe4-52d1112014ee req-61a4c2ff-1935-4433-8124-af171b995b98 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:40.320471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b86ca6f1-97b3-4917-abe4-52d1112014ee req-61a4c2ff-1935-4433-8124-af171b995b98 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:40.361751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.compute.server_external_events [req-b86ca6f1-97b3-4917-abe4-52d1112014ee req-61a4c2ff-1935-4433-8124-af171b995b98 service nova] Unable to find a host for instance 6453f292-44d8-48e4-881a-10a4c29cf384. Dropping event network-vif-deleted {{(pid=122373) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 18 01:24:40.362961 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b86ca6f1-97b3-4917-abe4-52d1112014ee req-61a4c2ff-1935-4433-8124-af171b995b98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.073022 Sep 18 01:24:40.365691 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2249/4528] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 18 01:24:40.453876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:40.454516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:40.469768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:40.471251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:40.474455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:40.475210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:40.476841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:40.477306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:40.629373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:40.630891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:40.641948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:40.643024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:40.643617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:40.645983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:40.647362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:40.648099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:40.668559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:40.687035 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bbba1e0b-7a2d-47fc-a8d2-3328c2264641 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1464 microversion: 2.1 time: 0.238504 Sep 18 01:24:40.687629 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2280/4529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:40 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:41.033163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:41.060801 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-44e0fe9a-e865-4f2f-81aa-ae8d2e587d54 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1532 microversion: 2.1 time: 0.436352 Sep 18 01:24:41.065915 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2250/4530] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:40 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1532 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:24:41.711580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:41.712195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:41.719066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:41.730891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:41.731611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:41.732549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:41.733744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:41.734361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:41.962075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:42.005435 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb4984fd-80fd-4fe1-937b-7a376b41cf83 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1464 microversion: 2.1 time: 0.295667 Sep 18 01:24:42.009410 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2281/4531] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:41 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1464 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:42.088795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:42.090226 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:42.102134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:42.102949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:42.105864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:42.106797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:42.110311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:42.111018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:42.911284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfddeaf8ab0495586cf33756f51ecdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e38310791d4e0d8517a308c5f2cf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:42.940129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8c5bf9a6-432e-461f-a851-c688fa7e8833 req-b3e5a0c4-074d-4660-9664-21a50d42cee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f22267-7e4b-43ed-ac39-2c46cbb65801", "name": "network-vif-deleted", "tag": "236ef0d1-2eb0-43f6-af0d-a396fa2cebc3"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:42.974914 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4943327d-a173-4169-8bde-1b42c2083b94 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 200 len: 1532 microversion: 2.1 time: 0.889766 Sep 18 01:24:42.980717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8c5bf9a6-432e-461f-a851-c688fa7e8833 req-b3e5a0c4-074d-4660-9664-21a50d42cee3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:42.981255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8c5bf9a6-432e-461f-a851-c688fa7e8833 req-b3e5a0c4-074d-4660-9664-21a50d42cee3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:42.984814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8c5bf9a6-432e-461f-a851-c688fa7e8833 req-b3e5a0c4-074d-4660-9664-21a50d42cee3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:42.988546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2251/4532] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:42 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 1532 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:43.027303 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8c5bf9a6-432e-461f-a851-c688fa7e8833 req-b3e5a0c4-074d-4660-9664-21a50d42cee3 service nova] Creating event network-vif-deleted:236ef0d1-2eb0-43f6-af0d-a396fa2cebc3 for instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 on n-h1-master-1 Sep 18 01:24:43.035583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:43.036814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:43.043951 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8c5bf9a6-432e-461f-a851-c688fa7e8833 req-b3e5a0c4-074d-4660-9664-21a50d42cee3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104797 Sep 18 01:24:43.045450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2282/4533] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:43.058118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:43.061522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:43.062458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:43.066388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:43.067638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:43.069678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:43.361283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:43.391012 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ce334be-5431-4313-aa83-b52f1ffffc94 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1464 microversion: 2.1 time: 0.360220 Sep 18 01:24:43.398963 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2252/4534] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:43 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:44.002919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:44.004198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] [instance: 23f22267-7e4b-43ed-ac39-2c46cbb65801] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:44.026554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:44.028404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:44.031881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:44.034097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:44.035081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:44.036355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:44.068930 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] HTTP exception thrown: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Request method failure captured: Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 HTTP/1.1 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnMsZxURUEBk6QrrIJkyXc4SSFvRYU_DJlam6esywX5vUo-Gt-UleAYT6E0DnX-ztwP0j7uMUCDYXtRfFgq6FJTkiv6QDkViCdaW9xhM6baM8HG6Re_dfWAvPQHRwDh_MCUM0f4iuCoFDodsCxlr3RDnv8DlROa5OGbscaKKAZOMP_s Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 17e38310791d4e0d8517a308c5f2cf07 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1107824243 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/17e38310791d4e0d8517a308c5f2cf07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/17e38310791d4e0d8517a308c5f2cf07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_17e38310791d4e0d8517a308c5f2cf07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/17e38310791d4e0d8517a308c5f2cf07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1107824243 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 17e38310791d4e0d8517a308c5f2cf07 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1107824243 Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1107824243-project Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 6dfddeaf8ab0495586cf33756f51ecdd Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1107824243-project Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '23f22267-7e4b-43ed-ac39-2c46cbb65801'} Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:44.071614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. Sep 18 01:24:44.080720 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:44.099672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] Returning 404 to user: Instance 23f22267-7e4b-43ed-ac39-2c46cbb65801 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:44.101630 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-541b9201-c336-4f12-b44a-10990db0f3c8 tempest-ServersNegativeTestMultiTenantJSON-1107824243 tempest-ServersNegativeTestMultiTenantJSON-1107824243-project] 10.222.0.25 "GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801" status: 404 len: 111 microversion: 2.1 time: 0.104436 Sep 18 01:24:44.103387 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2283/4535] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:43 2022] GET /compute/v2.1/servers/23f22267-7e4b-43ed-ac39-2c46cbb65801 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:44.420409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:44.421690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:44.439919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:44.441251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:44.441954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:44.442929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:44.443616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:44.444313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:44.544127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:44.552874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:44.553579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:44.554181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lazy-loading 'fault' on Instance uuid 5c963839-4902-4588-a336-b34fe7be811a {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:24:44.761980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:44.780975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e449d11-8610-4006-b9f9-8d952787f420 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 200 len: 1304 microversion: 2.1 time: 0.364535 Sep 18 01:24:44.783428 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2253/4536] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:44 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 1304 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:45.092875 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f1beece5-8749-4fe0-99a7-b369a50baa45 req-57f80d3b-a51a-4457-b3a2-d8dbd1babebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c963839-4902-4588-a336-b34fe7be811a", "name": "network-vif-deleted", "tag": "6d6361a7-5108-4299-a411-43d3e7b1ec74"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:45.115983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1beece5-8749-4fe0-99a7-b369a50baa45 req-57f80d3b-a51a-4457-b3a2-d8dbd1babebb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:45.117319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1beece5-8749-4fe0-99a7-b369a50baa45 req-57f80d3b-a51a-4457-b3a2-d8dbd1babebb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:45.118116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1beece5-8749-4fe0-99a7-b369a50baa45 req-57f80d3b-a51a-4457-b3a2-d8dbd1babebb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:45.140717 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f1beece5-8749-4fe0-99a7-b369a50baa45 req-57f80d3b-a51a-4457-b3a2-d8dbd1babebb service nova] Creating event network-vif-deleted:6d6361a7-5108-4299-a411-43d3e7b1ec74 for instance 5c963839-4902-4588-a336-b34fe7be811a on n-h1-master-1 Sep 18 01:24:45.148648 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f1beece5-8749-4fe0-99a7-b369a50baa45 req-57f80d3b-a51a-4457-b3a2-d8dbd1babebb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059667 Sep 18 01:24:45.150200 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2284/4537] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:45.812978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:45.813719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 5c963839-4902-4588-a336-b34fe7be811a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:45.834990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:45.835516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:45.837419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:45.840913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:45.841408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:45.842094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:45.907632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:45.908422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:45.912347 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] HTTP exception thrown: Instance 5c963839-4902-4588-a336-b34fe7be811a could not be found. Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Request method failure captured: Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a HTTP/1.1 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEOgNEG5Yrkuy4LYnmsLkfjDIZyusPsSFQGENObC2s1nEDt9jGhykJ7VVZwz_UFe4gEuuEvbq_ta4QaCq8Wj7f-IzNmZzMlb91c410eNKmtgKuLNWs8KRq_IBfuJ6fmq03SKKrL5P0Ck-_8fcFW7J4qiyDPfVMZDrOaS3dWphw7WSw Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 0212658356c1456ebe01dfe00dcd4fd2 Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5c963839-4902-4588-a336-b34fe7be811a could not be found. Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5c963839-4902-4588-a336-b34fe7be811a'} Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c963839-4902-4588-a336-b34fe7be811a could not be found. Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c963839-4902-4588-a336-b34fe7be811a could not be found. Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:45.920207 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.925352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:45.925352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:45.925352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:45.925352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:45.925352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:45.925352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c963839-4902-4588-a336-b34fe7be811a could not be found. Sep 18 01:24:45.925352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.926904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:45.927256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:45.927710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:45.929175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Returning 404 to user: Instance 5c963839-4902-4588-a336-b34fe7be811a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:45.930896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5be3e93-6aad-4de8-adac-aa0087e75ec6 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a" status: 404 len: 111 microversion: 2.1 time: 0.127259 Sep 18 01:24:45.933040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:45.934304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:45.935111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:45.936698 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2254/4538] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:45 2022] GET /compute/v2.1/servers/5c963839-4902-4588-a336-b34fe7be811a => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:45.949804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:45.950328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:45.963399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:45.963903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:45.964878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:45.965670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:45.966056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:45.967556 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] HTTP exception thrown: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:45.970361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Request method failure captured: Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 HTTP/1.1 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnKuUIc9iVfoz5Qkn5jlHXsP4Ah5bOpI84_Crn-dNFi2xI7XrqVbFyI56c7YNIczY3cUJ1k8Ia7yxROYtkEUXfFnv2knmBudEXOfDTJSAmmmO1qEUtGgzGeiBaioBS_3TrmHe2e41ppfbPSqSGkhweU13v0FXxs0rQmrm1ryksfmt3I Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe3e323f16e84023b3654df87c4cc55c Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6d6324c5-5c5c-4cb8-a8dc-873146ce7307'} Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:45.972996 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Returning 404 to user: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:45.978411 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9bd6b7f9-189a-4c0f-9dd4-bfcff85039dd tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 404 len: 111 microversion: 2.1 time: 0.073224 Sep 18 01:24:45.980680 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2285/4539] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:45 2022] DELETE /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:24:45.990042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:45.993038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 6d6324c5-5c5c-4cb8-a8dc-873146ce7307] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:46.005079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.008710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.009454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.010428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.013217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.013903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.051465 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] HTTP exception thrown: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Request method failure captured: Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 HTTP/1.1 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnKuUIc9iVfoz5Qkn5jlHXsP4Ah5bOpI84_Crn-dNFi2xI7XrqVbFyI56c7YNIczY3cUJ1k8Ia7yxROYtkEUXfFnv2knmBudEXOfDTJSAmmmO1qEUtGgzGeiBaioBS_3TrmHe2e41ppfbPSqSGkhweU13v0FXxs0rQmrm1ryksfmt3I Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe3e323f16e84023b3654df87c4cc55c Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6d6324c5-5c5c-4cb8-a8dc-873146ce7307'} Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:46.057595 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.061566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.061566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:46.061566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:46.061566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:46.061566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:46.061566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. Sep 18 01:24:46.061566 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.062205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:46.064004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Returning 404 to user: Instance 6d6324c5-5c5c-4cb8-a8dc-873146ce7307 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:46.066540 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac2f2562-059c-43f6-a455-903408370572 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307" status: 404 len: 111 microversion: 2.1 time: 0.084637 Sep 18 01:24:46.069450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2286/4540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:45 2022] GET /compute/v2.1/servers/6d6324c5-5c5c-4cb8-a8dc-873146ce7307 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:46.081323 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:46.084288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:46.094899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.096061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.097086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.103878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.107242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.107923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.161134 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] HTTP exception thrown: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Request method failure captured: Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 HTTP/1.1 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnKuUIc9iVfoz5Qkn5jlHXsP4Ah5bOpI84_Crn-dNFi2xI7XrqVbFyI56c7YNIczY3cUJ1k8Ia7yxROYtkEUXfFnv2knmBudEXOfDTJSAmmmO1qEUtGgzGeiBaioBS_3TrmHe2e41ppfbPSqSGkhweU13v0FXxs0rQmrm1ryksfmt3I Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe3e323f16e84023b3654df87c4cc55c Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1ecbea90-06d3-4936-be5c-54d9b42bc974'} Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:46.164134 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Returning 404 to user: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:46.171418 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d9f20257-7a7c-48b8-bf4f-edb00666d605 tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 404 len: 111 microversion: 2.1 time: 0.094731 Sep 18 01:24:46.172981 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2287/4541] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:46 2022] DELETE /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:24:46.186241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:46.190433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] [instance: 1ecbea90-06d3-4936-be5c-54d9b42bc974] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:46.205518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.206855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.208116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.210778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.211267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.211710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.260227 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:46.263856 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] HTTP exception thrown: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Request method failure captured: Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 HTTP/1.1 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnKuUIc9iVfoz5Qkn5jlHXsP4Ah5bOpI84_Crn-dNFi2xI7XrqVbFyI56c7YNIczY3cUJ1k8Ia7yxROYtkEUXfFnv2knmBudEXOfDTJSAmmmO1qEUtGgzGeiBaioBS_3TrmHe2e41ppfbPSqSGkhweU13v0FXxs0rQmrm1ryksfmt3I Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8ed34e8b9574a3c82538941c839cbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d8ed34e8b9574a3c82538941c839cbd5 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestMultiNic-244433142 Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe3e323f16e84023b3654df87c4cc55c Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestMultiNic-244433142-project Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1ecbea90-06d3-4936-be5c-54d9b42bc974'} Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:46.268051 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.272012 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:46.272012 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:46.272012 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:46.272012 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:46.272012 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:46.272012 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. Sep 18 01:24:46.272012 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:46.272434 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ddf1a81-8217-4630-9aa8-36f4caff0424 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 204 len: 0 microversion: 2.1 time: 0.329510 Sep 18 01:24:46.272525 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] Returning 404 to user: Instance 1ecbea90-06d3-4936-be5c-54d9b42bc974 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:46.272525 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f0e3582-b438-46bd-9710-c95fff464d4d tempest-ServersTestMultiNic-244433142 tempest-ServersTestMultiNic-244433142-project] 10.222.0.25 "GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974" status: 404 len: 111 microversion: 2.1 time: 0.096165 Sep 18 01:24:46.272844 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2255/4542] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:45 2022] DELETE /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:24:46.278208 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2288/4543] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:46 2022] GET /compute/v2.1/servers/1ecbea90-06d3-4936-be5c-54d9b42bc974 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:46.283938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:46.284571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:46.305298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.306659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.307113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.308514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:46.308987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:46.309455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:46.848433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:46.870973 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2e82a38-d079-4f2f-9737-701cdcae2731 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1505 microversion: 2.1 time: 0.589280 Sep 18 01:24:46.875103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2289/4544] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:46 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:47.904044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:47.905373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:47.921825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:47.923543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:47.924723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:47.927096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:47.928911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:47.930747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:48.289766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:48.317475 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00e2673a-52dc-4537-931b-da8ab415aef9 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1505 microversion: 2.1 time: 0.419709 Sep 18 01:24:48.320605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2256/4545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:47 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:48.493908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-95f41901-da74-40fa-95b3-9b7cd1fc4c58 req-f4912066-4f5f-4405-820c-42d4ce3c8763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e", "name": "network-vif-deleted", "tag": "4c635477-f2c9-4742-bdfe-5c726303ec90"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:48.511607 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:48.513525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95f41901-da74-40fa-95b3-9b7cd1fc4c58 req-f4912066-4f5f-4405-820c-42d4ce3c8763 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:48.514024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95f41901-da74-40fa-95b3-9b7cd1fc4c58 req-f4912066-4f5f-4405-820c-42d4ce3c8763 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:48.514453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95f41901-da74-40fa-95b3-9b7cd1fc4c58 req-f4912066-4f5f-4405-820c-42d4ce3c8763 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:48.548216 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-95f41901-da74-40fa-95b3-9b7cd1fc4c58 req-f4912066-4f5f-4405-820c-42d4ce3c8763 service nova] Creating event network-vif-deleted:4c635477-f2c9-4742-bdfe-5c726303ec90 for instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e on n-h2-master-1 Sep 18 01:24:48.559417 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-95f41901-da74-40fa-95b3-9b7cd1fc4c58 req-f4912066-4f5f-4405-820c-42d4ce3c8763 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063754 Sep 18 01:24:48.560533 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2290/4546] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:49.346880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:49.347571 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:49.351244 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:49.375681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:49.380427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:49.381282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:49.384446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:49.387426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:49.390609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:49.532061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:49.535036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:49.536046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:49.538405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lazy-loading 'fault' on Instance uuid eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:24:49.791122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:49.812453 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-391ea80f-5d62-494d-9b94-604ac2b2be02 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 200 len: 1304 microversion: 2.1 time: 0.467353 Sep 18 01:24:49.820551 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2257/4547] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:49 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 1304 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:50.847507 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:50.851970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:50.865719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:50.867350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:50.868038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:50.870109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:50.871041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:50.871646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:50.903131 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] HTTP exception thrown: Instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e could not be found. Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Request method failure captured: Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e HTTP/1.1 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEOgNEG5Yrkuy4LYnmsLkfjDIZyusPsSFQGENObC2s1nEDt9jGhykJ7VVZwz_UFe4gEuuEvbq_ta4QaCq8Wj7f-IzNmZzMlb91c410eNKmtgKuLNWs8KRq_IBfuJ6fmq03SKKrL5P0Ck-_8fcFW7J4qiyDPfVMZDrOaS3dWphw7WSw Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0212658356c1456ebe01dfe00dcd4fd2 Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: exception: Instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e could not be found. Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e'} Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e could not be found. Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e could not be found. Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:50.904936 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:50.909757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:50.909757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:50.909757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:50.909757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:50.909757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:50.909757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e could not be found. Sep 18 01:24:50.909757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:50.912377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Returning 404 to user: Instance eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:50.913492 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-18a1a1e3-d982-4e24-86b7-af80a597af66 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e" status: 404 len: 111 microversion: 2.1 time: 0.079338 Sep 18 01:24:50.916153 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2291/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:50 2022] GET /compute/v2.1/servers/eb5a03cf-8e29-4d0e-a19f-e7057e4dea2e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:50.925139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:50.926963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:50.936263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:50.937236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:50.937857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:50.939120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:50.939984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:50.942297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:50.977766 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:24:50.999659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:51.196570 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-278d67c8-18bd-4609-bef7-392610183a59 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "DELETE /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 204 len: 0 microversion: 2.1 time: 0.275213 Sep 18 01:24:51.197166 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2258/4549] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:50 2022] DELETE /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:24:51.206166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:51.206862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:51.217114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:51.224360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:51.225210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:51.228040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:51.232074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:51.232830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:51.740213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:51.750203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-32a38751-b247-488e-886d-87c8f3060ab3 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1494 microversion: 2.1 time: 0.547723 Sep 18 01:24:51.753965 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2292/4550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:51 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1494 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:52.782092 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:52.783186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:52.801062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:52.801991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:52.803441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:52.807059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:52.808679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:52.811534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:52.911594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d4d22bbd-ad1a-4069-83ec-e7b2989ec442 req-06f3a8ea-89a2-4c6a-b4ab-0e6f04d4905c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271b08cd-ead0-419b-a556-de0e468f4a74", "name": "network-vif-deleted", "tag": "444667b2-a45c-4097-8add-787209ff3d3c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:52.941468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d4d22bbd-ad1a-4069-83ec-e7b2989ec442 req-06f3a8ea-89a2-4c6a-b4ab-0e6f04d4905c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:52.942268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d4d22bbd-ad1a-4069-83ec-e7b2989ec442 req-06f3a8ea-89a2-4c6a-b4ab-0e6f04d4905c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:52.942882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d4d22bbd-ad1a-4069-83ec-e7b2989ec442 req-06f3a8ea-89a2-4c6a-b4ab-0e6f04d4905c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:52.957786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d4d22bbd-ad1a-4069-83ec-e7b2989ec442 req-06f3a8ea-89a2-4c6a-b4ab-0e6f04d4905c service nova] Creating event network-vif-deleted:444667b2-a45c-4097-8add-787209ff3d3c for instance 271b08cd-ead0-419b-a556-de0e468f4a74 on n-h1-master-1 Sep 18 01:24:52.963604 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d4d22bbd-ad1a-4069-83ec-e7b2989ec442 req-06f3a8ea-89a2-4c6a-b4ab-0e6f04d4905c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059895 Sep 18 01:24:52.969697 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2293/4551] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 18 01:24:53.576748 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:53.596931 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-db517263-3df9-4e85-abd8-e1f3d706025d tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 200 len: 1452 microversion: 2.1 time: 0.824184 Sep 18 01:24:53.597896 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2259/4552] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:52 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 1452 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:54.626960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:54.627878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 271b08cd-ead0-419b-a556-de0e468f4a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:54.645150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:54.645733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:54.646286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:54.649721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:54.650330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:54.650877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:54.678907 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] HTTP exception thrown: Instance 271b08cd-ead0-419b-a556-de0e468f4a74 could not be found. Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Request method failure captured: Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 HTTP/1.1 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnEOgNEG5Yrkuy4LYnmsLkfjDIZyusPsSFQGENObC2s1nEDt9jGhykJ7VVZwz_UFe4gEuuEvbq_ta4QaCq8Wj7f-IzNmZzMlb91c410eNKmtgKuLNWs8KRq_IBfuJ6fmq03SKKrL5P0Ck-_8fcFW7J4qiyDPfVMZDrOaS3dWphw7WSw Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 0212658356c1456ebe01dfe00dcd4fd2 Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 271b08cd-ead0-419b-a556-de0e468f4a74 could not be found. Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '271b08cd-ead0-419b-a556-de0e468f4a74'} Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271b08cd-ead0-419b-a556-de0e468f4a74 could not be found. Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271b08cd-ead0-419b-a556-de0e468f4a74 could not be found. Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:24:54.680625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271b08cd-ead0-419b-a556-de0e468f4a74 could not be found. Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Returning 404 to user: Instance 271b08cd-ead0-419b-a556-de0e468f4a74 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:24:54.685315 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-452d4a10-4d40-46c7-886a-b4687101c43b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74" status: 404 len: 111 microversion: 2.1 time: 0.061931 Sep 18 01:24:54.687721 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2294/4553] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:54 2022] GET /compute/v2.1/servers/271b08cd-ead0-419b-a556-de0e468f4a74 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:24:54.694422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:54.696854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:54.711634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:54.713414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:54.714995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:54.716780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:54.719185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:54.719636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:54.779215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:24:54.939649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-16185270-3ee2-451a-a1ec-6a36348c6362 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 204 len: 0 microversion: 2.1 time: 0.250251 Sep 18 01:24:54.941520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2260/4554] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:24:54 2022] DELETE /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:24:54.952441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:54.953856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:54.961988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:54.962663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:54.963450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:54.965025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:54.965753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:54.966351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:55.257433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:55.274386 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e40beba0-135b-4259-b39b-281233aa7790 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1673 microversion: 2.1 time: 0.324348 Sep 18 01:24:55.295314 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2295/4555] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:54 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1673 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:56.941792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:56.942446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:56.950947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:56.951491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:56.951936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:56.952626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:56.953527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:56.954383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:57.324157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:57.338965 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e43e0340-4d68-43fc-ac25-b9f12abbd299 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1673 microversion: 2.1 time: 1.036463 Sep 18 01:24:57.354673 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2261/4556] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:56 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1673 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:24:58.367837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:24:58.370711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:24:58.381317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:58.382390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:58.383107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:58.384088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:58.384824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:58.385487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:58.574712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d2c6b00e-1adf-43b1-a604-d5faddaf9357 req-a0eef3d9-cc47-4b35-87c2-cb95e6b2a528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085d846-e1d5-4d73-bea1-0ac4912d1cdb", "name": "network-vif-deleted", "tag": "7eb62dac-dafd-48ac-a780-f8a36329a4cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:24:58.605775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d2c6b00e-1adf-43b1-a604-d5faddaf9357 req-a0eef3d9-cc47-4b35-87c2-cb95e6b2a528 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:24:58.606643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d2c6b00e-1adf-43b1-a604-d5faddaf9357 req-a0eef3d9-cc47-4b35-87c2-cb95e6b2a528 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:24:58.607589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d2c6b00e-1adf-43b1-a604-d5faddaf9357 req-a0eef3d9-cc47-4b35-87c2-cb95e6b2a528 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:24:58.650674 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d2c6b00e-1adf-43b1-a604-d5faddaf9357 req-a0eef3d9-cc47-4b35-87c2-cb95e6b2a528 service nova] Creating event network-vif-deleted:7eb62dac-dafd-48ac-a780-f8a36329a4cd for instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb on n-h1-master-1 Sep 18 01:24:58.664588 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d2c6b00e-1adf-43b1-a604-d5faddaf9357 req-a0eef3d9-cc47-4b35-87c2-cb95e6b2a528 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096675 Sep 18 01:24:58.668318 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2262/4557] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:24:59.419775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0212658356c1456ebe01dfe00dcd4fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf8394fe0f148b8b5794af678f368b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:24:59.428601 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7092a2c2-f432-4d2b-9ff0-15df10eaae0e tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 200 len: 1605 microversion: 2.1 time: 1.066719 Sep 18 01:24:59.431133 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2296/4558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:24:58 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 1605 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:00.455310 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:00.456641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] [instance: 4085d846-e1d5-4d73-bea1-0ac4912d1cdb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:00.475928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:00.480986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:00.483684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:00.484707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:00.486975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:00.488466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:00.534348 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] HTTP exception thrown: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb could not be found. Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Request method failure captured: Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb HTTP/1.1 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnEOgNEG5Yrkuy4LYnmsLkfjDIZyusPsSFQGENObC2s1nEDt9jGhykJ7VVZwz_UFe4gEuuEvbq_ta4QaCq8Wj7f-IzNmZzMlb91c410eNKmtgKuLNWs8KRq_IBfuJ6fmq03SKKrL5P0Ck-_8fcFW7J4qiyDPfVMZDrOaS3dWphw7WSw Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf8394fe0f148b8b5794af678f368b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: faf8394fe0f148b8b5794af678f368b6 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721091470 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 0212658356c1456ebe01dfe00dcd4fd2 Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-1721091470-project Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb could not be found. Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4085d846-e1d5-4d73-bea1-0ac4912d1cdb'} Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb could not be found. Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb could not be found. Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:00.536027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:00.540664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:00.540664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:00.540664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:00.540664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:00.540664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:00.540664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb could not be found. Sep 18 01:25:00.540664 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:00.542625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Returning 404 to user: Instance 4085d846-e1d5-4d73-bea1-0ac4912d1cdb could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:00.544337 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c8e42a0-5fd1-4e7a-a7be-20b03e20613b tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb" status: 404 len: 111 microversion: 2.1 time: 0.093872 Sep 18 01:25:00.551589 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2263/4559] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:00 2022] GET /compute/v2.1/servers/4085d846-e1d5-4d73-bea1-0ac4912d1cdb => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:25:00.562469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a00a71c5-e6d8-4592-bee6-914aae843e22 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] Calling method '.version_select at 0x7f700651d8b0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:00.615931 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a00a71c5-e6d8-4592-bee6-914aae843e22 tempest-ServerActionsTestJSON-1721091470 tempest-ServerActionsTestJSON-1721091470-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56794768" status: 202 len: 0 microversion: 2.1 time: 0.059608 Sep 18 01:25:00.621013 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2297/4560] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Sep 18 01:25:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56794768 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:25:02.779648 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:25:02.780676 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 01:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 18 01:25:03.413397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1742889421", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": "none"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:04.327323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:25:04.327911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:25:04.328216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:25:04.329254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:25:04.332593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:25:04.372779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:04.373330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:04.373816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:04.374764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:04.376944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:04.377592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:04.423079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Getting quotas for project fe80ab8ad5484a9b9f55b90b2d8ea550. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:04.436135 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Getting quotas for user c2a19bde85274d58a7e8b2eb27e9d568 and project fe80ab8ad5484a9b9f55b90b2d8ea550. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:04.453833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:25:04.457298 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:25:04.531981 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d1e5aec-6612-4386-8969-fdb7d08ab355 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.758207 Sep 18 01:25:04.533286 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2264/4561] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:25:04.545672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c64b0b4-1aa9-43e1-80d2-10aaa461a538 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:04.546911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c64b0b4-1aa9-43e1-80d2-10aaa461a538 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:05.349288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c64b0b4-1aa9-43e1-80d2-10aaa461a538 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:05.363768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c64b0b4-1aa9-43e1-80d2-10aaa461a538 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:05.372095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c64b0b4-1aa9-43e1-80d2-10aaa461a538 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:05.376795 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c64b0b4-1aa9-43e1-80d2-10aaa461a538 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1281 microversion: 2.47 time: 0.834780 Sep 18 01:25:05.386596 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2298/4562] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:04 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1281 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:25:06.415923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:06.422137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:06.435776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:06.444746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:06.445483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:06.446898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:06.447695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:06.448999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:06.670743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:06.718762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:06.731524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:06.739341 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d62aeda7-bd68-4e54-9792-a2551c8814d5 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1333 microversion: 2.47 time: 0.327185 Sep 18 01:25:06.743572 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2265/4563] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:06 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1333 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:07.772793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:07.773638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:07.797332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:07.799821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:07.801179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:07.803305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:07.804771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:07.806122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:07.983096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:07.997757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:08.002533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:08.004757 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-968c14cd-8dd6-428e-81f9-7bb0f3895a53 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1339 microversion: 2.47 time: 0.236296 Sep 18 01:25:08.007715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2299/4564] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:07 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:09.038925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:09.040014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:09.066237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:09.069591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:09.070831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:09.071711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:09.072186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:09.075675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:09.283477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:09.321326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:09.333641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:09.336615 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6878047e-16ab-4bea-a779-171bb20edb88 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1339 microversion: 2.47 time: 0.304155 Sep 18 01:25:09.341912 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2266/4565] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:09 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:10.370949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:10.373082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:10.382905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:10.384228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:10.384867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:10.386663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:10.387549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:10.388459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:10.598213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:10.610733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:10.616002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:10.617522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-acea93c4-5983-48e4-b7b0-bfebf2c5c365 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1360 microversion: 2.47 time: 0.253712 Sep 18 01:25:10.623189 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2300/4566] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:10 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:10.655657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1217791872"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:10.659857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:10.673087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:10.673087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:10.673087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:10.677806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:10.678481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:10.679008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:11.115420 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-59647f6b-18fb-4a5f-a0f4-92b2419458fa tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "POST /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb/action" status: 202 len: 52 microversion: 2.47 time: 0.462918 Sep 18 01:25:11.141497 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2267/4567] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 18 01:25:10 2022] POST /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb/action => generated 52 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:25:11.152487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:11.153006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:11.165424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:11.166368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:11.167033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:11.167934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:11.170211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:11.170855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:11.222713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:25:11.354241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd46a07c-92f2-41a2-8862-fa1662c245b4 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "DELETE /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 204 len: 0 microversion: 2.47 time: 0.205379 Sep 18 01:25:11.357728 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2301/4568] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:25:11 2022] DELETE /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:25:11.368244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:11.368962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:11.379406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:11.379905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:11.380351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:11.381139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:11.381527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:11.386984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:11.568660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:11.583080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:11.594449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:11.596066 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05987e20-c646-4443-a133-2eed546a9a1a tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1366 microversion: 2.47 time: 0.234296 Sep 18 01:25:11.597235 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2268/4569] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:11 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:12.624518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:12.625302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:12.642022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:12.644753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:12.647678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:12.650669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:12.651471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:12.655193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:13.691395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:13.710315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:13.714919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:13.722102 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b51305b-6538-442c-987e-5267940b7a94 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1366 microversion: 2.47 time: 1.099796 Sep 18 01:25:13.726266 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2302/4570] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:12 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1366 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:14.756349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:14.757044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:14.784778 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:14.792603 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:14.796391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:14.797132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:14.802335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:14.803356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:14.804005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:14.804757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:14.993095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:15.007880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:15.014296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:15.015625 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea7c031e-9d25-4159-be9b-e2dcb9fd8bcd tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1366 microversion: 2.47 time: 0.263324 Sep 18 01:25:15.016192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2269/4571] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:14 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:16.044450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:16.045084 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:16.055288 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:16.060689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:16.061168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:16.068518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:16.075749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:16.076319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:16.078420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:16.375016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:16.384254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:16.391467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2a19bde85274d58a7e8b2eb27e9d568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe80ab8ad5484a9b9f55b90b2d8ea550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:16.409280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0adbcb8f-b967-40f5-b601-6e6914d5cae9 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 200 len: 1366 microversion: 2.47 time: 0.369611 Sep 18 01:25:16.410718 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2303/4572] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:16 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:25:17.439900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:17.440522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] [instance: 34b61c99-f7ac-4462-be12-2734df4fa7cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:17.461343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:17.461955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:17.462497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:17.463500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:17.464230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:17.464885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:17.492114 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] HTTP exception thrown: Instance 34b61c99-f7ac-4462-be12-2734df4fa7cb could not be found. Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Request method failure captured: Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb HTTP/1.1 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnNum9ruJFX8wLN87kLts2UE5K2_69nhYrnLgFa1NDyYjz_xlvC1g96JBcmTI4238PZZVvm0KLUOnxBvxijpQVuLHexOHjX-__cCyckrSbVNzQZxxN6DRMC9yf0f2UqKH2OR9oWp1b18VUL2Za6aEttUwWyxYkShoMQ9sqzr9UhDJpY Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.47 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fe80ab8ad5484a9b9f55b90b2d8ea550 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAaction247Test-1723618686 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fe80ab8ad5484a9b9f55b90b2d8ea550"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fe80ab8ad5484a9b9f55b90b2d8ea550"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fe80ab8ad5484a9b9f55b90b2d8ea550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fe80ab8ad5484a9b9f55b90b2d8ea550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAaction247Test-1723618686 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fe80ab8ad5484a9b9f55b90b2d8ea550 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAaction247Test-1723618686 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAaction247Test-1723618686-project Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c2a19bde85274d58a7e8b2eb27e9d568 Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAaction247Test-1723618686-project Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 34b61c99-f7ac-4462-be12-2734df4fa7cb could not be found. Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '34b61c99-f7ac-4462-be12-2734df4fa7cb'} Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b61c99-f7ac-4462-be12-2734df4fa7cb could not be found. Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b61c99-f7ac-4462-be12-2734df4fa7cb could not be found. Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:17.496142 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b61c99-f7ac-4462-be12-2734df4fa7cb could not be found. Sep 18 01:25:17.501296 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:17.506757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] Returning 404 to user: Instance 34b61c99-f7ac-4462-be12-2734df4fa7cb could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:17.509785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90e3ef2c-65d6-4b8d-9389-7879a5efffd1 tempest-ServersAaction247Test-1723618686 tempest-ServersAaction247Test-1723618686-project] 10.222.0.25 "GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb" status: 404 len: 111 microversion: 2.47 time: 0.074795 Sep 18 01:25:17.512239 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2270/4573] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:25:17 2022] GET /compute/v2.1/servers/34b61c99-f7ac-4462-be12-2734df4fa7cb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:25:21.016868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b4da88d-01cb-486e-9781-6e3a1e7281ab tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: .version_select at 0x7f700624aca0>, body: {"keypair": {"name": "tempest-keypair-1360059833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGitHxmUSa/uxRvT2lyaPHSHrS0FasPyUxS8vqy1x2L3/6CbSZOGGNs94BAt/68xSsZfMVUbPnZxjEGuJZ6RBIi1lnNyQebETiMbch6YDVGoZVDBvUfcFs1/fLEdhwO28A=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:21.044960 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:21.090929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1b4da88d-01cb-486e-9781-6e3a1e7281ab tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:21.109745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1b4da88d-01cb-486e-9781-6e3a1e7281ab tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:21.185339 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b4da88d-01cb-486e-9781-6e3a1e7281ab tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.819105 Sep 18 01:25:21.189325 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2304/4574] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:25:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:28.256273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1014625072", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f7c6e0e-8607-495c-8bc4-13fbec48411b"}], "security_groups": [{"name": "tempest-securitygroup--378987434"}], "key_name": "tempest-keypair-1360059833", "user_data": "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:28.294623 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:28.297345 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:28.944481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] validate_networks() for [('8f7c6e0e-8607-495c-8bc4-13fbec48411b', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:25:31.878111 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:31.882266 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:31.883356 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:32.145522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:25:32.146105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:25:32.146455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:25:32.146874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:25:32.147286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:25:32.190594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:32.191023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:32.192031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:32.192917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:32.193443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:32.204693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:32.210403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3fd1623-0bba-4a07-ad76-b072435192cb tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Action: 'create', calling method: .version_select at 0x7f70067c7f70>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-252634490", "policies": ["affinity"]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:32.253242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:32.263489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a3fd1623-0bba-4a07-ad76-b072435192cb tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:32.272237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:32.289334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a3fd1623-0bba-4a07-ad76-b072435192cb tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:32.318766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:25:32.329919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:25:32.419548 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a3fd1623-0bba-4a07-ad76-b072435192cb tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:32.443146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a3fd1623-0bba-4a07-ad76-b072435192cb tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:32.504956 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-24d831ee-45c8-43cb-bc8a-1c748de8b305 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.260194 Sep 18 01:25:32.510702 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2271/4575] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:25:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 4267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:25:32.522455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bacf7012-0bb5-4406-9336-f0b1bc6f088f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:32.523342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bacf7012-0bb5-4406-9336-f0b1bc6f088f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:32.530956 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3fd1623-0bba-4a07-ad76-b072435192cb tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.663653 Sep 18 01:25:32.533771 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2305/4576] 10.222.0.25 () {60 vars in 1174 bytes} [Sun Sep 18 01:25:31 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:25:32.548850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-01dc5223-5077-4629-8f1a-a7edd2931e8f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Action: 'create', calling method: .version_select at 0x7f7005061670>, body: {"server_group": {"name": "tempest-server-group-1674305177", "policies": ["affinity"]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:32.616946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-01dc5223-5077-4629-8f1a-a7edd2931e8f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:32.628329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-01dc5223-5077-4629-8f1a-a7edd2931e8f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:32.718550 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-01dc5223-5077-4629-8f1a-a7edd2931e8f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:32.733695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-01dc5223-5077-4629-8f1a-a7edd2931e8f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:32.752558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bacf7012-0bb5-4406-9336-f0b1bc6f088f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:32.766690 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bacf7012-0bb5-4406-9336-f0b1bc6f088f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1242 microversion: 2.1 time: 0.249458 Sep 18 01:25:32.767066 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-01dc5223-5077-4629-8f1a-a7edd2931e8f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.227234 Sep 18 01:25:32.768186 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2306/4577] 10.222.0.25 () {60 vars in 1173 bytes} [Sun Sep 18 01:25:32 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:32.778993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2272/4578] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:32 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:32.780633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8f9bc9a-72cd-46c4-aaf1-0b38af51a403 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Action: 'create', calling method: .version_select at 0x7f700663f700>, body: {"server_group": {"name": "tempest-server-group-1674305177", "policies": ["affinity"]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:32.822782 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d8f9bc9a-72cd-46c4-aaf1-0b38af51a403 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:32.838187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d8f9bc9a-72cd-46c4-aaf1-0b38af51a403 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:32.952613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d8f9bc9a-72cd-46c4-aaf1-0b38af51a403 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:32.962460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d8f9bc9a-72cd-46c4-aaf1-0b38af51a403 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:33.004525 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8f9bc9a-72cd-46c4-aaf1-0b38af51a403 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.228500 Sep 18 01:25:33.006285 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2307/4579] 10.222.0.25 () {60 vars in 1173 bytes} [Sun Sep 18 01:25:32 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:25:33.018162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26b66a9f-9e9c-474e-b8be-7a96542ec717 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:33.140301 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26b66a9f-9e9c-474e-b8be-7a96542ec717 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/422a4f89-23e6-4485-acc0-30468248abbf" status: 204 len: 0 microversion: 2.1 time: 0.126708 Sep 18 01:25:33.145460 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2273/4580] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:33 2022] DELETE /compute/v2.1/os-server-groups/422a4f89-23e6-4485-acc0-30468248abbf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:25:33.152702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-54a93ef7-35c9-4a3e-9275-851dde7a3acc tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:33.187312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-54a93ef7-35c9-4a3e-9275-851dde7a3acc tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.040503 Sep 18 01:25:33.197953 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2308/4581] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:25:33 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:33.215398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4dc399e-5cfd-4c3c-9b15-16f18de2230f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:33.251026 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b4dc399e-5cfd-4c3c-9b15-16f18de2230f tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ea67a1ce-5f39-4a15-94e1-075fbd46bb11" status: 204 len: 0 microversion: 2.1 time: 0.053384 Sep 18 01:25:33.256396 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2274/4582] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:33 2022] DELETE /compute/v2.1/os-server-groups/ea67a1ce-5f39-4a15-94e1-075fbd46bb11 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:25:33.261014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f65bcce-f764-4632-97d5-c84957125dbd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:33.282608 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f65bcce-f764-4632-97d5-c84957125dbd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025745 Sep 18 01:25:33.283201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2309/4583] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:25:33 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:25:33.309338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ac8b537-e36c-4949-816b-5d49ea863166 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Action: 'create', calling method: .version_select at 0x7f70052163a0>, body: {"server_group": {"name": "tempest-server-group-1731910522", "policies": ["affinity"]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:33.349641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3ac8b537-e36c-4949-816b-5d49ea863166 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:33.362287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3ac8b537-e36c-4949-816b-5d49ea863166 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:33.427197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3ac8b537-e36c-4949-816b-5d49ea863166 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:33.437814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3ac8b537-e36c-4949-816b-5d49ea863166 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:33.478589 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ac8b537-e36c-4949-816b-5d49ea863166 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.180648 Sep 18 01:25:33.484478 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2275/4584] 10.222.0.25 () {60 vars in 1173 bytes} [Sun Sep 18 01:25:33 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:33.502005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4068ff2-4911-41f4-ba37-fa8bb14cdffc tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:33.569793 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a4068ff2-4911-41f4-ba37-fa8bb14cdffc tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/5de990c6-3f01-489a-bd33-72c342c86763" status: 204 len: 0 microversion: 2.1 time: 0.076453 Sep 18 01:25:33.570389 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2310/4585] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:33 2022] DELETE /compute/v2.1/os-server-groups/5de990c6-3f01-489a-bd33-72c342c86763 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:25:33.578626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f77bd7e-742a-4ee3-8894-6f139185b21e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:33.610032 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f77bd7e-742a-4ee3-8894-6f139185b21e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.035040 Sep 18 01:25:33.615630 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2276/4586] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:25:33 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:33.628406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26e7bef7-498a-42a1-a520-a00642b541da tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Action: 'create', calling method: .version_select at 0x7f7006767550>, body: {"server_group": {"name": "tempest-server-group-1634066008", "policies": ["anti-affinity"]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:33.683732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-26e7bef7-498a-42a1-a520-a00642b541da tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:33.702661 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:33.704680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-26e7bef7-498a-42a1-a520-a00642b541da tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:33.790820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:33.791960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:33.799504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:33.799998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:33.800437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:33.801146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:33.817969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:33.818608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:33.881278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-26e7bef7-498a-42a1-a520-a00642b541da tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:33.913623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-26e7bef7-498a-42a1-a520-a00642b541da tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_groups'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:33.952932 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26e7bef7-498a-42a1-a520-a00642b541da tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.328424 Sep 18 01:25:33.961049 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2311/4587] 10.222.0.25 () {60 vars in 1173 bytes} [Sun Sep 18 01:25:33 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:33.972449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f489861-3edc-48f1-bcf9-846143e4ac24 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:34.035936 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f489861-3edc-48f1-bcf9-846143e4ac24 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484" status: 204 len: 0 microversion: 2.1 time: 0.070820 Sep 18 01:25:34.043821 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2312/4588] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:33 2022] DELETE /compute/v2.1/os-server-groups/ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:25:34.048949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3a15be9-925a-466b-86f5-4819a6a472a2 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:34.049455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:34.058370 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54b4f820-9c37-40b3-b508-e2f82f1791e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1238 microversion: 2.1 time: 0.271358 Sep 18 01:25:34.078030 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2277/4589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:33 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1238 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:25:34.087279 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3a15be9-925a-466b-86f5-4819a6a472a2 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042037 Sep 18 01:25:34.088436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2313/4590] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:25:34 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:34.542241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-81319546", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "c53cc04b-0351-4739-b7e9-534977e89d7b"}]}, "os:scheduler_hints": {"group": "67e93392-d2ad-4ed5-bf7f-c0954633ec1c"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:34.647858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] validate_networks() for [('c53cc04b-0351-4739-b7e9-534977e89d7b', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:25:35.091661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:35.092538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:35.107740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:35.108245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:35.108687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:35.109401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:35.109901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:35.110329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:35.549638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:35.558740 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f350aad-0571-4d1a-8edc-92315ea9df4f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1300 microversion: 2.1 time: 0.471490 Sep 18 01:25:35.572817 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2314/4591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:35 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1300 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:36.196481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:25:36.197847 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:25:36.198466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:25:36.198940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:25:36.199486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:25:36.235770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:36.238430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:36.239009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:36.240153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:36.242733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:36.243387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:36.290547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:36.304767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:36.345973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:25:36.355255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:25:36.467672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122373) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 18 01:25:36.496933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_group_members'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:36.505896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_group_members'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:36.519593 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:36.589186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:36.589856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:36.616826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:36.617388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:36.617865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:36.619638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_group_members'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:36.624139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:36.624837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:36.625289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:36.640162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Getting quotas for user 497459f4656f406aa3074618db0c861d and project f6e8393f78224f6ba4178450cbae510f. Resources: {'server_group_members'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:36.747739 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a901c1ac-1208-42b6-8f7a-324a08f15306 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.211141 Sep 18 01:25:36.755824 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2278/4592] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:25:36.761043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-441f1052-3499-473a-82bb-893875396d13 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:36.761701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-441f1052-3499-473a-82bb-893875396d13 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:37.951115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:37.964045 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd0508a4-836e-4227-8aa0-99dbd3f2289f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1300 microversion: 2.1 time: 1.380372 Sep 18 01:25:37.964874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2315/4593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:36 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1300 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:25:38.065544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-441f1052-3499-473a-82bb-893875396d13 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:38.094951 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-441f1052-3499-473a-82bb-893875396d13 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1211 microversion: 2.1 time: 1.337905 Sep 18 01:25:38.098369 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2279/4594] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:36 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1211 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:38.992206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:38.992843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:39.014897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:39.015402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:39.015848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:39.016586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:39.017046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:39.017471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:39.125060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:39.126003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:39.139410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:39.145622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:39.146599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:39.148075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:39.150056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:39.152037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:39.808527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:39.816693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-410c02d0-549d-4b2e-af4f-66efc0db837c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1263 microversion: 2.1 time: 0.695419 Sep 18 01:25:39.842074 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2280/4595] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:39 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1263 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:39.997794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:40.006244 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-144a752d-b228-4919-9722-ef8f3e01a5bc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1367 microversion: 2.1 time: 1.018178 Sep 18 01:25:40.015306 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2316/4596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:38 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1367 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:40.614920 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0d396ad5-5534-446c-bb27-136420cb8208 req-9a87f699-0c36-4860-bc1b-54cdf5fdeda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b4b9816-b230-4c64-b666-b095533aa203", "tag": "fe7a7cb1-5823-4413-bbd2-569dcfaad2cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:40.655854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0d396ad5-5534-446c-bb27-136420cb8208 req-9a87f699-0c36-4860-bc1b-54cdf5fdeda5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:40.656345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0d396ad5-5534-446c-bb27-136420cb8208 req-9a87f699-0c36-4860-bc1b-54cdf5fdeda5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:40.658414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0d396ad5-5534-446c-bb27-136420cb8208 req-9a87f699-0c36-4860-bc1b-54cdf5fdeda5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:40.700802 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0d396ad5-5534-446c-bb27-136420cb8208 req-9a87f699-0c36-4860-bc1b-54cdf5fdeda5 service nova] Creating event network-changed:fe7a7cb1-5823-4413-bbd2-569dcfaad2cd for instance 5b4b9816-b230-4c64-b666-b095533aa203 on n-h1-master-1 Sep 18 01:25:40.712521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0d396ad5-5534-446c-bb27-136420cb8208 req-9a87f699-0c36-4860-bc1b-54cdf5fdeda5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098865 Sep 18 01:25:40.715900 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2281/4597] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:40.844996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:40.845951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:40.854135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:40.854909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:40.855542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:40.856438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:40.857071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:40.857700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:41.040122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:41.041948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:41.058564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:41.059485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:41.061774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:41.064640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:41.065396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:41.066054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:41.214933 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:41.227252 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83d060bf-15b9-4be6-9fb9-9fd0ac56dd0a tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1269 microversion: 2.1 time: 0.386663 Sep 18 01:25:41.244679 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2317/4598] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:40 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1269 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:41.786157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:41.795646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5ae97dd-9944-464b-a492-a5392cd865c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1367 microversion: 2.1 time: 0.761571 Sep 18 01:25:41.796242 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2282/4599] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:41 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1367 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:42.255967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:42.256751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:42.270189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:42.271118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:42.271401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:42.272132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:42.272597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:42.273032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:42.828472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:42.829197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:42.851246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:42.852146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:42.854532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:42.858715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:42.861504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:42.862042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:43.021076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:43.050516 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c86078e2-e900-4d4c-ba46-dcb58376a42e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1311 microversion: 2.1 time: 0.798331 Sep 18 01:25:43.055955 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2318/4600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:42 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1311 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:43.346627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:43.358777 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d77af3b3-f10e-4f7a-80d7-0b6ae10b7dda tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1367 microversion: 2.1 time: 0.536494 Sep 18 01:25:43.360075 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2283/4601] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:42 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:25:43.934473 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=32 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:44.515846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-67408675", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "db58e845-5cee-49c5-a294-cf4c673807b6"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:44.595308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] validate_networks() for [('db58e845-5cee-49c5-a294-cf4c673807b6', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:25:44.708888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2113b32d-ee39-472e-bd43-d2421e63e29e req-1414ace7-6864-43b0-abb8-b59e8a773ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb3de06-f859-48cf-b58c-572589368eb5", "tag": "102dc1bd-7ce4-4f8b-9368-a2a7023396ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:44.728285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2113b32d-ee39-472e-bd43-d2421e63e29e req-1414ace7-6864-43b0-abb8-b59e8a773ab2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:44.728780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2113b32d-ee39-472e-bd43-d2421e63e29e req-1414ace7-6864-43b0-abb8-b59e8a773ab2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:44.729219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2113b32d-ee39-472e-bd43-d2421e63e29e req-1414ace7-6864-43b0-abb8-b59e8a773ab2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:44.755780 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2113b32d-ee39-472e-bd43-d2421e63e29e req-1414ace7-6864-43b0-abb8-b59e8a773ab2 service nova] Creating event network-changed:102dc1bd-7ce4-4f8b-9368-a2a7023396ea for instance 5cb3de06-f859-48cf-b58c-572589368eb5 on n-h2-master-1 Sep 18 01:25:44.767954 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2113b32d-ee39-472e-bd43-d2421e63e29e req-1414ace7-6864-43b0-abb8-b59e8a773ab2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.698377 Sep 18 01:25:44.774338 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2284/4602] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:44.786027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:44.786939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:44.811170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:44.815737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:44.816441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:44.817356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:44.818882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:44.819517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:45.501900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:45.516896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fbc86136-e85e-4697-9ad8-f51fc53742bd tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1311 microversion: 2.1 time: 0.737083 Sep 18 01:25:45.517767 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2285/4603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:44 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1311 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:45.525497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:45.526902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:45.536146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:45.537094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:45.538147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:45.539069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:45.539840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:45.541214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:45.619217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:25:45.619691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:25:45.620238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:25:45.620707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:25:45.621249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:25:45.644781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:45.647021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:45.652798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:45.654697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:45.655715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:45.659174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:45.713443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Getting quotas for project 1ed05294151747e38422999eb9aea434. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:25:45.729859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Getting quotas for user 7c49f9d15e72407da633a9227c5da519 and project 1ed05294151747e38422999eb9aea434. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:25:45.766704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:25:45.771907 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:25:45.888341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08f2558a-8578-465e-bb35-ea223ee6987a tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.035697 Sep 18 01:25:45.896286 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2319/4604] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:25:45.911392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a39f125-7587-423f-b4a9-5b5a8fe9433f tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:45.912799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8a39f125-7587-423f-b4a9-5b5a8fe9433f tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:45.947279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:45.977294 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-42538ee3-9c47-40e4-a277-a9d694ca2bed tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1367 microversion: 2.1 time: 0.458093 Sep 18 01:25:45.986256 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2286/4605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:45 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:46.089174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8a39f125-7587-423f-b4a9-5b5a8fe9433f tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:46.103602 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a39f125-7587-423f-b4a9-5b5a8fe9433f tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1223 microversion: 2.1 time: 0.202922 Sep 18 01:25:46.108123 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2320/4606] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:45 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:46.538953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c21b1b87-7169-47cb-8840-e83140dc85e3 req-09bef5c7-19bd-4afb-8fcf-656c13e9f579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b4b9816-b230-4c64-b666-b095533aa203", "name": "network-vif-plugged", "status": "completed", "tag": "fe7a7cb1-5823-4413-bbd2-569dcfaad2cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:46.547738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:46.548407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:46.562368 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:46.568144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:46.571296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:46.575877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:46.576943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:46.580269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:46.583751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:46.589331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c21b1b87-7169-47cb-8840-e83140dc85e3 req-09bef5c7-19bd-4afb-8fcf-656c13e9f579 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:46.590434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c21b1b87-7169-47cb-8840-e83140dc85e3 req-09bef5c7-19bd-4afb-8fcf-656c13e9f579 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:46.591922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c21b1b87-7169-47cb-8840-e83140dc85e3 req-09bef5c7-19bd-4afb-8fcf-656c13e9f579 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:46.619254 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c21b1b87-7169-47cb-8840-e83140dc85e3 req-09bef5c7-19bd-4afb-8fcf-656c13e9f579 service nova] Creating event network-vif-plugged:fe7a7cb1-5823-4413-bbd2-569dcfaad2cd for instance 5b4b9816-b230-4c64-b666-b095533aa203 on n-h1-master-1 Sep 18 01:25:46.630790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c21b1b87-7169-47cb-8840-e83140dc85e3 req-09bef5c7-19bd-4afb-8fcf-656c13e9f579 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098302 Sep 18 01:25:46.632304 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2287/4607] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:46.912506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:46.923616 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d6853ca-ae23-41b5-bb94-440378d9108b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1311 microversion: 2.1 time: 0.385522 Sep 18 01:25:46.925196 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2321/4608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:46 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1311 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:47.018708 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:47.020023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:47.034225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:47.034697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:47.038662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:47.046626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:47.047591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:47.049144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:47.129669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:47.130388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:47.152814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:47.154146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:47.154893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:47.155808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:47.156567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:47.157596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:47.325618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:47.337662 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a241b43b-e1e0-4457-a339-244ee786d650 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1219 microversion: 2.1 time: 0.211714 Sep 18 01:25:47.338270 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2322/4609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:47 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:25:47.417325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:47.429332 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-01446c4a-b866-4042-94cf-29ebb40e71e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1367 microversion: 2.1 time: 0.418351 Sep 18 01:25:47.430294 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2288/4610] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:47 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:47.949437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:47.950827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:47.967615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:47.969684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:47.971479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:47.971479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:47.973507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:47.974399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:48.275437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:48.285512 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ede0759-df86-49c2-8239-0cc3b767e6f5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1311 microversion: 2.1 time: 0.341338 Sep 18 01:25:48.292033 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2323/4611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:47 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1311 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:48.361975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:48.364210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:48.370445 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=32 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:48.379673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:48.380709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:48.381493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:48.382620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:48.383290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:48.383929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:48.473946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:48.476287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:48.522580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:48.523806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:48.524618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:48.528028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:48.528843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:48.529505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:48.578203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:48.602297 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-023ad0f6-8fee-47de-948b-fe35c51bcce8 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1283 microversion: 2.1 time: 0.240935 Sep 18 01:25:48.606004 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2289/4612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:48 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1283 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:48.831873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:48.843074 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b343e38-7e53-440d-9adb-4a0ff5a23788 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1557 microversion: 2.1 time: 0.390904 Sep 18 01:25:48.859390 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2324/4613] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:48 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1557 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:48.869947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:48.870639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:48.877741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:48.878491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:48.879536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:48.881146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:48.881976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:48.882902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:49.024615 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ab0529d-7e77-404c-906b-b1e850879e11 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160237 Sep 18 01:25:49.025422 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2290/4614] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:25:48 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:49.312904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:49.313762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:49.333449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:49.334089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:49.334620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:49.335524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:49.336058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:49.338832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:49.634093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:49.636170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:49.654409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:49.655102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:49.655702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:49.666383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:49.668470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:49.675568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:49.698219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:49.711702 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-576e4e62-83e8-454e-b71f-f79b330cff1c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1311 microversion: 2.1 time: 0.403890 Sep 18 01:25:49.725752 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2325/4615] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:49 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1311 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:49.946116 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:49.957278 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2fb4fd8b-12e5-4246-86f8-1eb7cb1e7f1d tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1281 microversion: 2.1 time: 0.330205 Sep 18 01:25:49.974436 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2291/4616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:49 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1281 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:50.739943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:50.742126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:50.749704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:50.762579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:50.763288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:50.766583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:50.767285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:50.770357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:50.998780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:50.999400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:51.015127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:51.021688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:51.025577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:51.027674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:51.028176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:51.031803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:51.206187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:51.217729 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-99899cc8-f11c-4465-9f05-00b07dc0fd1b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1311 microversion: 2.1 time: 0.483275 Sep 18 01:25:51.230064 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2326/4617] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:50 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1311 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:51.238436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-726d2078-d251-47dc-9c4e-265428178f0f req-a3329c0b-65da-4834-8318-3801357f466a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb3de06-f859-48cf-b58c-572589368eb5", "name": "network-vif-plugged", "status": "completed", "tag": "102dc1bd-7ce4-4f8b-9368-a2a7023396ea"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:51.270136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-726d2078-d251-47dc-9c4e-265428178f0f req-a3329c0b-65da-4834-8318-3801357f466a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:51.270623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-726d2078-d251-47dc-9c4e-265428178f0f req-a3329c0b-65da-4834-8318-3801357f466a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:51.271065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-726d2078-d251-47dc-9c4e-265428178f0f req-a3329c0b-65da-4834-8318-3801357f466a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:51.287708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-726d2078-d251-47dc-9c4e-265428178f0f req-a3329c0b-65da-4834-8318-3801357f466a service nova] Creating event network-vif-plugged:102dc1bd-7ce4-4f8b-9368-a2a7023396ea for instance 5cb3de06-f859-48cf-b58c-572589368eb5 on n-h2-master-1 Sep 18 01:25:51.305162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-726d2078-d251-47dc-9c4e-265428178f0f req-a3329c0b-65da-4834-8318-3801357f466a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070762 Sep 18 01:25:51.316185 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2327/4618] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:51.322401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-91a8b071-13a2-4efe-8890-754b31653f70 req-f188de3e-eb5c-4032-9ba4-65aae988185e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b4b9816-b230-4c64-b666-b095533aa203", "tag": "fe7a7cb1-5823-4413-bbd2-569dcfaad2cd"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:51.333924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-91a8b071-13a2-4efe-8890-754b31653f70 req-f188de3e-eb5c-4032-9ba4-65aae988185e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:51.334410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-91a8b071-13a2-4efe-8890-754b31653f70 req-f188de3e-eb5c-4032-9ba4-65aae988185e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:51.335319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-91a8b071-13a2-4efe-8890-754b31653f70 req-f188de3e-eb5c-4032-9ba4-65aae988185e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:51.348618 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-91a8b071-13a2-4efe-8890-754b31653f70 req-f188de3e-eb5c-4032-9ba4-65aae988185e service nova] Creating event network-changed:fe7a7cb1-5823-4413-bbd2-569dcfaad2cd for instance 5b4b9816-b230-4c64-b666-b095533aa203 on n-h1-master-1 Sep 18 01:25:51.382502 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-91a8b071-13a2-4efe-8890-754b31653f70 req-f188de3e-eb5c-4032-9ba4-65aae988185e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064642 Sep 18 01:25:51.387336 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2328/4619] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:51.737575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:51.752434 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ef6299c-60c5-45f7-9efb-70a0e2bb4248 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1323 microversion: 2.1 time: 0.757774 Sep 18 01:25:51.765381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2292/4620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:50 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1323 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:25:52.248933 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:52.252811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:52.277875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:52.281792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:52.281792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:52.283992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:52.283992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:52.283992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:52.602149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:52.611467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00fb45b8-b554-4de3-9657-fa844560b057 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1311 microversion: 2.1 time: 0.373491 Sep 18 01:25:52.612072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2329/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:52 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:52.722012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ca0b8cfb-9f4d-4793-ac7b-3d2d7ec8801f req-7e738a55-1863-4820-8510-7d131778dcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed5807a-4267-4239-b790-7d5bed1382db", "tag": "68755270-60e3-485b-9a99-d6a59f87c083"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:52.754582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca0b8cfb-9f4d-4793-ac7b-3d2d7ec8801f req-7e738a55-1863-4820-8510-7d131778dcb6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:52.759205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca0b8cfb-9f4d-4793-ac7b-3d2d7ec8801f req-7e738a55-1863-4820-8510-7d131778dcb6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:52.759897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ca0b8cfb-9f4d-4793-ac7b-3d2d7ec8801f req-7e738a55-1863-4820-8510-7d131778dcb6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:52.785189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:52.786067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:52.799634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:52.809256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:52.810037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:52.812303 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ca0b8cfb-9f4d-4793-ac7b-3d2d7ec8801f req-7e738a55-1863-4820-8510-7d131778dcb6 service nova] Creating event network-changed:68755270-60e3-485b-9a99-d6a59f87c083 for instance 6ed5807a-4267-4239-b790-7d5bed1382db on n-h1-master-1 Sep 18 01:25:52.825904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:52.827197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:52.828037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:52.836389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ca0b8cfb-9f4d-4793-ac7b-3d2d7ec8801f req-7e738a55-1863-4820-8510-7d131778dcb6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119365 Sep 18 01:25:52.841186 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2293/4622] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:53.639041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:53.642555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:53.655618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:53.656402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:53.657003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:53.659699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:53.660669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:53.662261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:53.848897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:53.876380 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-33984558-924b-4206-8977-e973f64c17d5 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1323 microversion: 2.1 time: 1.092867 Sep 18 01:25:53.878662 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2330/4623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:52 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1323 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:54.035780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:54.044904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68dfc1ff-dd12-451c-8476-e0cbdcc8aa3b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1496 microversion: 2.1 time: 0.412633 Sep 18 01:25:54.045505 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2294/4624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:53 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1496 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:54.072393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14118e3d-7f2b-4383-b45c-fb26379678e6 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:54.098748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.server_groups [None req-14118e3d-7f2b-4383-b45c-fb26379678e6 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Querying cell bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) for 1 instances {{(pid=122374) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 18 01:25:54.100595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14118e3d-7f2b-4383-b45c-fb26379678e6 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:54.101382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14118e3d-7f2b-4383-b45c-fb26379678e6 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:54.102196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14118e3d-7f2b-4383-b45c-fb26379678e6 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:54.128623 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14118e3d-7f2b-4383-b45c-fb26379678e6 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/67e93392-d2ad-4ed5-bf7f-c0954633ec1c" status: 200 len: 221 microversion: 2.1 time: 0.060386 Sep 18 01:25:54.130850 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2331/4625] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:25:54 2022] GET /compute/v2.1/os-server-groups/67e93392-d2ad-4ed5-bf7f-c0954633ec1c => generated 221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:54.142468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:54.143365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:54.175578 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:54.178531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:54.181136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:54.183542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:54.184264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:54.186208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:54.279724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:25:54.426077 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e1098f7-9392-4799-8753-52676495ba6c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 204 len: 0 microversion: 2.1 time: 0.287651 Sep 18 01:25:54.436224 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2295/4626] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:25:54 2022] DELETE /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:25:54.445142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:54.446051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:54.458206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:54.458708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:54.466287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:54.467303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:54.467779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:54.468212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:54.772394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:54.786403 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d141f9a-5ec6-4438-bf40-c5e0049eae2b tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1502 microversion: 2.1 time: 0.345080 Sep 18 01:25:54.800978 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2332/4627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:54 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:54.911905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:54.913461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:54.930369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:54.931492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:54.932029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:54.932820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:54.933618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:54.934745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:54.940989 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:55.176535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:55.192365 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3e51d199-39ea-4bb5-93e1-cc13cfb76bee tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1323 microversion: 2.1 time: 0.293329 Sep 18 01:25:55.193429 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2296/4628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:54 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:25:55.815152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:55.815878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:55.831093 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:55.843834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:55.845165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:55.845887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:55.846862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:55.847526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:55.848152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:56.099621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:56.102149 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:56.105751 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:56.123043 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0d590018-ff2e-41c8-90a0-c36893889a05 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1502 microversion: 2.1 time: 0.312404 Sep 18 01:25:56.138370 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2333/4629] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:55 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:56.220448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:56.221198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:56.229378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:56.230962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:56.231952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:56.232837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:56.233307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:56.233781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:56.687443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:56.697849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4e24471a-d5a6-4048-ad0f-49694e2c4c49 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1323 microversion: 2.1 time: 0.481199 Sep 18 01:25:56.719383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2297/4630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:56 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:57.150851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:57.151446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:57.159198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:57.159692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:57.160133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:57.160841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:57.174346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:57.175080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:57.577382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8c71e17f-26f2-43c6-bed2-196a06d2f7d7 req-c960c6b9-38d0-4a6e-b74c-c5445be33e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb3de06-f859-48cf-b58c-572589368eb5", "name": "network-vif-deleted", "tag": "102dc1bd-7ce4-4f8b-9368-a2a7023396ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:25:57.603461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8c71e17f-26f2-43c6-bed2-196a06d2f7d7 req-c960c6b9-38d0-4a6e-b74c-c5445be33e67 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:57.603947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8c71e17f-26f2-43c6-bed2-196a06d2f7d7 req-c960c6b9-38d0-4a6e-b74c-c5445be33e67 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:57.604520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8c71e17f-26f2-43c6-bed2-196a06d2f7d7 req-c960c6b9-38d0-4a6e-b74c-c5445be33e67 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:57.627945 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8c71e17f-26f2-43c6-bed2-196a06d2f7d7 req-c960c6b9-38d0-4a6e-b74c-c5445be33e67 service nova] Creating event network-vif-deleted:102dc1bd-7ce4-4f8b-9368-a2a7023396ea for instance 5cb3de06-f859-48cf-b58c-572589368eb5 on n-h2-master-1 Sep 18 01:25:57.635849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8c71e17f-26f2-43c6-bed2-196a06d2f7d7 req-c960c6b9-38d0-4a6e-b74c-c5445be33e67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061579 Sep 18 01:25:57.637170 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2298/4631] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:25:57.673736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497459f4656f406aa3074618db0c861d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e8393f78224f6ba4178450cbae510f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:57.692852 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a02d034-36bb-42a0-a54d-6a87b6ccb4ea tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 200 len: 1502 microversion: 2.1 time: 0.546600 Sep 18 01:25:57.715499 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2334/4632] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:57 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 1502 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:57.735714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:57.737447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:57.755079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:57.758548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:57.761517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:57.762673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:57.763315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:57.765520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:58.272719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:58.289192 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92b2f699-3e5d-4268-b6c2-3dfa9f9e7409 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1323 microversion: 2.1 time: 0.564304 Sep 18 01:25:58.290622 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2299/4633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:57 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:25:58.723700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:58.725260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:58.777230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:58.780050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:58.780978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:58.782573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:58.783299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:58.783913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:58.805448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] HTTP exception thrown: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Request method failure captured: Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 HTTP/1.1 Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOLEIOeRSp4kTEd6sor67L82ACgR__sn2zjw-1gQw3vPFKeWI1U0kNta5wCGHeNWweKvL06oNzsAgHz3A03KLpdG8JYBsv_Ee-4Eai74dv0AAT-TxMD4YKSzpAa78ce_83OxvVbsJ5MnWOtY0UJoE9HdheETVNZs6lI3tu2Ke3Qd9k Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 497459f4656f406aa3074618db0c861d Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5cb3de06-f859-48cf-b58c-572589368eb5'} Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:58.808528 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:58.813787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:58.813787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:58.813787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:58.813787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:58.813787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:58.813787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:58.813787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:58.814519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Returning 404 to user: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:58.815826 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-deb49e41-d981-49e0-a67e-7bd4f5f47b21 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 404 len: 111 microversion: 2.1 time: 0.100677 Sep 18 01:25:58.822454 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2335/4634] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:58 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:25:58.832300 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50774a1d-10db-454a-b8ec-f4e7bc24107c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:58.879308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.compute.server_groups [None req-50774a1d-10db-454a-b8ec-f4e7bc24107c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Querying cell bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) for 1 instances {{(pid=122373) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 18 01:25:58.880261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50774a1d-10db-454a-b8ec-f4e7bc24107c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:58.881636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50774a1d-10db-454a-b8ec-f4e7bc24107c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:58.886517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50774a1d-10db-454a-b8ec-f4e7bc24107c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:58.922192 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50774a1d-10db-454a-b8ec-f4e7bc24107c tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.096172 Sep 18 01:25:58.922857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2300/4635] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:25:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:58.981670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a5b46bb-4086-426d-b52f-04572617cc71 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.044806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.server_groups [None req-2a5b46bb-4086-426d-b52f-04572617cc71 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Querying cell bf287de1-14b9-4c4e-84a6-83b94fe82ce2(cell1) for 1 instances {{(pid=122374) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 18 01:25:59.045540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a5b46bb-4086-426d-b52f-04572617cc71 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:59.046084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a5b46bb-4086-426d-b52f-04572617cc71 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:59.046525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a5b46bb-4086-426d-b52f-04572617cc71 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:59.063285 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a5b46bb-4086-426d-b52f-04572617cc71 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/67e93392-d2ad-4ed5-bf7f-c0954633ec1c" status: 200 len: 183 microversion: 2.1 time: 0.124808 Sep 18 01:25:59.063961 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2336/4636] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Sep 18 01:25:58 2022] GET /compute/v2.1/os-server-groups/67e93392-d2ad-4ed5-bf7f-c0954633ec1c => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:25:59.077055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.077541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:59.084007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:59.084425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:59.084864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:59.085573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:59.086049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:59.086475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:59.112361 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] HTTP exception thrown: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Request method failure captured: Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 HTTP/1.1 Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOLEIOeRSp4kTEd6sor67L82ACgR__sn2zjw-1gQw3vPFKeWI1U0kNta5wCGHeNWweKvL06oNzsAgHz3A03KLpdG8JYBsv_Ee-4Eai74dv0AAT-TxMD4YKSzpAa78ce_83OxvVbsJ5MnWOtY0UJoE9HdheETVNZs6lI3tu2Ke3Qd9k Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 497459f4656f406aa3074618db0c861d Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5cb3de06-f859-48cf-b58c-572589368eb5'} Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:25:59.117515 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.122452 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.130498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Returning 404 to user: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:59.132578 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-62c86932-5647-444b-abb5-d0794a8b3fb5 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 404 len: 111 microversion: 2.1 time: 0.061196 Sep 18 01:25:59.137585 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2301/4637] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:25:59 2022] DELETE /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:25:59.144393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.145283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] [instance: 5cb3de06-f859-48cf-b58c-572589368eb5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:59.164284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:59.164787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:59.165265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:59.167433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:59.171105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:59.171617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:59.211022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] HTTP exception thrown: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Request method failure captured: Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 HTTP/1.1 Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOLEIOeRSp4kTEd6sor67L82ACgR__sn2zjw-1gQw3vPFKeWI1U0kNta5wCGHeNWweKvL06oNzsAgHz3A03KLpdG8JYBsv_Ee-4Eai74dv0AAT-TxMD4YKSzpAa78ce_83OxvVbsJ5MnWOtY0UJoE9HdheETVNZs6lI3tu2Ke3Qd9k Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 497459f4656f406aa3074618db0c861d Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5cb3de06-f859-48cf-b58c-572589368eb5'} Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.213233 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Returning 404 to user: Instance 5cb3de06-f859-48cf-b58c-572589368eb5 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9075e150-aa80-4949-ad20-5c69141086c1 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5" status: 404 len: 111 microversion: 2.1 time: 0.076801 Sep 18 01:25:59.218203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2337/4638] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:59 2022] GET /compute/v2.1/servers/5cb3de06-f859-48cf-b58c-572589368eb5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:25:59.224486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed7eceaf-7b04-44d5-b48c-406fd8a3aa63 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.232805 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ed7eceaf-7b04-44d5-b48c-406fd8a3aa63 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] HTTP exception thrown: Instance group ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 could not be found. Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed7eceaf-7b04-44d5-b48c-406fd8a3aa63 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Request method failure captured: Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-server-groups/ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 HTTP/1.1 Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOLEIOeRSp4kTEd6sor67L82ACgR__sn2zjw-1gQw3vPFKeWI1U0kNta5wCGHeNWweKvL06oNzsAgHz3A03KLpdG8JYBsv_Ee-4Eai74dv0AAT-TxMD4YKSzpAa78ce_83OxvVbsJ5MnWOtY0UJoE9HdheETVNZs6lI3tu2Ke3Qd9k Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 497459f4656f406aa3074618db0c861d Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: exception: Instance group ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 could not be found. Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484'} Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 could not be found. Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 could not be found. Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.234461 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 could not be found. Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed7eceaf-7b04-44d5-b48c-406fd8a3aa63 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Returning 404 to user: Instance group ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:59.242947 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed7eceaf-7b04-44d5-b48c-406fd8a3aa63 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484" status: 404 len: 117 microversion: 2.1 time: 0.015359 Sep 18 01:25:59.252217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1909e9f-dd66-49ae-a834-277c72d2661d tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.255112 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2302/4639] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:59 2022] DELETE /compute/v2.1/os-server-groups/ad8ebc1a-4bbc-430a-bb60-3e1ffe2a4484 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:25:59.266641 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:25:59.271473 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-f1909e9f-dd66-49ae-a834-277c72d2661d tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] HTTP exception thrown: Instance group 5de990c6-3f01-489a-bd33-72c342c86763 could not be found. Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1909e9f-dd66-49ae-a834-277c72d2661d tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Request method failure captured: Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-server-groups/5de990c6-3f01-489a-bd33-72c342c86763 HTTP/1.1 Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOLEIOeRSp4kTEd6sor67L82ACgR__sn2zjw-1gQw3vPFKeWI1U0kNta5wCGHeNWweKvL06oNzsAgHz3A03KLpdG8JYBsv_Ee-4Eai74dv0AAT-TxMD4YKSzpAa78ce_83OxvVbsJ5MnWOtY0UJoE9HdheETVNZs6lI3tu2Ke3Qd9k Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 497459f4656f406aa3074618db0c861d Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: exception: Instance group 5de990c6-3f01-489a-bd33-72c342c86763 could not be found. Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5de990c6-3f01-489a-bd33-72c342c86763'} Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5de990c6-3f01-489a-bd33-72c342c86763 could not be found. Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5de990c6-3f01-489a-bd33-72c342c86763 could not be found. Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.280103 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5de990c6-3f01-489a-bd33-72c342c86763 could not be found. Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1909e9f-dd66-49ae-a834-277c72d2661d tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Returning 404 to user: Instance group 5de990c6-3f01-489a-bd33-72c342c86763 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1909e9f-dd66-49ae-a834-277c72d2661d tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/5de990c6-3f01-489a-bd33-72c342c86763" status: 404 len: 117 microversion: 2.1 time: 0.035806 Sep 18 01:25:59.286455 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2338/4640] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:59 2022] DELETE /compute/v2.1/os-server-groups/5de990c6-3f01-489a-bd33-72c342c86763 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:25:59.293049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-830e4dc9-2edc-4116-8629-00c758da2e7e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.303193 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-830e4dc9-2edc-4116-8629-00c758da2e7e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] HTTP exception thrown: Instance group ea67a1ce-5f39-4a15-94e1-075fbd46bb11 could not be found. Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-830e4dc9-2edc-4116-8629-00c758da2e7e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Request method failure captured: Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-server-groups/ea67a1ce-5f39-4a15-94e1-075fbd46bb11 HTTP/1.1 Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOLEIOeRSp4kTEd6sor67L82ACgR__sn2zjw-1gQw3vPFKeWI1U0kNta5wCGHeNWweKvL06oNzsAgHz3A03KLpdG8JYBsv_Ee-4Eai74dv0AAT-TxMD4YKSzpAa78ce_83OxvVbsJ5MnWOtY0UJoE9HdheETVNZs6lI3tu2Ke3Qd9k Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 497459f4656f406aa3074618db0c861d Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: exception: Instance group ea67a1ce-5f39-4a15-94e1-075fbd46bb11 could not be found. Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'ea67a1ce-5f39-4a15-94e1-075fbd46bb11'} Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ea67a1ce-5f39-4a15-94e1-075fbd46bb11 could not be found. Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ea67a1ce-5f39-4a15-94e1-075fbd46bb11 could not be found. Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.306789 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.311838 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.311838 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.311838 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:59.311838 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:59.311838 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ea67a1ce-5f39-4a15-94e1-075fbd46bb11 could not be found. Sep 18 01:25:59.311838 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.311838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-830e4dc9-2edc-4116-8629-00c758da2e7e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Returning 404 to user: Instance group ea67a1ce-5f39-4a15-94e1-075fbd46bb11 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:59.320187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.321154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:25:59.326334 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-830e4dc9-2edc-4116-8629-00c758da2e7e tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ea67a1ce-5f39-4a15-94e1-075fbd46bb11" status: 404 len: 117 microversion: 2.1 time: 0.022388 Sep 18 01:25:59.332097 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2303/4641] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:59 2022] DELETE /compute/v2.1/os-server-groups/ea67a1ce-5f39-4a15-94e1-075fbd46bb11 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:25:59.339495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed5e3c25-3e10-4b6c-81eb-81f51a46ada0 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.341011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:59.342865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:59.343457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:59.344208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:25:59.344681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:25:59.345115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:25:59.353888 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ed5e3c25-3e10-4b6c-81eb-81f51a46ada0 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] HTTP exception thrown: Instance group 422a4f89-23e6-4485-acc0-30468248abbf could not be found. Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed5e3c25-3e10-4b6c-81eb-81f51a46ada0 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Request method failure captured: Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-server-groups/422a4f89-23e6-4485-acc0-30468248abbf HTTP/1.1 Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOLEIOeRSp4kTEd6sor67L82ACgR__sn2zjw-1gQw3vPFKeWI1U0kNta5wCGHeNWweKvL06oNzsAgHz3A03KLpdG8JYBsv_Ee-4Eai74dv0AAT-TxMD4YKSzpAa78ce_83OxvVbsJ5MnWOtY0UJoE9HdheETVNZs6lI3tu2Ke3Qd9k Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6e8393f78224f6ba4178450cbae510f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: f6e8393f78224f6ba4178450cbae510f Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerGroupTestJSON-1503117942 Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 497459f4656f406aa3074618db0c861d Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerGroupTestJSON-1503117942-project Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: exception: Instance group 422a4f89-23e6-4485-acc0-30468248abbf could not be found. Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '422a4f89-23e6-4485-acc0-30468248abbf'} Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 422a4f89-23e6-4485-acc0-30468248abbf could not be found. Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 422a4f89-23e6-4485-acc0-30468248abbf could not be found. Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.355438 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 422a4f89-23e6-4485-acc0-30468248abbf could not be found. Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed5e3c25-3e10-4b6c-81eb-81f51a46ada0 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Returning 404 to user: Instance group 422a4f89-23e6-4485-acc0-30468248abbf could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed5e3c25-3e10-4b6c-81eb-81f51a46ada0 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/422a4f89-23e6-4485-acc0-30468248abbf" status: 404 len: 117 microversion: 2.1 time: 0.022731 Sep 18 01:25:59.364987 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2304/4642] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:59 2022] DELETE /compute/v2.1/os-server-groups/422a4f89-23e6-4485-acc0-30468248abbf => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:25:59.375272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-503d0bc7-e24c-45d2-b72a-7ed9970ffbe9 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:25:59.432497 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-503d0bc7-e24c-45d2-b72a-7ed9970ffbe9 tempest-ServerGroupTestJSON-1503117942 tempest-ServerGroupTestJSON-1503117942-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/67e93392-d2ad-4ed5-bf7f-c0954633ec1c" status: 204 len: 0 microversion: 2.1 time: 0.067420 Sep 18 01:25:59.433599 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2305/4643] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 01:25:59 2022] DELETE /compute/v2.1/os-server-groups/67e93392-d2ad-4ed5-bf7f-c0954633ec1c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:25:59.620011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:25:59.634401 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7fabcae3-1eed-4932-91de-23f618de76a6 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1323 microversion: 2.1 time: 0.323022 Sep 18 01:25:59.636734 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2339/4644] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:25:59 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:00.278367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9f813abb-e61d-4327-8eac-64b1d5514578 req-afb49dce-b03f-4aba-adcf-d7b94169bb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed5807a-4267-4239-b790-7d5bed1382db", "name": "network-vif-plugged", "status": "completed", "tag": "68755270-60e3-485b-9a99-d6a59f87c083"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:00.294985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f813abb-e61d-4327-8eac-64b1d5514578 req-afb49dce-b03f-4aba-adcf-d7b94169bb64 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:00.296559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f813abb-e61d-4327-8eac-64b1d5514578 req-afb49dce-b03f-4aba-adcf-d7b94169bb64 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:00.297011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9f813abb-e61d-4327-8eac-64b1d5514578 req-afb49dce-b03f-4aba-adcf-d7b94169bb64 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:00.329069 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9f813abb-e61d-4327-8eac-64b1d5514578 req-afb49dce-b03f-4aba-adcf-d7b94169bb64 service nova] Creating event network-vif-plugged:68755270-60e3-485b-9a99-d6a59f87c083 for instance 6ed5807a-4267-4239-b790-7d5bed1382db on n-h1-master-1 Sep 18 01:26:00.345804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9f813abb-e61d-4327-8eac-64b1d5514578 req-afb49dce-b03f-4aba-adcf-d7b94169bb64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421413 Sep 18 01:26:00.346773 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2306/4645] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:00.660685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:00.661344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:00.674675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:00.676896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:00.677355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:00.678114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:00.678577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:00.679019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:01.209478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:01.218622 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7cae85b0-837e-4cd7-b41e-2e02f274255e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1323 microversion: 2.1 time: 0.562392 Sep 18 01:26:01.238955 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2340/4646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:00 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1323 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:01.832849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Calling method '.version_select at 0x7f70051963a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:01.834688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:01.835178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:01.835617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:01.897199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:01.903936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:01.904056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:01.927883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:01.928376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:01.929005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:01.945262 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-062cf41b-bf6d-41e6-9fb6-9df384c9923c tempest-PortsAdminExtendedAttrsTestJSON-1217162673 tempest-PortsAdminExtendedAttrsTestJSON-1217162673-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.619956 Sep 18 01:26:01.954467 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2307/4647] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:26:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:02.264747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:02.265482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:02.287822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:02.290650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:02.291686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:02.294405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:02.295086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:02.296166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:02.648155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:02.664674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8632e3b0-63d0-4f52-b268-5f4c173145c3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1521 microversion: 2.1 time: 0.415980 Sep 18 01:26:02.675152 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2341/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:02 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:02.691676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:02.692718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:02.704390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:02.708134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:02.708918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:02.711058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:02.713599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:02.714232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:02.776176 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] HTTP exception thrown: Instance is not a member of specified network Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Request method failure captured: Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db/ips/invalid HTTP/1.1 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOXRxiK4eyOqBttcTKtzbo-JSkDNyXA43XC7qaSnQztaVMYiepOyjC-x75Q1bQtkEsWk7_EeSbxfA5EF5HUHv7TCMecoeXrednxljvJQQKKGKn1fzjghkK_icNJ17Pz0MI2M6iFyDVheMFKf8bVlErhbKOBhpXLAb2FxVVTK7-L2TY Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1ed05294151747e38422999eb9aea434 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed05294151747e38422999eb9aea434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ed05294151747e38422999eb9aea434"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ed05294151747e38422999eb9aea434"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed05294151747e38422999eb9aea434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1ed05294151747e38422999eb9aea434 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerAddressesNegativeTestJSON-1254605646-project Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 7c49f9d15e72407da633a9227c5da519 Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1254605646-project Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: exception: Instance is not a member of specified network Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '6ed5807a-4267-4239-b790-7d5bed1382db', 'id': 'invalid'} Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 18 01:26:02.784644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.788720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:26:02.788953 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45f2f58e-c74f-4c66-bc85-441e1f0d6f18 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.101126 Sep 18 01:26:02.791320 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2308/4649] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 01:26:02 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db/ips/invalid => generated 91 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:26:02.800828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f699bff7-73de-4b05-b876-1f9488c131cd tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:02.801312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f699bff7-73de-4b05-b876-1f9488c131cd tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Failed to fetch instance by id 999 {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 01:26:02.801856 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-f699bff7-73de-4b05-b876-1f9488c131cd tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] HTTP exception thrown: Instance 999 could not be found. Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f699bff7-73de-4b05-b876-1f9488c131cd tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Request method failure captured: Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOXRxiK4eyOqBttcTKtzbo-JSkDNyXA43XC7qaSnQztaVMYiepOyjC-x75Q1bQtkEsWk7_EeSbxfA5EF5HUHv7TCMecoeXrednxljvJQQKKGKn1fzjghkK_icNJ17Pz0MI2M6iFyDVheMFKf8bVlErhbKOBhpXLAb2FxVVTK7-L2TY Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1ed05294151747e38422999eb9aea434 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed05294151747e38422999eb9aea434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ed05294151747e38422999eb9aea434"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ed05294151747e38422999eb9aea434"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed05294151747e38422999eb9aea434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1ed05294151747e38422999eb9aea434 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerAddressesNegativeTestJSON-1254605646-project Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 7c49f9d15e72407da633a9227c5da519 Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1254605646-project Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 999 could not be found. Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '999'} Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 18 01:26:02.804078 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:26:02.811417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f699bff7-73de-4b05-b876-1f9488c131cd tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:26:02.812435 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f699bff7-73de-4b05-b876-1f9488c131cd tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016274 Sep 18 01:26:02.814393 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2342/4650] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:26:02 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:26:02.824638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:02.825810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:02.840797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:02.841488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:02.841905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:02.847713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:02.848259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:02.848884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:02.906107 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:26:03.102936 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e47210a8-daee-446f-ab6c-8850de51702c tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 204 len: 0 microversion: 2.1 time: 0.281760 Sep 18 01:26:03.103729 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2309/4651] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:26:02 2022] DELETE /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:26:03.117724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:03.119161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:03.130614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:03.132496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:03.134262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:03.135418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:03.136103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:03.136880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:04.094586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:04.110062 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ea350b7-7090-4bcf-9bd9-2d2c8d02ff6e tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1527 microversion: 2.1 time: 1.001993 Sep 18 01:26:04.111485 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2343/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:03 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1527 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:05.137908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:05.138614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:05.141120 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:05.170879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:05.171580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:05.172077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:05.172818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:05.173272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:05.173801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:05.466907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:05.476935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-81b11c59-9d6f-4408-aa9f-3db97bb38265 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1527 microversion: 2.1 time: 0.342738 Sep 18 01:26:05.478750 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2310/4653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:05 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1527 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:06.500741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:06.501361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:06.519530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:06.520572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:06.521188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:06.522861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:06.523492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:06.524928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:06.746167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:06.756130 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-401ee536-1107-46cf-b7bc-744602d14f93 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1485 microversion: 2.1 time: 0.259415 Sep 18 01:26:06.769621 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2344/4654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:06 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1485 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:07.517335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-fc38123a-59c0-4acc-92ad-d0cb319669fc req-426cc0ab-717a-4505-9406-33df5cf6f1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed5807a-4267-4239-b790-7d5bed1382db", "name": "network-vif-deleted", "tag": "68755270-60e3-485b-9a99-d6a59f87c083"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:07.546544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fc38123a-59c0-4acc-92ad-d0cb319669fc req-426cc0ab-717a-4505-9406-33df5cf6f1a9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:07.550407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fc38123a-59c0-4acc-92ad-d0cb319669fc req-426cc0ab-717a-4505-9406-33df5cf6f1a9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:07.552321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fc38123a-59c0-4acc-92ad-d0cb319669fc req-426cc0ab-717a-4505-9406-33df5cf6f1a9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:07.584182 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-fc38123a-59c0-4acc-92ad-d0cb319669fc req-426cc0ab-717a-4505-9406-33df5cf6f1a9 service nova] Creating event network-vif-deleted:68755270-60e3-485b-9a99-d6a59f87c083 for instance 6ed5807a-4267-4239-b790-7d5bed1382db on n-h1-master-1 Sep 18 01:26:07.604657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-fc38123a-59c0-4acc-92ad-d0cb319669fc req-426cc0ab-717a-4505-9406-33df5cf6f1a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093018 Sep 18 01:26:07.614729 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2311/4655] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:07.782334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:07.783486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:07.806051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:07.806658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:07.807111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:07.807858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:07.808393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:07.808824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:07.853736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:07.854231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:07.854770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:07.855210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lazy-loading 'fault' on Instance uuid 6ed5807a-4267-4239-b790-7d5bed1382db {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:26:07.947297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c49f9d15e72407da633a9227c5da519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed05294151747e38422999eb9aea434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:07.962057 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-055e90f1-d0d8-415e-ab6c-8e07c5172ab3 tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 200 len: 1313 microversion: 2.1 time: 0.184016 Sep 18 01:26:07.966459 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2345/4656] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:07 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:08.994965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:08.996729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] [instance: 6ed5807a-4267-4239-b790-7d5bed1382db] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:09.004584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:09.005134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:09.006620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:09.006620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:09.007095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:09.007205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:09.039518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] HTTP exception thrown: Instance 6ed5807a-4267-4239-b790-7d5bed1382db could not be found. Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Request method failure captured: Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db HTTP/1.1 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOXRxiK4eyOqBttcTKtzbo-JSkDNyXA43XC7qaSnQztaVMYiepOyjC-x75Q1bQtkEsWk7_EeSbxfA5EF5HUHv7TCMecoeXrednxljvJQQKKGKn1fzjghkK_icNJ17Pz0MI2M6iFyDVheMFKf8bVlErhbKOBhpXLAb2FxVVTK7-L2TY Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1ed05294151747e38422999eb9aea434 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed05294151747e38422999eb9aea434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ed05294151747e38422999eb9aea434"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ed05294151747e38422999eb9aea434"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed05294151747e38422999eb9aea434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1ed05294151747e38422999eb9aea434 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1254605646 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerAddressesNegativeTestJSON-1254605646-project Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 7c49f9d15e72407da633a9227c5da519 Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1254605646-project Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6ed5807a-4267-4239-b790-7d5bed1382db could not be found. Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6ed5807a-4267-4239-b790-7d5bed1382db'} Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed5807a-4267-4239-b790-7d5bed1382db could not be found. Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed5807a-4267-4239-b790-7d5bed1382db could not be found. Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:09.042008 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed5807a-4267-4239-b790-7d5bed1382db could not be found. Sep 18 01:26:09.046102 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:26:09.047866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] Returning 404 to user: Instance 6ed5807a-4267-4239-b790-7d5bed1382db could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:26:09.048939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-87a09274-7078-4841-9296-bd779a0d64df tempest-ServerAddressesNegativeTestJSON-1254605646 tempest-ServerAddressesNegativeTestJSON-1254605646-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db" status: 404 len: 111 microversion: 2.1 time: 0.059843 Sep 18 01:26:09.051424 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2312/4657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:08 2022] GET /compute/v2.1/servers/6ed5807a-4267-4239-b790-7d5bed1382db => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:26:26.415191 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=14 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:26.416312 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=50 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:26.444720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:26.445233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:26.449132 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=5 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:26.449834 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:26.479175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:26.479619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:26.485608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:26.486515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:26.487070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:26.487751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:26.584022 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3aa92b7e-849c-4988-91d3-cb8cb02f06d9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/ips" status: 200 len: 149 microversion: 2.1 time: 0.144322 Sep 18 01:26:26.588782 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2313/4658] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:26:26 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/ips => generated 149 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:26.747358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-458157136", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:26.926840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] validate_networks() for [('e7b90fac-ccdd-4e68-9696-a2e46898b9e6', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:26:27.154808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:27.155959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:27.174261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:27.174956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:27.176703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:27.182034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:27.185163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:27.185833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:27.246321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:26:27.498496 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fcac0f1a-a6bf-4393-b206-7f444fd41989 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 204 len: 0 microversion: 2.32 time: 1.089259 Sep 18 01:26:27.502599 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2346/4659] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:26:26 2022] DELETE /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:26:27.519260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:27.520149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:27.529010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:27.529792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:27.530487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:27.531626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:27.532323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:27.533035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:29.267070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:29.280775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:29.301121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:29.305471 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ae27616-e390-4426-ba08-00fc32239330 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2957 microversion: 2.32 time: 1.800498 Sep 18 01:26:29.310385 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2347/4660] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:27 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2957 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:29.779786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68517600-ea10-4e6e-ad2b-44133d85a335"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:29.782616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:29.792146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:29.792885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:29.793510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:29.794467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:29.795090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:29.795818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:30.428589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46c665f1-d81d-4989-b885-2178c666326a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654344 Sep 18 01:26:30.429396 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2348/4661] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:26:29 2022] POST /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:30.435329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:30.446060 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:30.460763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:30.461297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:30.461819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:30.462584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:30.471789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:30.472350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:30.666479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:26:30.667461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:26:30.668144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:26:30.668808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:26:30.670149 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:26:30.703172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:30.703766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:30.704370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:30.708586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:30.709266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:30.710704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:30.754690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Getting quotas for project faf9f899c2054d8cb558dd1f01a2863e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:26:30.766554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Getting quotas for user 61cd7711674848c699775a6d27ed6752 and project faf9f899c2054d8cb558dd1f01a2863e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:26:30.807187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:26:30.809812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:26:30.985899 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7cbda192-3ee4-4c4c-a110-83ba48dabf98 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.356525 Sep 18 01:26:30.991735 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2314/4662] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:26:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 4364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:26:31.012292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a41a03af-e9ae-44dc-996a-2e332befb767 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:31.015812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a41a03af-e9ae-44dc-996a-2e332befb767 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:31.505638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a41a03af-e9ae-44dc-996a-2e332befb767 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:31.513495 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a41a03af-e9ae-44dc-996a-2e332befb767 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1213 microversion: 2.1 time: 0.505091 Sep 18 01:26:31.514090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2315/4663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:31 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1213 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:26:32.541011 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:32.541934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:32.555520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:32.561825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:32.562439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:32.563310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:32.563919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:32.564446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:32.975388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:32.995786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:33.007406 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-175066db-9704-4011-8761-97021c22a62c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1217 microversion: 2.1 time: 0.474157 Sep 18 01:26:33.009378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:33.015492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:33.016210 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2316/4664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:32 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1217 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:26:33.027227 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-593818c3-b268-4d73-8a5f-9fef68d85e76 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2957 microversion: 2.32 time: 2.595378 Sep 18 01:26:33.032294 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2349/4665] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:30 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2957 bytes in 2600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:34.067583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:34.069379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:34.070102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:34.071902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:34.088983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:34.098256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:34.099725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:34.100738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:34.101825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:34.102521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:34.117443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:34.122699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:34.126013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:34.126820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:34.127316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:34.132368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:35.561034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:35.583605 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-636a1f3e-3100-437a-b99d-da06a0f1d8c7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1271 microversion: 2.1 time: 1.526852 Sep 18 01:26:35.597616 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2317/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:34 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1271 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:35.603293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-955472b2-26a5-4174-96a3-32c50777e15c req-886e84c9-86b1-482a-bcc6-21296a229700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-unplugged", "status": "completed", "tag": "1e42e3f5-ed85-419a-a645-24442370ad64"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:35.642272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-955472b2-26a5-4174-96a3-32c50777e15c req-886e84c9-86b1-482a-bcc6-21296a229700 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:35.643053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-955472b2-26a5-4174-96a3-32c50777e15c req-886e84c9-86b1-482a-bcc6-21296a229700 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:35.643641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-955472b2-26a5-4174-96a3-32c50777e15c req-886e84c9-86b1-482a-bcc6-21296a229700 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:35.680310 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-955472b2-26a5-4174-96a3-32c50777e15c req-886e84c9-86b1-482a-bcc6-21296a229700 service nova] Creating event network-vif-unplugged:1e42e3f5-ed85-419a-a645-24442370ad64 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:35.695940 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-955472b2-26a5-4174-96a3-32c50777e15c req-886e84c9-86b1-482a-bcc6-21296a229700 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096574 Sep 18 01:26:35.704372 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2318/4667] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:36.528862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:36.554045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:36.571172 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:36.572849 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-367b11d5-a4a2-40ac-bedc-9cf1ab63a921 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2957 microversion: 2.32 time: 2.510658 Sep 18 01:26:36.575346 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2350/4668] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:34 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2957 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:36.626095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:36.628094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:36.643704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:36.643704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:36.643704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:36.644490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:36.644950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:36.645373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:36.866166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:36.886198 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef3f03db-cc38-4772-92fa-c345c68681cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1271 microversion: 2.1 time: 0.269954 Sep 18 01:26:36.894754 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2319/4669] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:36 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:37.606202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:37.607013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:37.635858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:37.637494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:37.638067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:37.638923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:37.639503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:37.640043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:37.916769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:37.917361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:37.935285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:37.935773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:37.936222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:37.936922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:37.937369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:37.938006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:38.161135 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:38.169946 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7ad3e841-5529-4d09-80ab-c21ce99d17a9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1271 microversion: 2.1 time: 0.258340 Sep 18 01:26:38.176680 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2320/4670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:37 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:26:38.181753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-unplugged", "status": "completed", "tag": "e1294bdc-7b69-46bd-a170-84a4cbbd005e"}, {"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-unplugged", "status": "completed", "tag": "21aaa75b-4e49-4512-a81f-a1352471c4d4"}, {"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-unplugged", "status": "completed", "tag": "08b14aba-a44c-4681-97f9-cbd1abf709fa"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:38.212764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:38.213235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:38.220524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:38.240539 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] Creating event network-vif-unplugged:e1294bdc-7b69-46bd-a170-84a4cbbd005e for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:38.241043 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] Creating event network-vif-unplugged:21aaa75b-4e49-4512-a81f-a1352471c4d4 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:38.241542 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] Creating event network-vif-unplugged:08b14aba-a44c-4681-97f9-cbd1abf709fa for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:38.258722 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b4dd1f1d-8c50-4be2-96e0-d56aa2378187 req-20ebfc0f-bf9b-45ac-afa8-525b29c4058f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.080511 Sep 18 01:26:38.259428 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2321/4671] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:38.417876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:38.434998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:38.440255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:38.445646 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ef45206-4d92-4185-bc90-997fc774545c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2936 microversion: 2.32 time: 0.841217 Sep 18 01:26:38.449266 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2351/4672] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:37 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2936 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:39.194277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:39.195683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:39.208794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:39.209646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:39.210354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:39.215745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:39.216567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:39.217239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:39.479903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:39.481131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:39.488145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:39.498123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:39.498769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:39.500180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:39.500855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:39.501457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:39.525310 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:39.541932 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac540935-05ac-4401-b41c-61888fddff31 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1271 microversion: 2.1 time: 0.344552 Sep 18 01:26:39.543366 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2322/4673] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:39 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1271 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:40.574023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:40.575477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:40.594618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:40.595581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:40.596312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:40.597612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:40.598385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:40.599794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:40.727816 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:41.188930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:41.220501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:41.234321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:41.238623 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-693370d8-2b6e-4721-aa5b-c442cad18527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2936 microversion: 2.32 time: 1.763257 Sep 18 01:26:41.240751 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2352/4674] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:39 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2936 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:26:41.393789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-940182985", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "1081af7e-d1ce-43cc-9dd9-e60fa5caffe2"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:41.488994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] validate_networks() for [('1081af7e-d1ce-43cc-9dd9-e60fa5caffe2', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:26:41.513168 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:43.212332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:43.221431 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8823c91b-f154-4850-9361-0daaacab259d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1313 microversion: 2.1 time: 2.656245 Sep 18 01:26:43.222208 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2323/4675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:40 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1313 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:43.233018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c2d32561-d269-4bf7-a872-89795128a519 req-3ea6a103-c253-45e1-a88c-cd530d986fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-unplugged", "status": "completed", "tag": "aa06682e-2b23-41ed-a2d7-e5c411718453"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:43.253744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c2d32561-d269-4bf7-a872-89795128a519 req-3ea6a103-c253-45e1-a88c-cd530d986fc6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:43.254225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c2d32561-d269-4bf7-a872-89795128a519 req-3ea6a103-c253-45e1-a88c-cd530d986fc6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:43.254678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c2d32561-d269-4bf7-a872-89795128a519 req-3ea6a103-c253-45e1-a88c-cd530d986fc6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:43.291935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c2d32561-d269-4bf7-a872-89795128a519 req-3ea6a103-c253-45e1-a88c-cd530d986fc6 service nova] Creating event network-vif-unplugged:aa06682e-2b23-41ed-a2d7-e5c411718453 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:43.299979 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c2d32561-d269-4bf7-a872-89795128a519 req-3ea6a103-c253-45e1-a88c-cd530d986fc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076539 Sep 18 01:26:43.302195 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2324/4676] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:43.318336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:43.319515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:43.333993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:43.334795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:43.336190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:43.337630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:43.338271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:43.338895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:44.233364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:44.255350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:44.256813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:44.258689 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0d1a032-2f34-4f25-aa77-7149fb800195 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2915 microversion: 2.32 time: 0.955167 Sep 18 01:26:44.259273 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2325/4677] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:43 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2915 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:44.640962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2953df30-4e49-43fa-a58a-71ef885f466a req-7196edec-2cb3-45c7-b428-106049c99fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432ebf1e-16b5-4f88-93e9-c46706a74599", "tag": "f21801fc-20c6-4bec-bcc1-9b0e6e8d46b0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:44.657452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2953df30-4e49-43fa-a58a-71ef885f466a req-7196edec-2cb3-45c7-b428-106049c99fb5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:44.658266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2953df30-4e49-43fa-a58a-71ef885f466a req-7196edec-2cb3-45c7-b428-106049c99fb5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:44.658980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2953df30-4e49-43fa-a58a-71ef885f466a req-7196edec-2cb3-45c7-b428-106049c99fb5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:44.677603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2953df30-4e49-43fa-a58a-71ef885f466a req-7196edec-2cb3-45c7-b428-106049c99fb5 service nova] Creating event network-changed:f21801fc-20c6-4bec-bcc1-9b0e6e8d46b0 for instance 432ebf1e-16b5-4f88-93e9-c46706a74599 on n-h2-master-1 Sep 18 01:26:44.684135 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2953df30-4e49-43fa-a58a-71ef885f466a req-7196edec-2cb3-45c7-b428-106049c99fb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.385151 Sep 18 01:26:44.689944 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2326/4678] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:44.699020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:44.700578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:44.710995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:44.712711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:44.713461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:44.715587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:44.716984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:44.718169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:44.835334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:26:44.838923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:26:44.841412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:26:44.843438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:26:44.844153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:26:44.857017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:44.857883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:44.858603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:44.859741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:44.860484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:44.861525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:44.887723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Getting quotas for project b8d4e190452e4709b3910dbcd5175014. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:26:44.896019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Getting quotas for user 713e0f47f0e24b84a3da9c78a119407a and project b8d4e190452e4709b3910dbcd5175014. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:26:44.914464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:26:44.917640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:26:45.018776 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a481bd1f-223c-40eb-b6c0-61a8eaa8ddc2 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.776692 Sep 18 01:26:45.022220 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2353/4679] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:26:45.049993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-79add870-bbb1-4cee-96d4-112ae316e87f tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:45.051082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-79add870-bbb1-4cee-96d4-112ae316e87f tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:45.755623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79add870-bbb1-4cee-96d4-112ae316e87f tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:45.767915 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-79add870-bbb1-4cee-96d4-112ae316e87f tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1215 microversion: 2.1 time: 0.722366 Sep 18 01:26:45.789231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2354/4680] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:45 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1215 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:45.807306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:45.811458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:45.849313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:45.852066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:45.854902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:45.857922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:45.861318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:45.862030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:46.693356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:46.707943 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-509a1717-5e2c-4342-a6d4-35a242c7eb24 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1313 microversion: 2.1 time: 2.015728 Sep 18 01:26:46.730314 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2327/4681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:44 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1313 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:46.749165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f3451b1f-c89b-46dd-a2b2-42a2223e64fd req-930a584e-0273-4244-8210-4c5669fef385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-deleted", "tag": "aa06682e-2b23-41ed-a2d7-e5c411718453"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:46.771854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f3451b1f-c89b-46dd-a2b2-42a2223e64fd req-930a584e-0273-4244-8210-4c5669fef385 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:46.773493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f3451b1f-c89b-46dd-a2b2-42a2223e64fd req-930a584e-0273-4244-8210-4c5669fef385 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:46.774698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f3451b1f-c89b-46dd-a2b2-42a2223e64fd req-930a584e-0273-4244-8210-4c5669fef385 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:46.807355 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f3451b1f-c89b-46dd-a2b2-42a2223e64fd req-930a584e-0273-4244-8210-4c5669fef385 service nova] Creating event network-vif-deleted:aa06682e-2b23-41ed-a2d7-e5c411718453 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:46.819429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f3451b1f-c89b-46dd-a2b2-42a2223e64fd req-930a584e-0273-4244-8210-4c5669fef385 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082189 Sep 18 01:26:46.819897 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2328/4682] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:46.837045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:46.840233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:46.856520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:46.857390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:46.858108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:46.859189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:46.859944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:46.864945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:47.660634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:47.671332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:47.681653 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9da599b3-0fe3-4b41-bfaa-5ee8258870c8 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1267 microversion: 2.1 time: 0.855470 Sep 18 01:26:47.702570 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2329/4683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:46 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1267 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:47.706597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:47.708075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:47.709347 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c0c03c3-ffa0-4038-8a7f-72ba14d87421 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2868 microversion: 2.32 time: 1.915625 Sep 18 01:26:47.710260 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2355/4684] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:45 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2868 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:47.750294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:47.751002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:47.768284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:47.770328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:47.773608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:47.779237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:47.780460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:47.781132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:48.182359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:48.191565 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c67987d-c814-461f-9e2c-1631c9a6dbac tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1313 microversion: 2.1 time: 0.447953 Sep 18 01:26:48.201953 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2330/4685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:47 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:48.715817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:48.716650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:48.738018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:48.739859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:48.743596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:48.744505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:48.744952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:48.749007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:48.749503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:48.750398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:48.751066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:48.758933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:48.759754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:48.763057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:48.763825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:48.764273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:48.983120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:49.005951 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37f896d7-93aa-4666-a0e0-cb8c6bdd20c5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1273 microversion: 2.1 time: 0.295026 Sep 18 01:26:49.006547 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2356/4686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:48 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:49.025808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-04fe5740-8e3d-4bb4-abf7-9db317271bc5 req-e91876bd-f554-4135-b9eb-2cb4906a0a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-deleted", "tag": "e1294bdc-7b69-46bd-a170-84a4cbbd005e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:49.061830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-04fe5740-8e3d-4bb4-abf7-9db317271bc5 req-e91876bd-f554-4135-b9eb-2cb4906a0a2f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:49.062372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-04fe5740-8e3d-4bb4-abf7-9db317271bc5 req-e91876bd-f554-4135-b9eb-2cb4906a0a2f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:49.062953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-04fe5740-8e3d-4bb4-abf7-9db317271bc5 req-e91876bd-f554-4135-b9eb-2cb4906a0a2f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:49.098728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-04fe5740-8e3d-4bb4-abf7-9db317271bc5 req-e91876bd-f554-4135-b9eb-2cb4906a0a2f service nova] Creating event network-vif-deleted:e1294bdc-7b69-46bd-a170-84a4cbbd005e for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:49.127696 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-04fe5740-8e3d-4bb4-abf7-9db317271bc5 req-e91876bd-f554-4135-b9eb-2cb4906a0a2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117642 Sep 18 01:26:49.128695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2357/4687] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:49.138115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55a60dc5-a293-4650-94dc-25ae2423c653 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: .version_select at 0x7f700651d1f0>, body: {"keypair": {"name": "tempest-keypair-604622960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHHWh2Rlg9tMLRi8xilTr82O5ohPiDpyI84tGYX4EHcQ+bLceGwqdXUJIRdmnCeq1JhV+VsyBI0ny5uyPkZlFp1MdlvBEGGVxxvZEk2DD7pTcnf2oIRhWltv0sbJ4e8ew=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:49.171614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-55a60dc5-a293-4650-94dc-25ae2423c653 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:26:49.178570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-55a60dc5-a293-4650-94dc-25ae2423c653 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:26:49.214657 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55a60dc5-a293-4650-94dc-25ae2423c653 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084430 Sep 18 01:26:49.215617 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2358/4688] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:26:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:49.234631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:49.254391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:49.269716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:49.270276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:49.270650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:49.276951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:49.277943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:49.278578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:49.421794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:49.437586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:49.442937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:49.447936 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efe82e48-b619-4d37-a671-d0ea6ed3b682 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2707 microversion: 2.32 time: 0.710201 Sep 18 01:26:49.468426 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2331/4689] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:48 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2707 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:49.489045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-49f6e5c8-9cd9-4e17-a674-4f1cfce08aa0 req-3fc38c27-e1ad-4f67-aa21-8ff594f97050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432ebf1e-16b5-4f88-93e9-c46706a74599", "name": "network-vif-plugged", "status": "completed", "tag": "f21801fc-20c6-4bec-bcc1-9b0e6e8d46b0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:49.521044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49f6e5c8-9cd9-4e17-a674-4f1cfce08aa0 req-3fc38c27-e1ad-4f67-aa21-8ff594f97050 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:49.521592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49f6e5c8-9cd9-4e17-a674-4f1cfce08aa0 req-3fc38c27-e1ad-4f67-aa21-8ff594f97050 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:49.522009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49f6e5c8-9cd9-4e17-a674-4f1cfce08aa0 req-3fc38c27-e1ad-4f67-aa21-8ff594f97050 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:49.557935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-49f6e5c8-9cd9-4e17-a674-4f1cfce08aa0 req-3fc38c27-e1ad-4f67-aa21-8ff594f97050 service nova] Creating event network-vif-plugged:f21801fc-20c6-4bec-bcc1-9b0e6e8d46b0 for instance 432ebf1e-16b5-4f88-93e9-c46706a74599 on n-h2-master-1 Sep 18 01:26:49.573977 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-49f6e5c8-9cd9-4e17-a674-4f1cfce08aa0 req-3fc38c27-e1ad-4f67-aa21-8ff594f97050 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089472 Sep 18 01:26:49.577955 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2332/4690] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:26:49.926089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:49.938077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0d8cc3b4-79d4-4d73-bcd1-43d29f3ed9b2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1313 microversion: 2.1 time: 0.720713 Sep 18 01:26:49.938852 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2359/4691] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:49 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:50.031320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:50.033034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:50.041940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:50.042741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:50.043634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:50.046236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:50.048508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:50.049378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:50.487443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:50.493400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:50.515166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:50.515781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:50.516462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:50.517262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:50.517827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:50.518443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:50.824528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:50.834532 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05c05114-09fa-4387-8f63-5b7b95863898 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1315 microversion: 2.1 time: 0.809290 Sep 18 01:26:50.836243 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2333/4692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:50 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:50.967138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:50.967931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:50.984877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:50.985378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:50.985896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:50.986611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:50.987074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:50.987832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:51.068367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:51.090290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:51.094361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:51.100888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-563451a7-2b82-4df9-862e-184dfdeab840 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2547 microversion: 2.32 time: 0.619594 Sep 18 01:26:51.103831 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2360/4693] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:50 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2547 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:51.862537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-915614c1-b7a9-4628-954f-765752533a89 req-95b4cc88-70cd-4802-8064-a74e31e7d155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-deleted", "tag": "08b14aba-a44c-4681-97f9-cbd1abf709fa"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:51.910743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-915614c1-b7a9-4628-954f-765752533a89 req-95b4cc88-70cd-4802-8064-a74e31e7d155 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:51.911416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-915614c1-b7a9-4628-954f-765752533a89 req-95b4cc88-70cd-4802-8064-a74e31e7d155 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:51.911873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-915614c1-b7a9-4628-954f-765752533a89 req-95b4cc88-70cd-4802-8064-a74e31e7d155 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:51.939334 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-915614c1-b7a9-4628-954f-765752533a89 req-95b4cc88-70cd-4802-8064-a74e31e7d155 service nova] Creating event network-vif-deleted:08b14aba-a44c-4681-97f9-cbd1abf709fa for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:51.959122 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-915614c1-b7a9-4628-954f-765752533a89 req-95b4cc88-70cd-4802-8064-a74e31e7d155 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101062 Sep 18 01:26:51.962062 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2361/4694] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:51.970105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:51.977129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:51.977950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:51.991147 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b615440f-39bb-4983-a400-09dc5315d557 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1313 microversion: 2.1 time: 1.027218 Sep 18 01:26:51.995283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:51.996945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:51.997656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:52.000130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:52.002680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:52.004858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:52.005731 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2334/4695] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:50 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1313 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:52.133405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:52.134600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:52.147200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:52.147863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:52.148622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:52.150836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:52.151607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:52.152278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:52.192744 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:52.286935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:52.298242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2aace221-7e90-474b-a201-3d1fd1222372 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1315 microversion: 2.1 time: 0.334881 Sep 18 01:26:52.307537 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2362/4696] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:51 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:52.850972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-959644eb-6cb5-44f9-a3fa-5c7ea83f4004 req-4a662662-5b67-4e1c-a38b-530eb113e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ceddd4-a70c-49d7-bad9-6f22e7dd653e", "tag": "d87057ac-aa41-4592-a9cf-f34f8710294b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:52.895279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-959644eb-6cb5-44f9-a3fa-5c7ea83f4004 req-4a662662-5b67-4e1c-a38b-530eb113e1fb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:52.895903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-959644eb-6cb5-44f9-a3fa-5c7ea83f4004 req-4a662662-5b67-4e1c-a38b-530eb113e1fb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:52.896310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-959644eb-6cb5-44f9-a3fa-5c7ea83f4004 req-4a662662-5b67-4e1c-a38b-530eb113e1fb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:52.916391 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-959644eb-6cb5-44f9-a3fa-5c7ea83f4004 req-4a662662-5b67-4e1c-a38b-530eb113e1fb service nova] Creating event network-changed:d87057ac-aa41-4592-a9cf-f34f8710294b for instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e on n-h1-master-1 Sep 18 01:26:52.922439 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-959644eb-6cb5-44f9-a3fa-5c7ea83f4004 req-4a662662-5b67-4e1c-a38b-530eb113e1fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088603 Sep 18 01:26:52.923775 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2363/4697] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:53.021432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:53.022434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:53.043633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:53.046220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:53.046892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:53.047821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:53.051117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:53.051775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:53.064957 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:53.462462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:53.479803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:53.483771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:53.488284 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96ed888a-bce8-46af-8559-2fd4ec7190ad tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2261 microversion: 2.32 time: 1.358686 Sep 18 01:26:53.490618 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2335/4698] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:52 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2261 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:26:53.516156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:53.517705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:53.532353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:53.533109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:53.534102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:53.539110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:53.539843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:53.540941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:53.793149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:53.827495 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c552bac3-db3d-4f2d-afdc-fa729882c47c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1498 microversion: 2.1 time: 0.811500 Sep 18 01:26:53.833780 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2364/4699] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:53 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1498 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:53.854489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:53.857097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:53.869528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:53.870292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:53.872630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:53.877662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:53.878324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:53.878929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:53.917641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lazy-loading 'flavor' on Instance uuid 432ebf1e-16b5-4f88-93e9-c46706a74599 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:26:53.993360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:54.001776 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a1eb0c5-c05f-432b-9652-79b603e1c2a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1315 microversion: 2.1 time: 0.508196 Sep 18 01:26:54.010879 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2336/4700] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:53 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:54.060495 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d79ad81-4791-4402-8dd7-87c2110d58b0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "POST /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599/action" status: 200 len: 32 microversion: 2.1 time: 0.209362 Sep 18 01:26:54.064963 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2365/4701] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:26:53 2022] POST /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:26:54.073795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:54.074072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:54.085077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:54.085898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:54.086548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:54.087445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:54.092253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:54.092896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:54.533422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:54.535036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:54.549830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:54.552640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:54.557143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:54.559692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:54.561661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:54.563972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:54.600275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:54.621314 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-706abd78-f5c6-4f4e-ae41-89fc4ea2b3dd tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.551752 Sep 18 01:26:54.625362 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2337/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:54 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:54.630688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d9f412dc-39f6-4290-b15e-81f7a3d09954 req-ad09f80d-88f6-4547-9e39-e7d39a382026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-deleted", "tag": "21aaa75b-4e49-4512-a81f-a1352471c4d4"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:54.670651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d9f412dc-39f6-4290-b15e-81f7a3d09954 req-ad09f80d-88f6-4547-9e39-e7d39a382026 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:54.673025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d9f412dc-39f6-4290-b15e-81f7a3d09954 req-ad09f80d-88f6-4547-9e39-e7d39a382026 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:54.673685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d9f412dc-39f6-4290-b15e-81f7a3d09954 req-ad09f80d-88f6-4547-9e39-e7d39a382026 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:54.704676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d9f412dc-39f6-4290-b15e-81f7a3d09954 req-ad09f80d-88f6-4547-9e39-e7d39a382026 service nova] Creating event network-vif-deleted:21aaa75b-4e49-4512-a81f-a1352471c4d4 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:54.716699 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d9f412dc-39f6-4290-b15e-81f7a3d09954 req-ad09f80d-88f6-4547-9e39-e7d39a382026 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089171 Sep 18 01:26:54.722372 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2338/4703] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:54.875281 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:55.036175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:55.037184 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:55.051547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:55.052331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:55.052958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:55.053914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:55.054563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:55.055153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:55.134727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:55.151348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:55.152843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:55.154138 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-89dc8892-f30a-47d9-8638-95d2aebb54c2 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 2214 microversion: 2.32 time: 0.637565 Sep 18 01:26:55.154725 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2366/4704] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:54 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 2214 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:26:55.349033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:55.359366 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca818743-a1dd-46a8-bfc0-fcf474bc2ac6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1315 microversion: 2.1 time: 0.327402 Sep 18 01:26:55.360841 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2339/4705] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:55 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:26:55.653403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:55.654450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:55.661765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:55.662358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:55.662889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:55.663715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:55.664262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:55.664752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:56.180889 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:56.185458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:56.189983 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:56.198820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c851a3c7-3e05-4c92-a486-20ac589f446f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.551904 Sep 18 01:26:56.225091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:56.226383 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2367/4706] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:55 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:56.232305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:56.233236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:56.234560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:56.237090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:56.239572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:56.383962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:56.384995 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:56.396587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:56.397352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:56.398544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:56.400957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:56.401696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:56.408919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:56.523362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:56.545492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:56.547746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:56.549151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b6ff665-2ab8-4c68-a67e-ad3834697527 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.371470 Sep 18 01:26:56.566531 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2340/4707] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:56 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:56.791349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ab3ce906-0409-44b3-92a3-523d17d82f78 req-1158afdb-b374-45a7-aa7a-8e78df7c70ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee842a7-7c90-404b-9914-e18568b33a74", "name": "network-vif-deleted", "tag": "1e42e3f5-ed85-419a-a645-24442370ad64"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:56.797016 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:56.875567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ab3ce906-0409-44b3-92a3-523d17d82f78 req-1158afdb-b374-45a7-aa7a-8e78df7c70ee service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:56.876066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ab3ce906-0409-44b3-92a3-523d17d82f78 req-1158afdb-b374-45a7-aa7a-8e78df7c70ee service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:56.876511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ab3ce906-0409-44b3-92a3-523d17d82f78 req-1158afdb-b374-45a7-aa7a-8e78df7c70ee service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:56.937995 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ab3ce906-0409-44b3-92a3-523d17d82f78 req-1158afdb-b374-45a7-aa7a-8e78df7c70ee service nova] Creating event network-vif-deleted:1e42e3f5-ed85-419a-a645-24442370ad64 for instance 8ee842a7-7c90-404b-9914-e18568b33a74 on n-h2-master-1 Sep 18 01:26:56.946896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ab3ce906-0409-44b3-92a3-523d17d82f78 req-1158afdb-b374-45a7-aa7a-8e78df7c70ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159590 Sep 18 01:26:56.962508 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2341/4708] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:26:57.059595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:57.068960 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52ba6dbf-140a-4432-aa78-7c5d9a7c03eb tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1315 microversion: 2.1 time: 0.689496 Sep 18 01:26:57.069727 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2368/4709] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:56 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:26:57.235930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:57.236749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:57.255083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:57.256631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:57.257759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:57.262410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:57.265415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:57.266878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:57.580504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:57.581133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:57.583589 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:57.603357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:57.604147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:57.604796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:57.605966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:57.606654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:57.607315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:57.748409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:57.761201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:57.762696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:57.775115 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00507858-9552-4209-b963-4c0dc0490d86 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.198630 Sep 18 01:26:57.777874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2369/4710] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:57 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:26:57.780448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:57.794497 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dd7a0210-bbae-4dc2-83bb-e69c482e4faf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.568761 Sep 18 01:26:57.797858 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2342/4711] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:57 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:58.093153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1771069317", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "d9d44926-8e00-4404-8340-c9ef292af441"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:58.102319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:58.104588 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:58.112008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:58.113075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:58.113808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:58.114890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:58.115897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:58.116533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:58.223644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] validate_networks() for [('d9d44926-8e00-4404-8340-c9ef292af441', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:26:58.830127 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:58.840128 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eca4cb81-6aba-4d17-be36-da153b2d2bd6 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1315 microversion: 2.1 time: 0.745285 Sep 18 01:26:58.840744 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2343/4712] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:58 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:26:58.850531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-683d225f-0536-4ce3-abfb-c8f16947a931 req-c00f9ed9-1aad-46c6-baae-f597d7e7436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ceddd4-a70c-49d7-bad9-6f22e7dd653e", "name": "network-vif-plugged", "status": "completed", "tag": "d87057ac-aa41-4592-a9cf-f34f8710294b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:58.879926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-683d225f-0536-4ce3-abfb-c8f16947a931 req-c00f9ed9-1aad-46c6-baae-f597d7e7436a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:58.880680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-683d225f-0536-4ce3-abfb-c8f16947a931 req-c00f9ed9-1aad-46c6-baae-f597d7e7436a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:58.881304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-683d225f-0536-4ce3-abfb-c8f16947a931 req-c00f9ed9-1aad-46c6-baae-f597d7e7436a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:58.899559 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-683d225f-0536-4ce3-abfb-c8f16947a931 req-c00f9ed9-1aad-46c6-baae-f597d7e7436a service nova] Creating event network-vif-plugged:d87057ac-aa41-4592-a9cf-f34f8710294b for instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e on n-h1-master-1 Sep 18 01:26:58.906599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-683d225f-0536-4ce3-abfb-c8f16947a931 req-c00f9ed9-1aad-46c6-baae-f597d7e7436a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064327 Sep 18 01:26:58.910634 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2344/4713] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:26:58.919333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1323542865", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f7c6e0e-8607-495c-8bc4-13fbec48411b"}], "security_groups": [{"name": "tempest-securitygroup--325504710"}], "key_name": "tempest-keypair-604622960", "user_data": "}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:26:59.189143 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:26:59.338532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] validate_networks() for [('8f7c6e0e-8607-495c-8bc4-13fbec48411b', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:26:59.424158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:26:59.425071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:26:59.425936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:26:59.426630 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:26:59.427211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:26:59.439239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:59.440098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:59.441313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:59.442561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:59.443239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:59.444217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:59.466027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Getting quotas for project 13204cd67779476b850251a7e54f8ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:26:59.472493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Getting quotas for user fc9cabbb13a3421797502d3a44a3804f and project 13204cd67779476b850251a7e54f8ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:26:59.488784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:26:59.493023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:26:59.614147 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56a3a641-79aa-4b79-9e99-6d3776a45452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830419 Sep 18 01:26:59.617786 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2370/4714] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:26:59.651069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:59.652214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:59.666011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:59.670703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:59.671682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:59.673109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:59.673733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:59.680833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:59.841302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:59.856133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:59.876704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:26:59.880216 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-32a9ef4e-8a4c-4549-8c7d-2f850a8ac88d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.260022 Sep 18 01:26:59.890089 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2371/4715] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:26:59 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:26:59.903856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:26:59.904479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:26:59.929989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:59.934052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:59.934739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:26:59.935699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:26:59.939906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:26:59.940825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:00.619762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:00.635185 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c2ce846c-56ae-4420-9ceb-ad75999449f6 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.742759 Sep 18 01:27:00.637633 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2372/4716] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:26:59 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:00.652301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:00.652958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:00.668737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:00.669149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:00.669622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:00.670354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:00.670816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:00.671249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:00.843311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:00.861265 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1827346d-1ada-4f50-96fc-0d6ea1bf3dc9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1219 microversion: 2.1 time: 0.217697 Sep 18 01:27:00.861971 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2373/4717] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:00 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1219 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:00.897016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:00.898228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:00.907051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:00.907565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:00.908011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:00.908883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:00.909493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:00.909961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:01.047700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:27:01.048681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:27:01.049403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:27:01.050168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:27:01.050772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:27:01.086592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:01.087739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:01.089570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:01.091224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:01.091930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:01.092567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:01.123474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:27:01.138928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:27:01.168468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:27:01.172292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:27:01.292270 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0adb034b-b025-4861-8464-f296dd87aac5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.379478 Sep 18 01:27:01.295043 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2345/4718] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:26:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:27:01.300486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:01.301433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:01.311645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:01.312519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:01.313177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:01.314335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:01.314983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:01.315981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:01.938325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:02.001754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:02.031137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:02.035181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bed182cb-a384-4fd9-92e0-1d885715d17b tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.738431 Sep 18 01:27:02.048011 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2346/4719] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:01 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:02.063869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-86d03211-4d7c-48c7-9293-82d5f7a2a4e1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:02.067904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-86d03211-4d7c-48c7-9293-82d5f7a2a4e1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:02.456285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:02.470812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9aaa6f6f-696f-4c98-8798-89d999e5f8fe tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1502 microversion: 2.1 time: 1.599765 Sep 18 01:27:02.473635 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2374/4720] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:00 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1502 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:02.479289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:02.489824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:02.498863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-86d03211-4d7c-48c7-9293-82d5f7a2a4e1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:02.509465 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-86d03211-4d7c-48c7-9293-82d5f7a2a4e1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1241 microversion: 2.1 time: 0.456031 Sep 18 01:27:02.518398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2347/4721] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:02 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1241 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:02.522163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:02.523623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:02.524487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:02.524615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:02.525326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:02.538496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:02.539013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:02.539496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:02.558628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:02.563016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:02.563628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:02.564476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:02.566185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:02.568113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:02.864321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:02.885741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dd6f854a-0c21-4a6c-920e-5c3c42f9600e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1273 microversion: 2.1 time: 0.364093 Sep 18 01:27:02.887653 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2348/4722] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:02 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1273 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:02.907714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:02.908306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:02.920409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:02.921609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:02.923223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:02.924071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:02.928081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:02.928636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.076514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:03.086142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a7eb345-95e3-43c2-aeed-32be478567da tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.611148 Sep 18 01:27:03.090508 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2375/4723] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:02 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:03.102366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:03.104413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:03.116019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.120742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.122134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.124650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.126049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.128133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.132331 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c782813a-4a17-42a6-99c3-7e825fe4cb22 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.242306 Sep 18 01:27:03.133486 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2349/4724] 10.222.0.25 () {58 vars in 1296 bytes} [Sun Sep 18 01:27:02 2022] DELETE /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e/os-server-password => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:27:03.169744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:03.170467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:03.194391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.196067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.198003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.208795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.211820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.212278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.267636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ccdb29a-1558-42d3-b3c0-54e0a91d57a5 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.113462 Sep 18 01:27:03.273721 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2350/4725] 10.222.0.25 () {58 vars in 1293 bytes} [Sun Sep 18 01:27:03 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e/os-server-password => generated 16 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:27:03.280974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:03.281489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:03.295596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:03.307556 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:03.309725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:03.314761 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ada04acc-6d05-4179-9d14-d83109099c4d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.222995 Sep 18 01:27:03.315371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2376/4726] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:03 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:03.315840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.322140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.322565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.323430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.324053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.324588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.379251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:27:03.543188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:03.544097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:03.560664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.561179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.561666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.562401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.565922 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-229cca1c-9de8-4955-b62b-394bc0f5640d tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 204 len: 0 microversion: 2.1 time: 0.290278 Sep 18 01:27:03.576749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.578024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.578928 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2351/4727] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:27:03 2022] DELETE /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:27:03.584187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:03.585999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:03.603407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.604076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.604642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.605945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.606519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.607052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.813769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:03.829698 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ff6a88d3-d76e-49d9-abbc-c0e320bc75a1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1301 microversion: 2.1 time: 0.289977 Sep 18 01:27:03.830743 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2377/4728] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:03 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1301 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:03.916985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:03.922481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:03.931955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.932453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.932888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:03.936925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:03.942549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:03.943338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:04.316490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:04.329251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-137cdc13-7642-443f-beec-d3cd8e0cbcb0 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1508 microversion: 2.1 time: 0.749233 Sep 18 01:27:04.331292 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2352/4729] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:03 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1508 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:04.340876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:04.355959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:04.389364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:04.400829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:04.402328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:04.403389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:04.404121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:04.404893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:04.413967 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:04.649638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:04.658245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c47f210-289a-4818-925d-279d7836521d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 0.747034 Sep 18 01:27:04.662397 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2378/4730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:03 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:04.675703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:04.677509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:04.692620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:04.693142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:04.693617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:04.694381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:04.694838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:04.699213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:04.773934 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:04.999824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:05.027237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:05.028948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:05.031353 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0784d1ad-0f88-4af6-9200-64df731fdf98 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.367337 Sep 18 01:27:05.032182 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2379/4731] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:04 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:05.038671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:05.039498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:05.047469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:05.048230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:05.048860 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:05.050101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:05.050759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:05.052017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:05.077330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:05.087368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-38292b35-2015-4db5-874e-2d81c5dd9ad5 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.754270 Sep 18 01:27:05.093082 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2353/4732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:04 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:05.140854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:05.156217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9e808398-ac93-4b0f-9317-663bddfb0bd8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1299 microversion: 2.1 time: 0.122742 Sep 18 01:27:05.157600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2380/4733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:05 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:05.355073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:05.357191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:05.367360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:05.368276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:05.369075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:05.370312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:05.371622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:05.372321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:05.606365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:05.619391 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c15700fa-2b58-402c-b10f-f93c85d88a03 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1508 microversion: 2.1 time: 0.269305 Sep 18 01:27:05.620249 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2354/4734] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:05 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:05.687230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:05.688960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:05.700757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:05.702438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:05.703209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:05.704243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:05.704941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:05.705707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.066980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:06.068053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:06.079880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.082751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.086783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.087865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.094104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.097006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.336035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:06.375688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:06.375688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:06.377802 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f30a2d00-8267-4657-9256-1ac2b02ccfa4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.314536 Sep 18 01:27:06.378765 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2355/4735] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:06 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:06.405003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:06.406854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:06.422316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.422818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.423400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.427430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.429251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.430806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.462065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:06.482665 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83f16bfc-39c8-460c-ad07-5d8f091d4486 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 0.801008 Sep 18 01:27:06.487194 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2381/4736] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:05 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:06.509358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:06.511864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:06.536559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.537055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.537492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.541028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.541507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.546099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.710554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:06.727763 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b45cde64-b3c3-426c-a3d5-e3060d81b081 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1299 microversion: 2.1 time: 0.238382 Sep 18 01:27:06.729230 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2382/4737] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:06 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:06.736303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:06.738713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:06.753308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.759479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.764048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:06.765157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:06.765831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:06.767949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.062491 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:07.073164 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad1c62c5-07c8-4221-964b-903275d6e879 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1466 microversion: 2.1 time: 0.342505 Sep 18 01:27:07.078393 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2383/4738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:06 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1466 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:07.306690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-878e08f2-9606-4d3e-8136-0dd78d792a37 req-8d6f9df6-ee13-4dad-b1d9-f8a91a37e860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ceddd4-a70c-49d7-bad9-6f22e7dd653e", "name": "network-vif-deleted", "tag": "d87057ac-aa41-4592-a9cf-f34f8710294b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:07.328129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-878e08f2-9606-4d3e-8136-0dd78d792a37 req-8d6f9df6-ee13-4dad-b1d9-f8a91a37e860 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:07.332060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-878e08f2-9606-4d3e-8136-0dd78d792a37 req-8d6f9df6-ee13-4dad-b1d9-f8a91a37e860 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:07.332868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-878e08f2-9606-4d3e-8136-0dd78d792a37 req-8d6f9df6-ee13-4dad-b1d9-f8a91a37e860 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.339251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:07.358174 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-950ef68f-a263-40f5-a54b-8b3e16ce2b32 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.977437 Sep 18 01:27:07.395558 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2356/4739] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:06 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:07.418992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:07.421391 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:07.428290 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-878e08f2-9606-4d3e-8136-0dd78d792a37 req-8d6f9df6-ee13-4dad-b1d9-f8a91a37e860 service nova] Creating event network-vif-deleted:d87057ac-aa41-4592-a9cf-f34f8710294b for instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e on n-h1-master-1 Sep 18 01:27:07.453926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:07.456515 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-878e08f2-9606-4d3e-8136-0dd78d792a37 req-8d6f9df6-ee13-4dad-b1d9-f8a91a37e860 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154814 Sep 18 01:27:07.457271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:07.463568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.464625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:07.465540 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2384/4740] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:27:07.466312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:07.467010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.512072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:07.512987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:07.536539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:07.537369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:07.538596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.539534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:07.540169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:07.540762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.712090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:07.726491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:07.736312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:07.742508 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d186a67-b0de-4d7c-bff3-83938b7b1569 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.333838 Sep 18 01:27:07.749826 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2357/4741] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:07 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:07.760424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:07.763437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:07.784203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:07.784740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:07.786329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.787070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:07.787532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:07.791199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:07.940637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:07.953430 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-86cd7ac2-721b-4692-a269-66cfb5319b3d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1299 microversion: 2.1 time: 0.199199 Sep 18 01:27:07.954080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2358/4742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:07 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:08.043727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:08.066758 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6bbd914f-e61a-479a-b540-5f86808c5e8e tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 0.559612 Sep 18 01:27:08.085871 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2385/4743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:07 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:08.103835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:08.105017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:08.118917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.119992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.125622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.126600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.127243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.127840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.234213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.234891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.235927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.238887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lazy-loading 'fault' on Instance uuid d5ceddd4-a70c-49d7-bad9-6f22e7dd653e {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:27:08.371879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713e0f47f0e24b84a3da9c78a119407a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d4e190452e4709b3910dbcd5175014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:08.387543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:08.388774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:08.396883 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a9c3345-7c4b-48fd-84bc-dfa1cf089730 tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 200 len: 1305 microversion: 2.1 time: 0.297891 Sep 18 01:27:08.398669 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2359/4744] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:08 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 1305 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:08.402275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.403070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.404665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.407142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.408959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.409622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.716596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:08.731282 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b30e35b3-f405-4fb0-9269-cf11a1ee1742 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.347471 Sep 18 01:27:08.742136 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2386/4745] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:08 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:08.813907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:08.814975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:08.825836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.830424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.833475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.842193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.843159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.845367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.984360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:08.984959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:08.996373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.997333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:08.998100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:08.999045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:08.999728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.000391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:09.066630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:09.086966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:09.089123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:09.091964 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3dcf6fe3-e74a-47af-93f1-fdd763e3d56f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.283390 Sep 18 01:27:09.110131 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2360/4746] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:08 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:09.124361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:09.125291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:09.133653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:09.134423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.135038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:09.136175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:09.136802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.137389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:09.457165 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:09.485094 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:09.538345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:09.552104 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b518694-ce2d-418a-8523-2d68a526cba2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 0.573659 Sep 18 01:27:09.558005 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2387/4747] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:08 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:09.566643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:09.568150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] [instance: d5ceddd4-a70c-49d7-bad9-6f22e7dd653e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:09.576862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:09.577346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.578441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:09.579499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:09.580898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.582815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:09.618934 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] HTTP exception thrown: Instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e could not be found. Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Request method failure captured: Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e HTTP/1.1 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnPQ1tYggbzBXStbVnFTHTCAySQVHWmqkoqLhPrV_xEwLwkMbr1jTmiia2IcoHzNAAXAZ5yVgXzKVPcwkOD8gRgXHvWHGFQ7G1nlf-bDbn5tn-WFxz_I8OV_X8TI3GUSQhRvSo0YbSZGmQBllpPYh61-cm8HJLPNVgEzfoEkSTxXchM Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: b8d4e190452e4709b3910dbcd5175014 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerPasswordTestJSON-1238604497 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8d4e190452e4709b3910dbcd5175014"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8d4e190452e4709b3910dbcd5175014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8d4e190452e4709b3910dbcd5175014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8d4e190452e4709b3910dbcd5175014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerPasswordTestJSON-1238604497 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: b8d4e190452e4709b3910dbcd5175014 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1238604497 Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerPasswordTestJSON-1238604497-project Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 713e0f47f0e24b84a3da9c78a119407a Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerPasswordTestJSON-1238604497-project Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: exception: Instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e could not be found. Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'd5ceddd4-a70c-49d7-bad9-6f22e7dd653e'} Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e could not be found. Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e could not be found. Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:09.622313 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:09.627196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:09.627196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:09.627196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:09.627196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:27:09.627196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:27:09.627196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e could not be found. Sep 18 01:27:09.627196 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:09.628418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] Returning 404 to user: Instance d5ceddd4-a70c-49d7-bad9-6f22e7dd653e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:27:09.628594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:09.631279 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-946a38d6-046b-45a7-b0ea-9b002a90ceea tempest-ServerPasswordTestJSON-1238604497 tempest-ServerPasswordTestJSON-1238604497-project] 10.222.0.25 "GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e" status: 404 len: 111 microversion: 2.1 time: 0.070504 Sep 18 01:27:09.634749 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2388/4748] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:09 2022] GET /compute/v2.1/servers/d5ceddd4-a70c-49d7-bad9-6f22e7dd653e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:27:09.639531 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67527985-b097-49c5-aa8c-ea6d4d57d46a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 0.524415 Sep 18 01:27:09.640129 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2361/4749] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:09 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:09.661788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b4dac431-f3ed-4910-971a-60111443c834 req-1d3166a0-e923-4602-b3d4-5fd17b763d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1c2b3c-4986-4c2b-8277-628fbd03575e", "tag": "27d61605-61f6-4762-b6d8-a95356b68a1c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:09.688570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b4dac431-f3ed-4910-971a-60111443c834 req-1d3166a0-e923-4602-b3d4-5fd17b763d7c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:09.689066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b4dac431-f3ed-4910-971a-60111443c834 req-1d3166a0-e923-4602-b3d4-5fd17b763d7c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.689645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b4dac431-f3ed-4910-971a-60111443c834 req-1d3166a0-e923-4602-b3d4-5fd17b763d7c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:09.722530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b4dac431-f3ed-4910-971a-60111443c834 req-1d3166a0-e923-4602-b3d4-5fd17b763d7c service nova] Creating event network-changed:27d61605-61f6-4762-b6d8-a95356b68a1c for instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e on n-h2-master-1 Sep 18 01:27:09.733857 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b4dac431-f3ed-4910-971a-60111443c834 req-1d3166a0-e923-4602-b3d4-5fd17b763d7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096284 Sep 18 01:27:09.741575 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2389/4750] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:09.758461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:09.759085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:09.770499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:09.776377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.777281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:09.778741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:09.779818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:09.780543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:10.136754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:10.140799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:10.151285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:10.152085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:10.152756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:10.153828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:10.154521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:10.155189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:10.342494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:10.368464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:10.375536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:10.379127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:10.380506 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2119174e-8acb-4cb2-84f5-caf205123955 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.254034 Sep 18 01:27:10.381585 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2390/4751] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:10 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:10.383025 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7adc59c4-acde-4494-9055-cd1597761c83 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.625699 Sep 18 01:27:10.383675 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2362/4752] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:09 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:10.579283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:10.581059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:10.591011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:10.591767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:10.592509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:10.593380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:10.594022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:10.594812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:10.666734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:10.667343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:10.685648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:10.688087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:10.688550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:10.689274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:10.695906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:10.696442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:11.106178 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:11.584140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:11.603877 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d39a78fa-b7c9-4fa9-9699-3722ed943d3f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 1.028839 Sep 18 01:27:11.609923 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2391/4753] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:10 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:11.620300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:11.623225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:11.637010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:11.639046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:11.644001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:11.644930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:11.645526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:11.646236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:11.724591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:11.750234 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-889af130-5a9a-4ffb-8d29-d75ba7e8c8e2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 1.081750 Sep 18 01:27:11.754385 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2363/4754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:10 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:11.768189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:11.773088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:11.783257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:11.783759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:11.784389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:11.785455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:11.786985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:11.787623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:12.172079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:12.182589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e958e848-f9c6-48af-a29e-85871aa61b45 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.571301 Sep 18 01:27:12.183190 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2392/4755] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:11 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:12.189063 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-09e4afe1-2ea6-47f6-ac46-0a08ee2aa5e6 req-53643629-473f-4369-8b8e-6fc4c1eda977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9ca3b9-b7c4-498d-88f0-14968493cff9", "tag": "b9fd6595-e589-4aa3-8593-b4b67ca746b5"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:12.213987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-09e4afe1-2ea6-47f6-ac46-0a08ee2aa5e6 req-53643629-473f-4369-8b8e-6fc4c1eda977 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:12.214773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-09e4afe1-2ea6-47f6-ac46-0a08ee2aa5e6 req-53643629-473f-4369-8b8e-6fc4c1eda977 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:12.222393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-09e4afe1-2ea6-47f6-ac46-0a08ee2aa5e6 req-53643629-473f-4369-8b8e-6fc4c1eda977 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:12.241487 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-09e4afe1-2ea6-47f6-ac46-0a08ee2aa5e6 req-53643629-473f-4369-8b8e-6fc4c1eda977 service nova] Creating event network-changed:b9fd6595-e589-4aa3-8593-b4b67ca746b5 for instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 on n-h1-master-1 Sep 18 01:27:12.250311 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-09e4afe1-2ea6-47f6-ac46-0a08ee2aa5e6 req-53643629-473f-4369-8b8e-6fc4c1eda977 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064920 Sep 18 01:27:12.251446 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2393/4756] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:12.449317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:12.483739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:12.488114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:12.494659 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-806b7eb8-ac92-406d-bba9-2a32b48def3d tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.735878 Sep 18 01:27:12.495941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2364/4757] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:11 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:12.641846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:12.644181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:12.666059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:12.672114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:12.677673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:12.679229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:12.682926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:12.684331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:12.778724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:12.780663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:12.790700 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:12.814014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:12.814878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:12.818340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:12.819417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:12.820068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:12.822505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:13.830045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:13.843804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d06012fb-7fc1-4ba0-8bdc-2e2a06024000 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 1.072271 Sep 18 01:27:13.848598 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2365/4758] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:12 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:13.867884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:13.868959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:13.884321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:13.885381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:13.886331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:13.887818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:13.889783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:13.892976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:14.054389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:14.072435 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ddf73ff6-65c2-4dc4-a262-b70fbe22c066 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 1.436327 Sep 18 01:27:14.081996 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2394/4759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:12 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:14.108424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:14.110329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:14.157822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:14.158579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:14.159036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:14.165925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:14.167662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:14.168645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:14.289497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:14.304159 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3b2ee61c-624a-48db-93a0-67ae710a0c6c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1504 microversion: 2.1 time: 0.452615 Sep 18 01:27:14.305396 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2366/4760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:13 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:14.536731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:14.560060 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:14.566520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:14.570661 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65d40ae1-857f-4e68-9c5f-d494958c7afd tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.486089 Sep 18 01:27:14.574290 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2395/4761] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:14 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:14.873001 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:14.874485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:14.903083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:14.903678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:14.911023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:14.914958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:14.918038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:14.918616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:15.105837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:15.106745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:15.128876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:15.132294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:15.137487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:15.138379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:15.138860 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:15.139295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:15.753107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:15.761930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:15.769829 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c7648e0f-aaef-41a0-ab62-ccb35cb0a1f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 0.668318 Sep 18 01:27:15.782918 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2396/4762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:15 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:15.786864 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d82ba3e5-b6fb-4c08-98f9-e49aa344f7cb tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 0.914517 Sep 18 01:27:15.789833 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2367/4763] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:14 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:15.810604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:15.811959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:15.816175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:15.816807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:15.828155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:15.829374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:15.830013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:15.830909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:15.832342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:15.832963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:15.843593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:15.845010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:15.856311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:15.856311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:15.856311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:15.856311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:16.125013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:16.144858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:16.146815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:16.148972 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4f186a1-7295-4b70-8844-7aeeab5c813c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.357895 Sep 18 01:27:16.154601 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2368/4764] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:15 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:16.535790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:16.566099 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d893028-e383-4b0c-9d57-639b8129d76c tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1484 microversion: 2.1 time: 0.777376 Sep 18 01:27:16.567054 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2397/4765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:15 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1484 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:16.808505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-273700907", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:16.817137 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:16.817786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:16.831855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:16.832345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:16.832781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:16.841479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:16.842045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:16.842485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:16.944708 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] validate_networks() for [('e7b90fac-ccdd-4e68-9696-a2e46898b9e6', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:27:17.357428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:17.361420 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:17.367710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68f3797a-9c67-4c6d-b74e-bb045f201c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 0.554399 Sep 18 01:27:17.371107 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2398/4766] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:16 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:17.384401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:17.388148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:17.405489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:17.406337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:17.408362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:17.415521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:17.419244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:17.419931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:17.816766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:17.835970 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b27367d6-fe74-489d-bdf9-7ef7d41ca0dd tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 0.463442 Sep 18 01:27:17.836752 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2399/4767] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:17 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:17.855941 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:17.858602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:17.896953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:17.899593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:17.901085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:17.902249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:17.905430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:17.906220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:18.258965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:18.277762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:18.279888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:18.281796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92e2b5cd-eb39-4bb5-8fde-34e82d38ed01 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.442774 Sep 18 01:27:18.282573 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2400/4768] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:17 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:18.391695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:18.393367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:18.404994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:18.405791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:18.407659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:18.408597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:18.410091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:18.411847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:18.425595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:27:18.426120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:27:18.426947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:27:18.427469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:27:18.428843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:27:18.469074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:18.471791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:18.474049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:18.475689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:18.478306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:18.484765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:18.554406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Getting quotas for project faf9f899c2054d8cb558dd1f01a2863e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:27:18.569924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Getting quotas for user 61cd7711674848c699775a6d27ed6752 and project faf9f899c2054d8cb558dd1f01a2863e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:27:18.621066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:27:18.626358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:27:18.775864 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2930603a-9d96-4c6b-83d5-631312d2ad02 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.972282 Sep 18 01:27:18.806094 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2369/4769] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:27:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:27:18.811995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82559bf5-4919-417c-8e2c-df10292dd06d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:18.812613 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-82559bf5-4919-417c-8e2c-df10292dd06d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:18.868753 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:18.999550 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:19.031649 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd4944aa-5152-4399-8456-d065a7af164a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 0.642720 Sep 18 01:27:19.034457 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2401/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:18 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:19.047553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:19.048321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:19.074048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-82559bf5-4919-417c-8e2c-df10292dd06d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:19.078763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:19.079482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:19.080251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:19.082568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:19.082737 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82559bf5-4919-417c-8e2c-df10292dd06d tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1213 microversion: 2.1 time: 0.275377 Sep 18 01:27:19.083236 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2370/4771] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:18 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1213 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:19.087346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:19.091145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:19.262729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-63a72a9f-9612-4b11-a2ff-ffcc624b6d3c req-2b1680ef-1201-4795-9b57-b84c01ad780e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1c2b3c-4986-4c2b-8277-628fbd03575e", "name": "network-vif-plugged", "status": "completed", "tag": "27d61605-61f6-4762-b6d8-a95356b68a1c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:19.283881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-63a72a9f-9612-4b11-a2ff-ffcc624b6d3c req-2b1680ef-1201-4795-9b57-b84c01ad780e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:19.284387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-63a72a9f-9612-4b11-a2ff-ffcc624b6d3c req-2b1680ef-1201-4795-9b57-b84c01ad780e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:19.285231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-63a72a9f-9612-4b11-a2ff-ffcc624b6d3c req-2b1680ef-1201-4795-9b57-b84c01ad780e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:19.291079 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:19.340170 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-63a72a9f-9612-4b11-a2ff-ffcc624b6d3c req-2b1680ef-1201-4795-9b57-b84c01ad780e service nova] Creating event network-vif-plugged:27d61605-61f6-4762-b6d8-a95356b68a1c for instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e on n-h2-master-1 Sep 18 01:27:19.357321 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-63a72a9f-9612-4b11-a2ff-ffcc624b6d3c req-2b1680ef-1201-4795-9b57-b84c01ad780e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113195 Sep 18 01:27:19.360120 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2371/4772] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 18 01:27:19.375807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:19.376746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:19.397360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:19.397892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:19.398336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:19.404880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:19.405608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:19.406071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:19.688843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:19.705759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:19.709495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:19.713827 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-862ade89-108f-4ff1-a5ab-2cf20e58ef81 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.351021 Sep 18 01:27:19.737652 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2372/4773] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:19 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:19.760556 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:19.770251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c7ec8acb-c8fc-4c09-b03c-9b734836dfff tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 0.734193 Sep 18 01:27:19.770837 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2402/4774] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:19 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:20.059047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:20.060012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:20.091022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:20.091846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:20.102477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:20.106456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:20.107248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:20.107923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:20.110787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:20.111506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:20.136205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:20.136747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:20.137498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:20.138497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:20.139186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:20.139862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:20.339530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:20.355159 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-73881de8-9a1d-4911-9996-c41f9afd49f9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1265 microversion: 2.1 time: 0.252983 Sep 18 01:27:20.356408 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2403/4775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:20 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:20.760841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:20.761603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:20.770845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:20.780237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:20.787365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:20.790179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:20.791389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:20.792499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:21.134459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:21.163480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:21.165034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:21.168057 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:21.169772 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee200a94-03b8-45b7-a3a5-6150d48ee87c tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1604 microversion: 2.32 time: 0.413343 Sep 18 01:27:21.173126 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2404/4776] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:20 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1604 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:27:21.187409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:21.189535 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6bbf02e7-2104-49a2-9278-3ef28272d416 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 1.133737 Sep 18 01:27:21.190532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:21.230087 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2373/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:20 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:21.230989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:21.231647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:21.232217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:21.233086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:21.238512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:21.241326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:21.384096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:21.384673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:21.401755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:21.402252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:21.402691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:21.403635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:21.404279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:21.404907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:21.626305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:21.640326 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a528449b-bf67-4733-9243-f57073d601c0 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1271 microversion: 2.1 time: 0.260777 Sep 18 01:27:21.662322 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2374/4778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:21 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:21.669512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-68ca2822-286d-4410-bb00-420bbc0c3d2f req-3acf7251-1bec-4cf5-9354-6a1eef6d9fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9ca3b9-b7c4-498d-88f0-14968493cff9", "name": "network-vif-plugged", "status": "completed", "tag": "b9fd6595-e589-4aa3-8593-b4b67ca746b5"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:21.688470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-68ca2822-286d-4410-bb00-420bbc0c3d2f req-3acf7251-1bec-4cf5-9354-6a1eef6d9fa7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:21.694317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-68ca2822-286d-4410-bb00-420bbc0c3d2f req-3acf7251-1bec-4cf5-9354-6a1eef6d9fa7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:21.695228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-68ca2822-286d-4410-bb00-420bbc0c3d2f req-3acf7251-1bec-4cf5-9354-6a1eef6d9fa7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:21.715041 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-68ca2822-286d-4410-bb00-420bbc0c3d2f req-3acf7251-1bec-4cf5-9354-6a1eef6d9fa7 service nova] Creating event network-vif-plugged:b9fd6595-e589-4aa3-8593-b4b67ca746b5 for instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 on n-h1-master-1 Sep 18 01:27:21.734225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-68ca2822-286d-4410-bb00-420bbc0c3d2f req-3acf7251-1bec-4cf5-9354-6a1eef6d9fa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060487 Sep 18 01:27:21.735288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2375/4779] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:22.211095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:22.212030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:22.253018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:22.255356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:22.256006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:22.259275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:22.259897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:22.275659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:22.375319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:22.376419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:22.380618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:22.381179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lazy-loading 'fault' on Instance uuid 8ee842a7-7c90-404b-9914-e18568b33a74 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:27:22.385578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:22.456732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46aa93bb-a073-4aa5-b5ca-ebb10efc70a2 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1315 microversion: 2.1 time: 1.278627 Sep 18 01:27:22.460809 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2405/4780] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:21 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1315 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:22.476665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:22.477308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:22.484226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:22.484937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:22.485538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:22.486754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:22.487541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:22.488139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:22.510618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:22.527817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:22.530860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '452b12f97b654516abad84b18eaecc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4554786105684c8caf0f6ee4e3eda683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:22.534530 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2e6fd9d-7dc6-4c3d-9349-6d69c1e477b4 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 200 len: 1609 microversion: 2.32 time: 0.333384 Sep 18 01:27:22.538124 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2376/4781] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:22 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 1609 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:22.676035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:22.677776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:22.719542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:22.720590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:22.721974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:22.723035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:22.723935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:22.725886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:23.000722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:23.016550 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bfab7ad2-c2cc-46f7-8d4f-adafc13277fb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1271 microversion: 2.1 time: 0.351058 Sep 18 01:27:23.037172 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2377/4782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:22 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1271 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:23.091193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:23.110131 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c4205662-4dc8-4c10-94ca-924caad0f3e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1366 microversion: 2.1 time: 0.647187 Sep 18 01:27:23.112040 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2406/4783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:22 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:23.499385 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:23.500000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:23.514386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:23.514888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:23.517898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:23.518817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:23.519292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:23.520042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:23.563392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:23.564186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:23.580640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:23.587229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:23.587996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:23.588832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:23.589378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:23.589972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:23.619820 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] HTTP exception thrown: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Request method failure captured: Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 HTTP/1.1 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnIlcdXlnvEyYm08kBvVxNkDjfl8XGdUm1223kPVbGuPac9AaFFVDp03zwu7vY1_7D2IMrSsUYHh4-AWJFEJi-do64h3XF-94PsB5rKhCCL0Jh5vD6tmxT1E_5mEM8t8V60ARqDeimeXqUyhMixFnCcfFf9FE0h3ME9VaU-ZBxjP7Ms Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.32 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4554786105684c8caf0f6ee4e3eda683 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4554786105684c8caf0f6ee4e3eda683 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TaggedBootDevicesTest-684798755-project Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 452b12f97b654516abad84b18eaecc17 Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TaggedBootDevicesTest-684798755-project Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8ee842a7-7c90-404b-9914-e18568b33a74'} Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:23.630371 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:23.635668 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:23.635668 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:23.635668 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:23.635668 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:27:23.635668 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:27:23.635668 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:23.635668 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:23.637652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Returning 404 to user: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:27:23.638936 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0964324a-082c-456a-8d68-81974a4b4e14 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 404 len: 111 microversion: 2.32 time: 0.081857 Sep 18 01:27:23.643301 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2407/4784] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:23 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:27:23.659973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7b91261f-a482-494c-aca5-49ba070fe13f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '.version_select at 0x7f7005e540d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:23.703670 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7b91261f-a482-494c-aca5-49ba070fe13f tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334996982" status: 204 len: 0 microversion: 2.32 time: 0.058849 Sep 18 01:27:23.707700 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2408/4785] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 18 01:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334996982 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:27:23.932937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:23.946724 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3bc344c-afb9-41ab-9116-2120c945aa85 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1502 microversion: 2.1 time: 0.450027 Sep 18 01:27:23.963840 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2378/4786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:23 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1502 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:23.972879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:23.973494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:23.979948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:23.980447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:23.980883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:23.981605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:23.982062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:23.982485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.044398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:24.045254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:24.057357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.058098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.059448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.061010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.061844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.066550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.160740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:24.172806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2368b5d-e60d-4e13-856f-062edb220d26 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1271 microversion: 2.1 time: 0.132323 Sep 18 01:27:24.175078 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2379/4787] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:24 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:24.183532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:24.184631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:24.230581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.231610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.232279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.235291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.236349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.238173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.637744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:24.655866 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6576d71e-bbd5-4572-afcc-507c5c047696 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1502 microversion: 2.1 time: 0.686832 Sep 18 01:27:24.657815 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2409/4788] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:23 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1502 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:24.686534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:24.687553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:24.704217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.704719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.705160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.716700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.717671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.718446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.766192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lazy-loading 'flavor' on Instance uuid 6b1c2b3c-4986-4c2b-8277-628fbd03575e {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:27:24.893467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f349ae5-601f-42a6-b77e-175e0fbd71e0 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action" status: 202 len: 0 microversion: 2.1 time: 0.212718 Sep 18 01:27:24.900104 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2410/4789] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:27:24 2022] POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:27:24.910959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:24.914512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:24.927524 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:24.930753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.931935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.933077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:24.934562 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.938643 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:24.940766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:24.942073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:24.956310 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-619f2a44-e484-4705-949a-a252e0968c60 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1557 microversion: 2.1 time: 0.774711 Sep 18 01:27:24.961733 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2380/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:24 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1557 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:24.990726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:24.992638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:25.017186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:25.030273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:25.034806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:25.037628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:25.040679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:25.044333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:25.414902 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e57b90a-b0fd-45fb-80ec-a79d499a686f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.427939 Sep 18 01:27:25.415546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2381/4791] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:27:24 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9/os-interface => generated 285 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:25.433331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:25.437686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:25.482971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:25.483506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:25.483961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:25.485312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:25.485904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:25.486345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:26.427896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:26.440038 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c31fdeea-1bce-4067-874d-7b17cf8fe779 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1510 microversion: 2.1 time: 1.535014 Sep 18 01:27:26.440929 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2411/4792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:24 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1510 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:26.552222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:26.566219 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7502dabe-2e70-4891-b57d-ac2031eb594a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 1.146705 Sep 18 01:27:26.575777 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2382/4793] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:25 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:27.486440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:27.488870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:27.507203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:27.511525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:27.512236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:27.513748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:27.514398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:27.515054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:27.592356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:27.593697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:27.607086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:27.607892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:27.608546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:27.611391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:27.612230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:27.615176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:28.512212 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:28.520324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:28.535132 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcd0734f-51a5-4f8c-882b-0ef25bb5ddce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 0.947708 Sep 18 01:27:28.537088 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2383/4794] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:27 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:28.664198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:28.691474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4b28fd11-499a-4eb0-8829-024645d44a73 req-43421659-e24d-4b50-81ea-11c04799e4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ca14ca-9722-4d31-a9cb-a51fa20d0b74", "tag": "27860fe9-879d-4687-84ee-c9bdb9554274"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:28.706207 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb9b2ed6-058d-45de-aeea-8a63877cb10d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1493 microversion: 2.1 time: 1.226753 Sep 18 01:27:28.707711 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2412/4795] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:27 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1493 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:28.715459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4b28fd11-499a-4eb0-8829-024645d44a73 req-43421659-e24d-4b50-81ea-11c04799e4b7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:28.725611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4b28fd11-499a-4eb0-8829-024645d44a73 req-43421659-e24d-4b50-81ea-11c04799e4b7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:28.727142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4b28fd11-499a-4eb0-8829-024645d44a73 req-43421659-e24d-4b50-81ea-11c04799e4b7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:28.736598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:28.737169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:28.746460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:28.747223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:28.748804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:28.749775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:28.750419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:28.751086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:28.767632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4b28fd11-499a-4eb0-8829-024645d44a73 req-43421659-e24d-4b50-81ea-11c04799e4b7 service nova] Creating event network-changed:27860fe9-879d-4687-84ee-c9bdb9554274 for instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 on n-h1-master-1 Sep 18 01:27:28.779208 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4b28fd11-499a-4eb0-8829-024645d44a73 req-43421659-e24d-4b50-81ea-11c04799e4b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095539 Sep 18 01:27:28.780385 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2384/4796] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:28.874896 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c343aed6-a793-44d4-b4f4-5aa532cd7712 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action" status: 202 len: 0 microversion: 2.1 time: 0.145113 Sep 18 01:27:28.890025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:28.890828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:28.894679 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2413/4797] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:27:28 2022] POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:27:28.901218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:28.901800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:28.902815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:28.904245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:28.904722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:28.905231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:29.078905 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:29.576261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:29.577293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:29.590944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:29.592349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:29.592969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:29.595512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:29.598653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:29.604026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:29.655821 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:29.979492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:29.989035 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ab321094-8ebe-481a-99de-2f677101d452 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1499 microversion: 2.1 time: 1.104351 Sep 18 01:27:29.995213 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2385/4798] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:28 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1499 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:30.373897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:30.401143 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-202d505b-62fc-42ae-a98a-560371db00bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 0.837032 Sep 18 01:27:30.405324 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2414/4799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:29 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:30.450766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-6179be56-f8a3-471c-a0a6-c64b5f1ad886 req-686938b4-21b5-47eb-82d8-b6094a9aab37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9ca3b9-b7c4-498d-88f0-14968493cff9", "tag": "b9fd6595-e589-4aa3-8593-b4b67ca746b5"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:30.500078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6179be56-f8a3-471c-a0a6-c64b5f1ad886 req-686938b4-21b5-47eb-82d8-b6094a9aab37 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:30.504301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6179be56-f8a3-471c-a0a6-c64b5f1ad886 req-686938b4-21b5-47eb-82d8-b6094a9aab37 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:30.509531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6179be56-f8a3-471c-a0a6-c64b5f1ad886 req-686938b4-21b5-47eb-82d8-b6094a9aab37 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:30.575237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-6179be56-f8a3-471c-a0a6-c64b5f1ad886 req-686938b4-21b5-47eb-82d8-b6094a9aab37 service nova] Creating event network-changed:b9fd6595-e589-4aa3-8593-b4b67ca746b5 for instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 on n-h1-master-1 Sep 18 01:27:30.587516 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-6179be56-f8a3-471c-a0a6-c64b5f1ad886 req-686938b4-21b5-47eb-82d8-b6094a9aab37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147723 Sep 18 01:27:30.589745 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2386/4800] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:31.019339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:31.020035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:31.044508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:31.045514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:31.048946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:31.050252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:31.053274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:31.053888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:31.456925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:31.463624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:31.492777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:31.497122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:31.498055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:31.521455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:31.522505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:31.523330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:31.632632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:31.656897 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0e33587e-4c93-4356-8199-23445b8a445d tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1502 microversion: 2.1 time: 0.632423 Sep 18 01:27:31.656897 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2415/4801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:31 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1502 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:31.694535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:31.695043 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:31.707566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:31.708070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:31.708505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:31.709310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:31.709799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:31.710229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:31.770077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lazy-loading 'flavor' on Instance uuid 6b1c2b3c-4986-4c2b-8277-628fbd03575e {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:27:31.984184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83c6f232-6f8f-43b3-986c-7a1909e4b48c tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action" status: 202 len: 0 microversion: 2.1 time: 0.289339 Sep 18 01:27:31.993387 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2416/4802] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:27:31 2022] POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:27:32.019024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:32.026701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:32.059974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:32.060848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:32.066396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:32.067838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:32.075644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:32.076832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:33.079549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:33.096666 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-28304ae8-3489-4757-aa27-7588be0c7fb8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 1.654635 Sep 18 01:27:33.098029 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2387/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:31 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:33.138514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:33.148066 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a500319-4bde-43e2-b7ae-1536974bef30 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1510 microversion: 2.1 time: 1.151145 Sep 18 01:27:33.162468 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2417/4804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:31 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1510 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:34.143494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:34.154675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:34.172894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:34.174334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:34.182334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.183757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.184979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:34.188671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.190686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.191291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.192144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:34.192859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.195724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:34.196769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.198546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.200933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:34.567904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:34.581278 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-67707615-e8e6-4395-82c3-de4f9af14683 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1493 microversion: 2.1 time: 0.412580 Sep 18 01:27:34.602524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:34.607198 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2418/4805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:34 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1493 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:34.620686 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-350d2526-c48a-48e8-a259-83e360c4833e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 0.498148 Sep 18 01:27:34.624099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:34.624704 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2388/4806] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:34 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:34.627799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:34.653628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.654211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.654665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:34.655405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.660541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.663651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:34.889995 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2f25d47-64cd-4733-adab-11f9682998ac tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action" status: 202 len: 0 microversion: 2.1 time: 0.280262 Sep 18 01:27:34.893715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2419/4807] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:27:34 2022] POST /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:27:34.901606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:34.902419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:34.910381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.911542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.912031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:34.913895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:34.914408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:34.915252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:35.449068 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:35.463031 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c9ff2752-293d-40c8-bd1e-a168675e58d9 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1499 microversion: 2.1 time: 0.567612 Sep 18 01:27:35.486009 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2389/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:34 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1499 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:35.650183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:35.651547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:35.667649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:35.673185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:35.674781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:35.676947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:35.677679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:35.680468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:36.180917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:36.192436 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-051fdc84-a3e3-49c4-9862-ba92f4f4a889 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 0.546896 Sep 18 01:27:36.196817 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2420/4809] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:35 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:36.493774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:36.495048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:36.511046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:36.512848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:36.513309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:36.515484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:36.518739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:36.519231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:36.565489 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:37.236655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:37.237931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:37.257920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:37.258680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:37.259435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:37.260337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:37.261120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:37.261772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:37.271955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:37.283363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-76546573-546a-481a-9571-a5d02a43ed94 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1499 microversion: 2.1 time: 0.795885 Sep 18 01:27:37.283965 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2390/4810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:36 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1499 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:37.567835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:37.584867 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46470293-3f06-4014-9665-2f42ebfe5534 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 0.348225 Sep 18 01:27:37.585830 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2421/4811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:37 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:38.231157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f9b6de4a-1d3b-4107-a0e1-93b515c2dabf req-a110069c-5a48-4acd-8e66-43650439477d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ca14ca-9722-4d31-a9cb-a51fa20d0b74", "name": "network-vif-plugged", "status": "completed", "tag": "27860fe9-879d-4687-84ee-c9bdb9554274"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:38.266330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f9b6de4a-1d3b-4107-a0e1-93b515c2dabf req-a110069c-5a48-4acd-8e66-43650439477d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.267460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f9b6de4a-1d3b-4107-a0e1-93b515c2dabf req-a110069c-5a48-4acd-8e66-43650439477d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.268983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f9b6de4a-1d3b-4107-a0e1-93b515c2dabf req-a110069c-5a48-4acd-8e66-43650439477d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.309371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:38.310197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:38.323413 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f9b6de4a-1d3b-4107-a0e1-93b515c2dabf req-a110069c-5a48-4acd-8e66-43650439477d service nova] Creating event network-vif-plugged:27860fe9-879d-4687-84ee-c9bdb9554274 for instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 on n-h1-master-1 Sep 18 01:27:38.324772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.325285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.338177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.338177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.338177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.338177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.374804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f9b6de4a-1d3b-4107-a0e1-93b515c2dabf req-a110069c-5a48-4acd-8e66-43650439477d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145881 Sep 18 01:27:38.388013 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2391/4812] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:38.392649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:38.393143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:38.400348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.400881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.401324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.402081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.402649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.403103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.419212 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] HTTP exception thrown: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Request method failure captured: Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 HTTP/1.1 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnIlcdXlnvEyYm08kBvVxNkDjfl8XGdUm1223kPVbGuPac9AaFFVDp03zwu7vY1_7D2IMrSsUYHh4-AWJFEJi-do64h3XF-94PsB5rKhCCL0Jh5vD6tmxT1E_5mEM8t8V60ARqDeimeXqUyhMixFnCcfFf9FE0h3ME9VaU-ZBxjP7Ms Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.32 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4554786105684c8caf0f6ee4e3eda683 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4554786105684c8caf0f6ee4e3eda683 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TaggedBootDevicesTest-684798755-project Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 452b12f97b654516abad84b18eaecc17 Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TaggedBootDevicesTest-684798755-project Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8ee842a7-7c90-404b-9914-e18568b33a74'} Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:27:38.421255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Returning 404 to user: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60f4bfba-aa0f-4a25-affe-f24b16997852 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 404 len: 111 microversion: 2.32 time: 0.038531 Sep 18 01:27:38.431414 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2392/4813] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:27:38 2022] DELETE /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:27:38.439614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:38.440233 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] [instance: 8ee842a7-7c90-404b-9914-e18568b33a74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:38.455103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.455921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.456558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.459225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.464849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.465674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.492073 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] HTTP exception thrown: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Request method failure captured: Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 HTTP/1.1 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnIlcdXlnvEyYm08kBvVxNkDjfl8XGdUm1223kPVbGuPac9AaFFVDp03zwu7vY1_7D2IMrSsUYHh4-AWJFEJi-do64h3XF-94PsB5rKhCCL0Jh5vD6tmxT1E_5mEM8t8V60ARqDeimeXqUyhMixFnCcfFf9FE0h3ME9VaU-ZBxjP7Ms Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.32 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4554786105684c8caf0f6ee4e3eda683 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4554786105684c8caf0f6ee4e3eda683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4554786105684c8caf0f6ee4e3eda683 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TaggedBootDevicesTest-684798755 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TaggedBootDevicesTest-684798755-project Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 452b12f97b654516abad84b18eaecc17 Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TaggedBootDevicesTest-684798755-project Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8ee842a7-7c90-404b-9914-e18568b33a74'} Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:38.495692 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.500249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:38.500249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:38.500249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:38.500249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:27:38.500249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:27:38.500249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. Sep 18 01:27:38.500249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:27:38.503022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] Returning 404 to user: Instance 8ee842a7-7c90-404b-9914-e18568b33a74 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:27:38.504688 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3df0e718-8d3d-427e-b0d8-4b1b940ca235 tempest-TaggedBootDevicesTest-684798755 tempest-TaggedBootDevicesTest-684798755-project] 10.222.0.25 "GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74" status: 404 len: 111 microversion: 2.32 time: 0.075929 Sep 18 01:27:38.508875 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2393/4814] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:38 2022] GET /compute/v2.1/servers/8ee842a7-7c90-404b-9914-e18568b33a74 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:27:38.613170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:38.613939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:38.626564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.627861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.628507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.629307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:38.630019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:38.630431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:38.951769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:38.986733 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-daea6e5f-a2e6-43bd-a7fe-cafbfdbec6af tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1499 microversion: 2.1 time: 0.680413 Sep 18 01:27:38.988218 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2422/4815] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:38 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1499 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:39.579055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:39.591699 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-249df625-5a85-41bb-952e-6b24dfe4f49f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1313 microversion: 2.1 time: 0.982951 Sep 18 01:27:39.596005 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2394/4816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:38 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:40.018902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:40.020963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:40.036919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:40.038820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:40.039973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:40.041444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:40.042494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:40.043424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:40.634982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:40.636361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:40.660924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:40.664193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:40.666787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:40.675486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:40.678924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:40.681723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:40.869327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:40.883752 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-213a8ab7-dc3e-40b9-8acf-3480a11a5803 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1502 microversion: 2.1 time: 0.872130 Sep 18 01:27:40.885695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2423/4817] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:40 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1502 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:40.912943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:40.913752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:40.926914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:40.927988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:40.928563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:40.929308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:40.929828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:40.930239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:41.086026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:27:41.306592 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-18bd9df7-0b9a-4fec-ac8d-b97d3579e83f tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 204 len: 0 microversion: 2.1 time: 0.397304 Sep 18 01:27:41.310344 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2424/4818] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:27:40 2022] DELETE /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:27:41.325781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:41.327912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:41.342483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:41.342981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:41.343414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:41.344132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:41.344705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:41.354575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:41.707646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:41.749873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-acd06176-0d1a-480c-a2af-701adb284547 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1498 microversion: 2.1 time: 1.120405 Sep 18 01:27:41.750857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2395/4819] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:40 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1498 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:41.794013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:41.797304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:41.829733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:41.830193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:41.854652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:41.859891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:41.861499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:41.862039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:41.946244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lazy-loading 'flavor' on Instance uuid c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:27:42.210283 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a390e1fb-8f4c-4806-8617-ef7239bb60e9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "POST /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74/action" status: 200 len: 32 microversion: 2.1 time: 0.427813 Sep 18 01:27:42.218505 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2396/4820] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:27:41 2022] POST /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74/action => generated 32 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:27:42.226323 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:42.227359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:42.240166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:42.240837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:42.241293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:42.242915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:42.244407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:42.244973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:43.462618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:43.479636 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-03c91054-5a90-45e5-bc39-bfe291780422 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1508 microversion: 2.1 time: 2.161566 Sep 18 01:27:43.494428 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2425/4821] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:41 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1508 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:43.578182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:43.592691 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd9575f6-b190-4f66-971e-077904bfcc3a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 1.369971 Sep 18 01:27:43.605429 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2397/4822] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:42 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:44.510845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:44.511405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:44.534363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:44.534927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:44.535369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:44.536250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:44.536788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:44.537449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:44.631694 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:44.632309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:44.655243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:44.656023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:44.656661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:44.657601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:44.658253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:44.658852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:44.988792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:45.017768 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8929e7d-3442-4cc9-9c18-8804f836bb9b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.390475 Sep 18 01:27:45.023554 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2398/4823] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:44 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:45.050558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:45.060141 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:45.066269 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a57c1965-b201-440f-aef3-5e59b6c9ab61 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1508 microversion: 2.1 time: 0.561711 Sep 18 01:27:45.085583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2426/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:44 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1508 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:46.048703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:46.049301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:46.064165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:46.065340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:46.066006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:46.066954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:46.067603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:46.068725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:46.099896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:46.100604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:46.127509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:46.128522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:46.129974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:46.135081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:46.135867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:46.156788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:48.117021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:48.155672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ffdf9a4d-281e-4792-9331-a0995ed79a5b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 2.112033 Sep 18 01:27:48.161825 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2399/4825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:46 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:48.218073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:48.227390 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-316634bf-6b87-4d6a-834b-8c3b5bf13152 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1508 microversion: 2.1 time: 2.134066 Sep 18 01:27:48.250076 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2427/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:46 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1508 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:48.908474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-874ad0dc-080d-4419-9aac-138c9af9f258 req-e9127107-ef0b-4fa2-8484-3ac03d53f341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1c2b3c-4986-4c2b-8277-628fbd03575e", "name": "network-vif-deleted", "tag": "27d61605-61f6-4762-b6d8-a95356b68a1c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:48.982516 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=62 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:48.991091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-874ad0dc-080d-4419-9aac-138c9af9f258 req-e9127107-ef0b-4fa2-8484-3ac03d53f341 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:49.004896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-874ad0dc-080d-4419-9aac-138c9af9f258 req-e9127107-ef0b-4fa2-8484-3ac03d53f341 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:49.005831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-874ad0dc-080d-4419-9aac-138c9af9f258 req-e9127107-ef0b-4fa2-8484-3ac03d53f341 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:49.046863 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-874ad0dc-080d-4419-9aac-138c9af9f258 req-e9127107-ef0b-4fa2-8484-3ac03d53f341 service nova] Creating event network-vif-deleted:27d61605-61f6-4762-b6d8-a95356b68a1c for instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e on n-h2-master-1 Sep 18 01:27:49.078632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-874ad0dc-080d-4419-9aac-138c9af9f258 req-e9127107-ef0b-4fa2-8484-3ac03d53f341 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179189 Sep 18 01:27:49.079901 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2400/4827] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:27:49.198151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:49.199016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:49.257024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:49.259062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:49.260453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:49.260960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:49.274958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:49.275467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:49.285950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:49.287373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:49.290116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:49.292719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:49.293224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:49.293703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:49.295646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:49.303738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:49.440719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:49.441659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:49.442331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:49.445786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lazy-loading 'fault' on Instance uuid 6b1c2b3c-4986-4c2b-8277-628fbd03575e {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:27:49.640133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9cabbb13a3421797502d3a44a3804f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13204cd67779476b850251a7e54f8ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:49.649814 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-10c8a295-b346-4908-b877-58e993ee6b25 tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 200 len: 1305 microversion: 2.1 time: 0.396635 Sep 18 01:27:49.656811 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2401/4828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:49 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 1305 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:50.043327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:50.060076 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-691794b9-3011-4adb-9e77-b068b5851bdf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.869880 Sep 18 01:27:50.062029 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2428/4829] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:49 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:50.073594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1484515185", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "9a8cda0e-2bee-45a3-991c-e1e9c5894285"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:27:50.214797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] validate_networks() for [('9a8cda0e-2bee-45a3-991c-e1e9c5894285', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:27:50.683592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:50.684967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] [instance: 6b1c2b3c-4986-4c2b-8277-628fbd03575e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:50.711550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:50.712598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:50.714165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:50.715127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:50.720814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:50.721642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:50.771197 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] HTTP exception thrown: Instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e could not be found. Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Request method failure captured: Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e HTTP/1.1 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnPeoMr3kwtEoXA0fuluTd0M44WOurAWjDIZSc9Vn1p-lgySa5_olCzTptwSRxmeyZslmId6eeYnehXIL7CxoqksHAE1eQ-lEpp51P2TrRDjaTh_5tFCWpSmTDy9YAE4f9UHQA-NsREeirYAIg-Ce_cT9EaEDsdu9MhNaHH6e-PNQm0 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 13204cd67779476b850251a7e54f8ad7 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestServerAdvancedOps-1926161576 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/13204cd67779476b850251a7e54f8ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/13204cd67779476b850251a7e54f8ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_13204cd67779476b850251a7e54f8ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/13204cd67779476b850251a7e54f8ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestServerAdvancedOps-1926161576 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 13204cd67779476b850251a7e54f8ad7 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestServerAdvancedOps-1926161576 Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestServerAdvancedOps-1926161576-project Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fc9cabbb13a3421797502d3a44a3804f Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestServerAdvancedOps-1926161576-project Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e could not be found. Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6b1c2b3c-4986-4c2b-8277-628fbd03575e'} Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e could not be found. Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e could not be found. Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:27:50.784526 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:50.790059 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:27:50.790059 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:27:50.790059 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:27:50.790059 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:27:50.790059 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:27:50.790059 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e could not be found. Sep 18 01:27:50.790059 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:27:50.792429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] Returning 404 to user: Instance 6b1c2b3c-4986-4c2b-8277-628fbd03575e could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:27:50.801092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc08ca76-75de-403b-8fba-df13b6dd4a8a tempest-TestServerAdvancedOps-1926161576 tempest-TestServerAdvancedOps-1926161576-project] 10.222.0.25 "GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e" status: 404 len: 111 microversion: 2.1 time: 0.121992 Sep 18 01:27:50.803531 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2429/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:50 2022] GET /compute/v2.1/servers/6b1c2b3c-4986-4c2b-8277-628fbd03575e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:27:51.089189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:51.090117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:51.097097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:51.097617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:51.098066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:51.099569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:51.100029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:51.100456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:52.445830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:52.454468 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5393dc29-3ac7-4584-9855-bcc9ffdccc75 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 1.370082 Sep 18 01:27:52.466352 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2430/4831] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:51 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:52.828098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:27:52.829065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:27:52.829759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:27:52.830528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:27:52.831123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:27:52.853187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:52.862177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:52.864664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:52.866969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:52.871037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:52.871738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:52.955701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Getting quotas for project 93f2a03e475041f6adc19511d7520e86. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:27:52.962846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Getting quotas for user 8dbdf2d923e842f28d62ab287f9aabc6 and project 93f2a03e475041f6adc19511d7520e86. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:27:52.977330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:27:52.985217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:27:53.079491 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cef87c5e-c377-49fa-854f-d0407e805812 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.419325 Sep 18 01:27:53.082616 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2402/4832] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3425 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:27:53.091719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d115545-d90a-4d8e-9539-b51ea4de1bff tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:53.092643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1d115545-d90a-4d8e-9539-b51ea4de1bff tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:53.343633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1d115545-d90a-4d8e-9539-b51ea4de1bff tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:53.369750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1d115545-d90a-4d8e-9539-b51ea4de1bff tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:53.383364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1d115545-d90a-4d8e-9539-b51ea4de1bff tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:53.385480 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d115545-d90a-4d8e-9539-b51ea4de1bff tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1262 microversion: 2.26 time: 0.297594 Sep 18 01:27:53.386619 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2431/4833] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:53 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1262 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:53.495338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:53.496333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:53.525767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:53.526650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:53.528519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:53.529988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:53.531898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:53.534545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:54.116443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:54.131392 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ec593658-8904-46da-b94a-029e6c7d84d8 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.642865 Sep 18 01:27:54.133494 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2403/4834] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:53 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:54.434155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:54.435460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:54.466605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:54.467416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:54.471123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:54.472094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:54.475978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:54.477461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:54.700662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:54.726988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:54.729884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:54.738326 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adfb7aab-2ecf-4280-b5ed-d01c1fd63695 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1266 microversion: 2.26 time: 0.307955 Sep 18 01:27:54.743105 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2432/4835] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:54 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:55.168143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:55.172192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:55.194743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:55.196900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:55.199100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:55.200637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:55.207333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:55.207943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:55.728728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:55.758917 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb7c8e54-df7c-49b4-8635-5734b0f434be tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.604894 Sep 18 01:27:55.773597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:55.774656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:55.776645 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2404/4836] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:55 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:27:55.792374 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:27:55.797755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:55.805582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:55.806846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:55.807631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:55.808109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:55.808550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:56.027615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:56.046361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:56.051729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:56.054615 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e1df024a-9f93-43d9-8e37-af5c10aea356 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1322 microversion: 2.26 time: 0.286173 Sep 18 01:27:56.059682 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2433/4837] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:55 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:56.805831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:56.808879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:56.827873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:56.828708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:56.830399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:56.832013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:56.835512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:56.836532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:57.093184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:57.094147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:57.112427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:57.113149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:57.113853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:57.116054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:57.116958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:57.119401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:57.371311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:57.402628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:57.421433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:57.422702 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d664c303-887b-41c1-9c84-e0d7122b4aaf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1320 microversion: 2.26 time: 0.335940 Sep 18 01:27:57.423282 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2434/4838] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:57 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:27:57.478840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:57.497945 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fd16c31-9084-42f3-ad02-84ef3df38f68 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.697777 Sep 18 01:27:57.500632 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2405/4839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:56 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:58.449883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:58.450791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:58.469382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:58.470289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:58.472291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:58.473319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:58.475162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:58.476348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:58.529006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:58.530324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:58.542402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:58.547209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:58.548503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:58.550457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:58.553790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:58.554564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:58.801127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:58.816711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:58.820845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:58.832648 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06649073-6038-4f3d-ac0c-3ff6bd512b83 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1320 microversion: 2.26 time: 0.382872 Sep 18 01:27:58.849386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2435/4840] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:58 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:27:59.033364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:27:59.050593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-48f0a7df-b203-4e21-b020-ac658dccfaaf tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.522914 Sep 18 01:27:59.056221 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2406/4841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:27:58 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:27:59.874330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:27:59.875028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:27:59.887018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:59.887298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:59.891756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:27:59.892764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:27:59.893421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:27:59.894241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:00.087450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:00.088766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:00.106732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:00.107517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:00.108251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:00.109423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:00.110180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:00.110861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:00.495888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:00.513288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:00.514919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:00.516674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:00.519281 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1601366b-9136-4fa3-a169-8ba069807be2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.649449 Sep 18 01:28:00.521482 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-332857df-0db7-4afc-beda-9543a015589e tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.439175 Sep 18 01:28:00.536929 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2436/4842] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:27:59 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:00.542240 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2407/4843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:00 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:01.553051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:01.556178 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:01.557663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:01.558577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:01.578821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:01.585140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:01.586033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:01.586760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:01.587758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:01.588544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:01.589243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:01.594374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:01.594851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:01.595588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:01.596551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:01.596551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:01.655497 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:01.988685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:02.009450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:02.011502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:02.013933 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e7dc4a34-b385-4195-aa33-171e56a58ce8 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.467917 Sep 18 01:28:02.015916 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2437/4844] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:01 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:02.023526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:02.024617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:02.032891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.035092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.035445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.036187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.038617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.040161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.085767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:02.099692 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2bd0063e-b921-44e5-bc98-5fc20e2430cb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.549698 Sep 18 01:28:02.100620 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41e74015-f936-44e8-b9f9-6a68f9d6d25a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9/ips" status: 200 len: 151 microversion: 2.1 time: 0.078482 Sep 18 01:28:02.101657 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2408/4845] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:01 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:02.123168 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2438/4846] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:28:02 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:02.129073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b6d3d64e-c450-4669-95e4-7901e0382f46 req-85dc04be-8177-4e66-8401-d8acadb6b24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4869cc9e-c29f-4311-af93-3617b8714261", "tag": "2bc3444b-e75f-4f97-8a15-b2ee7de108d1"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:02.135106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68517600-ea10-4e6e-ad2b-44133d85a335"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:02.141919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:02.155671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.156553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.157394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.158474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.159172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.162011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b6d3d64e-c450-4669-95e4-7901e0382f46 req-85dc04be-8177-4e66-8401-d8acadb6b24e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.163126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.166176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b6d3d64e-c450-4669-95e4-7901e0382f46 req-85dc04be-8177-4e66-8401-d8acadb6b24e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.166959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b6d3d64e-c450-4669-95e4-7901e0382f46 req-85dc04be-8177-4e66-8401-d8acadb6b24e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.196901 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b6d3d64e-c450-4669-95e4-7901e0382f46 req-85dc04be-8177-4e66-8401-d8acadb6b24e service nova] Creating event network-changed:2bc3444b-e75f-4f97-8a15-b2ee7de108d1 for instance 4869cc9e-c29f-4311-af93-3617b8714261 on n-h2-master-1 Sep 18 01:28:02.204040 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b6d3d64e-c450-4669-95e4-7901e0382f46 req-85dc04be-8177-4e66-8401-d8acadb6b24e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078618 Sep 18 01:28:02.204668 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2409/4847] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:02.314788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Invalid volume: volume 68517600-ea10-4e6e-ad2b-44133d85a335 is already attached to instances: 5b4b9816-b230-4c64-b666-b095533aa203 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9/os-volume_attachments HTTP/1.1 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 74 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: {"volumeAttachment": {"volumeId": "68517600-ea10-4e6e-ad2b-44133d85a335"}} Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid volume: volume 68517600-ea10-4e6e-ad2b-44133d85a335 is already attached to instances: 5b4b9816-b230-4c64-b666-b095533aa203 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '2f9ca3b9-b7c4-498d-88f0-14968493cff9', 'body': {'volumeAttachment': {'volumeId': '68517600-ea10-4e6e-ad2b-44133d85a335'}}} Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 68517600-ea10-4e6e-ad2b-44133d85a335 is already attached to instances: 5b4b9816-b230-4c64-b666-b095533aa203 Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:28:02.318952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 68517600-ea10-4e6e-ad2b-44133d85a335 is already attached to instances: 5b4b9816-b230-4c64-b666-b095533aa203 Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 68517600-ea10-4e6e-ad2b-44133d85a335 is already attached to instances: 5b4b9816-b230-4c64-b666-b095533aa203 Sep 18 01:28:02.323866 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:02.330100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 400 to user: Invalid volume: volume 68517600-ea10-4e6e-ad2b-44133d85a335 is already attached to instances: 5b4b9816-b230-4c64-b666-b095533aa203 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:28:02.331077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a10dadc-afc3-4d0c-88a7-834c05607ab3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.199960 Sep 18 01:28:02.336471 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2439/4848] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:28:02 2022] POST /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9/os-volume_attachments => generated 174 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:28:02.343600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:02.344704 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:02.356202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.357639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.358515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.359769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.360329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.361734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.422972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:28:02.523228 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f4d1922a-5706-4f4c-b15e-0fe3f973a54d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 204 len: 0 microversion: 2.1 time: 0.184286 Sep 18 01:28:02.531445 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2410/4849] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:28:02 2022] DELETE /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:28:02.538786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:02.539632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:02.547909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.548417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.548857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.549745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:02.550540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:02.553107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:02.890141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:02.900750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5ce57b3b-7f1a-45e9-a6f7-927e00be7407 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1682 microversion: 2.1 time: 0.370363 Sep 18 01:28:02.913579 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2440/4850] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:02 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1682 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:03.046167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:03.048340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:03.052507 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:03.053535 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:03.072852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:03.073845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:03.074731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:03.075994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:03.076721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:03.077929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:03.138945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:03.139547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:03.153219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:03.155147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:03.157233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:03.158655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:03.159491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:03.164504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:03.367250 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:03.647850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:03.663554 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:03.665018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:03.666218 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7d2feba0-37f0-4a0c-8782-701ebfdbf068 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.625289 Sep 18 01:28:03.670093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:03.675922 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2411/4851] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:03 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:03.684962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-05faa403-fa3d-452b-a61b-58d066940031 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.550348 Sep 18 01:28:03.685856 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2441/4852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:03 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:03.926009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:03.926635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:03.941831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:03.944004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:03.945836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:03.950151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:03.951010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:03.951671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:04.299941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:04.312120 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9dd83f4f-d49f-4104-97f1-b87569a35f05 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1682 microversion: 2.1 time: 0.391084 Sep 18 01:28:04.326948 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2412/4853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:03 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1682 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:04.694895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:04.695529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:04.702434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:04.706031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:04.706764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:04.715552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:04.716282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:04.716983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:04.718902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:04.719943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:04.729285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:04.730483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:04.731240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:04.732231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:04.733044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:04.733693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:05.119471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:05.129049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:05.136644 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-21f7e67f-e8bc-4d71-9146-4347a4821f06 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.420432 Sep 18 01:28:05.140581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2413/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:04 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:05.143996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:05.162485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:05.164767 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c0da4467-fb5f-464d-bad2-050c7a314663 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.474998 Sep 18 01:28:05.166543 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2442/4855] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:04 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:05.342309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:05.343565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:05.353117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:05.354513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:05.355367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:05.356349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:05.357279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:05.358142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:05.697975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:05.711122 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2b612ae-2879-4634-aafc-463c73bcd3db tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1682 microversion: 2.1 time: 0.374758 Sep 18 01:28:05.713259 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2414/4856] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:05 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1682 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:06.162014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:06.163756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:06.184639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:06.195380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:06.196163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:06.202678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:06.209196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:06.210872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:06.211680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:06.213618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:06.234898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:06.235076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:06.235448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:06.236185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:06.236648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:06.237088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:06.992025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:06.992732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:07.001618 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80308686-f218-460f-88d7-9f6c56f8bcad tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.843988 Sep 18 01:28:07.025159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:07.025869 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2443/4857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:06 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:07.028701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:07.031467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:07.031784 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-575cc84f-0e36-45d0-9571-f9c06aab1733 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.843223 Sep 18 01:28:07.037199 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2415/4858] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:06 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:28:07.040989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:07.057035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:07.057776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:07.058427 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:07.059457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:07.061607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:07.062303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:07.237469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:07.247510 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eefae6f9-a51b-40a8-9a3b-6578cb9e6d7b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1615 microversion: 2.1 time: 0.220237 Sep 18 01:28:07.270158 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2444/4859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:07 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1615 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:08.033625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:08.034260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:08.052540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.059273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.061899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:08.062758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:08.067072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.070858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.071583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.071738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.072116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.072475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.074647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.076816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.078859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.083774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.130814 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:08.601139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:08.614820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:08.620405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:08.624497 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fa604d1-eea2-4b53-8801-f3706bb98cdc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.566394 Sep 18 01:28:08.627634 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2445/4860] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:08 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:08.642507 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5fb27e91-54bd-4f99-a27c-2968f079620f req-4d6f9a1f-0687-4971-8310-615ca7b3c6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9ca3b9-b7c4-498d-88f0-14968493cff9", "name": "network-vif-deleted", "tag": "b9fd6595-e589-4aa3-8593-b4b67ca746b5"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:08.665624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5fb27e91-54bd-4f99-a27c-2968f079620f req-4d6f9a1f-0687-4971-8310-615ca7b3c6ec service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.667324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5fb27e91-54bd-4f99-a27c-2968f079620f req-4d6f9a1f-0687-4971-8310-615ca7b3c6ec service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.668396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5fb27e91-54bd-4f99-a27c-2968f079620f req-4d6f9a1f-0687-4971-8310-615ca7b3c6ec service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.690221 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5fb27e91-54bd-4f99-a27c-2968f079620f req-4d6f9a1f-0687-4971-8310-615ca7b3c6ec service nova] Creating event network-vif-deleted:b9fd6595-e589-4aa3-8593-b4b67ca746b5 for instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 on n-h1-master-1 Sep 18 01:28:08.694022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:08.701229 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5fb27e91-54bd-4f99-a27c-2968f079620f req-4d6f9a1f-0687-4971-8310-615ca7b3c6ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068898 Sep 18 01:28:08.702355 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2446/4861] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:08.707706 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1070011f-b1ea-4a1b-a76c-fa74ae7c308f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.677960 Sep 18 01:28:08.708621 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2416/4862] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:08 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:08.716258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:08.717328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:08.738894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.742505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.743348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.745152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.746547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.748202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.831404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:08.832131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:08.832686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:08.833279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lazy-loading 'fault' on Instance uuid 2f9ca3b9-b7c4-498d-88f0-14968493cff9 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:08.948807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:08.972489 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fff441e2-c6d0-4b0d-94be-d9b4464e1c95 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 200 len: 1331 microversion: 2.1 time: 0.261169 Sep 18 01:28:09.002380 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2447/4863] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:08 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 1331 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:09.660515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:09.662374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:09.682325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:09.682896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:09.683525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:09.686173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:09.686854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:09.689122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:09.732849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:09.734414 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:09.748634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:09.750615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:09.751358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:09.754158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:09.754905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:09.757334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:10.142810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:10.153202 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6705f588-cb79-404a-ab55-d33cabed6f69 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.425411 Sep 18 01:28:10.173467 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2448/4864] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:09 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:10.173467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:10.174226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:10.195998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:10.197801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:10.198506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:10.202358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:10.210245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:10.211048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:10.232104 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 HTTP/1.1 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2f9ca3b9-b7c4-498d-88f0-14968493cff9'} Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:10.234365 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:10.240093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:10.240093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:10.240093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:10.240093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:28:10.240093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:28:10.240093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:28:10.240093 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:10.241422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:28:10.242478 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-885476e5-3539-48de-be04-42980f12c366 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 404 len: 111 microversion: 2.1 time: 0.081778 Sep 18 01:28:10.243228 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2449/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:10 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:28:10.253403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-62996b0e-cc39-4172-9e07-1cd32029371b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '.version_select at 0x7f7005492ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:10.296954 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-62996b0e-cc39-4172-9e07-1cd32029371b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604622960" status: 202 len: 0 microversion: 2.1 time: 0.048872 Sep 18 01:28:10.303705 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2450/4866] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604622960 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:28:10.357274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:10.372722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:10.376460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:10.381580 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67db74e7-25a8-4e4c-904e-064b67b3b9c3 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.728776 Sep 18 01:28:10.384517 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2417/4867] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:09 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:10.632826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-03a2bf12-bfea-4f3b-b5f8-67fcaa335d2e req-2f654deb-2e48-4fd7-b1bb-35c3b02e3a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4869cc9e-c29f-4311-af93-3617b8714261", "name": "network-vif-plugged", "status": "completed", "tag": "2bc3444b-e75f-4f97-8a15-b2ee7de108d1"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:10.666294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-03a2bf12-bfea-4f3b-b5f8-67fcaa335d2e req-2f654deb-2e48-4fd7-b1bb-35c3b02e3a4b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:10.666701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-03a2bf12-bfea-4f3b-b5f8-67fcaa335d2e req-2f654deb-2e48-4fd7-b1bb-35c3b02e3a4b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:10.667490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-03a2bf12-bfea-4f3b-b5f8-67fcaa335d2e req-2f654deb-2e48-4fd7-b1bb-35c3b02e3a4b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:10.691944 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-03a2bf12-bfea-4f3b-b5f8-67fcaa335d2e req-2f654deb-2e48-4fd7-b1bb-35c3b02e3a4b service nova] Creating event network-vif-plugged:2bc3444b-e75f-4f97-8a15-b2ee7de108d1 for instance 4869cc9e-c29f-4311-af93-3617b8714261 on n-h2-master-1 Sep 18 01:28:10.702531 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-03a2bf12-bfea-4f3b-b5f8-67fcaa335d2e req-2f654deb-2e48-4fd7-b1bb-35c3b02e3a4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074268 Sep 18 01:28:10.703186 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2451/4868] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:11.181714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:11.183038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:11.198446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:11.198953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:11.199401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:11.200131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:11.200606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:11.201082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:11.414597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:11.415973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:11.435387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:11.436175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:11.436792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:11.437722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:11.438352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:11.438950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:12.011271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:12.019967 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9be8c94-eb74-4f13-85a2-42690e682dce tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.843240 Sep 18 01:28:12.021117 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2418/4869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:11 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:12.119336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:12.128686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:12.130990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:12.132867 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-249ccf3d-8040-4c7c-820a-99f78d147126 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1362 microversion: 2.26 time: 0.723407 Sep 18 01:28:12.133656 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2452/4870] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:11 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:13.055193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:13.056756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:13.072637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:13.078374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:13.079600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:13.080747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:13.089883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:13.090782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:13.168914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:13.170655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:13.193353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:13.194791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:13.195498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:13.196492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:13.201527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:13.202254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:13.991019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:14.006425 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de1eee0f-8399-4a7a-ad31-270a379cfff7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1484 microversion: 2.1 time: 0.953413 Sep 18 01:28:14.008260 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2419/4871] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:13 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1484 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:14.042800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:14.043951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:14.071155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.071845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.072092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.072821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.086595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.089725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.341530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:14.342277 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8fedb24d-03ff-4f90-861f-c5b9a446cc10 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "POST /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74/action" status: 202 len: 0 microversion: 2.1 time: 0.310295 Sep 18 01:28:14.349901 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2420/4872] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:28:14 2022] POST /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:28:14.356034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:14.371254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:14.371865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:14.375090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:14.376966 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aecfedb7-0778-46d2-b47b-a1293294fdbf tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1546 microversion: 2.26 time: 1.212864 Sep 18 01:28:14.386741 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2453/4873] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:13 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1546 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:28:14.391859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:14.395504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:14.422397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.425987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.428141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.428316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.428719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.429175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.429956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.430421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.430852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.431547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.435918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.437173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.672293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lazy-loading 'services' on Instance uuid 5b4b9816-b230-4c64-b666-b095533aa203 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:14.846912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-481dea1a-3562-4201-9f32-7b5a2da307a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments/68517600-ea10-4e6e-ad2b-44133d85a335" status: 202 len: 0 microversion: 2.1 time: 0.490957 Sep 18 01:28:14.856085 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2421/4874] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:28:14 2022] DELETE /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments/68517600-ea10-4e6e-ad2b-44133d85a335 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:28:14.900199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f7005196b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:14.948489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.950767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.954755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.956240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:14.978906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.979730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.980383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:14.982009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:14.983735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:14.987368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:15.050875 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:15.071919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:15.073121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:15.073812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:15.104686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:15.113830 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d0c6ec7d-31ec-4209-925d-11e67735232b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1492 microversion: 2.1 time: 0.725007 Sep 18 01:28:15.114738 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2454/4875] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:14 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1492 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:15.115784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:15.116675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:15.117273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:15.124844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:15.127574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:15.151378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:15.153386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:15.156010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:15.157173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:15.157993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:15.159343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:15.182361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:15.212231 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [292fe416-926f-427d-95a6-8883ad845304] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 01:28:15.232713 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-492aa634-e01b-40ed-8511-801bcb033bdd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116534 Sep 18 01:28:15.239544 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2455/4876] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:15 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:16.144220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.146155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:16.160449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.166183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.166638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.167391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.167855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.168287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.228170 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [292fe416-926f-427d-95a6-8883ad845304] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34184. Sep 18 01:28:16.236579 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6fb22e85-7b47-4d43-bd81-4279a676a3bb tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-864856609" status: 201 len: 0 microversion: 2.26 time: 1.373794 Sep 18 01:28:16.237254 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2422/4877] 10.222.0.25 () {62 vars in 1377 bytes} [Sun Sep 18 01:28:14 2022] PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-864856609 => generated 0 bytes in 1381 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 18 01:28:16.265470 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1da02bed-7a60-422e-a8e3-a8f0c41da7b6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f7005196ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.300834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da02bed-7a60-422e-a8e3-a8f0c41da7b6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.301372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da02bed-7a60-422e-a8e3-a8f0c41da7b6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.305581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da02bed-7a60-422e-a8e3-a8f0c41da7b6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.341836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1da02bed-7a60-422e-a8e3-a8f0c41da7b6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-864856609" status: 204 len: 0 microversion: 2.26 time: 0.093137 Sep 18 01:28:16.348486 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2423/4878] 10.222.0.25 () {60 vars in 1358 bytes} [Sun Sep 18 01:28:16 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-864856609 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:16.365028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.370512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:16.393082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.395764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.396575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.397667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.400247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.400970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.481874 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f090fc3e-d993-4b7b-bd40-6c32403bc53a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130697 Sep 18 01:28:16.490444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2424/4879] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:16 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:16.503139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70050ba4c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.519397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.522357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.522938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.524308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:16.542289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.543207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.543910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.544979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.545760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.546582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.618905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.620294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.622234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.650372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:16.675371 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a653b31e-cfd6-4956-8d51-76bf72f0a924 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 204 len: 0 microversion: 2.26 time: 0.182687 Sep 18 01:28:16.681717 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2425/4880] 10.222.0.25 () {60 vars in 1295 bytes} [Sun Sep 18 01:28:16 2022] DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:16.689715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6f6f21b-85d5-47a6-8909-048365828042 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70066d24c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.703273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f6f21b-85d5-47a6-8909-048365828042 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.704365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f6f21b-85d5-47a6-8909-048365828042 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.705864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6f6f21b-85d5-47a6-8909-048365828042 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.719195 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6f6f21b-85d5-47a6-8909-048365828042 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 200 len: 12 microversion: 2.26 time: 0.034868 Sep 18 01:28:16.732640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2426/4881] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 01:28:16 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:16.732640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70051cae50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.745025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.745721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.746278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.747410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:16.754803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.755477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.756880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.758322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.759130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.760280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.797631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.799696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.800439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.813273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.813968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.814522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.855135 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:16.877440 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d75a7d3b-e325-4709-982b-c29af9f9a727 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-428276117" status: 201 len: 0 microversion: 2.26 time: 0.149035 Sep 18 01:28:16.878148 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2427/4882] 10.222.0.25 () {62 vars in 1377 bytes} [Sun Sep 18 01:28:16 2022] PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-428276117 => generated 0 bytes in 151 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 18 01:28:16.889888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45ab2947-ca68-4a58-8da0-637b0c0bef7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70053e45e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.901519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45ab2947-ca68-4a58-8da0-637b0c0bef7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.902490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45ab2947-ca68-4a58-8da0-637b0c0bef7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.903189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45ab2947-ca68-4a58-8da0-637b0c0bef7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.917366 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45ab2947-ca68-4a58-8da0-637b0c0bef7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 200 len: 35 microversion: 2.26 time: 0.032256 Sep 18 01:28:16.927664 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2428/4883] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 01:28:16 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 35 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:16.937796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70050f11f0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:16.950775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.951542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.952190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.953537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:16.971422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.974541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.975556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.977542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:16.978306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:16.978919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:16.990211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:17.012312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b511421-92f0-4ce2-9935-d9b36e484391 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1492 microversion: 2.1 time: 0.871774 Sep 18 01:28:17.031450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2456/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:16 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1492 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:17.053829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.054619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.055436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.089096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:17.110235 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f288c502-286e-4618-aa80-8f2411fd1eb4 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-428276117" status: 204 len: 0 microversion: 2.26 time: 0.180685 Sep 18 01:28:17.110867 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2429/4885] 10.222.0.25 () {60 vars in 1361 bytes} [Sun Sep 18 01:28:16 2022] DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-428276117 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:17.124100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c781762-032e-41fb-91ae-dadb5081e80e tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f7005396af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:17.136149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c781762-032e-41fb-91ae-dadb5081e80e tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.136652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c781762-032e-41fb-91ae-dadb5081e80e tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.137180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c781762-032e-41fb-91ae-dadb5081e80e tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.160220 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c781762-032e-41fb-91ae-dadb5081e80e tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 200 len: 12 microversion: 2.26 time: 0.043499 Sep 18 01:28:17.167205 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2457/4886] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 01:28:17 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 12 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:17.172004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70050f1e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:17.187032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.187891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.189225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.194035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:17.225871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.226578 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.227033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.227841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.228318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.229052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.333869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.334625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.335472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.348745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:17.367774 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fa1eaa0c-a77d-44b3-baca-2bec2e22dd7d tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 204 len: 0 microversion: 2.26 time: 0.199833 Sep 18 01:28:17.369056 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2430/4887] 10.222.0.25 () {60 vars in 1295 bytes} [Sun Sep 18 01:28:17 2022] DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:17.380296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f7006d694c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:17.407727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.408240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.408689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.410924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:17.430036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.430566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.431015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.431767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.432230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.432668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.500493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.500994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.501447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.511400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:17.518220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:17.533002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.533507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.533974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.541892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.542568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.543031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.543803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.544268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.544699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.614372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:17.671896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67cee0b0-e58c-4d6a-8ea1-3e73e86f8776 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164270 Sep 18 01:28:17.672837 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2431/4888] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:17 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:17.679281 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3291add-937e-40d4-ab03-dd4f0cccb273 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-1658915308" status: 201 len: 0 microversion: 2.26 time: 0.304595 Sep 18 01:28:17.681941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2458/4889] 10.222.0.25 () {62 vars in 1380 bytes} [Sun Sep 18 01:28:17 2022] PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-1658915308 => generated 0 bytes in 308 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 18 01:28:17.693137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f700520f3a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:17.706696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.707180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.707763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.708129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:17.719326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.719823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.720261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.723003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.723658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.725162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.832889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.835875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.837958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.878945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:17.880137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:17.880585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:17.968793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:17.979283 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:18.016778 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-972e88a4-f98f-4b89-a06d-82005655d918 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-1693498473" status: 201 len: 0 microversion: 2.26 time: 0.328464 Sep 18 01:28:18.019457 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2432/4890] 10.222.0.25 () {62 vars in 1380 bytes} [Sun Sep 18 01:28:17 2022] PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-1693498473 => generated 0 bytes in 332 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 18 01:28:18.030739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f700635cca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.067435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.068494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.071492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:18.073707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.074201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.076891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:18.082801 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:18.099444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.102420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.103171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.103928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.104407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.104837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.107757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.108259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.108705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.109425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.109915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.116350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.165911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.166407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.168592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.200752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:18.233416 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0267184b-16ad-4004-a274-c5ab42ab42d9 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 204 len: 0 microversion: 2.26 time: 0.209642 Sep 18 01:28:18.234514 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2459/4891] 10.222.0.25 () {60 vars in 1295 bytes} [Sun Sep 18 01:28:18 2022] DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:18.245968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f053b989-28b3-47c2-a8a8-6437bc63a92b tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70053b5790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.257464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f053b989-28b3-47c2-a8a8-6437bc63a92b tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.258271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f053b989-28b3-47c2-a8a8-6437bc63a92b tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.258956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f053b989-28b3-47c2-a8a8-6437bc63a92b tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.274673 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f053b989-28b3-47c2-a8a8-6437bc63a92b tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 200 len: 12 microversion: 2.26 time: 0.033954 Sep 18 01:28:18.278551 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2460/4892] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 01:28:18 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:18.292479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f700635c160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.318989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.319877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.320509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.321357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:18.329246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.330141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.330769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.332396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.334069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.334703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.375876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.376596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.377266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.392186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:18.418015 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-86fc445f-d33d-45da-a6ae-38a3adadeeab tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 204 len: 0 microversion: 2.26 time: 0.135563 Sep 18 01:28:18.419578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2461/4893] 10.222.0.25 () {60 vars in 1295 bytes} [Sun Sep 18 01:28:18 2022] DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:18.431658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f70054923a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.462865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.463752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.464610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.467772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:18.484135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.484915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.486110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.487000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.487649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.488623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.540302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.541257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.541901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.561315 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:18.564351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.565058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.566795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.615752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:18.663588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-13b2de09-10d8-4ce0-999e-cb493762d732 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-2144087808" status: 201 len: 0 microversion: 2.26 time: 0.238183 Sep 18 01:28:18.665366 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2462/4894] 10.222.0.25 () {62 vars in 1380 bytes} [Sun Sep 18 01:28:18 2022] PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-2144087808 => generated 0 bytes in 241 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 18 01:28:18.679360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f7005492af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.682903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:18.698490 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-577eee63-d572-4498-aa16-6f79df071a78 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1498 microversion: 2.1 time: 0.654653 Sep 18 01:28:18.700701 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2433/4895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:18 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1498 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:18.709607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.712298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.714709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.715217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.716357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:18.720772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:18.736794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.738295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.739550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.740350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.740763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.741570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.742179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.743349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.744680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.762063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.762929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.763582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.816665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.828509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.830846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.859964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.862653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.863935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.898915 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f9abbfc-d012-4f2f-840a-a4bd37a513ee tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196782 Sep 18 01:28:18.903139 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2434/4896] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:18 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:18.923388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:18.928261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:18.932247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:18.958534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.963801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.966462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:18.975519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:18.976119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:18.980470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.011740 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4649af71-72d0-4575-93d3-6bd8a815f104 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-1359904296" status: 201 len: 0 microversion: 2.26 time: 0.340895 Sep 18 01:28:19.025753 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2463/4897] 10.222.0.25 () {62 vars in 1380 bytes} [Sun Sep 18 01:28:18 2022] PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags/tempest-tag-1359904296 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 18 01:28:19.057775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Action: 'update_all', calling method: .version_select at 0x7f7006d694c0>, body: {"tags": ["tempest-tag-1741276245", "tempest-tag-324381441"]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:19.085522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.086161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.090980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.091557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:19.094775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:28:19.110251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.110774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.115260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.115260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.115260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.120460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.229609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.230206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.230569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.322586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:19.365464 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d5c742e-563c-43fb-8d6f-7853584920a2 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 204 len: 0 microversion: 2.1 time: 0.452915 Sep 18 01:28:19.366410 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2435/4898] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:28:18 2022] DELETE /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:28:19.378417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:19.381386 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0415fff2-5d77-445f-8e61-ae3d25da8021 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 200 len: 61 microversion: 2.26 time: 0.339454 Sep 18 01:28:19.388760 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2464/4899] 10.222.0.25 () {62 vars in 1312 bytes} [Sun Sep 18 01:28:19 2022] PUT /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 61 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:19.389241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:19.394971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f2d6f01-a446-4f08-b64f-83c2a9a7b5dc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f7005ea7ca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:19.404068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d6f01-a446-4f08-b64f-83c2a9a7b5dc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.404450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d6f01-a446-4f08-b64f-83c2a9a7b5dc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.404892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f2d6f01-a446-4f08-b64f-83c2a9a7b5dc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.410916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.411472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.411925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.412681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.413151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.413583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.415371 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f2d6f01-a446-4f08-b64f-83c2a9a7b5dc tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 200 len: 61 microversion: 2.26 time: 0.025209 Sep 18 01:28:19.422154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2465/4900] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 18 01:28:19 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 61 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:19.428149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '.version_select at 0x7f700540e160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:19.438202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.438696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.439144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.439633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:19.451267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.452055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.452366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.453367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.453874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.455268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.516499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.517215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.518019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.554200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'flavor' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:19.596327 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3959b8d3-5387-4d74-8205-eec3bc5a2e32 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags" status: 204 len: 0 microversion: 2.26 time: 0.172816 Sep 18 01:28:19.605452 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2466/4901] 10.222.0.25 () {60 vars in 1295 bytes} [Sun Sep 18 01:28:19 2022] DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261/tags => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:19.618829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:19.619447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:19.642143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.642711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.643928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.644688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.648356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.648822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.714801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:28:19.931203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f5b339e-c037-4d92-bbfc-54148749e12a tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 204 len: 0 microversion: 2.26 time: 0.323968 Sep 18 01:28:19.940661 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2467/4902] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:28:19 2022] DELETE /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:28:19.959532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:19.962194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:19.977032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.977528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.978000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:19.979134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:19.979295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:19.979631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:20.123429 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e5b8735-06cb-4d56-8eb0-3ea5bf3459d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181183 Sep 18 01:28:20.124462 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2468/4903] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:19 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:20.135645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:20.136275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:20.154400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:20.155049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:20.155496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:20.156419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:20.156899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:20.157333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:20.440110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:20.450502 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ec5d2ee8-b0be-4062-96d5-effb72e68a59 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 1.077696 Sep 18 01:28:20.451755 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2436/4904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:19 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:20.631393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:20.641662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:20.646789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:20.651884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-95a9211e-b3f6-4384-81a1-a11e3a2fb3f2 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1552 microversion: 2.26 time: 0.526196 Sep 18 01:28:20.653293 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2469/4905] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:20 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1552 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:21.139019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:21.141491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:21.161256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:21.162224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:21.168421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:21.178247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:21.178901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:21.179366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:21.251109 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d31693fd-9419-41ea-9135-c0a19b2ffd65 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118460 Sep 18 01:28:21.254808 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2437/4906] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:21 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:21.477698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:21.478683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:21.494087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:21.504955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:21.508210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:21.509314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:21.510108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:21.510841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:21.700528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:21.703130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:21.724938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:21.729992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:21.734218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:21.735380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:21.736105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:21.736776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:22.055820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:22.069283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d4ce184-cdee-4ae2-a518-51a155d4fe2b tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.595473 Sep 18 01:28:22.070316 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2470/4907] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:21 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:22.142195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:22.154686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:22.157404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:22.159514 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e50ab994-ad40-433f-94e4-27ec2ca3ded6 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1552 microversion: 2.26 time: 0.481765 Sep 18 01:28:22.160663 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2438/4908] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:21 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1552 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:22.267807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:22.270455 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:22.272712 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:22.287219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:22.288101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:22.288788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:22.289711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:22.294553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:22.295385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:22.368342 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-058f252e-cdc8-45ec-8a90-0b07c30c32e0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104555 Sep 18 01:28:22.369184 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2471/4909] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:22 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:23.095719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:23.096697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:23.109791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:23.110325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:23.113089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:23.115018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:23.115512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:23.115956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:23.188627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:23.189903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:23.203687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:23.204188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:23.204630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:23.205360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:23.205823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:23.206374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:23.588399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:23.597209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:23.606359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:23.616009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b60cc99-1c8c-4dd0-93d6-7d50bdb34d7c tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1510 microversion: 2.26 time: 0.431549 Sep 18 01:28:23.617203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2472/4910] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:23 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:28:23.644101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:23.646611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:23.659244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:23.659721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:23.660161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:23.661411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:23.677825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:23.678639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:23.680788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:23.697627 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-74b5b213-f319-4447-a239-b783b5a86596 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.604362 Sep 18 01:28:23.725522 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2439/4911] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:23 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:23.743861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c5da2e88-0973-4ca1-9243-aa5048aad771 req-06007612-d042-4206-9771-d6b8061f6bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4869cc9e-c29f-4311-af93-3617b8714261", "name": "network-vif-deleted", "tag": "2bc3444b-e75f-4f97-8a15-b2ee7de108d1"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:23.751185 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:23.766316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5da2e88-0973-4ca1-9243-aa5048aad771 req-06007612-d042-4206-9771-d6b8061f6bed service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:23.766826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5da2e88-0973-4ca1-9243-aa5048aad771 req-06007612-d042-4206-9771-d6b8061f6bed service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:23.767369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5da2e88-0973-4ca1-9243-aa5048aad771 req-06007612-d042-4206-9771-d6b8061f6bed service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:23.789594 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-011823c0-a903-41ee-ae82-f981491156d6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170901 Sep 18 01:28:23.790763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2473/4912] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:23 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:23.792667 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c5da2e88-0973-4ca1-9243-aa5048aad771 req-06007612-d042-4206-9771-d6b8061f6bed service nova] Creating event network-vif-deleted:2bc3444b-e75f-4f97-8a15-b2ee7de108d1 for instance 4869cc9e-c29f-4311-af93-3617b8714261 on n-h2-master-1 Sep 18 01:28:23.810753 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c5da2e88-0973-4ca1-9243-aa5048aad771 req-06007612-d042-4206-9771-d6b8061f6bed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082269 Sep 18 01:28:23.811458 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2440/4913] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:24.649739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:24.650564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:24.665197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:24.670406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:24.671016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:24.672133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:24.672694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:24.673159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:24.732521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:24.736020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:24.757179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:24.757959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:24.758585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:24.759513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:24.772040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:24.775936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:24.776963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:24.777720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lazy-loading 'fault' on Instance uuid 4869cc9e-c29f-4311-af93-3617b8714261 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:24.778883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:24.780031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:24.941470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:24.951667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:24.954724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbdf2d923e842f28d62ab287f9aabc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f2a03e475041f6adc19511d7520e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:24.961218 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e876361-f581-439f-a842-433970c2ad97 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 200 len: 1352 microversion: 2.26 time: 0.317263 Sep 18 01:28:24.970873 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2474/4914] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:24 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 1352 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:28:24.976447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:24.978962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:24.988914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:24.990259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:24.990880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:24.992034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:24.992683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:24.993430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:25.046170 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-503d82c6-fba1-4887-8e6b-b9a759cc5560 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073777 Sep 18 01:28:25.047174 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2475/4915] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:24 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:25.387740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:25.399957 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82ffd41b-0c86-4a78-a7e6-b396227bd9c3 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.673169 Sep 18 01:28:25.401217 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2441/4916] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:24 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:26.003438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:26.004669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] [instance: 4869cc9e-c29f-4311-af93-3617b8714261] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:26.036289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.037174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.038060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.039147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.039778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.040371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.062583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:26.066992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:26.095733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.096746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.099608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.101857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.105197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.105727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.115131 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] HTTP exception thrown: Instance 4869cc9e-c29f-4311-af93-3617b8714261 could not be found. Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Request method failure captured: Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 HTTP/1.1 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnQUgxvtyuGfKFbQG_cLINcqroHes3lMk2_AoLDuh4t_CrJiFUHhJ-uiGWouDZbb3Id5j7bmlxi3_VmRLFKP6o9DdOuf68KuAfrFumX2JjXGjTApACi58dhk1PHtsqvSh2-4ViQVQuqADPC1vNCjOlptgrMPE8-w9hnCW89WJG5Up6s Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.26 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 93f2a03e475041f6adc19511d7520e86 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerTagsTestJSON-1009962854 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93f2a03e475041f6adc19511d7520e86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93f2a03e475041f6adc19511d7520e86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93f2a03e475041f6adc19511d7520e86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93f2a03e475041f6adc19511d7520e86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerTagsTestJSON-1009962854 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 93f2a03e475041f6adc19511d7520e86 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerTagsTestJSON-1009962854 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerTagsTestJSON-1009962854-project Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 8dbdf2d923e842f28d62ab287f9aabc6 Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerTagsTestJSON-1009962854-project Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4869cc9e-c29f-4311-af93-3617b8714261 could not be found. Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4869cc9e-c29f-4311-af93-3617b8714261'} Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4869cc9e-c29f-4311-af93-3617b8714261 could not be found. Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4869cc9e-c29f-4311-af93-3617b8714261 could not be found. Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:26.119895 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4869cc9e-c29f-4311-af93-3617b8714261 could not be found. Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] Returning 404 to user: Instance 4869cc9e-c29f-4311-af93-3617b8714261 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:28:26.127468 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b8338e6-40ce-4afa-a811-bebfa88a4ac5 tempest-ServerTagsTestJSON-1009962854 tempest-ServerTagsTestJSON-1009962854-project] 10.222.0.25 "GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261" status: 404 len: 111 microversion: 2.26 time: 0.123805 Sep 18 01:28:26.133712 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2476/4917] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:28:25 2022] GET /compute/v2.1/servers/4869cc9e-c29f-4311-af93-3617b8714261 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:28:26.161908 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ebbc3f7-fc4b-4d43-9263-4f580731aca1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106275 Sep 18 01:28:26.168444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2442/4918] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:28:26 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:28:26.262153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:26.262861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:26.281176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.281997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.282599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.283509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.284609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.285210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.346089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:28:26.424053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:26.425022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:26.433338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.433853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.434289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.434989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.437291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.443047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.482894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8d1e85c7-bc1e-440f-aa71-7f9a5affd68a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 204 len: 0 microversion: 2.1 time: 0.224384 Sep 18 01:28:26.483965 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2477/4919] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:28:26 2022] DELETE /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:28:26.497471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:26.500918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:26.508801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.509301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.509766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:26.510555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:26.510903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:26.511321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:27.227487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:27.244562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:27.253957 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6beadcc0-ab5d-4487-976e-87afdb9fd05f tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1504 microversion: 2.1 time: 0.834090 Sep 18 01:28:27.259462 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2443/4920] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:26 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1504 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:27.272322 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d59a32d2-c096-4107-9bd7-b9e85f9a9d68 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1681 microversion: 2.1 time: 0.783019 Sep 18 01:28:27.273605 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2478/4921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:26 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1681 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:27.277203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-59c3132e-ab9e-4de6-aae2-4618908989e4 req-4b62eff2-d250-49d7-9bf5-0a743cbf2604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ca14ca-9722-4d31-a9cb-a51fa20d0b74", "name": "network-vif-deleted", "tag": "27860fe9-879d-4687-84ee-c9bdb9554274"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:27.313960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-59c3132e-ab9e-4de6-aae2-4618908989e4 req-4b62eff2-d250-49d7-9bf5-0a743cbf2604 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:27.314827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-59c3132e-ab9e-4de6-aae2-4618908989e4 req-4b62eff2-d250-49d7-9bf5-0a743cbf2604 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:27.315611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-59c3132e-ab9e-4de6-aae2-4618908989e4 req-4b62eff2-d250-49d7-9bf5-0a743cbf2604 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:27.339559 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-59c3132e-ab9e-4de6-aae2-4618908989e4 req-4b62eff2-d250-49d7-9bf5-0a743cbf2604 service nova] Creating event network-vif-deleted:27860fe9-879d-4687-84ee-c9bdb9554274 for instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 on n-h1-master-1 Sep 18 01:28:27.345462 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-59c3132e-ab9e-4de6-aae2-4618908989e4 req-4b62eff2-d250-49d7-9bf5-0a743cbf2604 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084427 Sep 18 01:28:27.346579 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2444/4922] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:28.298324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:28.299670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:28.306202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:28.307415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:28.320463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:28.325271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:28.326694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:28.327577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:28.328561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:28.329198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:28.329871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:28.333110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:28.333589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:28.334353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:28.334830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:28.335262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:28.376413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:28.377289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:28.378420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:28.380982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lazy-loading 'fault' on Instance uuid c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:28.596784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:28.610336 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e44817f-60d2-46d0-8154-265b1b892fde tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 200 len: 1303 microversion: 2.1 time: 0.315217 Sep 18 01:28:28.613012 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2479/4923] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:28 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:28.992199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:29.007426 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ba916670-57db-4117-88d7-fc16ab2132f4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1681 microversion: 2.1 time: 0.705929 Sep 18 01:28:29.008667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2445/4924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:28 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1681 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:29.647114 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:29.648796 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: c0ca14ca-9722-4d31-a9cb-a51fa20d0b74] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:29.661799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:29.662704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:29.665159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:29.666707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:29.667517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:29.677217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:29.703855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] HTTP exception thrown: Instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 could not be found. Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Request method failure captured: Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 HTTP/1.1 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnPCgJchBcdm2bus42mqgZHBH-LKuozV3wCwz8rB9S8bgGy-2Zu0EBDi9FyllKfHVohZrBI-AakEpZ1GUcZh5p84vdGOlPio1bpo8LnfrThX3_gWSm3kRYoH1Fa0gohiceURmDYg7JOqfNxP_dUyvT0MFzkYfX5TQb4dV5cMxy8GrMQ Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: faf9f899c2054d8cb558dd1f01a2863e Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerRescueTestJSON-747223310 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerRescueTestJSON-747223310 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: faf9f899c2054d8cb558dd1f01a2863e Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerRescueTestJSON-747223310 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerRescueTestJSON-747223310-project Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 61cd7711674848c699775a6d27ed6752 Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerRescueTestJSON-747223310-project Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: exception: Instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 could not be found. Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'c0ca14ca-9722-4d31-a9cb-a51fa20d0b74'} Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 could not be found. Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 could not be found. Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:29.713197 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:29.720348 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:29.720348 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:29.720348 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:29.720348 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:28:29.720348 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:28:29.720348 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 could not be found. Sep 18 01:28:29.720348 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:29.725346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Returning 404 to user: Instance c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:28:29.726912 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a883fe7-0b28-4600-a6f5-60c995ae25c9 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74" status: 404 len: 111 microversion: 2.1 time: 0.092764 Sep 18 01:28:29.729937 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2480/4925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:29 2022] GET /compute/v2.1/servers/c0ca14ca-9722-4d31-a9cb-a51fa20d0b74 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:28:29.737510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:29.738164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:29.753569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:29.754758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:29.755200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:29.756816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:29.758634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:29.759673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:29.852276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:28:30.034585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:30.035839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:30.050318 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d7ca4930-18d8-44c9-9134-519c13fad448 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "DELETE /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 204 len: 0 microversion: 2.1 time: 0.312482 Sep 18 01:28:30.053828 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2446/4926] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:28:29 2022] DELETE /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:28:30.064437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:30.065293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:30.067409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:30.069983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:30.073056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:30.076408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:30.080535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:30.081275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:30.112420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:30.112936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:30.113446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:30.120341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:30.124547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:30.125204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:30.216144 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:30.757237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:30.771999 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f1d5edf-adf0-4675-9565-a5030f37349d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1681 microversion: 2.1 time: 0.743137 Sep 18 01:28:30.773725 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2481/4927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:30 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1681 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:31.706199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:31.720229 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c9b3996-2da9-43cf-bc84-cbfdef04ddd7 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1490 microversion: 2.1 time: 1.660183 Sep 18 01:28:31.720826 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2447/4928] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:30 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1490 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:31.802181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:31.802939 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:31.820081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:31.825870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:31.826903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:31.830688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:31.831410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:31.832026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:31.883776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0f31d12b-f68e-484d-9cd5-40ee58d74a26 req-8b6cca87-3f44-4e50-b0b1-3d1c3913391d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b4b9816-b230-4c64-b666-b095533aa203", "name": "network-vif-deleted", "tag": "fe7a7cb1-5823-4413-bbd2-569dcfaad2cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:31.918552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f31d12b-f68e-484d-9cd5-40ee58d74a26 req-8b6cca87-3f44-4e50-b0b1-3d1c3913391d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:31.922959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f31d12b-f68e-484d-9cd5-40ee58d74a26 req-8b6cca87-3f44-4e50-b0b1-3d1c3913391d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:31.923559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f31d12b-f68e-484d-9cd5-40ee58d74a26 req-8b6cca87-3f44-4e50-b0b1-3d1c3913391d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:31.947321 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0f31d12b-f68e-484d-9cd5-40ee58d74a26 req-8b6cca87-3f44-4e50-b0b1-3d1c3913391d service nova] Creating event network-vif-deleted:fe7a7cb1-5823-4413-bbd2-569dcfaad2cd for instance 5b4b9816-b230-4c64-b666-b095533aa203 on n-h1-master-1 Sep 18 01:28:31.953598 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0f31d12b-f68e-484d-9cd5-40ee58d74a26 req-8b6cca87-3f44-4e50-b0b1-3d1c3913391d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073128 Sep 18 01:28:31.954499 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2448/4929] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:32.168206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:32.182553 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a50815fe-bfa5-45de-a072-7f44055c2b49 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 200 len: 1614 microversion: 2.1 time: 0.386215 Sep 18 01:28:32.189461 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2482/4930] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:31 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 1614 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:32.750707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:32.752238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:32.762269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:32.763233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:32.765119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:32.771735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:32.792737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:32.794067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:33.227361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:33.228755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:33.245023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:33.246480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:33.248877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:33.272430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:33.273294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:33.276341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:33.366659 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 HTTP/1.1 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5b4b9816-b230-4c64-b666-b095533aa203'} Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:33.372885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:28:33.378542 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9bd76ce0-e5aa-41e0-995f-8ddda6fa2aa4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 404 len: 111 microversion: 2.1 time: 0.152249 Sep 18 01:28:33.382577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2483/4931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:33 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:28:33.409162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-558e236b-5b5f-473e-8a20-300250c24e31 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '.version_select at 0x7f7005492af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:33.461853 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-558e236b-5b5f-473e-8a20-300250c24e31 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360059833" status: 202 len: 0 microversion: 2.1 time: 0.077332 Sep 18 01:28:33.463719 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2484/4932] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 18 01:28:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360059833 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:28:33.749106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:33.761095 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b753998b-3397-402e-afc0-852d34d7a11a tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1490 microversion: 2.1 time: 1.016287 Sep 18 01:28:33.768811 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2449/4933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:32 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1490 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:34.480791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ae5618f9-6499-4dca-ad1a-0de358911591 req-8d332cb5-77ca-4c56-ac84-acb624149eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432ebf1e-16b5-4f88-93e9-c46706a74599", "name": "network-vif-deleted", "tag": "f21801fc-20c6-4bec-bcc1-9b0e6e8d46b0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:34.509922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ae5618f9-6499-4dca-ad1a-0de358911591 req-8d332cb5-77ca-4c56-ac84-acb624149eb7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:34.510541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ae5618f9-6499-4dca-ad1a-0de358911591 req-8d332cb5-77ca-4c56-ac84-acb624149eb7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:34.511015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ae5618f9-6499-4dca-ad1a-0de358911591 req-8d332cb5-77ca-4c56-ac84-acb624149eb7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:34.547222 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ae5618f9-6499-4dca-ad1a-0de358911591 req-8d332cb5-77ca-4c56-ac84-acb624149eb7 service nova] Creating event network-vif-deleted:f21801fc-20c6-4bec-bcc1-9b0e6e8d46b0 for instance 432ebf1e-16b5-4f88-93e9-c46706a74599 on n-h2-master-1 Sep 18 01:28:34.563346 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ae5618f9-6499-4dca-ad1a-0de358911591 req-8d332cb5-77ca-4c56-ac84-acb624149eb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087268 Sep 18 01:28:34.564388 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2485/4934] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:34.787415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:34.788464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:34.800855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:34.801366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:34.803402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:34.804156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:34.804641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:34.805074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:34.854533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:34.854887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:34.855520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:34.856418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lazy-loading 'fault' on Instance uuid 432ebf1e-16b5-4f88-93e9-c46706a74599 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:28:35.078515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cd7711674848c699775a6d27ed6752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf9f899c2054d8cb558dd1f01a2863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:35.087196 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4a056d0-d923-4502-a2ff-772625cb74bb tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 200 len: 1303 microversion: 2.1 time: 0.304642 Sep 18 01:28:35.110270 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2450/4935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:34 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 1303 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:36.003154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1020b0a3-49b7-4cc9-b29e-80b2526c0328 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: .version_select at 0x7f7005ea7c10>, body: {"keypair": {"name": "tempest-keypair-567297203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBZd5Zauq4ThO2RMpH4fAzcbxzHUH4Wb8BcIfw642gPDGGI6T70D5FH8LFI7rsrg2gxXtDJ78aqDA0XX/etCjOKWvXUla2L13NFA6DADDGYMyOkiq3TAkyGcAhoAsx6HA=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:36.058605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1020b0a3-49b7-4cc9-b29e-80b2526c0328 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:28:36.069584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-1020b0a3-49b7-4cc9-b29e-80b2526c0328 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:28:36.126505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:36.127916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] [instance: 432ebf1e-16b5-4f88-93e9-c46706a74599] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:36.146790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:36.150268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:36.151044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:36.151994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:36.154143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:36.155020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:36.172422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1020b0a3-49b7-4cc9-b29e-80b2526c0328 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182288 Sep 18 01:28:36.182289 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2486/4936] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:28:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:36.199394 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] HTTP exception thrown: Instance 432ebf1e-16b5-4f88-93e9-c46706a74599 could not be found. Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Request method failure captured: Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 HTTP/1.1 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnPCgJchBcdm2bus42mqgZHBH-LKuozV3wCwz8rB9S8bgGy-2Zu0EBDi9FyllKfHVohZrBI-AakEpZ1GUcZh5p84vdGOlPio1bpo8LnfrThX3_gWSm3kRYoH1Fa0gohiceURmDYg7JOqfNxP_dUyvT0MFzkYfX5TQb4dV5cMxy8GrMQ Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: faf9f899c2054d8cb558dd1f01a2863e Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerRescueTestJSON-747223310 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faf9f899c2054d8cb558dd1f01a2863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerRescueTestJSON-747223310 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: faf9f899c2054d8cb558dd1f01a2863e Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerRescueTestJSON-747223310 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerRescueTestJSON-747223310-project Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 61cd7711674848c699775a6d27ed6752 Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerRescueTestJSON-747223310-project Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 432ebf1e-16b5-4f88-93e9-c46706a74599 could not be found. Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '432ebf1e-16b5-4f88-93e9-c46706a74599'} Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432ebf1e-16b5-4f88-93e9-c46706a74599 could not be found. Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432ebf1e-16b5-4f88-93e9-c46706a74599 could not be found. Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:28:36.211581 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:28:36.217132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:28:36.217132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:28:36.217132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:28:36.217132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:28:36.217132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:28:36.217132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432ebf1e-16b5-4f88-93e9-c46706a74599 could not be found. Sep 18 01:28:36.217132 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:28:36.226444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] Returning 404 to user: Instance 432ebf1e-16b5-4f88-93e9-c46706a74599 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:28:36.227521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4e35ff4a-c865-47d5-ae87-31ec87a8ed95 tempest-ServerRescueTestJSON-747223310 tempest-ServerRescueTestJSON-747223310-project] 10.222.0.25 "GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599" status: 404 len: 111 microversion: 2.1 time: 0.113792 Sep 18 01:28:36.228941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2451/4937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:36 2022] GET /compute/v2.1/servers/432ebf1e-16b5-4f88-93e9-c46706a74599 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:28:43.198411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1740647789", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f7c6e0e-8607-495c-8bc4-13fbec48411b"}], "security_groups": [{"name": "tempest-securitygroup--1926316254"}], "key_name": "tempest-keypair-567297203", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:43.758184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] validate_networks() for [('8f7c6e0e-8607-495c-8bc4-13fbec48411b', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:28:44.547374 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:45.243117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:28:45.243540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:28:45.244016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:28:45.244425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:28:45.244835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:28:45.260466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:45.263208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:45.263958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:45.268388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:45.269931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:45.270774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:45.321327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:28:45.336145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:28:45.364424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:28:45.370047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:28:45.546740 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c110789a-a627-48e7-942e-02dba89f965f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.358116 Sep 18 01:28:45.549369 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2487/4938] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:28:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:28:45.561819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2bd0ef2d-83b4-4cd9-a2ec-556a190dfdbd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:45.562674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2bd0ef2d-83b4-4cd9-a2ec-556a190dfdbd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:45.939051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2bd0ef2d-83b4-4cd9-a2ec-556a190dfdbd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:45.947979 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2bd0ef2d-83b4-4cd9-a2ec-556a190dfdbd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1241 microversion: 2.1 time: 0.390201 Sep 18 01:28:45.961641 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2452/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:45 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1241 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:46.606576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe7ecc6c-2cca-4e6f-a187-61f383259761 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f70053c8dc0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:46.717073 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe7ecc6c-2cca-4e6f-a187-61f383259761 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9e9978b7-8be7-4416-a959-51af04ff7ff5" status: 200 len: 350 microversion: 2.1 time: 0.114558 Sep 18 01:28:46.717986 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2488/4940] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:28:46 2022] GET /compute/v2.1/os-volumes/9e9978b7-8be7-4416-a959-51af04ff7ff5 => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:46.981949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:46.988334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:46.993930 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=20 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:47.027509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:47.028017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:47.028464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:47.029202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:47.029683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:47.030252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:47.382156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:47.391241 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3fac0c4f-cee5-4412-a051-53cf4f4d74ba tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1237 microversion: 2.1 time: 0.418572 Sep 18 01:28:47.391241 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2453/4941] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:46 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1237 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:48.419656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:48.420291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:48.432518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:48.433019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:48.433465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:48.434208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:48.434704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:48.435185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:48.699696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:48.717774 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-58652838-2d86-49d0-86b8-bef53daa7143 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1299 microversion: 2.1 time: 0.300257 Sep 18 01:28:48.720570 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2489/4942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:48 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:49.712488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea49716c-f4ae-4c9e-91dd-c9a53e24fa16 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f700551b8b0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:49.749694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:49.750368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:49.760669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:49.761164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:49.761627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:49.762343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:49.762801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:49.763226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:49.818940 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea49716c-f4ae-4c9e-91dd-c9a53e24fa16 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/534d04dd-fc00-438b-8919-4ae36897e2ca" status: 200 len: 351 microversion: 2.1 time: 0.111915 Sep 18 01:28:49.819534 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2454/4943] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:28:49 2022] GET /compute/v2.1/os-volumes/534d04dd-fc00-438b-8919-4ae36897e2ca => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:50.193375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:50.202290 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d5d7acd-e3bc-4eb9-9d17-addee97a179c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1299 microversion: 2.1 time: 0.456409 Sep 18 01:28:50.214206 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2490/4944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:49 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1299 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:50.423232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d861e5c-623d-4eb0-af2d-f3ac8a31221c tempest-ExtensionsTest-518163765 tempest-ExtensionsTest-518163765-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:50.424925 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d861e5c-623d-4eb0-af2d-f3ac8a31221c tempest-ExtensionsTest-518163765 tempest-ExtensionsTest-518163765-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.466739 Sep 18 01:28:50.425859 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2455/4945] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 18 01:28:49 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:50.438030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-23f264ad-2540-41ff-a9f6-1000228eaa88 tempest-ExtensionsTest-518163765 tempest-ExtensionsTest-518163765-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:50.440653 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-23f264ad-2540-41ff-a9f6-1000228eaa88 tempest-ExtensionsTest-518163765 tempest-ExtensionsTest-518163765-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009768 Sep 18 01:28:50.442439 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2491/4946] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Sep 18 01:28:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:28:51.249481 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:51.259829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:51.283364 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:51.285777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:51.288602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:51.292196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:51.297264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:51.303673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:51.307061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:51.518423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:51.532562 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-859672f5-8c1b-4676-b5f5-c6fb20e8b4ec tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1299 microversion: 2.1 time: 0.308268 Sep 18 01:28:51.533640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2456/4947] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:51 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1299 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:52.560079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:52.562349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:52.591929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:52.593001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:52.602509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:52.603991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:52.607874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:52.611029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:53.191080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:53.204522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb2b44e7-bd36-404b-918b-a96b19be7337 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 0.648581 Sep 18 01:28:53.208179 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2492/4948] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:52 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:53.891425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dde6553e-993d-49b7-bf83-2ca8dae4cd13 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f7005305790>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:54.011436 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dde6553e-993d-49b7-bf83-2ca8dae4cd13 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c78b35c1-e1be-49bd-9d1b-184eb2015306" status: 200 len: 351 microversion: 2.1 time: 0.124268 Sep 18 01:28:54.012616 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2457/4949] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:28:53 2022] GET /compute/v2.1/os-volumes/c78b35c1-e1be-49bd-9d1b-184eb2015306 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:54.027189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fbdbb086-5e0f-4626-8127-aef7c2f58109 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f70061c30d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:54.233165 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fbdbb086-5e0f-4626-8127-aef7c2f58109 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.211199 Sep 18 01:28:54.235007 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2493/4950] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Sep 18 01:28:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:54.236715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:54.238771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:54.251300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e76a8d2d-2d5c-4d85-b9e6-ba249892bd25 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f7005042af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:54.270845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:54.271730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:54.276103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:54.276882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:54.277364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:54.288305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:54.533600 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e76a8d2d-2d5c-4d85-b9e6-ba249892bd25 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.286032 Sep 18 01:28:54.534386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2494/4951] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 18 01:28:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:54.559519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4e1add7-1349-4c3d-b06a-13ee5ccf0380 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f7005042160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:54.782034 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4e1add7-1349-4c3d-b06a-13ee5ccf0380 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.234621 Sep 18 01:28:54.782949 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2495/4952] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Sep 18 01:28:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:54.797211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd47482f-305b-4008-ab20-0fdaf4a5be21 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f700511b280>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:55.049894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd47482f-305b-4008-ab20-0fdaf4a5be21 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.256832 Sep 18 01:28:55.051192 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2496/4953] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 18 01:28:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:28:55.072650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a6c9fd6-f1e1-4cab-b040-65ca48715983 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f7005e4f040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:55.264389 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a6c9fd6-f1e1-4cab-b040-65ca48715983 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.197631 Sep 18 01:28:55.274287 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2497/4954] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 18 01:28:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:55.283786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3084f2f-f3f8-44ff-961a-937ad9c3ec1b tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f700529b940>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:55.316246 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:55.353096 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:55.529371 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3084f2f-f3f8-44ff-961a-937ad9c3ec1b tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.250631 Sep 18 01:28:55.530174 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2498/4955] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:28:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:55.544855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3b35a254-016a-4c29-bada-01493d0b1697 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f700511b310>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:55.700299 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3b35a254-016a-4c29-bada-01493d0b1697 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.159460 Sep 18 01:28:55.711380 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2499/4956] 10.222.0.25 () {58 vars in 1188 bytes} [Sun Sep 18 01:28:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:55.742776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:55.766495 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9e29b4f-8004-4d72-96db-7aa8ee975733 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 1.532795 Sep 18 01:28:55.769284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2458/4957] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:54 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:55.785383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0138a654-20b1-4b0b-b9a5-b5ad0fefe439 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] Calling method '.version_select at 0x7f7005305790>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:55.948021 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:56.076031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70fbdecf-472f-4cf4-b9d1-a029f0cf9539 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] Calling method '.version_select at 0x7f7005455ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:56.125772 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0138a654-20b1-4b0b-b9a5-b5ad0fefe439 tempest-VolumesTestJSON-39566957 tempest-VolumesTestJSON-39566957-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.353145 Sep 18 01:28:56.136870 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2459/4958] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:28:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:28:56.237489 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:28:56.249254 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70fbdecf-472f-4cf4-b9d1-a029f0cf9539 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.534353 Sep 18 01:28:56.252256 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2500/4959] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:28:55 2022] GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c/defaults => generated 371 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:56.267335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e317a87e-d7c7-4acd-9903-2bb98eb63cf5 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] Calling method '.version_select at 0x7f70054fe040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:56.482846 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e317a87e-d7c7-4acd-9903-2bb98eb63cf5 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c" status: 200 len: 371 microversion: 2.1 time: 0.219275 Sep 18 01:28:56.487191 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2460/4960] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:28:56 2022] GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c => generated 371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:56.502771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d556621d-8bb0-47af-9f38-9698a5f79392 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] Calling method '.version_select at 0x7f700511b0d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:56.566724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2bfc7933-c737-40d5-8115-c7a541a5fd41 req-0061be29-1f91-4b1d-849a-24cacdee6852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5d09e1-875c-425d-9034-03287d68823d", "tag": "df38f3cc-8bc0-44b5-a230-ffbb48fb586c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:28:56.589758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2bfc7933-c737-40d5-8115-c7a541a5fd41 req-0061be29-1f91-4b1d-849a-24cacdee6852 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:56.590244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2bfc7933-c737-40d5-8115-c7a541a5fd41 req-0061be29-1f91-4b1d-849a-24cacdee6852 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:56.590671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2bfc7933-c737-40d5-8115-c7a541a5fd41 req-0061be29-1f91-4b1d-849a-24cacdee6852 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:56.644748 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2bfc7933-c737-40d5-8115-c7a541a5fd41 req-0061be29-1f91-4b1d-849a-24cacdee6852 service nova] Creating event network-changed:df38f3cc-8bc0-44b5-a230-ffbb48fb586c for instance 3e5d09e1-875c-425d-9034-03287d68823d on n-h2-master-1 Sep 18 01:28:56.682216 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d556621d-8bb0-47af-9f38-9698a5f79392 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.179963 Sep 18 01:28:56.682216 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2501/4961] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:28:56 2022] GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c/defaults => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:56.682541 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2bfc7933-c737-40d5-8115-c7a541a5fd41 req-0061be29-1f91-4b1d-849a-24cacdee6852 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103927 Sep 18 01:28:56.687092 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2461/4962] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:56.711537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-306ad9f0-7f99-4d2d-9a46-f4830a9a97b8 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] Calling method '.version_select at 0x7f7004febe50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:56.793238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:56.794686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:56.811808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:56.818608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:56.819401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:56.820373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:56.822385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:56.822962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:56.903459 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-306ad9f0-7f99-4d2d-9a46-f4830a9a97b8 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c" status: 200 len: 371 microversion: 2.1 time: 0.212641 Sep 18 01:28:56.904066 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2502/4963] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:28:56 2022] GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c => generated 371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:56.933416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28650af8-75b8-4c8f-a092-3c062dfb8ad7 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] Calling method '.version_select at 0x7f70054551f0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:57.171528 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28650af8-75b8-4c8f-a092-3c062dfb8ad7 tempest-QuotasTestJSON-555173814 tempest-QuotasTestJSON-555173814-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c?user_id=3a2c94834b1b4eeb8127c5c651ef7db0" status: 200 len: 371 microversion: 2.1 time: 0.241915 Sep 18 01:28:57.182445 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2503/4964] 10.222.0.25 () {58 vars in 1323 bytes} [Sun Sep 18 01:28:56 2022] GET /compute/v2.1/os-quota-sets/c4c742b2d6514577b09dc7482936f55c?user_id=3a2c94834b1b4eeb8127c5c651ef7db0 => generated 371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:28:58.146311 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:28:58.155555 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-71d3abe4-7ce0-4c9b-be64-cf044209cfea tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 1.366829 Sep 18 01:28:58.156155 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2462/4965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:56 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:28:59.183608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:28:59.184217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:28:59.195373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:59.202767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:59.203440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:28:59.204393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:28:59.205020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:28:59.205654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:00.053793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:00.073832 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-235e396d-5c8f-42c3-8fcc-f383a824df27 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 0.895252 Sep 18 01:29:00.075942 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2504/4966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:28:59 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:01.101848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:01.103027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:01.115701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:01.116211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:01.116705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:01.123633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:01.124556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:01.128910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:01.917357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:01.936143 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf421dba-cc35-4059-84b0-4f2b3c1c1866 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 0.839373 Sep 18 01:29:01.947860 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2463/4967] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:01 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:02.585188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1fda3186-f913-4c93-bc04-4ed677d5b402 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Action: 'create', calling method: .version_select at 0x7f700529b700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-887677491"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:02.965275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:02.966061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:02.988324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:02.988829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:02.989262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:02.996797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:02.998647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:03.000717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:03.294668 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1fda3186-f913-4c93-bc04-4ed677d5b402 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.020935 Sep 18 01:29:03.295301 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2505/4968] 10.222.0.25 () {60 vars in 1155 bytes} [Sun Sep 18 01:29:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1022 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 18 01:29:03.310125 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a008966-1f11-4874-9e3a-dd89c175eda4 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f700678b3a0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:03.501045 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a008966-1f11-4874-9e3a-dd89c175eda4 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.194735 Sep 18 01:29:03.502386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2506/4969] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:03 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:03.636521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:03.649005 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30a0f169-8b50-4e27-810a-367b3d70ebac tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 0.684717 Sep 18 01:29:03.653654 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2464/4970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:02 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:29:04.517364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8ebd2b3-348e-4359-95ab-d687339533c5 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f700529ba60>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:04.641758 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8ebd2b3-348e-4359-95ab-d687339533c5 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.129550 Sep 18 01:29:04.642811 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2507/4971] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:04 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:04.681643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:04.682688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:04.698062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:04.700041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:04.704145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:04.707769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:04.709047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:04.710038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:05.559935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:05.573481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-138667f2-a9a9-4812-a318-a5256a5a0d67 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 0.895790 Sep 18 01:29:05.579415 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2465/4972] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:04 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:05.657624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-314ae0f0-4b55-48aa-beea-67570c12a9c5 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005396af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:05.827079 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-314ae0f0-4b55-48aa-beea-67570c12a9c5 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 345 microversion: 2.1 time: 0.174805 Sep 18 01:29:05.836068 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2508/4973] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:05 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:05.843858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4828130-759b-4c89-9e69-ed88e000303b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Action: 'create', calling method: .version_select at 0x7f700615ec10>, body: {"snapshot": {"volume_id": "00a24d28-3f8a-46b7-8fb8-97860bbfc165", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1071368899"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:06.170400 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4828130-759b-4c89-9e69-ed88e000303b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.330420 Sep 18 01:29:06.171682 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2466/4974] 10.222.0.25 () {60 vars in 1162 bytes} [Sun Sep 18 01:29:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:06.185010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-875d786d-235f-439b-946e-54e71571ff8e tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70053b5790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:06.258469 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-875d786d-235f-439b-946e-54e71571ff8e tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.077942 Sep 18 01:29:06.262856 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2509/4975] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:06 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:06.277197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-589f4ea5-5d0f-4a2e-83f9-75de40e1cd3b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70053b9820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:06.327397 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-589f4ea5-5d0f-4a2e-83f9-75de40e1cd3b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.057078 Sep 18 01:29:06.328194 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2467/4976] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Sep 18 01:29:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:06.341474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59861600-ea3f-418d-a14f-b92462c9b13b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005042700>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:06.379385 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59861600-ea3f-418d-a14f-b92462c9b13b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.041467 Sep 18 01:29:06.380402 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2510/4977] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:06 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:06.603754 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:06.613052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:06.614122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:06.640276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:06.654764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:06.658444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:06.659273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:06.659766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:06.660210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:07.392341 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:07.399320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-012e8743-dcde-40f5-ad1f-bc30a9ef6578 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005447700>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:07.474051 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-012e8743-dcde-40f5-ad1f-bc30a9ef6578 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.083243 Sep 18 01:29:07.475897 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2511/4978] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:07 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:07.493932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:07.508091 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-480094b3-88ca-4021-85f0-6d698bbe408b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 0.906057 Sep 18 01:29:07.508984 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2468/4979] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:06 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:08.490013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b06b91f-36c3-45ea-9aa2-5863b3cc9f3d tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005396b80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:08.532678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:08.533312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:08.556812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:08.561278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:08.561976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:08.562904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:08.568567 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b06b91f-36c3-45ea-9aa2-5863b3cc9f3d tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.084167 Sep 18 01:29:08.569736 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2512/4980] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:08 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:29:08.571047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:08.572201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:09.108017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d9f85e0c-f770-4d2d-a7f0-e724427f0057 req-dea83259-144f-45f4-b99e-d1f755f85080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e5d09e1-875c-425d-9034-03287d68823d", "name": "network-vif-plugged", "status": "completed", "tag": "df38f3cc-8bc0-44b5-a230-ffbb48fb586c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:09.145981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d9f85e0c-f770-4d2d-a7f0-e724427f0057 req-dea83259-144f-45f4-b99e-d1f755f85080 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:09.151884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d9f85e0c-f770-4d2d-a7f0-e724427f0057 req-dea83259-144f-45f4-b99e-d1f755f85080 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:09.159574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d9f85e0c-f770-4d2d-a7f0-e724427f0057 req-dea83259-144f-45f4-b99e-d1f755f85080 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:09.206816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d9f85e0c-f770-4d2d-a7f0-e724427f0057 req-dea83259-144f-45f4-b99e-d1f755f85080 service nova] Creating event network-vif-plugged:df38f3cc-8bc0-44b5-a230-ffbb48fb586c for instance 3e5d09e1-875c-425d-9034-03287d68823d on n-h2-master-1 Sep 18 01:29:09.231444 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d9f85e0c-f770-4d2d-a7f0-e724427f0057 req-dea83259-144f-45f4-b99e-d1f755f85080 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123179 Sep 18 01:29:09.233916 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2513/4981] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:09.390800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:09.406458 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7ebb407-3b2c-4779-bb9f-5251cdc406b3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 0.877014 Sep 18 01:29:09.425578 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2469/4982] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:08 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:09.588851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7a452f9-c433-4d42-b530-7ea0e68c74a3 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005422790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:09.692572 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7a452f9-c433-4d42-b530-7ea0e68c74a3 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.113366 Sep 18 01:29:09.693431 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2514/4983] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:09 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:10.437831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:10.438482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:10.455606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:10.460045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:10.460690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:10.461740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:10.464134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:10.464767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:10.706921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8884ec14-652c-4d0b-9f6d-83806d9949c4 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f700635cd30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:10.766891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8884ec14-652c-4d0b-9f6d-83806d9949c4 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 288 microversion: 2.1 time: 0.063340 Sep 18 01:29:10.776482 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2515/4984] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:10 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:29:10.782911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9188d68b-8571-4382-9beb-bfc69bf2d135 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70053275e0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:10.937625 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9188d68b-8571-4382-9beb-bfc69bf2d135 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 202 len: 0 microversion: 2.1 time: 0.159603 Sep 18 01:29:10.942544 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2516/4985] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Sep 18 01:29:10 2022] DELETE /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:29:10.950376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59010d05-39a0-46dd-bdce-e01515ac30f0 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70053270d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:11.007665 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59010d05-39a0-46dd-bdce-e01515ac30f0 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.063480 Sep 18 01:29:11.008410 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2517/4986] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:10 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:11.539110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:11.548984 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d668962b-1c59-4d0a-8a22-02357657b67e tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1367 microversion: 2.1 time: 1.115477 Sep 18 01:29:11.552744 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2470/4987] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:10 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1367 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:12.024728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5042fcba-60a9-49b9-8185-1b03e0915399 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005039f70>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:12.099370 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5042fcba-60a9-49b9-8185-1b03e0915399 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.078611 Sep 18 01:29:12.104819 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2518/4988] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:12 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:12.574773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:12.576003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:12.587459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:12.594117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:12.595011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:12.600556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:12.602065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:12.603068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:13.069449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:13.078842 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30805d66-32fb-4746-8b73-b22216044afa tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1557 microversion: 2.1 time: 0.510078 Sep 18 01:29:13.083056 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2471/4989] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:12 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1557 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:13.113479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:13.114129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:13.120963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33f53b3f-da91-4756-aca9-6bd54819c242 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70050ba0d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:13.140316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:13.140827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:13.141273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:13.147556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:13.148545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:13.151804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:13.209786 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33f53b3f-da91-4756-aca9-6bd54819c242 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.094235 Sep 18 01:29:13.210768 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2472/4990] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:13 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:13.407098 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d34b7615-8612-450e-81e7-ca8a612ab047 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.301228 Sep 18 01:29:13.407925 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2519/4991] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:29:13 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:14.223548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36cc78e8-2fff-4cfc-b7ea-698c31b04bb7 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005e753a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:14.296350 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36cc78e8-2fff-4cfc-b7ea-698c31b04bb7 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 200 len: 287 microversion: 2.1 time: 0.076923 Sep 18 01:29:14.296934 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2473/4992] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:14 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:15.324195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa14d6af-7d4e-47bc-b3aa-50cd8c7d63de tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005039700>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:15.373373 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-aa14d6af-7d4e-47bc-b3aa-50cd8c7d63de tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] HTTP exception thrown: Snapshot 6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 could not be found. Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa14d6af-7d4e-47bc-b3aa-50cd8c7d63de tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Request method failure captured: Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 HTTP/1.1 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnRelZU8Xo17CoJtGGULR1F-Sd8u4GRBB2Ye1pYes1H1D2LipphePvqeo7Y2Zf6dvSwKR7hpT5FxKPIJCFTFYldFjatymLydSVl-_7jf1FrV4rLgZ0DqCJdAn0UgxHi50fs49Uv00IDqwzj_YVnEi903KeGR5ttRULi8Qj8XD23e9js Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: df9bc61c27b74c5fb7cac89cd57ad71b Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: exception: Snapshot 6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 could not be found. Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6eddade6-3c6c-4536-9cdf-1f46f1ac40b0'} Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 could not be found. (HTTP 404) (Request-ID: req-3d0ab35f-029c-4bc7-971d-644d1aa0badd) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:29:15.380910 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 could not be found. Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 could not be found. Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 could not be found. Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa14d6af-7d4e-47bc-b3aa-50cd8c7d63de tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Returning 404 to user: Snapshot 6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa14d6af-7d4e-47bc-b3aa-50cd8c7d63de tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0" status: 404 len: 111 microversion: 2.1 time: 0.074250 Sep 18 01:29:15.385715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2520/4993] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 01:29:15 2022] GET /compute/v2.1/os-snapshots/6eddade6-3c6c-4536-9cdf-1f46f1ac40b0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:29:15.401424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6fd5ca20-5803-489e-9de7-71baafcb1763 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005196820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:15.536288 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6fd5ca20-5803-489e-9de7-71baafcb1763 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 202 len: 0 microversion: 2.1 time: 0.140088 Sep 18 01:29:15.536866 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2474/4994] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:29:15 2022] DELETE /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:29:15.545409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b1e9be33-e8d2-43f9-93b0-79f21b2723eb tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005ea7ca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:15.688073 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b1e9be33-e8d2-43f9-93b0-79f21b2723eb tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.146460 Sep 18 01:29:15.689630 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2521/4995] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:15 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:16.711398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f089a838-f430-401e-9ed9-93a7764938d3 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70050bab80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:16.858007 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f089a838-f430-401e-9ed9-93a7764938d3 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.154883 Sep 18 01:29:16.858797 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2475/4996] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:16 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:17.878049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-354f0e19-7c56-41ba-bee3-3ee0c50a8438 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005039f70>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:18.056943 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-354f0e19-7c56-41ba-bee3-3ee0c50a8438 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.187061 Sep 18 01:29:18.064951 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2522/4997] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:17 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:18.255734 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-808a2606-0fe8-44d6-8813-b16b6781a7b3 req-482dcb9b-14eb-4467-bfd4-411179c817a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5d09e1-875c-425d-9034-03287d68823d", "tag": "df38f3cc-8bc0-44b5-a230-ffbb48fb586c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:18.291897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-808a2606-0fe8-44d6-8813-b16b6781a7b3 req-482dcb9b-14eb-4467-bfd4-411179c817a3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:18.293205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-808a2606-0fe8-44d6-8813-b16b6781a7b3 req-482dcb9b-14eb-4467-bfd4-411179c817a3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:18.293804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-808a2606-0fe8-44d6-8813-b16b6781a7b3 req-482dcb9b-14eb-4467-bfd4-411179c817a3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:18.335025 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=69 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:18.343858 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-808a2606-0fe8-44d6-8813-b16b6781a7b3 req-482dcb9b-14eb-4467-bfd4-411179c817a3 service nova] Creating event network-changed:df38f3cc-8bc0-44b5-a230-ffbb48fb586c for instance 3e5d09e1-875c-425d-9034-03287d68823d on n-h2-master-1 Sep 18 01:29:18.367512 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-808a2606-0fe8-44d6-8813-b16b6781a7b3 req-482dcb9b-14eb-4467-bfd4-411179c817a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114413 Sep 18 01:29:18.368379 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2476/4998] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:19.071636 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f35d1c2-cb57-4e61-a60b-c6582d7f973f tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7005336ee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:19.228908 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9f35d1c2-cb57-4e61-a60b-c6582d7f973f tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.161291 Sep 18 01:29:19.229486 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2523/4999] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:19 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:20.243571 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b6dfd10-f1c1-447c-a6d2-7cac51b17f6b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f700550a310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:20.386804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b6dfd10-f1c1-447c-a6d2-7cac51b17f6b tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.147609 Sep 18 01:29:20.387911 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2477/5000] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:20 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:21.405358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6779008a-265d-4f20-84a7-d80e22b94239 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70050180d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:21.525364 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6779008a-265d-4f20-84a7-d80e22b94239 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 200 len: 344 microversion: 2.1 time: 0.126806 Sep 18 01:29:21.525981 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2524/5001] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:21 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:22.542620 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6aca507-456d-46db-b380-c48abc9387ee tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70054fe5e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:22.596630 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a6aca507-456d-46db-b380-c48abc9387ee tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] HTTP exception thrown: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6aca507-456d-46db-b380-c48abc9387ee tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Request method failure captured: Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 HTTP/1.1 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnRelZU8Xo17CoJtGGULR1F-Sd8u4GRBB2Ye1pYes1H1D2LipphePvqeo7Y2Zf6dvSwKR7hpT5FxKPIJCFTFYldFjatymLydSVl-_7jf1FrV4rLgZ0DqCJdAn0UgxHi50fs49Uv00IDqwzj_YVnEi903KeGR5ttRULi8Qj8XD23e9js Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: df9bc61c27b74c5fb7cac89cd57ad71b Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: exception: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '00a24d28-3f8a-46b7-8fb8-97860bbfc165'} Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. (HTTP 404) (Request-ID: req-b6cc6377-05bd-4d59-80f4-136722a60993) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:29:22.621896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.625506 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.630544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6aca507-456d-46db-b380-c48abc9387ee tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Returning 404 to user: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:29:22.631581 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6aca507-456d-46db-b380-c48abc9387ee tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 404 len: 109 microversion: 2.1 time: 0.094648 Sep 18 01:29:22.632763 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2478/5002] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:22 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:29:22.646023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e6a1b21e-51b6-4d98-aef2-816db4bf113d tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f70054590d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:22.706844 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e6a1b21e-51b6-4d98-aef2-816db4bf113d tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] HTTP exception thrown: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e6a1b21e-51b6-4d98-aef2-816db4bf113d tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Request method failure captured: Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 HTTP/1.1 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnRelZU8Xo17CoJtGGULR1F-Sd8u4GRBB2Ye1pYes1H1D2LipphePvqeo7Y2Zf6dvSwKR7hpT5FxKPIJCFTFYldFjatymLydSVl-_7jf1FrV4rLgZ0DqCJdAn0UgxHi50fs49Uv00IDqwzj_YVnEi903KeGR5ttRULi8Qj8XD23e9js Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: df9bc61c27b74c5fb7cac89cd57ad71b Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: exception: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '00a24d28-3f8a-46b7-8fb8-97860bbfc165'} Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. (HTTP 404) (Request-ID: req-75d82579-6cd4-4564-a6c0-435d9f0ed769) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:29:22.712757 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.715961 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.732803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e6a1b21e-51b6-4d98-aef2-816db4bf113d tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Returning 404 to user: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:29:22.737647 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e6a1b21e-51b6-4d98-aef2-816db4bf113d tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 404 len: 109 microversion: 2.1 time: 0.096879 Sep 18 01:29:22.742177 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2525/5003] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:29:22 2022] DELETE /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:29:22.751769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07da783c-6edd-4717-9ec8-c236734a4f37 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Calling method '.version_select at 0x7f7006136ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:22.823923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-07da783c-6edd-4717-9ec8-c236734a4f37 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] HTTP exception thrown: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07da783c-6edd-4717-9ec8-c236734a4f37 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Request method failure captured: Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 HTTP/1.1 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnRelZU8Xo17CoJtGGULR1F-Sd8u4GRBB2Ye1pYes1H1D2LipphePvqeo7Y2Zf6dvSwKR7hpT5FxKPIJCFTFYldFjatymLydSVl-_7jf1FrV4rLgZ0DqCJdAn0UgxHi50fs49Uv00IDqwzj_YVnEi903KeGR5ttRULi8Qj8XD23e9js Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c848ffb301a14f9ebad4dc9e2b386d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c848ffb301a14f9ebad4dc9e2b386d48 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1874698798 Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: df9bc61c27b74c5fb7cac89cd57ad71b Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1874698798-project Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: exception: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '00a24d28-3f8a-46b7-8fb8-97860bbfc165'} Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. (HTTP 404) (Request-ID: req-acc23515-c3f3-4d63-b77f-04d4761784b9) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:29:22.827569 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. Sep 18 01:29:22.831410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:29:22.837994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-07da783c-6edd-4717-9ec8-c236734a4f37 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] Returning 404 to user: Volume 00a24d28-3f8a-46b7-8fb8-97860bbfc165 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:29:22.839237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-07da783c-6edd-4717-9ec8-c236734a4f37 tempest-VolumesSnapshotsTestJSON-1874698798 tempest-VolumesSnapshotsTestJSON-1874698798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165" status: 404 len: 109 microversion: 2.1 time: 0.091872 Sep 18 01:29:22.840695 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2479/5004] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:29:22 2022] GET /compute/v2.1/os-volumes/00a24d28-3f8a-46b7-8fb8-97860bbfc165 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:29:30.780109 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=19 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:30.781451 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=32 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:31.319417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a47369a6-54bd-4a9b-bab1-ce50f411200b tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Action: 'create', calling method: .version_select at 0x7f700511b3a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1737935857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxU+ATkepNodabri2gl7QCbr6h5gDfScdXKqjIFPfJCM0QsqNvZpCKxOQIKhLya6uOlq72YjJbSlVPg0HBJrBLYdZO/MYWwcHMCGJE9XeGwZsghavd1WbNaNpBgN/aphQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:31.383457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a47369a6-54bd-4a9b-bab1-ce50f411200b tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Getting quotas for project ec1bd6811ab14757abb1d3d7e8c1924f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:29:31.400722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a47369a6-54bd-4a9b-bab1-ce50f411200b tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Getting quotas for user 32482797a12e43bba5da043b05ebe983 and project ec1bd6811ab14757abb1d3d7e8c1924f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:29:31.463576 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a47369a6-54bd-4a9b-bab1-ce50f411200b tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.685394 Sep 18 01:29:31.464494 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2526/5005] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:29:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:29:48.729413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-952061252-access_point-917355737", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "61df69bb-d434-4b6c-8c39-7544660300e9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1737935857", "security_groups": [{"name": "tempest-secgroup_access--360351716"}, {"name": "tempest-secgroup_general--1525047051"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:48.821824 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=27 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:48.826890 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:49.416628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] validate_networks() for [('61df69bb-d434-4b6c-8c39-7544660300e9', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:29:50.793417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:29:50.794069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:29:50.794688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:29:50.795335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:29:50.796077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:29:50.827610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:50.828128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:50.828536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:50.829273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:50.830307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:50.830735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:50.894495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Getting quotas for project ec1bd6811ab14757abb1d3d7e8c1924f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:29:50.907767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Getting quotas for user 32482797a12e43bba5da043b05ebe983 and project ec1bd6811ab14757abb1d3d7e8c1924f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:29:50.963911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:29:50.969232 n-d-master-1 devstack@n-api.service[122373]: WARNING nova.utils [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-952061252-access_point-917355737 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-952061252-acc Sep 18 01:29:50.975666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:29:51.167210 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1e1b18a2-e9ab-4e71-b50c-8c2e735c2639 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.437201 Sep 18 01:29:51.172421 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2480/5006] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:29:48 2022] POST /compute/v2.1/servers => generated 457 bytes in 2448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:29:51.181049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82647806-669a-436d-977d-3d688ce6b535 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:51.181714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82647806-669a-436d-977d-3d688ce6b535 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:51.184952 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:51.185783 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:29:51.304561 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:51.305158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:51.323384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:51.324128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:51.328129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:51.329273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:51.330461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:51.331207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:51.377370 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c134034e-af66-423d-8bc9-c24991330388 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/ips" status: 200 len: 150 microversion: 2.1 time: 0.080401 Sep 18 01:29:51.388039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-82647806-669a-436d-977d-3d688ce6b535 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:51.409529 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82647806-669a-436d-977d-3d688ce6b535 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1293 microversion: 2.1 time: 0.233119 Sep 18 01:29:51.410755 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2481/5007] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:29:51 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/ips => generated 150 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:51.415264 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2527/5008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:51 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1293 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:52.442857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7141c591-4c0c-43a8-8f95-583b9c5f392a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:52.443489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7141c591-4c0c-43a8-8f95-583b9c5f392a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:52.706314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7141c591-4c0c-43a8-8f95-583b9c5f392a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:52.713849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7141c591-4c0c-43a8-8f95-583b9c5f392a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1293 microversion: 2.1 time: 0.275709 Sep 18 01:29:52.715646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2482/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:52 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1293 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:53.745101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:53.746364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:53.762340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:53.766863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:53.768407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:53.773622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:53.775382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:53.776055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:53.964317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:53.977464 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8849e3aa-d890-4b9d-a29a-2bbeafd2d79e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1353 microversion: 2.1 time: 0.235635 Sep 18 01:29:53.978842 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2528/5010] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:53 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:54.509024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1714f3b0-fb75-4aad-ab48-a0320f58b059"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:54.541156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:54.568422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:54.570576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:54.571180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:54.572693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:54.575763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:54.577356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:55.009992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:55.011170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:55.041786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:55.043854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:55.045775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:55.047157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:55.052368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:55.052886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:55.137490 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00d8f799-7059-42ea-b952-14d5a7ca8642 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637934 Sep 18 01:29:55.149454 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2483/5011] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:29:54 2022] POST /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:29:55.463156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:55.474797 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-386d4afb-9a69-4c52-b3d0-c076e210ad7a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1351 microversion: 2.1 time: 0.473743 Sep 18 01:29:55.481254 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2529/5012] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:54 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1351 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:56.516269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:56.517287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:56.542451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:56.544160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:56.545756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:56.549767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:56.551891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:56.553501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:57.703065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:57.719946 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2241bbc0-bf7e-46a4-ba27-918d178c5872 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1470 microversion: 2.1 time: 1.211335 Sep 18 01:29:57.724369 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2484/5013] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:56 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1470 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:29:58.362319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ddff12a2-28ba-4907-9fe0-3e88a15b6cff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Action: 'create', calling method: .version_select at 0x7f7005459790>, body: {"keypair": {"name": "tempest-keypair-332039213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI982+RB8Rr5+G6RQBC7stU8tJlc67wbLxDQubRfmHhg2spwcUwJBT4GFPSc0YO3JPoP6jzB2R6ILYHg7P6wRiU1n5l8b0iSqYEIEw1BwXAI7sUOMluVgoBDfZWhIY1VQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:29:58.409196 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ddff12a2-28ba-4907-9fe0-3e88a15b6cff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Getting quotas for project e14e7fe58a1c4c0fb68a9aa803a0888f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:29:58.420936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ddff12a2-28ba-4907-9fe0-3e88a15b6cff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Getting quotas for user 6c90f881c9db4dcb9a9ecf4f8f31fc0b and project e14e7fe58a1c4c0fb68a9aa803a0888f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:29:58.486477 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ddff12a2-28ba-4907-9fe0-3e88a15b6cff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.134812 Sep 18 01:29:58.487247 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2530/5014] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:29:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:29:58.771640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:29:58.774555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:29:58.822334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:58.825138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:58.826451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:58.834335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:29:58.835467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:29:58.839234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:29:59.537443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:29:59.552720 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ab032170-b26a-4aab-a13c-eab91236a954 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1470 microversion: 2.1 time: 0.809671 Sep 18 01:29:59.557642 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2485/5015] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:29:58 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1470 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:00.586926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:00.587679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:00.602329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:00.608415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:00.610220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:00.611841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:00.614789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:00.618224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:01.773932 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:01.782806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2d93fcc6-80b8-4db3-85d6-46494ea7ed0b req-d2d1b702-7f93-405c-9741-67f622653fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79398ae-219d-4e8b-91a9-25a19f0aaeb9", "tag": "94ad4821-da7f-4a9a-9d03-58515e6a9169"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:01.822113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2d93fcc6-80b8-4db3-85d6-46494ea7ed0b req-d2d1b702-7f93-405c-9741-67f622653fb2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:01.822669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2d93fcc6-80b8-4db3-85d6-46494ea7ed0b req-d2d1b702-7f93-405c-9741-67f622653fb2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:01.823383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2d93fcc6-80b8-4db3-85d6-46494ea7ed0b req-d2d1b702-7f93-405c-9741-67f622653fb2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:01.883326 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2d93fcc6-80b8-4db3-85d6-46494ea7ed0b req-d2d1b702-7f93-405c-9741-67f622653fb2 service nova] Creating event network-changed:94ad4821-da7f-4a9a-9d03-58515e6a9169 for instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 on n-h1-master-1 Sep 18 01:30:01.912211 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2d93fcc6-80b8-4db3-85d6-46494ea7ed0b req-d2d1b702-7f93-405c-9741-67f622653fb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141268 Sep 18 01:30:01.912990 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2486/5016] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:02.234363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:02.268920 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-47794c44-c8f7-4ec9-8828-800023522389 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1470 microversion: 2.1 time: 1.685689 Sep 18 01:30:02.270873 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2531/5017] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:00 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1470 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:03.292985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:03.293822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:03.295992 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:03.303571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:03.316805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:03.323548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:03.329646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:03.330464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:03.330962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:04.166091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:04.191557 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1e68bc63-1e00-45de-b056-7dd1644fa8ae tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1470 microversion: 2.1 time: 0.902864 Sep 18 01:30:04.201108 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2487/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:03 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1470 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:05.230426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:05.231949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:05.262126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:05.262727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:05.263182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:05.270287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:05.273406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:05.278347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:06.079038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:06.107017 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-033b11c4-82d3-4ad7-a2a6-940dc4ba0a36 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1470 microversion: 2.1 time: 0.880221 Sep 18 01:30:06.122418 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2532/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:05 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1470 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:06.165604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1516042311", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "09731183-fcba-4319-a1a1-12296d7ce5f3"}, {"port": "4dc2e4b9-6db2-4e88-8f9c-d04c056bfe26", "tag": "port-1"}, {"port": "4cb81f05-c146-4d6c-be7e-00763cbe091a", "tag": "port-2"}, {"uuid": "51e737af-b5c9-49e0-a5b6-bd6381d66d64", "tag": "net-1"}, {"uuid": "51e737af-b5c9-49e0-a5b6-bd6381d66d64"}, {"uuid": "7c234198-718d-4dea-9585-1dbfa0fefe8a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7c234198-718d-4dea-9585-1dbfa0fefe8a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bdbaca72-4e9b-4117-b71b-881e995c4072", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "10844f2d-6a9a-4b2a-94e7-c2826f41a6c7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "054f237e-a7b4-49a6-814c-f72f7237ca50", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1114139239"}], "key_name": "tempest-keypair-332039213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:07.138937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:07.139567 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:07.156149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:07.161745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:07.163071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:07.164425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:07.165268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:07.165911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:07.180129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] validate_networks() for [('09731183-fcba-4319-a1a1-12296d7ce5f3', None, None, None, None, None), (None, None, '4dc2e4b9-6db2-4e88-8f9c-d04c056bfe26', None, None, None), (None, None, '4cb81f05-c146-4d6c-be7e-00763cbe091a', None, None, None), ('51e737af-b5c9-49e0-a5b6-bd6381d66d64', None, None, None, None, None), ('51e737af-b5c9-49e0-a5b6-bd6381d66d64', None, None, None, None, None), ('7c234198-718d-4dea-9585-1dbfa0fefe8a', '10.2.2.100', None, None, None, None), ('7c234198-718d-4dea-9585-1dbfa0fefe8a', '10.2.2.200', None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:30:07.971109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:07.985664 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-12eb3884-d897-4807-9f05-d9f62920c868 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1470 microversion: 2.1 time: 0.851805 Sep 18 01:30:07.989789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2533/5020] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:07 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1470 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:30:08.008281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4bd16184-8dc9-4777-b11a-bce6d30531ac req-162a5705-d680-4213-bfa2-64e784c6a078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79398ae-219d-4e8b-91a9-25a19f0aaeb9", "name": "network-vif-plugged", "status": "completed", "tag": "94ad4821-da7f-4a9a-9d03-58515e6a9169"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:08.029438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4bd16184-8dc9-4777-b11a-bce6d30531ac req-162a5705-d680-4213-bfa2-64e784c6a078 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:08.033305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4bd16184-8dc9-4777-b11a-bce6d30531ac req-162a5705-d680-4213-bfa2-64e784c6a078 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:08.035344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4bd16184-8dc9-4777-b11a-bce6d30531ac req-162a5705-d680-4213-bfa2-64e784c6a078 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:08.063491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4bd16184-8dc9-4777-b11a-bce6d30531ac req-162a5705-d680-4213-bfa2-64e784c6a078 service nova] Creating event network-vif-plugged:94ad4821-da7f-4a9a-9d03-58515e6a9169 for instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 on n-h1-master-1 Sep 18 01:30:08.082552 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4bd16184-8dc9-4777-b11a-bce6d30531ac req-162a5705-d680-4213-bfa2-64e784c6a078 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090993 Sep 18 01:30:08.083302 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2534/5021] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:09.024000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:09.024000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:09.034199 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:09.049086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:09.049735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:09.050448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:09.051786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:09.052552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:09.053179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:09.595633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:09.605026 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-71eddc40-b525-4bc1-8d63-2ba85d67bea2 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1470 microversion: 2.1 time: 0.593615 Sep 18 01:30:09.622579 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2535/5022] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:09 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1470 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:30:10.632263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:10.632869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:10.649785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:10.650286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:10.660002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:10.662521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:10.663172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:10.668793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:11.182794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:11.191287 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ffe36cd7-f4c4-4bb1-b1dd-ae5c49a14af4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1643 microversion: 2.1 time: 0.563138 Sep 18 01:30:11.192071 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2536/5023] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:10 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1643 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:11.215218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:11.220443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:11.228053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:11.229289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:11.230170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:11.231083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:11.231724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:11.232310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:11.530857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:11.539715 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d551e9ed-bf26-4de4-b786-aba2fe90d41f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1643 microversion: 2.1 time: 0.329338 Sep 18 01:30:11.546410 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2537/5024] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:11 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1643 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:11.575957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:11.576947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:11.584402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:11.592466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:11.593285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:11.594278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:11.594987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:11.595656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:12.246709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:30:12.248480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:30:12.250439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:30:12.251849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:30:12.252944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:30:12.289845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:12.293644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:12.297656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:12.305428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:12.306006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:12.306781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:12.336820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Getting quotas for project e14e7fe58a1c4c0fb68a9aa803a0888f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:30:12.354723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Getting quotas for user 6c90f881c9db4dcb9a9ecf4f8f31fc0b and project e14e7fe58a1c4c0fb68a9aa803a0888f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:30:12.420317 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a07d321-4c0d-476c-a08f-8851d7c04ebc tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1794 microversion: 2.1 time: 0.854282 Sep 18 01:30:12.444768 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2538/5025] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:11 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1794 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:30:12.775469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:30:12.779509 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bdbaca72-4e9b-4117-b71b-881e995c4072',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='10844f2d-6a9a-4b2a-94e7-c2826f41a6c7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='054f237e-a7b4-49a6-814c-f72f7237ca50',volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:30:13.785830 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-41831b7a-fee3-441c-b7aa-e64080b5d445 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.626014 Sep 18 01:30:13.796988 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2488/5026] 10.222.0.25 () {62 vars in 1189 bytes} [Sun Sep 18 01:30:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 7638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:30:13.801816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f675409-42db-4b91-917d-978160e5f496 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:13.802439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f675409-42db-4b91-917d-978160e5f496 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:13.964555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f675409-42db-4b91-917d-978160e5f496 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:13.975684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f675409-42db-4b91-917d-978160e5f496 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:13.980371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f675409-42db-4b91-917d-978160e5f496 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:13.984079 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f675409-42db-4b91-917d-978160e5f496 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1285 microversion: 2.42 time: 0.185508 Sep 18 01:30:13.989198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1714f3b0-fb75-4aad-ab48-a0320f58b059"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:13.991957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:14.005575 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2539/5027] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:13 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:30:14.043326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:14.048307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:14.051024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:14.059393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:14.062050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:14.062672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:14.366473 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Invalid volume: volume 1714f3b0-fb75-4aad-ab48-a0320f58b059 is already attached to instances: 3e5d09e1-875c-425d-9034-03287d68823d Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments HTTP/1.1 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 74 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: {"volumeAttachment": {"volumeId": "1714f3b0-fb75-4aad-ab48-a0320f58b059"}} Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid volume: volume 1714f3b0-fb75-4aad-ab48-a0320f58b059 is already attached to instances: 3e5d09e1-875c-425d-9034-03287d68823d Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '3e5d09e1-875c-425d-9034-03287d68823d', 'body': {'volumeAttachment': {'volumeId': '1714f3b0-fb75-4aad-ab48-a0320f58b059'}}} Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1714f3b0-fb75-4aad-ab48-a0320f58b059 is already attached to instances: 3e5d09e1-875c-425d-9034-03287d68823d Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:30:14.397889 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1714f3b0-fb75-4aad-ab48-a0320f58b059 is already attached to instances: 3e5d09e1-875c-425d-9034-03287d68823d Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1714f3b0-fb75-4aad-ab48-a0320f58b059 is already attached to instances: 3e5d09e1-875c-425d-9034-03287d68823d Sep 18 01:30:14.402466 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:30:14.410063 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 400 to user: Invalid volume: volume 1714f3b0-fb75-4aad-ab48-a0320f58b059 is already attached to instances: 3e5d09e1-875c-425d-9034-03287d68823d {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:30:14.416102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20eed6ff-e819-4fcd-b0c5-d3c90396cc24 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.435760 Sep 18 01:30:14.419589 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2489/5028] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:30:13 2022] POST /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 174 bytes in 441 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:30:14.600611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:14.602829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:14.745985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:14.746677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:14.757685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:14.758847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:14.762375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:14.763023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:14.967199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lazy-loading 'services' on Instance uuid 3e5d09e1-875c-425d-9034-03287d68823d {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:30:15.022366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ced7fae-7620-4886-987f-65a62eb2efab tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:15.022979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ced7fae-7620-4886-987f-65a62eb2efab tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:15.118634 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b8c2e3c-251e-4bea-b2a7-134646bc06ef tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments/1714f3b0-fb75-4aad-ab48-a0320f58b059" status: 202 len: 0 microversion: 2.1 time: 0.527200 Sep 18 01:30:15.121673 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2540/5029] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:30:14 2022] DELETE /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments/1714f3b0-fb75-4aad-ab48-a0320f58b059 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:30:15.142342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:15.151037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:15.186431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:15.188134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:15.189604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:15.192874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:15.193724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:15.195986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:15.293028 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-491f1831-3c15-414e-92bf-3b9c750619a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167696 Sep 18 01:30:15.295262 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2541/5030] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:15 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:15.347657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ced7fae-7620-4886-987f-65a62eb2efab tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:15.359201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ced7fae-7620-4886-987f-65a62eb2efab tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:15.362315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ced7fae-7620-4886-987f-65a62eb2efab tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:15.363975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ced7fae-7620-4886-987f-65a62eb2efab tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1285 microversion: 2.42 time: 0.345576 Sep 18 01:30:15.365607 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2490/5031] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:15 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1285 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:30:16.307746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:16.311291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:16.332933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:16.334745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:16.335456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:16.338310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:16.338956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:16.340609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:16.392865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cd3dc4be-0108-44cf-bce4-37f0498249e9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:16.394365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cd3dc4be-0108-44cf-bce4-37f0498249e9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:16.424560 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-242d70a0-e0fe-4a32-9c8a-5cdde030386d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121253 Sep 18 01:30:16.426387 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2542/5032] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:16 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:16.593432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cd3dc4be-0108-44cf-bce4-37f0498249e9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:16.602180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cd3dc4be-0108-44cf-bce4-37f0498249e9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:16.612441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cd3dc4be-0108-44cf-bce4-37f0498249e9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:16.614098 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cd3dc4be-0108-44cf-bce4-37f0498249e9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1285 microversion: 2.42 time: 0.226801 Sep 18 01:30:16.614841 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2491/5033] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:16 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:17.443152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:17.446088 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:17.458957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:17.460152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:17.460861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:17.462060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:17.463310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:17.464033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:17.534899 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04d904f7-f038-4396-a768-f49624598a18 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100138 Sep 18 01:30:17.536365 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2543/5034] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:17 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:17.599722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a323d466-59c4-4ace-aca2-56fe3a95e7de req-e0cf919b-83bf-4ab6-bda5-61d5b7318d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79398ae-219d-4e8b-91a9-25a19f0aaeb9", "tag": "94ad4821-da7f-4a9a-9d03-58515e6a9169"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:17.622720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a323d466-59c4-4ace-aca2-56fe3a95e7de req-e0cf919b-83bf-4ab6-bda5-61d5b7318d0b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:17.624346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a323d466-59c4-4ace-aca2-56fe3a95e7de req-e0cf919b-83bf-4ab6-bda5-61d5b7318d0b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:17.627249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a323d466-59c4-4ace-aca2-56fe3a95e7de req-e0cf919b-83bf-4ab6-bda5-61d5b7318d0b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:17.646188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:17.648019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:17.650323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a323d466-59c4-4ace-aca2-56fe3a95e7de req-e0cf919b-83bf-4ab6-bda5-61d5b7318d0b service nova] Creating event network-changed:94ad4821-da7f-4a9a-9d03-58515e6a9169 for instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 on n-h1-master-1 Sep 18 01:30:17.674079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:17.675352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:17.679345 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a323d466-59c4-4ace-aca2-56fe3a95e7de req-e0cf919b-83bf-4ab6-bda5-61d5b7318d0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084096 Sep 18 01:30:17.680089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:17.680974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:17.681326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:17.685208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:17.686205 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2492/5035] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:17.871135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:17.892616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:17.895097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:17.897370 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-127eecb7-e277-49f8-b5fd-f753fa595c88 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1575 microversion: 2.42 time: 0.256909 Sep 18 01:30:17.898506 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2544/5036] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:17 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1575 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:18.549867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:18.552584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:18.569947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:18.570802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:18.571637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:18.572547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:18.573171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:18.578479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:18.668102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b1611a6-bf89-4979-8d47-3acc53741691 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123680 Sep 18 01:30:18.678791 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2493/5037] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:18 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:18.926675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:18.928045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:18.941748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:18.942569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:18.944432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:18.946389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:18.949063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:18.949811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:19.372819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:19.389052 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:19.390842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:19.395248 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e213367e-c681-40fb-bfa4-4e916b6b2a21 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1593 microversion: 2.42 time: 0.471456 Sep 18 01:30:19.396470 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2545/5038] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:18 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1593 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:19.681522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:19.685838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:19.697946 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:19.702483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:19.705128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:19.705777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:19.706662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:19.712305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:19.712975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:19.718283 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:19.798937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ad5e58a-794d-4752-881a-dde6cd22d725 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122118 Sep 18 01:30:19.801871 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2494/5039] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:19 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:20.428500 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:20.429696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:20.436903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:20.437813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:20.439092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:20.440002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:20.440632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:20.441307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:20.472747 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:20.524688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:20.538150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:20.539956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:20.541404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26f1b06e-16a4-43aa-b31d-4bb4e1a2d625 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1593 microversion: 2.42 time: 0.119257 Sep 18 01:30:20.557591 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2546/5040] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:20 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1593 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:21.194062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:21.197796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:21.207465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:21.209064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:21.210291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:21.212278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:21.213098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:21.214630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:21.309430 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-376701af-4a86-4fee-b448-7b458914bec4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.502098 Sep 18 01:30:21.310432 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2495/5041] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:20 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 197 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:21.570101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:21.570745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:21.579972 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:21.582225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:21.582881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:21.583668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:21.584693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:21.585291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:21.586128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:21.691164 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:21.703291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:21.706203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:21.707840 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-79fd561e-f45b-4a87-9756-a3ba82711f98 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1593 microversion: 2.42 time: 0.142089 Sep 18 01:30:21.723596 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2547/5042] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:21 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:22.323776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:22.326656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:22.343365 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:22.348483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:22.350649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:22.356883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:22.358182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:22.358812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:22.359431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:22.471254 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-abfac473-145b-4885-b5f7-b458dab8778d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152584 Sep 18 01:30:22.471886 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2496/5043] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:22 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:22.738741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:22.739532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:22.758076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:22.759019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:22.760209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:22.761293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:22.763491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:22.765404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:23.353780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:23.379396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:23.389980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:23.391549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5fb7ce89-c66b-45b0-89e5-59649f73d6db tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1661 microversion: 2.42 time: 0.658198 Sep 18 01:30:23.393825 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2548/5044] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:22 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1661 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:23.485259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:23.492241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:23.517534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:23.523303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:23.525172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:23.526683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:23.528592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:23.530335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:23.610936 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c388a4f-f606-4ea3-b715-c60f1fad05fd tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130029 Sep 18 01:30:23.612051 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2497/5045] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:30:23 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:30:23.711118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:23.711967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:23.736590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:23.743160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:23.744645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:23.748585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:23.752576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:23.755445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:23.899838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:30:23.975410 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:24.170265 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b180e335-cd87-4f0a-8d67-1318e28ae96c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 204 len: 0 microversion: 2.1 time: 0.462376 Sep 18 01:30:24.171770 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2549/5046] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:30:23 2022] DELETE /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:30:24.181919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:24.182691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:24.202648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:24.203157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:24.203643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:24.213095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:24.213631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:24.218281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:24.429104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:24.429868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:24.443115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:24.443633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:24.444085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:24.444818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:24.445284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:24.450861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:24.576993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:24.595028 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88de6977-358c-4fe1-94fd-8dcd9c8d2274 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1682 microversion: 2.1 time: 0.418057 Sep 18 01:30:24.598005 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2498/5047] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:24 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:24.830209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:24.844779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:24.847031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:24.848441 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2c4f20d1-8f96-4b6b-ad3c-aa9603b5bffc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1708 microversion: 2.42 time: 0.430078 Sep 18 01:30:24.870440 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2550/5048] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:24 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1708 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:25.624591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:25.625290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:25.641118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:25.641529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:25.643596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:25.650178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:25.652187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:25.652817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:25.884893 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:25.886166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:25.897419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:25.898979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:25.899894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:25.900858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:25.901468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:25.902317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:26.214011 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:26.225631 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f72fe748-868e-4009-93d2-f790c835b253 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1682 microversion: 2.1 time: 0.606505 Sep 18 01:30:26.226238 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2499/5049] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:25 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1682 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:30:26.434932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:26.447871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:26.454452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:26.456904 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abf9fc3a-435e-4978-b4ba-0a2f12625e1f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1708 microversion: 2.42 time: 0.582395 Sep 18 01:30:26.458682 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2551/5050] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:25 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1708 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:27.254280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:27.255025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:27.264964 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:27.268027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:27.282388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:27.283026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:27.284007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:27.284585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:27.285258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:27.488609 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:27.489231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:27.504334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:27.504892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:27.505276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:27.506033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:27.506494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:27.511707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:28.310283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:28.319219 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7658578e-a78e-405b-ac12-8dcb5e0a21d1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1682 microversion: 2.1 time: 1.071844 Sep 18 01:30:28.320206 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2500/5051] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:27 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1682 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:28.372634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:28.398315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:28.411280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:28.412523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f93dfe3f-3a6e-436b-83b8-b100b746db4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1755 microversion: 2.42 time: 0.928507 Sep 18 01:30:28.413109 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2552/5052] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:27 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1755 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:30:29.353806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:29.355327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:29.377079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:29.382355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:29.384566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:29.385861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:29.390369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:29.391085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:29.443369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:29.444724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:29.473488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:29.474027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:29.474489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:29.475195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:29.475668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:29.476071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:29.819013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:29.830095 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ee1a677-e8ec-4503-9eae-3dfa36ebd362 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1614 microversion: 2.1 time: 0.483991 Sep 18 01:30:29.834368 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2501/5053] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:29 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1614 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:30.857588 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:30.858933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:30.902382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:30.907029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:30.911771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:30.916636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:30.919790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:30.921863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:30.923440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:30.929676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:30.943987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:30.947348 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f495e02d-282b-4818-9910-259130633dfb tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1755 microversion: 2.42 time: 1.509100 Sep 18 01:30:30.959742 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2553/5054] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:29 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1755 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:31.327669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:31.337406 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0937cab7-3db2-4591-a2aa-5ee4fad34f4d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 200 len: 1614 microversion: 2.1 time: 0.483844 Sep 18 01:30:31.342625 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2502/5055] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:30 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 1614 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:30:31.345223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-661c1ab9-e294-486e-a1b6-c7207153e3d4 req-94be8553-2b03-4ca4-861e-72d861d606fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e5d09e1-875c-425d-9034-03287d68823d", "name": "network-vif-deleted", "tag": "df38f3cc-8bc0-44b5-a230-ffbb48fb586c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:31.383589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-661c1ab9-e294-486e-a1b6-c7207153e3d4 req-94be8553-2b03-4ca4-861e-72d861d606fb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:31.384185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-661c1ab9-e294-486e-a1b6-c7207153e3d4 req-94be8553-2b03-4ca4-861e-72d861d606fb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:31.384961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-661c1ab9-e294-486e-a1b6-c7207153e3d4 req-94be8553-2b03-4ca4-861e-72d861d606fb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:31.406283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-661c1ab9-e294-486e-a1b6-c7207153e3d4 req-94be8553-2b03-4ca4-861e-72d861d606fb service nova] Creating event network-vif-deleted:df38f3cc-8bc0-44b5-a230-ffbb48fb586c for instance 3e5d09e1-875c-425d-9034-03287d68823d on n-h2-master-1 Sep 18 01:30:31.429259 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-661c1ab9-e294-486e-a1b6-c7207153e3d4 req-94be8553-2b03-4ca4-861e-72d861d606fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094865 Sep 18 01:30:31.432561 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2554/5056] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:30:31.991166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:31.993147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:32.033148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:32.033746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:32.039158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:32.040066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:32.040417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:32.040846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:32.372123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:32.373924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:32.391827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:32.394160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:32.396899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:32.400320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:32.401091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:32.402314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:32.436482 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d HTTP/1.1 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3e5d09e1-875c-425d-9034-03287d68823d'} Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:30:32.439106 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:30:32.444706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:30:32.444706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:30:32.444706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:30:32.444706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:30:32.444706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:30:32.444706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:30:32.444706 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:30:32.450090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:30:32.451413 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9ae1185c-a206-4a6b-8fa0-508b2535b0f7 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 404 len: 111 microversion: 2.1 time: 0.087164 Sep 18 01:30:32.452646 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2555/5057] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:32 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:30:32.464281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba545b56-ff0d-4e3f-b3e0-021093dcf8f9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '.version_select at 0x7f700511baf0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:32.503681 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba545b56-ff0d-4e3f-b3e0-021093dcf8f9 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567297203" status: 202 len: 0 microversion: 2.1 time: 0.046188 Sep 18 01:30:32.505196 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2556/5058] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:30:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567297203 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:30:33.047763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:33.077162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:33.082482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:33.087099 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f5a76394-5c30-409c-8949-d6a57e761c2a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1802 microversion: 2.42 time: 1.104316 Sep 18 01:30:33.089311 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2503/5059] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:31 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1802 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:34.118071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:34.118774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:34.141326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:34.149044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:34.154551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:34.156054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:34.163416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:34.168320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:35.364656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:35.387932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:35.400107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:35.410852 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-40ffd67c-e2c6-4582-bf27-cc0c9cb837cf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1849 microversion: 2.42 time: 1.296595 Sep 18 01:30:35.430951 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2557/5060] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:34 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1849 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:36.184682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-17963ddb-b1f8-47b6-885f-b25dc68c2b77 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: .version_select at 0x7f70063f2670>, body: {"keypair": {"name": "tempest-keypair-54544393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENenrYMYkRjWtvyKQlQAywRCDIYr6EeRHzDKyPR4xCOo/cArDp7crBi0QUKwyXTil/V6787cbzwqgB4GfuewH1ker48k+31Bl0XgwTKzRQEVeyWvW20K7rJbF9xsj4CjQ=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:36.225305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-17963ddb-b1f8-47b6-885f-b25dc68c2b77 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:30:36.243455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-17963ddb-b1f8-47b6-885f-b25dc68c2b77 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:30:36.304280 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-17963ddb-b1f8-47b6-885f-b25dc68c2b77 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.123516 Sep 18 01:30:36.305811 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2504/5061] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:30:36 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:36.459021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:36.460533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:36.479232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:36.482136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:36.483346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:36.484302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:36.485540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:36.486452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:37.233963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:37.257778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:37.259484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:37.265609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a2e7441-68f7-4f98-817a-4e648bbcb85d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1849 microversion: 2.42 time: 0.811353 Sep 18 01:30:37.267965 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2558/5062] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:36 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1849 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:37.901133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-82377892-4ef8-4e26-929e-a9494cae3608 req-4ff1393e-57ef-4979-aa07-8595a1f21ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:37.927964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-82377892-4ef8-4e26-929e-a9494cae3608 req-4ff1393e-57ef-4979-aa07-8595a1f21ef5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:37.931249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-82377892-4ef8-4e26-929e-a9494cae3608 req-4ff1393e-57ef-4979-aa07-8595a1f21ef5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:37.932818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-82377892-4ef8-4e26-929e-a9494cae3608 req-4ff1393e-57ef-4979-aa07-8595a1f21ef5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:37.993696 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-82377892-4ef8-4e26-929e-a9494cae3608 req-4ff1393e-57ef-4979-aa07-8595a1f21ef5 service nova] Creating event network-changed:54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:30:38.007983 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-82377892-4ef8-4e26-929e-a9494cae3608 req-4ff1393e-57ef-4979-aa07-8595a1f21ef5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111398 Sep 18 01:30:38.012533 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2505/5063] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:38.300819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:38.302310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:38.322125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:38.322950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:38.323746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:38.324693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:38.325638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:38.326308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:39.602403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:39.624084 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:39.627047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:39.628760 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5868ce63-00cc-4c11-909c-dabfadbcdb85 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1849 microversion: 2.42 time: 1.335667 Sep 18 01:30:39.633043 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2559/5064] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:38 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1849 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:40.662634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:40.663988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:40.686166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:40.689429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:40.693949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:40.696692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:40.697358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:40.698654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:41.688440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-366013168", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f7c6e0e-8607-495c-8bc4-13fbec48411b"}], "security_groups": [{"name": "tempest-securitygroup--265604943"}], "key_name": "tempest-keypair-54544393", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:41.709021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:41.727611 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:41.730994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:41.733921 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6e81071c-828d-404a-b4a6-77c99d756f99 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1870 microversion: 2.42 time: 1.078629 Sep 18 01:30:41.735135 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2506/5065] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:40 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1870 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:42.060330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] validate_networks() for [('8f7c6e0e-8607-495c-8bc4-13fbec48411b', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:30:42.516718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-acccfab8-f78a-4af0-b3aa-5712d1b34a55 req-db6c9cc6-2323-47fe-9200-fc9bcac9630d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "4dc2e4b9-6db2-4e88-8f9c-d04c056bfe26"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:42.542669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-acccfab8-f78a-4af0-b3aa-5712d1b34a55 req-db6c9cc6-2323-47fe-9200-fc9bcac9630d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:42.543174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-acccfab8-f78a-4af0-b3aa-5712d1b34a55 req-db6c9cc6-2323-47fe-9200-fc9bcac9630d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:42.543615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-acccfab8-f78a-4af0-b3aa-5712d1b34a55 req-db6c9cc6-2323-47fe-9200-fc9bcac9630d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:42.601389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-acccfab8-f78a-4af0-b3aa-5712d1b34a55 req-db6c9cc6-2323-47fe-9200-fc9bcac9630d service nova] Creating event network-changed:4dc2e4b9-6db2-4e88-8f9c-d04c056bfe26 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:30:42.612499 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-acccfab8-f78a-4af0-b3aa-5712d1b34a55 req-db6c9cc6-2323-47fe-9200-fc9bcac9630d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099827 Sep 18 01:30:42.614444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2507/5066] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:42.764566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:42.765362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:42.789383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:42.791551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:42.792408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:42.793362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:42.794055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:42.794730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:43.945574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:43.956488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:43.966354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:43.971391 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50e463c0-5605-441e-850e-7e8a8241bbc2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1870 microversion: 2.42 time: 1.213478 Sep 18 01:30:43.972227 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2508/5067] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:42 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1870 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:30:44.031628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:30:44.032047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:30:44.032616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:30:44.034465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:30:44.035315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:30:44.054458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:44.055304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:44.055892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:44.056794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:44.057496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:44.058257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:44.087508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:30:44.096338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Getting quotas for user fe88855efe9449a590be4319ae39005d and project 4f99682924f64752a4195424e12e2d82. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:30:44.110806 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:30:44.113637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:30:44.200337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ef9f3c86-3a97-4e9f-8c72-dff92eb6f20d tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.517797 Sep 18 01:30:44.201406 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2560/5068] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:30:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:30:44.219263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-242345ec-cea9-4604-b3ed-052689618bfc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:44.220832 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-242345ec-cea9-4604-b3ed-052689618bfc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:44.516925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-242345ec-cea9-4604-b3ed-052689618bfc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:44.527921 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-242345ec-cea9-4604-b3ed-052689618bfc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1239 microversion: 2.1 time: 0.318743 Sep 18 01:30:44.528453 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2509/5069] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:44 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1239 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:45.001647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-df60f337-fc6e-4fe1-a51b-6ef5840adf8d req-378d2695-1267-425b-8be0-4215cb91343e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "4cb81f05-c146-4d6c-be7e-00763cbe091a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:45.003928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:45.004717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:45.024934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-df60f337-fc6e-4fe1-a51b-6ef5840adf8d req-378d2695-1267-425b-8be0-4215cb91343e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:45.025434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-df60f337-fc6e-4fe1-a51b-6ef5840adf8d req-378d2695-1267-425b-8be0-4215cb91343e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:45.026146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-df60f337-fc6e-4fe1-a51b-6ef5840adf8d req-378d2695-1267-425b-8be0-4215cb91343e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:45.046434 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-df60f337-fc6e-4fe1-a51b-6ef5840adf8d req-378d2695-1267-425b-8be0-4215cb91343e service nova] Creating event network-changed:4cb81f05-c146-4d6c-be7e-00763cbe091a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:30:45.055298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:45.055892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:45.057507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:45.060413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:45.060902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:45.064215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:45.074947 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-df60f337-fc6e-4fe1-a51b-6ef5840adf8d req-378d2695-1267-425b-8be0-4215cb91343e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059794 Sep 18 01:30:45.076108 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2510/5070] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:30:45.557405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:45.560270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:45.574293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:45.575609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:45.576629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:45.579068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:45.579777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:45.580733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:45.821502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:45.835959 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92fbbb4b-636b-4c1b-81ba-0e13a9cdda33 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1291 microversion: 2.1 time: 0.285486 Sep 18 01:30:45.837364 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2511/5071] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:45 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1291 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:45.912277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:45.937895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:45.939960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:45.942125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ef5b7f93-e2ed-4d5a-90c4-1d288d4f3620 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1891 microversion: 2.42 time: 0.945409 Sep 18 01:30:45.944448 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2561/5072] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:44 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1891 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:46.864461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:46.866026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:46.893101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:46.893898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:46.894489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:46.895377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:46.897936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:46.898529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:46.975888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:46.976506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:46.998264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:46.999016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:47.002067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:47.003678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:47.005320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:47.005962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:47.207229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:47.231761 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54821faa-6b06-434e-97e3-8bedd060272a tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1297 microversion: 2.1 time: 0.359439 Sep 18 01:30:47.247102 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2512/5073] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:46 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1297 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:47.658742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:47.668993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:47.670929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:47.673769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3cb09b9c-5b7a-46d2-8fe8-ed0f6c696c37 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1891 microversion: 2.42 time: 0.702735 Sep 18 01:30:47.678946 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2562/5074] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:46 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1891 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:48.264967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:48.266671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:48.284346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:48.284853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:48.285413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:48.286178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:48.286725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:48.287046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:48.493848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:48.504866 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d76617b0-6eb7-4614-9e2f-4eced771c29b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1297 microversion: 2.1 time: 0.243689 Sep 18 01:30:48.505473 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2513/5075] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:48 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1297 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:48.573274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3f2c6403-6277-4ef4-b695-b18342205592 req-d04f1895-a9c0-42c3-9b74-5d6dba63b1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "fe99f160-71f0-4606-9e60-e36067aaf2a5"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:48.584086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3f2c6403-6277-4ef4-b695-b18342205592 req-d04f1895-a9c0-42c3-9b74-5d6dba63b1fa service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:48.584563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3f2c6403-6277-4ef4-b695-b18342205592 req-d04f1895-a9c0-42c3-9b74-5d6dba63b1fa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:48.584991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3f2c6403-6277-4ef4-b695-b18342205592 req-d04f1895-a9c0-42c3-9b74-5d6dba63b1fa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:48.600809 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3f2c6403-6277-4ef4-b695-b18342205592 req-d04f1895-a9c0-42c3-9b74-5d6dba63b1fa service nova] Creating event network-changed:fe99f160-71f0-4606-9e60-e36067aaf2a5 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:30:48.607953 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3f2c6403-6277-4ef4-b695-b18342205592 req-d04f1895-a9c0-42c3-9b74-5d6dba63b1fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037552 Sep 18 01:30:48.609110 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2563/5076] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:48.713879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:48.714560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:48.723276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:48.726001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:48.726696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:48.729016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:48.730040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:48.731177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:49.530171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:49.530877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:49.541454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:49.541980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:49.563135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:49.563926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:49.564413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:49.564849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:49.709220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:49.712042 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:49.759852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:49.770754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:49.772003 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b48ecdad-0528-46ce-8683-7f9408688129 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1891 microversion: 2.42 time: 1.063077 Sep 18 01:30:49.772906 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2514/5077] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:48 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1891 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:49.947928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:49.961149 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e4678a6e-a507-49b0-a7a9-3ef150ed2073 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.433528 Sep 18 01:30:49.961832 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2564/5078] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:49 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:30:50.805315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:50.806576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:50.810474 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:50.824812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:50.825796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:50.832137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:50.834005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:50.834841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:50.836982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:50.986621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:50.987985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:50.996749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:50.997664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:50.998397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:50.999488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:51.000774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:51.001459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:51.031615 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:51.329425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:51.341150 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31c1eb4f-81e4-468e-bf3d-9777689b7507 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.358869 Sep 18 01:30:51.346989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:51.348555 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2565/5079] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:50 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:51.373059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:51.376802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:51.383812 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78610f45-472c-40d6-9797-ae2fdc23a680 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.583756 Sep 18 01:30:51.384284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2515/5080] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:50 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:52.311742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c814e161-3f7e-4ca3-a32f-0dec9eb82e59 req-b94e68d4-41bb-40f3-bff8-5c6549f12a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "d33135cb-c28f-4fec-bab1-a5780eba555a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:52.324311 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:52.326709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c814e161-3f7e-4ca3-a32f-0dec9eb82e59 req-b94e68d4-41bb-40f3-bff8-5c6549f12a7b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:52.327361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c814e161-3f7e-4ca3-a32f-0dec9eb82e59 req-b94e68d4-41bb-40f3-bff8-5c6549f12a7b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:52.328751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c814e161-3f7e-4ca3-a32f-0dec9eb82e59 req-b94e68d4-41bb-40f3-bff8-5c6549f12a7b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:52.346037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c814e161-3f7e-4ca3-a32f-0dec9eb82e59 req-b94e68d4-41bb-40f3-bff8-5c6549f12a7b service nova] Creating event network-changed:d33135cb-c28f-4fec-bab1-a5780eba555a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:30:52.353047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c814e161-3f7e-4ca3-a32f-0dec9eb82e59 req-b94e68d4-41bb-40f3-bff8-5c6549f12a7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045062 Sep 18 01:30:52.354425 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2566/5081] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:52.369408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:52.370860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:52.378290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:52.379065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:52.379670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:52.380544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:52.381169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:52.381783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:52.411688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:52.412586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:52.426462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:52.430405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:52.431138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:52.432042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:52.432670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:52.433843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:52.879446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:52.889194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:52.891898 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:52.895954 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb435236-0e04-4a8f-94d7-af67e142c5d0 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.489827 Sep 18 01:30:52.896552 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2567/5082] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:52 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:30:52.905624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:52.917169 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-27fcc416-30ba-473a-a120-9b327b42f7b5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.551810 Sep 18 01:30:52.918061 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2516/5083] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:52 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:53.926809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:53.928936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:53.941373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:53.942833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:53.950630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:53.953323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:53.954048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:53.955483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:53.956548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:53.957285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:53.958072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:53.961352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:53.963459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:53.965711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:53.966496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:53.971559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:54.073169 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:54.105900 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:54.526041 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:30:54.680870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:54.704285 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-608c8371-e9ca-4a8b-8109-041c60fd1a9b tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.761346 Sep 18 01:30:54.708108 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2517/5084] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:53 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:30:54.730518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e2417b5c-2531-4985-9932-69bb4faffd09 req-57fc0a61-0ca2-41ef-bac7-18e761d5378e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73edbac6-82b3-4a69-aa42-b95045d27726", "tag": "b1a52326-3b5c-4429-b0ae-e52b8b36bd1b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:54.768155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:54.779056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e2417b5c-2531-4985-9932-69bb4faffd09 req-57fc0a61-0ca2-41ef-bac7-18e761d5378e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:54.779553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e2417b5c-2531-4985-9932-69bb4faffd09 req-57fc0a61-0ca2-41ef-bac7-18e761d5378e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:54.779992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e2417b5c-2531-4985-9932-69bb4faffd09 req-57fc0a61-0ca2-41ef-bac7-18e761d5378e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:54.786717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:54.794668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:54.796536 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c453f0c1-b48c-411c-8339-186b0f27d0ff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.873636 Sep 18 01:30:54.801867 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2568/5085] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:53 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:54.865419 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e2417b5c-2531-4985-9932-69bb4faffd09 req-57fc0a61-0ca2-41ef-bac7-18e761d5378e service nova] Creating event network-changed:b1a52326-3b5c-4429-b0ae-e52b8b36bd1b for instance 73edbac6-82b3-4a69-aa42-b95045d27726 on n-h1-master-1 Sep 18 01:30:54.886571 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e2417b5c-2531-4985-9932-69bb4faffd09 req-57fc0a61-0ca2-41ef-bac7-18e761d5378e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168787 Sep 18 01:30:54.887708 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2518/5086] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:55.739459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:55.742526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:55.764923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:55.766576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:55.768589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:55.769476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:55.771590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:55.772534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:55.842556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:55.844787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:55.867939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:55.868509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:55.870669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:55.873795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:55.874305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:55.874903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:56.247996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:56.261453 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a3ec1b7-668a-4c68-8906-4a437645b7a2 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.529669 Sep 18 01:30:56.264524 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2569/5087] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:55 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:56.312931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:56.332003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:56.333484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:56.334736 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d39abfb1-abbf-42fe-9df7-680bd5891a97 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.506469 Sep 18 01:30:56.342025 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2519/5088] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:55 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:56.967018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c300aca3-f00d-408d-aba3-c5b380a4ec6d req-01483eed-ae95-4b5c-8563-7f1a65e26f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "fddbdb0d-62d9-4264-a95b-6cfdc8a06749"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:56.989111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c300aca3-f00d-408d-aba3-c5b380a4ec6d req-01483eed-ae95-4b5c-8563-7f1a65e26f6d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:56.993329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c300aca3-f00d-408d-aba3-c5b380a4ec6d req-01483eed-ae95-4b5c-8563-7f1a65e26f6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:56.993857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c300aca3-f00d-408d-aba3-c5b380a4ec6d req-01483eed-ae95-4b5c-8563-7f1a65e26f6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:57.028783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c300aca3-f00d-408d-aba3-c5b380a4ec6d req-01483eed-ae95-4b5c-8563-7f1a65e26f6d service nova] Creating event network-changed:fddbdb0d-62d9-4264-a95b-6cfdc8a06749 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:30:57.035786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c300aca3-f00d-408d-aba3-c5b380a4ec6d req-01483eed-ae95-4b5c-8563-7f1a65e26f6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072640 Sep 18 01:30:57.037020 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2570/5089] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:30:57.294618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:57.295260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:57.314067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:57.316289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:57.316928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:57.318497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:57.320598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:57.322998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:57.361514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:57.363349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:57.376396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:57.379190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:57.381440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:57.384507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:57.387043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:57.387711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:57.877529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:57.887095 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1cb199a6-2650-418b-bd64-1a0192a78980 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.600239 Sep 18 01:30:57.894175 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2520/5090] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:57 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:57.978656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:58.011092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:58.017659 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:58.021349 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abd52769-c8bc-4578-b642-bc6bd5e67434 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.664291 Sep 18 01:30:58.024924 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2571/5091] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:57 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:30:58.920153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:58.925955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:58.944173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:58.947735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:58.949355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:58.951726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:58.953294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:58.954762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:59.048948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:30:59.049589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:30:59.061023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:59.065140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:59.065905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:59.068776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:59.070208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:59.072656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:59.685006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:59.697107 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dda4d11a-7ac7-4ed1-a0df-586c4ebef2e4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.780281 Sep 18 01:30:59.699457 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2521/5092] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:30:58 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:30:59.712324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-64a1f6cb-3de5-4e36-a4c9-0fd3f1ffc413 req-f16727ee-38a6-4e06-9bdc-486ebc3c40db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "bce09105-fb4a-4f06-b514-bb0b783a9256"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:30:59.738383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-64a1f6cb-3de5-4e36-a4c9-0fd3f1ffc413 req-f16727ee-38a6-4e06-9bdc-486ebc3c40db service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:30:59.738976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-64a1f6cb-3de5-4e36-a4c9-0fd3f1ffc413 req-f16727ee-38a6-4e06-9bdc-486ebc3c40db service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:30:59.740745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-64a1f6cb-3de5-4e36-a4c9-0fd3f1ffc413 req-f16727ee-38a6-4e06-9bdc-486ebc3c40db service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:30:59.772731 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-64a1f6cb-3de5-4e36-a4c9-0fd3f1ffc413 req-f16727ee-38a6-4e06-9bdc-486ebc3c40db service nova] Creating event network-changed:bce09105-fb4a-4f06-b514-bb0b783a9256 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:30:59.781015 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-64a1f6cb-3de5-4e36-a4c9-0fd3f1ffc413 req-f16727ee-38a6-4e06-9bdc-486ebc3c40db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080120 Sep 18 01:30:59.782059 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2522/5093] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:30:59.963175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:59.982287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:59.984692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:30:59.989051 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63ff8ac5-5baa-4ab3-859e-fbee7d9a4416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.944710 Sep 18 01:30:59.991758 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2572/5094] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:30:59 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:31:00.727352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:00.728887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:00.765692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:00.768107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:00.768909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:00.771776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:00.772439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:00.778228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:01.024492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:01.024492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:01.040886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:01.047371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:01.047847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:01.048790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:01.049275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:01.049734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:01.512388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:01.522323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12f07ebd-677a-4f9b-8de4-0e92be6adfc5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 0.801510 Sep 18 01:31:01.523237 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2523/5095] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:00 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:01.624166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:01.644470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:01.646514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:01.647360 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adbe0d1d-9a42-47a5-a6e3-b512b7df765a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.628719 Sep 18 01:31:01.648268 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2573/5096] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:01 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:31:01.997415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4c3924e6-2414-4b4a-97b7-9919bb338fc7 req-b2e3a544-40b6-4e50-9996-d3cbd9dbde83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73edbac6-82b3-4a69-aa42-b95045d27726", "name": "network-vif-plugged", "status": "completed", "tag": "b1a52326-3b5c-4429-b0ae-e52b8b36bd1b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:02.017410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4c3924e6-2414-4b4a-97b7-9919bb338fc7 req-b2e3a544-40b6-4e50-9996-d3cbd9dbde83 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:02.018287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4c3924e6-2414-4b4a-97b7-9919bb338fc7 req-b2e3a544-40b6-4e50-9996-d3cbd9dbde83 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:02.018856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4c3924e6-2414-4b4a-97b7-9919bb338fc7 req-b2e3a544-40b6-4e50-9996-d3cbd9dbde83 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:02.040663 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4c3924e6-2414-4b4a-97b7-9919bb338fc7 req-b2e3a544-40b6-4e50-9996-d3cbd9dbde83 service nova] Creating event network-vif-plugged:b1a52326-3b5c-4429-b0ae-e52b8b36bd1b for instance 73edbac6-82b3-4a69-aa42-b95045d27726 on n-h1-master-1 Sep 18 01:31:02.048349 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4c3924e6-2414-4b4a-97b7-9919bb338fc7 req-b2e3a544-40b6-4e50-9996-d3cbd9dbde83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260163 Sep 18 01:31:02.056734 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2524/5097] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:02.549658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:02.550980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:02.558251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:02.558741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:02.559180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:02.559887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:02.560342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:02.560767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:02.679215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:02.680290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:02.701881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:02.708912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:02.714811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:02.721945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:02.722740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:02.726203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:03.728755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:03.741074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:03.753654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:03.755243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b46d286f-b669-4f6c-8cc0-be32eacf88c5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 1.080699 Sep 18 01:31:03.756049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2525/5098] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:02 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:03.793234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:03.812830 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-096bdfa7-99c6-4f6a-897c-3d82aa439216 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1364 microversion: 2.1 time: 1.265367 Sep 18 01:31:03.813641 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2574/5099] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:02 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1364 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:04.689124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1536649036", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "d3357cfe-48a8-4060-bccf-c0feb86c3b10"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1737935857", "security_groups": []}, "os:scheduler_hints": {"different_host": ["e79398ae-219d-4e8b-91a9-25a19f0aaeb9"]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:04.798528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:04.799223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:04.827034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:04.846574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:04.846909 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] validate_networks() for [('d3357cfe-48a8-4060-bccf-c0feb86c3b10', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:31:04.847366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:04.850274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:04.850947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:04.853148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:05.928190 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:05.971255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:05.977603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:05.986161 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14da08a2-1835-49f1-929f-efe875256190 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 1.198878 Sep 18 01:31:06.009730 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2575/5100] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:04 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:06.023865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:06.026755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:06.043716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:06.047610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:06.048664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:06.050039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:06.050894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:06.052292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:06.766909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:06.773253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:31:06.774684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:31:06.775175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:31:06.775698 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b999af9a-0a47-4c1a-965b-a2b8f5af88c6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1554 microversion: 2.1 time: 0.760577 Sep 18 01:31:06.775831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:31:06.776179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:31:06.776282 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2576/5101] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:06 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1554 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:06.787215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:06.787708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:06.788153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:06.788893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:06.789355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:06.789980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:06.804311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:06.804750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:06.814464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:06.814967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:06.815493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:06.816426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:06.816933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:06.817461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:06.835456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Getting quotas for project ec1bd6811ab14757abb1d3d7e8c1924f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:31:06.848244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Getting quotas for user 32482797a12e43bba5da043b05ebe983 and project ec1bd6811ab14757abb1d3d7e8c1924f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:31:06.883676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:31:06.886322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:31:06.976817 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e29d63e-f807-4576-9fe4-ffeaedaff1e6 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176290 Sep 18 01:31:06.986104 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2577/5102] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 01:31:06 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:07.012697 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-70c9ce8f-d468-4bbe-9882-47d23b966f4d tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.327311 Sep 18 01:31:07.013812 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2526/5103] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:31:04 2022] POST /compute/v2.1/servers => generated 361 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:31:07.018582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:07.019535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:07.026345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d6f3a6f-290f-4df3-81a4-44abcf1b8ce8 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:07.027208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d6f3a6f-290f-4df3-81a4-44abcf1b8ce8 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:07.029600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:07.034237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:07.034780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:07.035530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:07.039512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:07.041218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:07.194303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d6f3a6f-290f-4df3-81a4-44abcf1b8ce8 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:07.223078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d6f3a6f-290f-4df3-81a4-44abcf1b8ce8 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1242 microversion: 2.1 time: 0.201421 Sep 18 01:31:07.225087 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2527/5104] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:07 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1242 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:07.570966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:07.587637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:07.589613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:07.591884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68d85499-0f5e-48ad-9240-844a755f1467 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.579959 Sep 18 01:31:07.611221 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2578/5105] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:07 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:31:08.270995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:08.271787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:08.290190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:08.291053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:08.295068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:08.299369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:08.300341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:08.302212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:08.537206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:08.548710 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6db3c6b-98e2-425a-940c-3c370c5c2d3e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1238 microversion: 2.1 time: 0.300197 Sep 18 01:31:08.579346 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2528/5106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:08 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1238 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:08.629666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:08.631194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:08.643368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:08.643900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:08.644316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:08.645037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:08.645906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:08.646420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:09.576731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:09.577999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:09.598044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:09.598531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:09.602094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:09.603139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:09.603859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:09.607243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:09.652184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:09.682795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:09.685649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:09.687934 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-074dec4d-d151-4b5c-b407-226195805e67 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 1.066420 Sep 18 01:31:09.707042 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2579/5107] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:08 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:09.946634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:09.999950 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bfedfc96-53f0-413e-bf19-610978b587a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.418874 Sep 18 01:31:10.012737 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2529/5108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:09 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:31:10.720768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:10.722577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:10.738175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:10.739165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:10.740143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:10.741222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:10.743143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:10.745884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:10.919009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5880d3d7-7274-4745-bab1-268763645cd8 req-50c8976d-31f6-4f16-bb90-d8fc5d874246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73edbac6-82b3-4a69-aa42-b95045d27726", "tag": "b1a52326-3b5c-4429-b0ae-e52b8b36bd1b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:10.941636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5880d3d7-7274-4745-bab1-268763645cd8 req-50c8976d-31f6-4f16-bb90-d8fc5d874246 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:10.944413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5880d3d7-7274-4745-bab1-268763645cd8 req-50c8976d-31f6-4f16-bb90-d8fc5d874246 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:10.944967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5880d3d7-7274-4745-bab1-268763645cd8 req-50c8976d-31f6-4f16-bb90-d8fc5d874246 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:10.984671 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5880d3d7-7274-4745-bab1-268763645cd8 req-50c8976d-31f6-4f16-bb90-d8fc5d874246 service nova] Creating event network-changed:b1a52326-3b5c-4429-b0ae-e52b8b36bd1b for instance 73edbac6-82b3-4a69-aa42-b95045d27726 on n-h1-master-1 Sep 18 01:31:11.000476 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5880d3d7-7274-4745-bab1-268763645cd8 req-50c8976d-31f6-4f16-bb90-d8fc5d874246 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084127 Sep 18 01:31:11.010370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2530/5109] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:11.068047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:11.069783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:11.087523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:11.088328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:11.090583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:11.091616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:11.096376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:11.098074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:11.351889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:11.382965 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a6371ad-6ecb-4435-95a8-5be36a16ed0f tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.342226 Sep 18 01:31:11.390091 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2531/5110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:11 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:11.431300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:11.448001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:11.464713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:11.471591 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0349fa48-abc0-4f89-8690-ed347951866f tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.756239 Sep 18 01:31:11.480303 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2580/5111] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:10 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:12.413154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:12.414557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:12.433800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:12.435870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:12.438709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:12.439674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:12.441264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:12.443447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:12.517674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:12.518908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:12.545482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:12.546787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:12.547408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:12.548354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:12.549360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:12.550221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:12.742672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:12.763139 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ba6bf8ce-f01a-4588-9c5f-50d8f2124b6e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.353931 Sep 18 01:31:12.769596 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2532/5112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:12 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:13.299738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:13.331603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:13.334317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:13.339183 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e035c05-4a3d-4376-b2c2-9c0f76915e01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.827272 Sep 18 01:31:13.352727 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2581/5113] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:12 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:13.799587 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:13.800553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:13.821146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:13.824803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:13.826630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:13.828329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:13.830251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:13.831989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:14.074436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:14.087917 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e615d172-c6d4-421d-9b8f-52f4f5e0c7e4 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.298400 Sep 18 01:31:14.089963 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2533/5114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:13 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:14.368374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:14.369029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:14.394970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:14.395819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:14.396499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:14.397494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:14.398232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:14.398914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:14.525707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-fb80c797-227a-492f-903e-0f919304ac63 req-5f253c24-3ef3-4fd7-bb9a-c6a29ee4fc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36", "tag": "e89f3c08-a32a-491d-8a80-46c1fda13b79"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:14.541132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fb80c797-227a-492f-903e-0f919304ac63 req-5f253c24-3ef3-4fd7-bb9a-c6a29ee4fc31 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:14.541754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fb80c797-227a-492f-903e-0f919304ac63 req-5f253c24-3ef3-4fd7-bb9a-c6a29ee4fc31 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:14.542278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fb80c797-227a-492f-903e-0f919304ac63 req-5f253c24-3ef3-4fd7-bb9a-c6a29ee4fc31 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:14.556675 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-fb80c797-227a-492f-903e-0f919304ac63 req-5f253c24-3ef3-4fd7-bb9a-c6a29ee4fc31 service nova] Creating event network-changed:e89f3c08-a32a-491d-8a80-46c1fda13b79 for instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 on n-h2-master-1 Sep 18 01:31:14.564076 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-fb80c797-227a-492f-903e-0f919304ac63 req-5f253c24-3ef3-4fd7-bb9a-c6a29ee4fc31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417723 Sep 18 01:31:14.565858 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2582/5115] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:14.903529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:14.919225 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:14.922032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:14.923415 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40589609-e156-45d9-ac39-887ac4bdd38a tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.559080 Sep 18 01:31:14.925031 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2534/5116] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:14 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:31:15.117078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:15.118333 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:15.125680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:15.126171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:15.126605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:15.127309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:15.127760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:15.128181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:15.310181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:15.335750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-49cda1ca-40bc-439b-a51d-c05343f96f8e tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.220402 Sep 18 01:31:15.345603 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2583/5117] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:15 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:15.956477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:15.957107 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:15.974358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:15.974857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:15.975299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:15.976073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:15.976532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:15.976957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:16.364819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:16.365906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:16.380147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:16.380652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:16.381095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:16.382012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:16.382712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:16.383363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:16.409850 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:16.420330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:16.423489 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:16.443518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:16.444886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:16.451693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-28dc9adc-eab9-4807-b096-6d1a7897535e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.500000 Sep 18 01:31:16.452663 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2535/5118] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:15 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:16.566709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:16.582461 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d1eb99fd-88bf-435f-967c-13ab158b759a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.226008 Sep 18 01:31:16.584049 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2584/5119] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:16 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:31:17.479665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:17.480342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:17.482352 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:17.484088 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:17.499801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:17.500380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:17.500916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:17.505688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:17.506177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:17.506680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:17.606473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:17.607275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:17.615955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:17.616448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:17.616898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:17.618094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:17.622107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:17.622586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:17.916480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:17.926520 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-da1cfa6e-5a5a-47a3-b4cd-3ad3b9fe457c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.323833 Sep 18 01:31:17.927112 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2585/5120] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:17 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:18.047532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:18.067871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:18.069954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:18.071514 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0abf255d-4d11-47f1-8cc9-220c38320836 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.596412 Sep 18 01:31:18.072495 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2536/5121] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:17 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:18.952938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:18.953946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:18.966165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:18.966664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:18.967123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:18.967879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:18.970269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:18.973846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:19.120728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:19.122930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:19.155360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:19.157775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:19.169447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:19.174161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:19.181345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:19.184348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:19.184959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:19.186323 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9558029c-e87e-487f-8f23-aec9873f6df3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.236387 Sep 18 01:31:19.186323 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2586/5122] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:18 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:19.513429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:19.534863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:19.537445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:19.540987 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e74909aa-467d-4567-80ab-67cf226ad010 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.446250 Sep 18 01:31:19.545112 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2537/5123] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:19 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:31:20.212305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:20.213344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:20.224987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:20.227845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:20.230335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:20.231162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:20.234122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:20.234722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:20.470405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c4d3e0e8-047c-4763-82f3-eeeec4c9ebab req-8a50b22b-5707-4a7f-b09e-c86103120902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36", "name": "network-vif-plugged", "status": "completed", "tag": "e89f3c08-a32a-491d-8a80-46c1fda13b79"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:20.503534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c4d3e0e8-047c-4763-82f3-eeeec4c9ebab req-8a50b22b-5707-4a7f-b09e-c86103120902 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:20.504319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c4d3e0e8-047c-4763-82f3-eeeec4c9ebab req-8a50b22b-5707-4a7f-b09e-c86103120902 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:20.505042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c4d3e0e8-047c-4763-82f3-eeeec4c9ebab req-8a50b22b-5707-4a7f-b09e-c86103120902 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:20.517208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:20.522098 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c4d3e0e8-047c-4763-82f3-eeeec4c9ebab req-8a50b22b-5707-4a7f-b09e-c86103120902 service nova] Creating event network-vif-plugged:e89f3c08-a32a-491d-8a80-46c1fda13b79 for instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 on n-h2-master-1 Sep 18 01:31:20.531355 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa21707a-dd93-4740-8a28-cbc7d8cd6a58 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.326547 Sep 18 01:31:20.538110 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c4d3e0e8-047c-4763-82f3-eeeec4c9ebab req-8a50b22b-5707-4a7f-b09e-c86103120902 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070834 Sep 18 01:31:20.538771 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2538/5124] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:20.542181 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2587/5125] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:20 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:20.595227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:20.596162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:20.619755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:20.622647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:20.622984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:20.625058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:20.625717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:20.626806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:20.993010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:21.003281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:21.005097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:21.007268 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9bbc67cc-f6aa-4277-8f5d-c88c461fe921 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.417480 Sep 18 01:31:21.009087 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2539/5126] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:20 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:21.572969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:21.574916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:21.588581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:21.589077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:21.589504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:21.590264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:21.590730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:21.591165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:21.767143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:21.780684 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21527223-c86d-47ef-b212-0bf39cd5e357 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1300 microversion: 2.1 time: 0.215267 Sep 18 01:31:21.781302 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2588/5127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:21 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1300 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:22.049886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:22.051243 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:22.054948 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:22.073272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:22.073272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:22.073272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:22.073272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:22.073272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:22.073272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:22.517176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:22.529619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:22.531700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:22.532912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-894bca5d-c4fb-40c2-979e-6b55a311177c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.489367 Sep 18 01:31:22.533627 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2540/5128] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:22 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:22.810816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:22.813036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:22.821981 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=46 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:22.833681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:22.834627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:22.835405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:22.836366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:22.837046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:22.837714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:22.964584 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:22.975997 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cedeaf98-7bb9-4f17-a6f8-e54cf2813869 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1473 microversion: 2.1 time: 0.172766 Sep 18 01:31:22.976757 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2589/5129] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:22 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1473 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:23.001496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:23.002725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:23.013291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.014996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.015882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.016923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.017810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.018922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.130065 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:23.140742 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c30aa7c-6dd2-408c-8be4-33fdd97f54e3 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1473 microversion: 2.1 time: 0.143747 Sep 18 01:31:23.142987 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2541/5130] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:22 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1473 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:23.164701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:23.165343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:23.171948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.172456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.172899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.173633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.174103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.174515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.305812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-680b2cd2-d30e-4735-94a5-6c272a5eb007 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1624 microversion: 2.1 time: 0.144800 Sep 18 01:31:23.306203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2590/5131] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:23 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1624 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:23.328682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:23.329469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:23.339149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.339700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.345457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.346605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.350996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.351769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.590967 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fab31f0-5677-4d72-9120-f2402249c7a1 tempest-TestSecurityGroupsBasicOps-918580512 tempest-TestSecurityGroupsBasicOps-918580512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1912 microversion: 2.1 time: 0.267536 Sep 18 01:31:23.591803 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2542/5132] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:23 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1912 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:23.615561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:23.617724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:23.626038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.626828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.627482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.628395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.629305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.630785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.696504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:23.697019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:23.705033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.705832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.706801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.708003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.708764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.709636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.759054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:31:23.892268 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a3b7dea5-5211-4f44-a4de-e9ea45c15792 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 204 len: 0 microversion: 2.1 time: 0.199494 Sep 18 01:31:23.894027 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2543/5133] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:31:23 2022] DELETE /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:31:23.907281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:23.908243 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:23.918908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.920079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.920972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:23.922274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:23.923053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:23.923638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:24.053017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:24.071071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:24.072916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:24.074196 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-38940632-e408-4968-af60-2a5f35a80fd8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.462819 Sep 18 01:31:24.075120 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2591/5134] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:23 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:24.112029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:24.122814 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1616e6a9-cbbc-4397-82fe-ee39d1b3151c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1479 microversion: 2.1 time: 0.223640 Sep 18 01:31:24.135173 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2544/5135] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:23 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1479 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:31:25.112392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:25.113129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:25.133719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:25.133719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:25.133719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:25.133719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:25.134019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:25.134358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:25.152189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:25.152757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:25.161523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:25.162267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:25.162904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:25.163622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:25.164079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:25.164546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:25.440096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:25.449002 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7e923cb2-fbb9-4100-a301-19d22811f671 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1479 microversion: 2.1 time: 0.302713 Sep 18 01:31:25.449913 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2545/5136] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:25 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1479 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:25.585335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:25.596484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:25.608253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:25.610128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0a88f99-c143-4062-baae-feb7f9583d49 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.504391 Sep 18 01:31:25.611133 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2592/5137] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:25 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:26.485785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:26.486422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:26.502841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:26.503350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:26.503797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:26.504534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:26.505006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:26.521335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:26.638395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:26.639011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:26.661772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:26.663016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:26.663672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:26.664591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:26.665578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:26.674981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:26.791185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:26.801582 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d291f5a4-82db-4ef7-8d27-d517b7338368 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 200 len: 1479 microversion: 2.1 time: 0.320724 Sep 18 01:31:26.802386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2546/5138] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:26 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 1479 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:27.031041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8e7e8c8a-67f3-4afc-9692-ecb52606134b req-c28728f0-0c32-4729-95f7-b15bfae637e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36", "name": "network-vif-deleted", "tag": "e89f3c08-a32a-491d-8a80-46c1fda13b79"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:27.067657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8e7e8c8a-67f3-4afc-9692-ecb52606134b req-c28728f0-0c32-4729-95f7-b15bfae637e2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:27.069617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8e7e8c8a-67f3-4afc-9692-ecb52606134b req-c28728f0-0c32-4729-95f7-b15bfae637e2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:27.073011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8e7e8c8a-67f3-4afc-9692-ecb52606134b req-c28728f0-0c32-4729-95f7-b15bfae637e2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:27.105714 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8e7e8c8a-67f3-4afc-9692-ecb52606134b req-c28728f0-0c32-4729-95f7-b15bfae637e2 service nova] Creating event network-vif-deleted:e89f3c08-a32a-491d-8a80-46c1fda13b79 for instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 on n-h2-master-1 Sep 18 01:31:27.116460 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8e7e8c8a-67f3-4afc-9692-ecb52606134b req-c28728f0-0c32-4729-95f7-b15bfae637e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095230 Sep 18 01:31:27.124406 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2547/5139] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:27.185237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:27.203009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:27.204610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:27.212849 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db45f107-3766-4baa-ab1f-bd6f7c2c825e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.578264 Sep 18 01:31:27.216016 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2593/5140] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:26 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:31:27.825332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:27.826137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:27.841288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:27.842005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:27.843633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:27.845721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:27.848581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:27.849239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:27.930288 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] HTTP exception thrown: Instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 could not be found. Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Request method failure captured: Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 HTTP/1.1 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnR3wIJZyNeSktBYP6cRSa0y3yWav6T9kZkOzPq9V7c7z1J4E2GPZXGFZRlDNjTaFX5nx-PZxMLLM6f0C-EPoEKBllmO9nuOyiWEBORFIQeaAoh7_dy6HF222c50tJuxWelViBsbVeEni8RnIxe5Hm-0rWTcRlFgl-K-v-8kYXlADbY Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: ec1bd6811ab14757abb1d3d7e8c1924f Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-952061252 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestSecurityGroupsBasicOps-952061252 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: ec1bd6811ab14757abb1d3d7e8c1924f Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-952061252 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestSecurityGroupsBasicOps-952061252-project Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 32482797a12e43bba5da043b05ebe983 Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestSecurityGroupsBasicOps-952061252-project Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 could not be found. Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36'} Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 could not be found. Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 could not be found. Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:31:27.932190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:31:27.937231 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:31:27.937231 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:31:27.937231 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:31:27.937231 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:31:27.937231 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:31:27.937231 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 could not be found. Sep 18 01:31:27.937231 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:31:27.939215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Returning 404 to user: Instance 0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:31:27.940568 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d4b07ef7-c0f8-499c-940a-89dfe3c57fdf tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36" status: 404 len: 111 microversion: 2.1 time: 0.119778 Sep 18 01:31:27.941396 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2548/5141] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:27 2022] GET /compute/v2.1/servers/0b16ea9d-1a81-42bd-ab46-b7aeffd3ee36 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:31:28.247952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:28.248679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:28.269706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:28.270574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:28.271027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:28.271755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:28.272221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:28.272649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:28.844477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:28.862634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:28.866033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:28.872853 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c111b54e-ae68-4d79-989f-2791bc6bbcff tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.631472 Sep 18 01:31:28.873871 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2594/5142] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:28 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:29.906050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:29.906669 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:29.920417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:29.921039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:29.929755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:29.930953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:29.932020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:29.932799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:30.646720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:30.664815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:30.671157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:30.688060 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ff32a5e-4525-4202-8511-a159e8791cc8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.773417 Sep 18 01:31:30.694941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2549/5143] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:29 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:31.729986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:31.730635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:31.758865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:31.763488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:31.763955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:31.768113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:31.771398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:31.771857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:32.325633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:32.344353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:32.346332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:32.347518 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-54f015fa-e1fd-4925-b2f0-a479309d808d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.629611 Sep 18 01:31:32.348866 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2595/5144] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:31 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:33.376803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:33.379173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:33.408637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:33.412402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:33.413297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:33.416313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:33.418031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:33.418927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:33.788005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:33.799180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:33.801102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:33.802720 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c595410e-52c7-4003-9f1c-43c1190358e5 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.430254 Sep 18 01:31:33.803580 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2550/5145] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:33 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:34.846308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:34.850771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:34.872840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:34.874432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:34.875111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:34.876357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:34.877040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:34.877943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:35.375383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:35.402021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:35.404325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:35.409146 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-850fefac-f19a-484c-bf4a-9f3370cd808e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.572321 Sep 18 01:31:35.426435 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2596/5146] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:34 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:36.083644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:36.084175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:36.099655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:36.100204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:36.100663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:36.101412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:36.101940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:36.102569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:36.184193 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7c3b94e-3297-4b87-9a2e-106374ac2699 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/ips" status: 200 len: 150 microversion: 2.1 time: 0.106182 Sep 18 01:31:36.187239 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2551/5147] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:31:36 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/ips => generated 150 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:36.462606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:36.479805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:36.548453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:36.549292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:36.559509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:36.561611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:36.563865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:36.564307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:37.333858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:37.343966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:37.354058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:37.359090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9db888e-c8ed-4353-892f-46e09b2297ed tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.916148 Sep 18 01:31:37.362747 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2597/5148] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:36 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:38.076487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-15081c05-e9c7-459a-bf44-be40b3966f69 req-4b984f9a-faf3-4f09-a420-36916ca799b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-plugged", "status": "completed", "tag": "fe99f160-71f0-4606-9e60-e36067aaf2a5"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:38.106937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-15081c05-e9c7-459a-bf44-be40b3966f69 req-4b984f9a-faf3-4f09-a420-36916ca799b9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:38.107431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-15081c05-e9c7-459a-bf44-be40b3966f69 req-4b984f9a-faf3-4f09-a420-36916ca799b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:38.108425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-15081c05-e9c7-459a-bf44-be40b3966f69 req-4b984f9a-faf3-4f09-a420-36916ca799b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:38.165639 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-15081c05-e9c7-459a-bf44-be40b3966f69 req-4b984f9a-faf3-4f09-a420-36916ca799b9 service nova] Creating event network-vif-plugged:fe99f160-71f0-4606-9e60-e36067aaf2a5 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:38.179461 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-15081c05-e9c7-459a-bf44-be40b3966f69 req-4b984f9a-faf3-4f09-a420-36916ca799b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107461 Sep 18 01:31:38.205605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2552/5149] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:38.393000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:38.393662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:38.406700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:38.407197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:38.407634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:38.408341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:38.408794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:38.409216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:39.286684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "858a4186-91a3-4dae-890d-cb68bc5633aa"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:39.289309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:39.332077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:39.333530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:39.337894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:39.338775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:39.339365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:39.339893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:39.522455 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:39.688408 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:39.717375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:39.726433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:39.738450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b946b7a5-a492-4e5c-9be8-01e1debf2cf7 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 1.344434 Sep 18 01:31:39.742627 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2598/5150] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:38 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:39.995775 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a2ab27e6-2e18-42e8-8900-f242880410b8 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "POST /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706138 Sep 18 01:31:40.001276 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2553/5151] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:31:39 2022] POST /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:40.469420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:40.470159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:40.489109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:40.500935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:40.501870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:40.502657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:40.503136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:40.503581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:40.520530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-935c3fbe-9685-4c2c-bb32-8a91a8dcebd1 req-86a594eb-7743-4908-8fa5-bca47324bbae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79398ae-219d-4e8b-91a9-25a19f0aaeb9", "tag": "94ad4821-da7f-4a9a-9d03-58515e6a9169"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:40.548822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-935c3fbe-9685-4c2c-bb32-8a91a8dcebd1 req-86a594eb-7743-4908-8fa5-bca47324bbae service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:40.549892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-935c3fbe-9685-4c2c-bb32-8a91a8dcebd1 req-86a594eb-7743-4908-8fa5-bca47324bbae service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:40.550872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-935c3fbe-9685-4c2c-bb32-8a91a8dcebd1 req-86a594eb-7743-4908-8fa5-bca47324bbae service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:40.579189 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-935c3fbe-9685-4c2c-bb32-8a91a8dcebd1 req-86a594eb-7743-4908-8fa5-bca47324bbae service nova] Creating event network-changed:94ad4821-da7f-4a9a-9d03-58515e6a9169 for instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 on n-h1-master-1 Sep 18 01:31:40.584482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:31:40.600065 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-935c3fbe-9685-4c2c-bb32-8a91a8dcebd1 req-86a594eb-7743-4908-8fa5-bca47324bbae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091562 Sep 18 01:31:40.601531 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2554/5152] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:31:40.708145 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:40.779067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:40.781303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:40.810417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:40.813111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:40.827446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:40.832376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:40.833366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:40.835427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:40.848433 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-baf8f282-6029-479e-b998-62fcaf11bc0a tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 204 len: 0 microversion: 2.1 time: 0.387829 Sep 18 01:31:40.849918 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2599/5153] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:31:40 2022] DELETE /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:31:40.877193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:40.879597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:40.970271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:40.970886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:40.971337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:40.983411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:40.984357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:40.994896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:41.590680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:41.605044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:41.613302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:41.615207 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-297c6505-c388-4683-a7b8-8153b7485d69 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.844399 Sep 18 01:31:41.649859 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2555/5154] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:40 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:41.658633 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-287de41e-f5f2-4887-be9f-494763dd0f27 req-36b786c1-2b33-4a61-9f15-9c57251b8b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-plugged", "status": "completed", "tag": "4cb81f05-c146-4d6c-be7e-00763cbe091a"}, {"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-plugged", "status": "completed", "tag": "fddbdb0d-62d9-4264-a95b-6cfdc8a06749"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:41.671479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-287de41e-f5f2-4887-be9f-494763dd0f27 req-36b786c1-2b33-4a61-9f15-9c57251b8b7a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:41.672363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-287de41e-f5f2-4887-be9f-494763dd0f27 req-36b786c1-2b33-4a61-9f15-9c57251b8b7a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:41.672970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-287de41e-f5f2-4887-be9f-494763dd0f27 req-36b786c1-2b33-4a61-9f15-9c57251b8b7a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:41.689771 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-287de41e-f5f2-4887-be9f-494763dd0f27 req-36b786c1-2b33-4a61-9f15-9c57251b8b7a service nova] Creating event network-vif-plugged:4cb81f05-c146-4d6c-be7e-00763cbe091a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:41.690574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-287de41e-f5f2-4887-be9f-494763dd0f27 req-36b786c1-2b33-4a61-9f15-9c57251b8b7a service nova] Creating event network-vif-plugged:fddbdb0d-62d9-4264-a95b-6cfdc8a06749 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:41.697407 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-287de41e-f5f2-4887-be9f-494763dd0f27 req-36b786c1-2b33-4a61-9f15-9c57251b8b7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044333 Sep 18 01:31:41.699114 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2556/5155] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:41.722420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:41.730691 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a7354b66-a4e2-4596-b27d-65ff7439ea6c tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1767 microversion: 2.1 time: 0.876351 Sep 18 01:31:41.745812 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2600/5156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:40 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1767 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:42.648188 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:42.648938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:42.664129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:42.665873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:42.666643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:42.698874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:42.700953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:42.703120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:42.757375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:42.758186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:42.797136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:42.797136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:42.797136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:42.797136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:42.797136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:42.797136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:43.352932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:43.367135 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:43.374491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:43.378910 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-02961b39-ab3b-42a0-8499-2c1af79eb416 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.734995 Sep 18 01:31:43.398733 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2557/5157] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:42 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:43.473899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:43.483487 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c126419e-38bd-4311-b726-990eea814804 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1767 microversion: 2.1 time: 0.731300 Sep 18 01:31:43.484084 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2601/5158] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:42 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1767 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:43.723455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-plugged", "status": "completed", "tag": "bce09105-fb4a-4f06-b514-bb0b783a9256"}, {"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-plugged", "status": "completed", "tag": "54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a"}, {"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-plugged", "status": "completed", "tag": "4dc2e4b9-6db2-4e88-8f9c-d04c056bfe26"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:43.745488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:43.750223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:43.750831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:43.777904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] Creating event network-vif-plugged:bce09105-fb4a-4f06-b514-bb0b783a9256 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:43.781507 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] Creating event network-vif-plugged:54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:43.782679 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] Creating event network-vif-plugged:4dc2e4b9-6db2-4e88-8f9c-d04c056bfe26 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:43.802268 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1638aa82-ae96-4926-99a9-330f9b387347 req-0e81244e-9f60-4547-8769-b56046fa99d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.082953 Sep 18 01:31:43.803082 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2558/5159] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:44.417739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:44.418409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:44.443559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:44.446513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:44.452085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:44.453167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:44.458606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:44.459513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:44.828936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2e1227d0-3073-4d20-a9c0-0d72aa25aaf7 req-07918802-ab12-4c36-85ff-5db6c833a4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79398ae-219d-4e8b-91a9-25a19f0aaeb9", "name": "network-vif-deleted", "tag": "94ad4821-da7f-4a9a-9d03-58515e6a9169"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:44.848477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2e1227d0-3073-4d20-a9c0-0d72aa25aaf7 req-07918802-ab12-4c36-85ff-5db6c833a4a8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:44.850365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2e1227d0-3073-4d20-a9c0-0d72aa25aaf7 req-07918802-ab12-4c36-85ff-5db6c833a4a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:44.853034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2e1227d0-3073-4d20-a9c0-0d72aa25aaf7 req-07918802-ab12-4c36-85ff-5db6c833a4a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:44.881443 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2e1227d0-3073-4d20-a9c0-0d72aa25aaf7 req-07918802-ab12-4c36-85ff-5db6c833a4a8 service nova] Creating event network-vif-deleted:94ad4821-da7f-4a9a-9d03-58515e6a9169 for instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 on n-h1-master-1 Sep 18 01:31:44.893006 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2e1227d0-3073-4d20-a9c0-0d72aa25aaf7 req-07918802-ab12-4c36-85ff-5db6c833a4a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426403 Sep 18 01:31:44.894875 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2559/5160] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:31:44.907720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:44.910024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:44.958997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:44.959516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:44.961167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:44.962062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:44.962545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:44.962986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:45.067396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:45.069048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:45.069971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:45.070575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:45.072015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lazy-loading 'fault' on Instance uuid e79398ae-219d-4e8b-91a9-25a19f0aaeb9 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:31:45.078554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:45.081018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:45.084133 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61ecb534-655c-43b8-be08-dead44d494b4 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.671060 Sep 18 01:31:45.109084 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2602/5161] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:44 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:45.221096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32482797a12e43bba5da043b05ebe983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1bd6811ab14757abb1d3d7e8c1924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:45.236626 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1661a3f6-dc60-42d9-8ff3-cf1bde0bade9 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 200 len: 1383 microversion: 2.1 time: 0.338121 Sep 18 01:31:45.237485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2560/5162] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:44 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 1383 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:31:45.837981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-caa21705-6dba-4265-a132-0b72d115a747 req-f0fe18a6-f766-4879-92c3-f2566b827682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-plugged", "status": "completed", "tag": "d33135cb-c28f-4fec-bab1-a5780eba555a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:45.896892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-caa21705-6dba-4265-a132-0b72d115a747 req-f0fe18a6-f766-4879-92c3-f2566b827682 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:45.902997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-caa21705-6dba-4265-a132-0b72d115a747 req-f0fe18a6-f766-4879-92c3-f2566b827682 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:45.903650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-caa21705-6dba-4265-a132-0b72d115a747 req-f0fe18a6-f766-4879-92c3-f2566b827682 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:45.975136 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-caa21705-6dba-4265-a132-0b72d115a747 req-f0fe18a6-f766-4879-92c3-f2566b827682 service nova] Creating event network-vif-plugged:d33135cb-c28f-4fec-bab1-a5780eba555a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:45.987191 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-caa21705-6dba-4265-a132-0b72d115a747 req-f0fe18a6-f766-4879-92c3-f2566b827682 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157328 Sep 18 01:31:45.988340 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2603/5163] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:46.120327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:46.121625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:46.140417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:46.141410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:46.142078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:46.143031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:46.143645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:46.144270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:46.262802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:46.263829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] [instance: e79398ae-219d-4e8b-91a9-25a19f0aaeb9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:46.280398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:46.302423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:46.306185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:46.307229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:46.307799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:46.308237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:46.354645 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] HTTP exception thrown: Instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 could not be found. Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Request method failure captured: Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 HTTP/1.1 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnR3wIJZyNeSktBYP6cRSa0y3yWav6T9kZkOzPq9V7c7z1J4E2GPZXGFZRlDNjTaFX5nx-PZxMLLM6f0C-EPoEKBllmO9nuOyiWEBORFIQeaAoh7_dy6HF222c50tJuxWelViBsbVeEni8RnIxe5Hm-0rWTcRlFgl-K-v-8kYXlADbY Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: ec1bd6811ab14757abb1d3d7e8c1924f Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-952061252 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec1bd6811ab14757abb1d3d7e8c1924f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestSecurityGroupsBasicOps-952061252 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: ec1bd6811ab14757abb1d3d7e8c1924f Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-952061252 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestSecurityGroupsBasicOps-952061252-project Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 32482797a12e43bba5da043b05ebe983 Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestSecurityGroupsBasicOps-952061252-project Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 could not be found. Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e79398ae-219d-4e8b-91a9-25a19f0aaeb9'} Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 could not be found. Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 could not be found. Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:31:46.362073 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 could not be found. Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Returning 404 to user: Instance e79398ae-219d-4e8b-91a9-25a19f0aaeb9 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:31:46.366074 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4483dc1d-0d60-43cd-8290-79fd397437a6 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9" status: 404 len: 111 microversion: 2.1 time: 0.105172 Sep 18 01:31:46.390342 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2604/5164] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:31:46 2022] GET /compute/v2.1/servers/e79398ae-219d-4e8b-91a9-25a19f0aaeb9 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:31:46.735589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:46.751602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:46.760901 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:46.762592 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e039e738-a17f-4036-a6b9-60384eb8fe52 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.647427 Sep 18 01:31:46.763314 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2561/5165] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:46 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:47.793596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:47.795629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:47.813918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:47.814694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:47.817099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:47.822861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:47.823731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:47.824447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:48.521033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:48.538022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:48.540211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:48.542834 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0fc4cfa5-b9ad-4a8c-9389-8dca9f5d8028 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1879 microversion: 2.42 time: 0.754812 Sep 18 01:31:48.546365 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2605/5166] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:47 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1879 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:49.577793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:49.579257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:49.594136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:49.596747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:49.597311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:49.598164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:49.600881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:49.601455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:50.317820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:50.385883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:50.392465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:31:50.395324 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0035fecf-482d-4329-bc71-9f724555cd70 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2835 microversion: 2.42 time: 0.822856 Sep 18 01:31:50.398633 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2562/5167] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:31:49 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2835 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:50.439213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:50.439723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:50.453919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:50.455026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:50.455626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:50.456538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:50.457458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:50.458056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:50.854938 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-66b57bbf-b0f2-47b2-a9d9-cb6f54d488a6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.421136 Sep 18 01:31:50.856124 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2606/5168] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 18 01:31:50 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd/os-interface => generated 1829 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:31:53.226251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d776b6ac-df06-43d7-9633-0af95069a22b req-833e800e-337a-49d3-897d-174ea50aaf26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "tag": "54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:31:53.246495 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:53.249308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d776b6ac-df06-43d7-9633-0af95069a22b req-833e800e-337a-49d3-897d-174ea50aaf26 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:53.250098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d776b6ac-df06-43d7-9633-0af95069a22b req-833e800e-337a-49d3-897d-174ea50aaf26 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:53.258413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d776b6ac-df06-43d7-9633-0af95069a22b req-833e800e-337a-49d3-897d-174ea50aaf26 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:53.281901 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d776b6ac-df06-43d7-9633-0af95069a22b req-833e800e-337a-49d3-897d-174ea50aaf26 service nova] Creating event network-changed:54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:31:53.300004 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d776b6ac-df06-43d7-9633-0af95069a22b req-833e800e-337a-49d3-897d-174ea50aaf26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077782 Sep 18 01:31:53.300862 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2563/5169] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:55.984548 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-10fffb0a-0dc7-463a-a610-e782b6815f35 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] Calling method '.version_select at 0x7f7005459790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:56.025375 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:31:56.065280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-10fffb0a-0dc7-463a-a610-e782b6815f35 tempest-TestSecurityGroupsBasicOps-952061252 tempest-TestSecurityGroupsBasicOps-952061252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1737935857" status: 202 len: 0 microversion: 2.1 time: 0.086612 Sep 18 01:31:56.065981 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2607/5170] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 01:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1737935857 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:31:57.733972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:57.736827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:57.753395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:57.755132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:57.758082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:57.760858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:57.766547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:57.767320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:57.950060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lazy-loading 'services' on Instance uuid 73edbac6-82b3-4a69-aa42-b95045d27726 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:31:58.097865 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9fcf3c63-ec3c-416e-9a36-5958a4afa759 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments/858a4186-91a3-4dae-890d-cb68bc5633aa" status: 202 len: 0 microversion: 2.1 time: 0.381451 Sep 18 01:31:58.102687 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2564/5171] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:31:57 2022] DELETE /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments/858a4186-91a3-4dae-890d-cb68bc5633aa => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:31:58.108447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:58.110967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:58.132887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:58.133385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:58.134057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:58.135049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:58.135359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:58.135959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:58.201004 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb450b33-ca53-44ae-9f6e-8311e34857df tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097295 Sep 18 01:31:58.202155 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2608/5172] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:31:58 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:31:59.216105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:31:59.218709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:31:59.241717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:59.242275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:59.242865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:59.253014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:31:59.253647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:31:59.254258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:31:59.350429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2b408ceb-fe4d-4ff8-a9f1-900061b29296 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137382 Sep 18 01:31:59.352640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2565/5173] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:31:59 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:00.389945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:00.405460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:00.417184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:00.418047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:00.418669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:00.420153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:00.420838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:00.421423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:00.487854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b9cceb5-862f-44f2-a051-14bb281fdda1 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126258 Sep 18 01:32:00.493305 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2609/5174] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:32:00 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:01.508494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:01.511656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:01.583095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:01.592168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:01.598484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:01.599367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:01.621128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:01.628228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:01.776215 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b70dfbce-5d69-4506-8d41-f4bf3e3f0813 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.274386 Sep 18 01:32:01.777127 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2566/5175] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:32:01 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:02.791211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:02.796034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:02.832040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:02.832600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:02.833096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:02.833842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:02.841976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:02.842564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:02.938737 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8d80bf57-4601-482b-ae5e-5fc3f9a43031 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153300 Sep 18 01:32:02.942558 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2610/5176] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:32:02 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:03.951957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:03.954487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:03.984829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:03.985323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:03.985792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:03.986514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:03.986974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:03.987402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:04.083914 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c494f963-9977-4584-8fe5-35be2101a205 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135983 Sep 18 01:32:04.084896 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2567/5177] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:32:03 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:32:05.102722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:05.105983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:05.120579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:05.121083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:05.121521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:05.122271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:05.125796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:05.129115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:05.194362 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a9fb6c2-67e6-4f51-8d99-d1812b073198 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097806 Sep 18 01:32:05.196726 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2611/5178] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:32:05 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:06.210126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:06.212574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:06.228048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:06.228932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:06.233199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:06.234129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:06.234609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:06.235041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:06.297125 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-733ad1eb-f41c-405d-9412-6fc0ef0a64c5 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092798 Sep 18 01:32:06.298546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2568/5179] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:32:06 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:07.313058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:07.315530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:07.333794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:07.334777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:07.336882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:07.338098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:07.339940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:07.341316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:07.417962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d13f83d9-b69a-431b-b1b1-ea4bf150ef2f tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110732 Sep 18 01:32:07.420278 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2612/5180] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 01:32:07 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:32:07.510678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:07.511324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:07.518944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:07.519436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:07.519877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:07.520598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:07.521055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:07.521480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:07.580046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:32:07.652578 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:07.687603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c6c7f5f6-d805-4984-8241-beebd3b8a555 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 204 len: 0 microversion: 2.1 time: 0.180365 Sep 18 01:32:07.688978 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2569/5181] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:32:07 2022] DELETE /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:32:07.698626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:07.699593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:07.707449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:07.708436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:07.709525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:07.710799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:07.711525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:07.712155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:07.897393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:07.910404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b719aca4-f608-44e2-950c-6360b246ebd0 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1679 microversion: 2.1 time: 0.216872 Sep 18 01:32:07.922567 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2613/5182] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:07 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:08.938818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:08.940170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:08.948277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:08.949023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:08.949647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:08.950600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:08.951220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:08.951804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:09.185246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:09.200061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92ba780f-f4ea-4d57-9595-09a1161184c4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1679 microversion: 2.1 time: 0.266657 Sep 18 01:32:09.201668 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2570/5183] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:08 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:10.233729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:10.235082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:10.269347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:10.275089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:10.284617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:10.288992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:10.289833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:10.290534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:10.605401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:10.615882 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-28fc8a2f-4f37-4257-9d2e-cb13337f89a4 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1612 microversion: 2.1 time: 0.387164 Sep 18 01:32:10.618722 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2614/5184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:10 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1612 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:32:11.370174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9b678795-4d8b-47da-a1eb-8b2cbc0024c9 req-504fe795-47eb-4c54-a0ce-1a9230be85c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73edbac6-82b3-4a69-aa42-b95045d27726", "name": "network-vif-deleted", "tag": "b1a52326-3b5c-4429-b0ae-e52b8b36bd1b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:32:11.396715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9b678795-4d8b-47da-a1eb-8b2cbc0024c9 req-504fe795-47eb-4c54-a0ce-1a9230be85c3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:11.397745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9b678795-4d8b-47da-a1eb-8b2cbc0024c9 req-504fe795-47eb-4c54-a0ce-1a9230be85c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:11.400471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9b678795-4d8b-47da-a1eb-8b2cbc0024c9 req-504fe795-47eb-4c54-a0ce-1a9230be85c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:11.423224 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9b678795-4d8b-47da-a1eb-8b2cbc0024c9 req-504fe795-47eb-4c54-a0ce-1a9230be85c3 service nova] Creating event network-vif-deleted:b1a52326-3b5c-4429-b0ae-e52b8b36bd1b for instance 73edbac6-82b3-4a69-aa42-b95045d27726 on n-h1-master-1 Sep 18 01:32:11.437307 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9b678795-4d8b-47da-a1eb-8b2cbc0024c9 req-504fe795-47eb-4c54-a0ce-1a9230be85c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079345 Sep 18 01:32:11.438863 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2571/5185] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:11.646314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:11.658531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:11.681070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:11.692594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:11.698679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:11.699720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:11.708086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:11.709649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:11.748525 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:11.760916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:11.761819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:11.762488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:11.763719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lazy-loading 'fault' on Instance uuid 73edbac6-82b3-4a69-aa42-b95045d27726 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:32:11.904266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe88855efe9449a590be4319ae39005d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99682924f64752a4195424e12e2d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:11.913300 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5df909fe-217b-4aa0-9506-bea9752eae16 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 200 len: 1329 microversion: 2.1 time: 0.272265 Sep 18 01:32:11.914262 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2615/5186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:11 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 1329 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:12.943499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:12.944909 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:12.969751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:12.972038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:12.973814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:12.975159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:12.979014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:12.982557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:13.027518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 HTTP/1.1 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '73edbac6-82b3-4a69-aa42-b95045d27726'} Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:13.031732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:13.037303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:13.037303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:13.037303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:13.037303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:13.037303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:13.037303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:13.037303 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:13.038984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:13.041741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f45facd2-1c3c-4bef-b557-690f08b93552 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 404 len: 111 microversion: 2.1 time: 0.103531 Sep 18 01:32:13.047492 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2572/5187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:12 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:32:13.056550 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6ec57f7-7a2a-453d-8419-6502555093ae tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '.version_select at 0x7f70050420d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:13.093482 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6ec57f7-7a2a-453d-8419-6502555093ae tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54544393" status: 202 len: 0 microversion: 2.1 time: 0.041253 Sep 18 01:32:13.094468 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2616/5188] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Sep 18 01:32:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54544393 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:32:19.274749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:19.276001 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:19.289267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:19.299028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:19.300593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:19.302563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:19.306996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:19.308094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:19.354429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 HTTP/1.1 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '73edbac6-82b3-4a69-aa42-b95045d27726'} Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:19.357980 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.362266 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.368336 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:19.369491 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-be429dfc-6362-46bc-87ce-8d4185539966 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 404 len: 111 microversion: 2.1 time: 0.099064 Sep 18 01:32:19.376046 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2573/5189] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:32:19 2022] DELETE /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:32:19.379759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:19.380376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 73edbac6-82b3-4a69-aa42-b95045d27726] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:19.399569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:19.400072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:19.400507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:19.401309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:19.401688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:19.402117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:19.446104 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 HTTP/1.1 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '73edbac6-82b3-4a69-aa42-b95045d27726'} Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:19.453047 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 73edbac6-82b3-4a69-aa42-b95045d27726 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:19.459402 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-440e2f23-b3f8-45dd-8985-750bd3595a99 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726" status: 404 len: 111 microversion: 2.1 time: 0.079703 Sep 18 01:32:19.473726 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2617/5190] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:19 2022] GET /compute/v2.1/servers/73edbac6-82b3-4a69-aa42-b95045d27726 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:32:24.111087 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:24.112036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:24.128966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.131682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.132500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.133655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.135608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.136722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.181890 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d HTTP/1.1 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3e5d09e1-875c-425d-9034-03287d68823d'} Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:24.184032 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:24.187841 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d438b94a-71a2-47b3-823d-f40b0476c42c tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 404 len: 111 microversion: 2.1 time: 0.079833 Sep 18 01:32:24.192669 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2574/5191] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:32:24 2022] DELETE /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:32:24.195216 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:24.196864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 3e5d09e1-875c-425d-9034-03287d68823d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:24.221930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.222540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.223071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.223948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.224568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.225043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.257365 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d HTTP/1.1 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3e5d09e1-875c-425d-9034-03287d68823d'} Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.258882 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 3e5d09e1-875c-425d-9034-03287d68823d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:24.263205 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27eb90b1-5ec1-446e-b8e6-4a849d367354 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d" status: 404 len: 111 microversion: 2.1 time: 0.070003 Sep 18 01:32:24.270192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:24.270704 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:24.284786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.285570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.286685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.287031 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2618/5192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:24 2022] GET /compute/v2.1/servers/3e5d09e1-875c-425d-9034-03287d68823d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:32:24.290407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.290917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.291369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.328071 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 HTTP/1.1 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '2f9ca3b9-b7c4-498d-88f0-14968493cff9'} Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:24.330128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.334422 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.339057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:24.340142 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff172427-55bf-45e9-b572-d22c311d3cc3 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 404 len: 111 microversion: 2.1 time: 0.075111 Sep 18 01:32:24.346789 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2575/5193] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:32:24 2022] DELETE /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:32:24.350760 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:24.351636 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 2f9ca3b9-b7c4-498d-88f0-14968493cff9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:24.367808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.372812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.373454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.374771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:24.377106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:24.380826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:24.415434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 HTTP/1.1 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2f9ca3b9-b7c4-498d-88f0-14968493cff9'} Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:24.417228 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 2f9ca3b9-b7c4-498d-88f0-14968493cff9 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9cac8044-9f9c-4c03-8d1e-a933bd7564fc tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9" status: 404 len: 111 microversion: 2.1 time: 0.076107 Sep 18 01:32:24.424334 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2619/5194] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:24 2022] GET /compute/v2.1/servers/2f9ca3b9-b7c4-498d-88f0-14968493cff9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:32:30.280965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:30.281491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:30.308142 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:30.311488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:30.318273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:30.319404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:30.320974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:30.336140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:30.338163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:30.379967 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 HTTP/1.1 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5b4b9816-b230-4c64-b666-b095533aa203'} Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:30.382352 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5cadb916-2582-4a4c-9f7c-9c2ff22ddf54 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 404 len: 111 microversion: 2.1 time: 0.108353 Sep 18 01:32:30.386896 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2576/5195] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:32:30 2022] DELETE /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:32:30.397403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:30.399604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] [instance: 5b4b9816-b230-4c64-b666-b095533aa203] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:30.407970 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:30.412103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:30.412917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:30.413595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:30.414970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:30.416843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:30.417466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:30.473463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] HTTP exception thrown: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Request method failure captured: Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 HTTP/1.1 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnOAuLWUVljqxUh8J52ycY6VF4CcTCKZBVSV5FytacaW9KU3Qq21_-WIrTD-omI9VVTNgIB3LynkjEcBH-BiJ2YqCy2l9Lht4k9W_n4E6hhdIuxKLnCqNTmbOPv3mCxojBqoJn_sUFEsVv82z7FpucdLmi1HD3bU1qUsno9sR5CIjyo Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f99682924f64752a4195424e12e2d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f99682924f64752a4195424e12e2d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f99682924f64752a4195424e12e2d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 4f99682924f64752a4195424e12e2d82 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-562766810 Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fe88855efe9449a590be4319ae39005d Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-AttachVolumeNegativeTest-562766810-project Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5b4b9816-b230-4c64-b666-b095533aa203'} Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:30.476841 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:30.480943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] Returning 404 to user: Instance 5b4b9816-b230-4c64-b666-b095533aa203 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:30.485880 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad63066f-1d35-43c5-b705-cb46bb7f6c85 tempest-AttachVolumeNegativeTest-562766810 tempest-AttachVolumeNegativeTest-562766810-project] 10.222.0.25 "GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203" status: 404 len: 111 microversion: 2.1 time: 0.088122 Sep 18 01:32:30.487204 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2620/5196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:30 2022] GET /compute/v2.1/servers/5b4b9816-b230-4c64-b666-b095533aa203 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:32:36.200221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:36.201517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:36.210887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:36.212398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:36.213086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:36.214515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:36.216417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:36.217093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:37.079685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:37.109495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:37.116158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:37.122410 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36650bfc-beaf-48b0-b9a1-6794b885b1e1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2954 microversion: 2.42 time: 0.925992 Sep 18 01:32:37.123723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2577/5197] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:32:36 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2954 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:32:37.161256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:37.161949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:37.171839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:37.175892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:37.175892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:37.175892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:37.175892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:37.175892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:37.574992 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-952afa7b-594f-4009-8094-5790d84a2fc3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.418175 Sep 18 01:32:37.575646 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2621/5198] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 18 01:32:37 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd/os-interface => generated 1829 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:32:41.603229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e33a576-8a53-45ee-96a7-724ab3c48279 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Action: 'create', calling method: .version_select at 0x7f7005fdc820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-283431824", "metadata": {"Type": "work"}}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e33a576-8a53-45ee-96a7-724ab3c48279 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Request method failure captured: Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 121 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnU4j_nkNN7hcRhWi8CRcSwW7UwzPh6kvyX4U6aO5bfLe86gPBpT01Pni-LjF_BHa216QvbFpF37cZEwTNJk_e8fHwvSF2GYD4v3Yftq26foRLLWHUZxpKyf5NOeD8q8Ehj30mOlOL0WKhc2HxLZma00yIYsVJSBlXI6JeLORb84fEE Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 2f11c245cec047c8934cf05673c76817 Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-283431824", "metadata": {"Type": "work"}}} Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-283431824', 'metadata': {'Type': 'work'}}}} Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi '#$%' Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:32:41.608338 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 18 01:32:41.612365 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.617299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e33a576-8a53-45ee-96a7-724ab3c48279 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:41.619005 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e33a576-8a53-45ee-96a7-724ab3c48279 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.584212 Sep 18 01:32:41.622721 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2578/5199] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 18 01:32:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 589 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:32:41.634824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a188e732-70cd-45a9-b332-f060499ab65a tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Action: 'create', calling method: .version_select at 0x7f7005042700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1504636877", "metadata": {"Type": "work"}}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a188e732-70cd-45a9-b332-f060499ab65a tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Request method failure captured: Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 120 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnU4j_nkNN7hcRhWi8CRcSwW7UwzPh6kvyX4U6aO5bfLe86gPBpT01Pni-LjF_BHa216QvbFpF37cZEwTNJk_e8fHwvSF2GYD4v3Yftq26foRLLWHUZxpKyf5NOeD8q8Ehj30mOlOL0WKhc2HxLZma00yIYsVJSBlXI6JeLORb84fEE Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 2f11c245cec047c8934cf05673c76817 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1504636877", "metadata": {"Type": "work"}}} Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1504636877', 'metadata': {'Type': 'work'}}}} Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '0' Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:32:41.642302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 18 01:32:41.656299 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.661627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a188e732-70cd-45a9-b332-f060499ab65a tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:41.663080 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a188e732-70cd-45a9-b332-f060499ab65a tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034379 Sep 18 01:32:41.666818 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2622/5200] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 18 01:32:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:32:41.681428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e060d14-ddfc-4d6c-a2ba-70e11ed9709f tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Action: 'create', calling method: .version_select at 0x7f700a60e310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-877162451", "metadata": {"Type": "work"}}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e060d14-ddfc-4d6c-a2ba-70e11ed9709f tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Request method failure captured: Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 118 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnU4j_nkNN7hcRhWi8CRcSwW7UwzPh6kvyX4U6aO5bfLe86gPBpT01Pni-LjF_BHa216QvbFpF37cZEwTNJk_e8fHwvSF2GYD4v3Yftq26foRLLWHUZxpKyf5NOeD8q8Ehj30mOlOL0WKhc2HxLZma00yIYsVJSBlXI6JeLORb84fEE Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 2f11c245cec047c8934cf05673c76817 Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-877162451", "metadata": {"Type": "work"}}} Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-877162451', 'metadata': {'Type': 'work'}}}} Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise error Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi '' Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 01:32:41.697903 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 18 01:32:41.702258 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.705782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e060d14-ddfc-4d6c-a2ba-70e11ed9709f tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:41.710135 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e060d14-ddfc-4d6c-a2ba-70e11ed9709f tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035842 Sep 18 01:32:41.711401 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2579/5201] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 18 01:32:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:32:41.722837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5aa99343-da6e-4a15-b7c5-78787e52f8f0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Calling method '.version_select at 0x7f70050bb430>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:41.770400 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-5aa99343-da6e-4a15-b7c5-78787e52f8f0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] HTTP exception thrown: Volume tempest-invalid-1961114118 could not be found. Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5aa99343-da6e-4a15-b7c5-78787e52f8f0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Request method failure captured: Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1961114118 HTTP/1.1 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnU4j_nkNN7hcRhWi8CRcSwW7UwzPh6kvyX4U6aO5bfLe86gPBpT01Pni-LjF_BHa216QvbFpF37cZEwTNJk_e8fHwvSF2GYD4v3Yftq26foRLLWHUZxpKyf5NOeD8q8Ehj30mOlOL0WKhc2HxLZma00yIYsVJSBlXI6JeLORb84fEE Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 2f11c245cec047c8934cf05673c76817 Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: exception: Volume tempest-invalid-1961114118 could not be found. Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'tempest-invalid-1961114118'} Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1961114118 could not be found. (HTTP 404) (Request-ID: req-874fdcd3-a72f-4348-93fa-aebfded4dd68) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:32:41.782859 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1961114118 could not be found. Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1961114118 could not be found. Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1961114118 could not be found. Sep 18 01:32:41.787512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.792905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5aa99343-da6e-4a15-b7c5-78787e52f8f0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Returning 404 to user: Volume tempest-invalid-1961114118 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:41.792905 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5aa99343-da6e-4a15-b7c5-78787e52f8f0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1961114118" status: 404 len: 99 microversion: 2.1 time: 0.075446 Sep 18 01:32:41.795972 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2623/5202] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 01:32:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1961114118 => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 18 01:32:41.806650 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0457e1f1-de9d-4e95-bbe0-53db81f24f8f tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005001 Sep 18 01:32:41.807129 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2580/5203] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Sep 18 01:32:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 18 01:32:41.825186 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4e91787-aca5-4203-8ba5-441de5e5a0e9 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011348 Sep 18 01:32:41.830534 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2624/5204] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:32:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 18 01:32:41.836024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b158166f-d858-41fa-9112-17414df05ae0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Calling method '.version_select at 0x7f700558bd30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:41.895110 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b158166f-d858-41fa-9112-17414df05ae0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] HTTP exception thrown: Volume af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 could not be found. Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b158166f-d858-41fa-9112-17414df05ae0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Request method failure captured: Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/os-volumes/af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 HTTP/1.1 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnU4j_nkNN7hcRhWi8CRcSwW7UwzPh6kvyX4U6aO5bfLe86gPBpT01Pni-LjF_BHa216QvbFpF37cZEwTNJk_e8fHwvSF2GYD4v3Yftq26foRLLWHUZxpKyf5NOeD8q8Ehj30mOlOL0WKhc2HxLZma00yIYsVJSBlXI6JeLORb84fEE Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 2f11c245cec047c8934cf05673c76817 Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: exception: Volume af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 could not be found. Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'af0ae5ca-33ae-4bd3-89fd-5b0541664bd8'} Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 could not be found. (HTTP 404) (Request-ID: req-d7f7a902-4297-40e5-9958-48f446fc567f) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:32:41.899739 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 could not be found. Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 could not be found. Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 could not be found. Sep 18 01:32:41.905545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.908825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b158166f-d858-41fa-9112-17414df05ae0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Returning 404 to user: Volume af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:41.912097 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b158166f-d858-41fa-9112-17414df05ae0 tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/af0ae5ca-33ae-4bd3-89fd-5b0541664bd8" status: 404 len: 109 microversion: 2.1 time: 0.079272 Sep 18 01:32:41.914658 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2581/5205] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:32:41 2022] DELETE /compute/v2.1/os-volumes/af0ae5ca-33ae-4bd3-89fd-5b0541664bd8 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:32:41.924222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f4fe628-3992-4ff5-8076-a8e5bc63e67b tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Calling method '.version_select at 0x7f70050c08b0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:41.961161 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-5f4fe628-3992-4ff5-8076-a8e5bc63e67b tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] HTTP exception thrown: Volume 1037143d-d68c-4f42-bb03-e79594bcfbf4 could not be found. Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f4fe628-3992-4ff5-8076-a8e5bc63e67b tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Request method failure captured: Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/os-volumes/1037143d-d68c-4f42-bb03-e79594bcfbf4 HTTP/1.1 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnU4j_nkNN7hcRhWi8CRcSwW7UwzPh6kvyX4U6aO5bfLe86gPBpT01Pni-LjF_BHa216QvbFpF37cZEwTNJk_e8fHwvSF2GYD4v3Yftq26foRLLWHUZxpKyf5NOeD8q8Ehj30mOlOL0WKhc2HxLZma00yIYsVJSBlXI6JeLORb84fEE Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21297e9f8a404ccbac1726faa2c5c38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 21297e9f8a404ccbac1726faa2c5c38e Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesNegativeTest-468041512 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 2f11c245cec047c8934cf05673c76817 Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesNegativeTest-468041512-project Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: method: Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: exception: Volume 1037143d-d68c-4f42-bb03-e79594bcfbf4 could not be found. Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1037143d-d68c-4f42-bb03-e79594bcfbf4'} Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1037143d-d68c-4f42-bb03-e79594bcfbf4 could not be found. (HTTP 404) (Request-ID: req-25e13222-cdb9-429a-9ace-b31120e20135) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:32:41.966793 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1037143d-d68c-4f42-bb03-e79594bcfbf4 could not be found. Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1037143d-d68c-4f42-bb03-e79594bcfbf4 could not be found. Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1037143d-d68c-4f42-bb03-e79594bcfbf4 could not be found. Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f4fe628-3992-4ff5-8076-a8e5bc63e67b tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] Returning 404 to user: Volume 1037143d-d68c-4f42-bb03-e79594bcfbf4 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f4fe628-3992-4ff5-8076-a8e5bc63e67b tempest-VolumesNegativeTest-468041512 tempest-VolumesNegativeTest-468041512-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1037143d-d68c-4f42-bb03-e79594bcfbf4" status: 404 len: 109 microversion: 2.1 time: 0.048608 Sep 18 01:32:41.970732 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2625/5206] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:32:41 2022] GET /compute/v2.1/os-volumes/1037143d-d68c-4f42-bb03-e79594bcfbf4 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:32:44.998182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1795811489", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "5413c750-9b15-4200-9f38-450e5b4f84ce"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:32:45.080992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] validate_networks() for [('5413c750-9b15-4200-9f38-450e5b4f84ce', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:32:46.075027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:32:46.075621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:32:46.076790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:32:46.077430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:32:46.077951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:32:46.098561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:46.099060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:46.099505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:46.100345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:46.106367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:46.107260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:46.139226 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=25 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:46.191670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Getting quotas for project c9f1c2a01a9946d080191371b4b583a3. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:32:46.210841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Getting quotas for user 918d549ad8c44c229daaf11504f79d3e and project c9f1c2a01a9946d080191371b4b583a3. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:32:46.228092 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:32:46.231129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:32:46.332118 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d240c573-1178-42e3-b45e-c98d43cc50e8 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703502 Sep 18 01:32:46.339723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2582/5207] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:32:46.349210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81e823c0-380e-4585-b5d9-c09b04e58ff3 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:46.350794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-81e823c0-380e-4585-b5d9-c09b04e58ff3 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:46.543339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-81e823c0-380e-4585-b5d9-c09b04e58ff3 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:46.550669 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-81e823c0-380e-4585-b5d9-c09b04e58ff3 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1214 microversion: 2.1 time: 0.208216 Sep 18 01:32:46.551251 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2626/5208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:46 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:47.583149 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:47.583774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:47.601395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:47.602467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:47.603119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:47.604592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:47.605449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:47.608022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:47.795893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:47.835461 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5b15dc9-bd55-443f-b96f-fd489c0af4a1 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1210 microversion: 2.1 time: 0.262949 Sep 18 01:32:47.836129 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2583/5209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:47 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1210 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:48.866598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:48.882601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:48.884998 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=19 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:48.904866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:48.905372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:48.909981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:48.911496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:48.912584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:48.913439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:49.056174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:49.074442 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27f90666-bafc-4ad9-b3b3-4085e9d9011f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1272 microversion: 2.1 time: 0.210417 Sep 18 01:32:49.087208 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2627/5210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:48 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:50.105781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:50.107100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:50.114807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:50.119479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:50.120269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:50.121070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:50.121585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:50.122253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:50.243735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-004c177f-5912-4398-9a07-668b5d5393f1 req-3c815e37-3e2c-492e-b030-deb101a1421c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30042f0e-d8e0-4688-8ac0-5351118871cd", "tag": "f91f9496-6252-473a-ae6b-04ca3f410a6a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:32:50.262272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-004c177f-5912-4398-9a07-668b5d5393f1 req-3c815e37-3e2c-492e-b030-deb101a1421c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:50.264501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-004c177f-5912-4398-9a07-668b5d5393f1 req-3c815e37-3e2c-492e-b030-deb101a1421c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:50.265231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-004c177f-5912-4398-9a07-668b5d5393f1 req-3c815e37-3e2c-492e-b030-deb101a1421c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:50.299063 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-004c177f-5912-4398-9a07-668b5d5393f1 req-3c815e37-3e2c-492e-b030-deb101a1421c service nova] Creating event network-changed:f91f9496-6252-473a-ae6b-04ca3f410a6a for instance 30042f0e-d8e0-4688-8ac0-5351118871cd on n-h1-master-1 Sep 18 01:32:50.306251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-004c177f-5912-4398-9a07-668b5d5393f1 req-3c815e37-3e2c-492e-b030-deb101a1421c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069853 Sep 18 01:32:50.307943 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2628/5211] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:50.479259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:50.492448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-564d72a7-4f1d-40d8-b2b6-2b7902855c7a tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1314 microversion: 2.1 time: 0.391614 Sep 18 01:32:50.515813 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2584/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:50 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:51.527056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:51.530966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:51.540844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:51.546113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:51.548617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:51.549456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:51.551563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:51.552104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:51.841193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:51.856704 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c34a8fb-4bd8-4da8-bd55-3aa30913f382 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1314 microversion: 2.1 time: 0.332038 Sep 18 01:32:51.860196 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2629/5213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:51 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:32:52.888915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:52.889798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:52.904950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:52.905444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:52.906573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:52.907311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:52.907778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:52.908215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:53.169662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:53.179684 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8003600-0cd3-4b11-aa57-7bbc49d8c5da tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1314 microversion: 2.1 time: 0.296660 Sep 18 01:32:53.180696 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2585/5214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:52 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:32:54.204698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:54.205309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:54.220358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:54.220852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:54.221291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:54.222031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:54.222490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:54.222905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:54.626623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:54.637860 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4460d9dd-0857-46aa-af4b-7b29ec191ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1314 microversion: 2.1 time: 0.436967 Sep 18 01:32:54.639748 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2630/5215] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:54 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:55.669525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:55.670143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:55.678895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:55.679615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:55.680211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:55.681230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:55.682021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:55.682605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:55.958265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:55.974093 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45005bc9-a9d3-41e5-a92b-72aad4654ff0 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1314 microversion: 2.1 time: 0.311937 Sep 18 01:32:55.979619 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2586/5216] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:55 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:56.371383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-31969bcb-29eb-47dd-a426-04286113d21c req-89c68abd-f8d1-4bf3-a885-c17083b69c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30042f0e-d8e0-4688-8ac0-5351118871cd", "name": "network-vif-plugged", "status": "completed", "tag": "f91f9496-6252-473a-ae6b-04ca3f410a6a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:32:56.399640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-31969bcb-29eb-47dd-a426-04286113d21c req-89c68abd-f8d1-4bf3-a885-c17083b69c93 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:56.401205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-31969bcb-29eb-47dd-a426-04286113d21c req-89c68abd-f8d1-4bf3-a885-c17083b69c93 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:56.401896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-31969bcb-29eb-47dd-a426-04286113d21c req-89c68abd-f8d1-4bf3-a885-c17083b69c93 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:56.442020 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-31969bcb-29eb-47dd-a426-04286113d21c req-89c68abd-f8d1-4bf3-a885-c17083b69c93 service nova] Creating event network-vif-plugged:f91f9496-6252-473a-ae6b-04ca3f410a6a for instance 30042f0e-d8e0-4688-8ac0-5351118871cd on n-h1-master-1 Sep 18 01:32:56.456639 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-31969bcb-29eb-47dd-a426-04286113d21c req-89c68abd-f8d1-4bf3-a885-c17083b69c93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089509 Sep 18 01:32:56.464269 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2631/5217] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:32:57.002111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:57.003526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:57.006737 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:57.007898 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:57.019224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:57.019902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:57.020697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:57.021765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:57.022605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:57.023646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:57.285503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:57.294695 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-99ea18a2-d5de-4c34-af30-35ebde02261c tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1314 microversion: 2.1 time: 0.297594 Sep 18 01:32:57.310515 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2587/5218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:56 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:32:58.320837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:32:58.321543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:32:58.323556 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:32:58.333370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:58.334162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:58.334830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:58.335744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:32:58.336351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:32:58.336929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:32:58.590771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:32:58.601537 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63e7aa26-952f-484a-90ed-db503e60b28e tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1497 microversion: 2.1 time: 0.284770 Sep 18 01:32:58.602843 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2632/5219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:32:58 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1497 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:33:03.854286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:33:03.854286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:33:03.883747 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:33:03.902328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:03.903464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:03.904633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:03.905800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:03.906588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:03.907187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:03.964325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:33:04.140194 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7f27c32-7c8f-437a-a040-0a52c380262f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 204 len: 0 microversion: 2.1 time: 0.292979 Sep 18 01:33:04.144578 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2588/5220] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:33:03 2022] DELETE /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:33:04.150240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:33:04.150240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:33:04.153152 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=20 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:33:04.167374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:04.168486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:04.168928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:04.169888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:04.170248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:04.170669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:04.487973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:33:04.505219 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f9fcf32f-5ae5-4b8f-849e-a8615e9bd131 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1503 microversion: 2.1 time: 0.357584 Sep 18 01:33:04.510029 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2633/5221] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:33:04 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:33:05.543804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:33:05.545089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:33:05.558956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:05.559866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:05.560515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:05.561985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:05.562608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:05.563682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:05.948578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:33:05.970016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fdf23dc2-f0ed-4499-9589-7ed03c2e5d72 tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1503 microversion: 2.1 time: 0.424105 Sep 18 01:33:05.988550 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2589/5222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:33:05 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1503 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:33:06.485039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c5aeef59-49d6-458b-aa81-63c826e3c8e9 req-8829b8ca-7171-42af-a7ac-6817d9941ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30042f0e-d8e0-4688-8ac0-5351118871cd", "name": "network-vif-deleted", "tag": "f91f9496-6252-473a-ae6b-04ca3f410a6a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:33:06.498606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5aeef59-49d6-458b-aa81-63c826e3c8e9 req-8829b8ca-7171-42af-a7ac-6817d9941ce0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:06.499968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5aeef59-49d6-458b-aa81-63c826e3c8e9 req-8829b8ca-7171-42af-a7ac-6817d9941ce0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:06.500803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5aeef59-49d6-458b-aa81-63c826e3c8e9 req-8829b8ca-7171-42af-a7ac-6817d9941ce0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:06.534236 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c5aeef59-49d6-458b-aa81-63c826e3c8e9 req-8829b8ca-7171-42af-a7ac-6817d9941ce0 service nova] Creating event network-vif-deleted:f91f9496-6252-473a-ae6b-04ca3f410a6a for instance 30042f0e-d8e0-4688-8ac0-5351118871cd on n-h1-master-1 Sep 18 01:33:06.544094 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c5aeef59-49d6-458b-aa81-63c826e3c8e9 req-8829b8ca-7171-42af-a7ac-6817d9941ce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062778 Sep 18 01:33:06.547925 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2634/5223] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:33:07.005241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:33:07.006493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:33:07.030897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:07.031651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:07.032554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:07.033986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:07.035362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:07.036381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:07.141014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:07.141670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:07.142116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:07.142581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lazy-loading 'fault' on Instance uuid 30042f0e-d8e0-4688-8ac0-5351118871cd {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:33:07.281437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918d549ad8c44c229daaf11504f79d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f1c2a01a9946d080191371b4b583a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:33:07.290066 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-43f091aa-4a07-440e-96ba-f06e53c17f7f tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 200 len: 1304 microversion: 2.1 time: 0.297343 Sep 18 01:33:07.305265 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2590/5224] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:33:06 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 1304 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:33:08.322775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:33:08.324787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] [instance: 30042f0e-d8e0-4688-8ac0-5351118871cd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:33:08.349634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:08.351245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:08.353908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:08.356511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:33:08.358312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:33:08.360851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:33:08.396142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] HTTP exception thrown: Instance 30042f0e-d8e0-4688-8ac0-5351118871cd could not be found. Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Request method failure captured: Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd HTTP/1.1 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnU5smSTLmw6wcvnAzJ2jizt5BdOr9vGpBxTHJw36uatJM3tpM3x1esPGFR0KKlqAClDJISD-tnTF-wJ5CKSsimo2mo91I9EA6EGMTamPodAr63EXn7EF6oqWqSf5wPdaTDqtAMDZnQQh71_G936TroA6ek-bV1mQp94HyfB8zEze1c Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c9f1c2a01a9946d080191371b4b583a3 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-VolumesActionsTest-1318296921 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9f1c2a01a9946d080191371b4b583a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9f1c2a01a9946d080191371b4b583a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9f1c2a01a9946d080191371b4b583a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9f1c2a01a9946d080191371b4b583a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-VolumesActionsTest-1318296921 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c9f1c2a01a9946d080191371b4b583a3 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-VolumesActionsTest-1318296921 Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-VolumesActionsTest-1318296921-project Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 918d549ad8c44c229daaf11504f79d3e Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-VolumesActionsTest-1318296921-project Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 30042f0e-d8e0-4688-8ac0-5351118871cd could not be found. Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '30042f0e-d8e0-4688-8ac0-5351118871cd'} Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30042f0e-d8e0-4688-8ac0-5351118871cd could not be found. Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30042f0e-d8e0-4688-8ac0-5351118871cd could not be found. Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:33:08.400077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:33:08.404303 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:33:08.404303 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:33:08.404303 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:33:08.404303 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:33:08.404303 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:33:08.404303 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30042f0e-d8e0-4688-8ac0-5351118871cd could not be found. Sep 18 01:33:08.404303 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:33:08.410068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] Returning 404 to user: Instance 30042f0e-d8e0-4688-8ac0-5351118871cd could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:33:08.414829 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-20151861-31a9-4441-908d-3a6586b84cad tempest-VolumesActionsTest-1318296921 tempest-VolumesActionsTest-1318296921-project] 10.222.0.25 "GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd" status: 404 len: 111 microversion: 2.1 time: 0.103431 Sep 18 01:33:08.418488 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2635/5225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:33:08 2022] GET /compute/v2.1/servers/30042f0e-d8e0-4688-8ac0-5351118871cd => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:34:11.313277 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:34:11.314060 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:34:11.315082 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:34:11.315316 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 01:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-hypervisors (ip 10.222.0.25) !!! Sep 18 01:34:11.649639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Calling method '.version_select at 0x7f7006189820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:11.659653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:11.660605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:11.663549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:11.684447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:11.685290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:11.686000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:11.697776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:11.698631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:11.699540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:11.707657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-995af31c-9324-49ec-a813-fe79100b971f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1664877523-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.396181 Sep 18 01:34:11.709276 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2591/5226] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:34:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:34:44.273324 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=5 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:34:44.276929 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=38 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:34:44.278002 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:34:44.279503 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:34:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd (ip 10.222.0.25) !!! Sep 18 01:34:44.284900 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 01:34:44.285357 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:34:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd (ip 10.222.0.25) !!! Sep 18 01:34:44.797336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:44.798266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:44.808272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:44.810348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:44.811041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:44.812672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:44.813727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:44.814422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:44.850342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:34:45.127922 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9fd44259-e9df-4682-b8c8-6f00ecaf6df8 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 204 len: 0 microversion: 2.42 time: 0.853733 Sep 18 01:34:45.130153 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2636/5227] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:34:44 2022] DELETE /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 0 bytes in 860 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:34:45.140374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:45.142492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:45.164126 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:34:45.168434 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:34:45.172738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:45.175690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:45.176812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:45.179499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:45.180882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:45.181502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:46.678598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:46.698132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:46.711082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:46.716017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e5875745-ee04-4b52-9894-92fc382bf663 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2960 microversion: 2.42 time: 1.580888 Sep 18 01:34:46.722421 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2592/5228] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:34:45 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2960 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:34:47.050728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf2c80c4-2d5f-4673-bbfc-e308fbac2bdc tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'create', calling method: .version_select at 0x7f70050c0b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1438376753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfqTlpbq5ukSDjrDxWdhli9FbbrAf2cauoBTL4nNC9pfvf3TZ0cSC+aLavp0zk2Vn6NBy6PJNVG65RjMPwFFRu86eyq5VU7zopnkLSx4LRJpP9UPGTj84DjXcS0MPaJFw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:34:47.092465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-cf2c80c4-2d5f-4673-bbfc-e308fbac2bdc tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for project efdad25b20bf447aa134ee525e6596e7. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:34:47.099044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-cf2c80c4-2d5f-4673-bbfc-e308fbac2bdc tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for user 9325389461a64760b4575af8a52065f5 and project efdad25b20bf447aa134ee525e6596e7. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:34:47.164379 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf2c80c4-2d5f-4673-bbfc-e308fbac2bdc tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.118889 Sep 18 01:34:47.165936 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2637/5229] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:34:47 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:34:47.756792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:47.757413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:47.771942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:47.773577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:47.776179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:47.778679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:47.782201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:47.786082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:48.522226 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:48.542709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:48.547283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:48.552162 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-da639d9e-e54d-47da-b133-e83ce1f54b26 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2960 microversion: 2.42 time: 0.797290 Sep 18 01:34:48.568518 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2593/5230] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:34:47 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2960 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:34:49.591210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:49.592708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:49.613349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:49.614260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:49.614884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:49.615805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:49.617659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:49.620872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:50.807267 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:50.821308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:50.822879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:50.824712 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af6e8ad3-cfd2-4fb6-bd03-d9dd8b0d2e45 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2960 microversion: 2.42 time: 1.238768 Sep 18 01:34:50.826020 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2638/5231] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:34:49 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2960 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:34:51.419217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1197447748", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "788767f6-f0c3-4f28-8222-6ea63da24502"}], "key_name": "tempest-TestNetworkBasicOps-1438376753", "security_groups": [{"name": "tempest-secgroup-smoke-1567129169"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:34:51.786770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1714665044", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "4b60bdec-45b5-4962-9774-750c19fd0f30"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:34:51.803567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] validate_networks() for [('788767f6-f0c3-4f28-8222-6ea63da24502', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:34:51.952352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] validate_networks() for [('4b60bdec-45b5-4962-9774-750c19fd0f30', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:34:52.986271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:34:52.986853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:34:52.987282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:34:52.992099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:34:52.992588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:34:53.017425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:53.018340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:53.019001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:53.020128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:53.021122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:53.026826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:53.133612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:34:53.134077 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:34:53.134452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:34:53.134863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:34:53.135771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:34:53.143554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Getting quotas for project 0b2a96e1edca4a6482bacfe886221621. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:34:53.155514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Getting quotas for user 4cf096e909804ae2a93315271fb3a38a and project 0b2a96e1edca4a6482bacfe886221621. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:34:53.165318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:53.167741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:53.169164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:53.171596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:53.172465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:53.172906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:53.184918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:34:53.188758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:34:53.252067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for project efdad25b20bf447aa134ee525e6596e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:34:53.273287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for user 9325389461a64760b4575af8a52065f5 and project efdad25b20bf447aa134ee525e6596e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:34:53.323421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:34:53.328793 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:34:53.345017 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ddb5f60-1286-4df7-b9f2-e30f32b4a1b3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562639 Sep 18 01:34:53.369298 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2639/5232] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:34:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:34:53.387537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:53.388980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:53.411507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:53.412097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:53.412554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:53.413307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:53.413801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:53.414796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:53.466752 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78e9ffc2-5f97-4b1c-bccd-0fe87dffaded tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.051219 Sep 18 01:34:53.470318 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2594/5233] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:34:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:34:53.483756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-10311843-804c-48c6-a71b-abee406802c2 req-0354181d-a715-43a2-8439-1fcb3947c74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-unplugged", "status": "completed", "tag": "fe99f160-71f0-4606-9e60-e36067aaf2a5"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:34:53.512150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-10311843-804c-48c6-a71b-abee406802c2 req-0354181d-a715-43a2-8439-1fcb3947c74a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:53.513679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-10311843-804c-48c6-a71b-abee406802c2 req-0354181d-a715-43a2-8439-1fcb3947c74a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:53.514083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-10311843-804c-48c6-a71b-abee406802c2 req-0354181d-a715-43a2-8439-1fcb3947c74a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:53.528377 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-10311843-804c-48c6-a71b-abee406802c2 req-0354181d-a715-43a2-8439-1fcb3947c74a service nova] Creating event network-vif-unplugged:fe99f160-71f0-4606-9e60-e36067aaf2a5 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:53.535334 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-10311843-804c-48c6-a71b-abee406802c2 req-0354181d-a715-43a2-8439-1fcb3947c74a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063321 Sep 18 01:34:53.536382 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2595/5234] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:34:53.544557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2271f148-975d-44e2-8ba4-132b52b6189b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:53.545871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2271f148-975d-44e2-8ba4-132b52b6189b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:53.693358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2271f148-975d-44e2-8ba4-132b52b6189b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:53.702815 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2271f148-975d-44e2-8ba4-132b52b6189b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1214 microversion: 2.1 time: 0.165196 Sep 18 01:34:53.705874 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2596/5235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:53 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:53.720309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-04ecde9d-d6b8-46b8-9108-1b8dad34f7be tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:53.720992 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-04ecde9d-d6b8-46b8-9108-1b8dad34f7be tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:53.972952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-04ecde9d-d6b8-46b8-9108-1b8dad34f7be tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:53.992150 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-04ecde9d-d6b8-46b8-9108-1b8dad34f7be tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1249 microversion: 2.1 time: 0.283693 Sep 18 01:34:53.993484 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2597/5236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:53 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1249 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:54.155523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:54.172248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:54.177680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:54.179071 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15942602-7044-484e-b4c9-cbda6168e1be tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2939 microversion: 2.42 time: 0.808665 Sep 18 01:34:54.179744 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2640/5237] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:34:53 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2939 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:34:54.731749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:54.732680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:54.749272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:54.751542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:54.752862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:54.753807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:54.758760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:54.761078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:54.903781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:54.916574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ebdd12e3-f1e4-49d8-82e7-4e922322de17 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1218 microversion: 2.1 time: 0.189579 Sep 18 01:34:54.936085 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2598/5238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:54 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:55.019282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:55.020009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:55.038544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.039573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.050115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.051553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.052268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.055570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.175246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:55.186826 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-13462eab-5b28-4012-b099-14cd9574718c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1301 microversion: 2.1 time: 0.173081 Sep 18 01:34:55.203817 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2641/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:55 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1301 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:55.209285 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:55.209936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:55.221274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.225410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.228033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.228815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.229304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.229775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.635189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-unplugged", "status": "completed", "tag": "4cb81f05-c146-4d6c-be7e-00763cbe091a"}, {"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-unplugged", "status": "completed", "tag": "fddbdb0d-62d9-4264-a95b-6cfdc8a06749"}, {"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-unplugged", "status": "completed", "tag": "bce09105-fb4a-4f06-b514-bb0b783a9256"}, {"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-unplugged", "status": "completed", "tag": "54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a"}, {"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-unplugged", "status": "completed", "tag": "d33135cb-c28f-4fec-bab1-a5780eba555a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:34:55.704576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.707992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.717265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.765288 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Creating event network-vif-unplugged:4cb81f05-c146-4d6c-be7e-00763cbe091a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:55.766195 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Creating event network-vif-unplugged:fddbdb0d-62d9-4264-a95b-6cfdc8a06749 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:55.766937 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Creating event network-vif-unplugged:bce09105-fb4a-4f06-b514-bb0b783a9256 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:55.769883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Creating event network-vif-unplugged:54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:55.771196 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] Creating event network-vif-unplugged:d33135cb-c28f-4fec-bab1-a5780eba555a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:55.815744 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-950b787a-10d0-46dd-947b-d23dbe3099f7 req-265734d6-b0be-4da0-9099-de7577c70a2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.187672 Sep 18 01:34:55.826087 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2642/5240] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:34:55.860773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-7b891cf0-a234-4907-b3b4-6c779e40f92e req-67fb35bd-b819-4f62-86eb-09af16d231bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-deleted", "tag": "fe99f160-71f0-4606-9e60-e36067aaf2a5"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:34:55.889416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:55.908373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:55.909303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7b891cf0-a234-4907-b3b4-6c779e40f92e req-67fb35bd-b819-4f62-86eb-09af16d231bc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.910059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:55.910842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7b891cf0-a234-4907-b3b4-6c779e40f92e req-67fb35bd-b819-4f62-86eb-09af16d231bc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.912000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7b891cf0-a234-4907-b3b4-6c779e40f92e req-67fb35bd-b819-4f62-86eb-09af16d231bc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.912296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-95331621-4d92-463b-86fc-3832288bd5bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2871 microversion: 2.42 time: 0.707006 Sep 18 01:34:55.913234 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2599/5241] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:34:55 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2871 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:34:55.941076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:55.942224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:55.960486 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-7b891cf0-a234-4907-b3b4-6c779e40f92e req-67fb35bd-b819-4f62-86eb-09af16d231bc service nova] Creating event network-vif-deleted:fe99f160-71f0-4606-9e60-e36067aaf2a5 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:55.965574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.966069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.970307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.971360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:55.971850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:55.972277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:55.979687 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-7b891cf0-a234-4907-b3b4-6c779e40f92e req-67fb35bd-b819-4f62-86eb-09af16d231bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143142 Sep 18 01:34:55.982420 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2643/5242] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:34:56.130714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:56.144710 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0583498b-4194-4869-be01-53fcb474bc2f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1266 microversion: 2.1 time: 0.207890 Sep 18 01:34:56.146458 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2600/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:55 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:34:56.215083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:56.216405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:56.232485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:56.233243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:56.233903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:56.234892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:56.236689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:56.237306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:56.397938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:56.431810 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63e18971-715a-48d3-b076-6b7b7de823b7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1307 microversion: 2.1 time: 0.218885 Sep 18 01:34:56.434187 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2644/5244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:56 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:56.950369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:56.951694 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:56.971917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:56.972846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:56.973436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:56.978443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:56.979229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:56.979835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:57.171233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:57.172327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:57.181521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:57.182908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:57.184189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:57.185792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:57.188518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:57.191784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:57.482290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:57.501761 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d80bfd5-e460-4146-af29-591fc3c94714 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1272 microversion: 2.1 time: 0.328438 Sep 18 01:34:57.525833 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2645/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:57 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:57.545815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:57.551628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:57.565231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:57.574236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:57.577974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:57.579113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:57.579741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:57.580375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:57.705934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:57.747907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:57.752049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:57.757953 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3640d461-e7f0-4328-ba75-d9cf0de69fa6 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2710 microversion: 2.42 time: 0.817126 Sep 18 01:34:57.759686 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2601/5246] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:34:56 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2710 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:34:58.089286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8ec512bd-465d-4da1-b15f-943f6a66e930 req-b84ed9ec-d461-43d8-ba68-c805f1d26b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-deleted", "tag": "bce09105-fb4a-4f06-b514-bb0b783a9256"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:34:58.104790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8ec512bd-465d-4da1-b15f-943f6a66e930 req-b84ed9ec-d461-43d8-ba68-c805f1d26b3c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:58.105535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8ec512bd-465d-4da1-b15f-943f6a66e930 req-b84ed9ec-d461-43d8-ba68-c805f1d26b3c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:58.106148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8ec512bd-465d-4da1-b15f-943f6a66e930 req-b84ed9ec-d461-43d8-ba68-c805f1d26b3c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:58.122582 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8ec512bd-465d-4da1-b15f-943f6a66e930 req-b84ed9ec-d461-43d8-ba68-c805f1d26b3c service nova] Creating event network-vif-deleted:bce09105-fb4a-4f06-b514-bb0b783a9256 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:34:58.130181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8ec512bd-465d-4da1-b15f-943f6a66e930 req-b84ed9ec-d461-43d8-ba68-c805f1d26b3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055830 Sep 18 01:34:58.131401 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2602/5247] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:34:58.295711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:58.307636 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9b6cdc1-c959-45f3-9dee-84eb5abd0076 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1375 microversion: 2.1 time: 0.778335 Sep 18 01:34:58.322652 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2646/5248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:57 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1375 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:58.540458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:58.542208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:58.555949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:58.556693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:58.557295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:58.563436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:58.564181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:58.564823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:58.795061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:58.796304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:58.807855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:58.808734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:58.811925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:58.815391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:58.816030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:58.818737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:58.907504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:58.919697 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2a567f3a-4caf-4a85-9e3c-fb7c1c9f11bb tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.385649 Sep 18 01:34:58.925926 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2603/5249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:58 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:34:59.332543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:59.334003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:59.354060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:59.354060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:59.355939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:59.355939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:59.355939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:59.356194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:59.435688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:59.479683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:59.481567 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:59.483160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adfa3271-f691-4a82-98b8-d1ec21d43253 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2596 microversion: 2.42 time: 0.692032 Sep 18 01:34:59.484893 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2647/5250] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:34:58 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2596 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:34:59.860122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:34:59.874724 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-308f179e-c4d5-4653-87e0-e092a03e3a47 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1375 microversion: 2.1 time: 0.545996 Sep 18 01:34:59.883803 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2604/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:59 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1375 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:34:59.949514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:34:59.950161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:34:59.960259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:59.961315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:59.962074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:34:59.968349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:34:59.969347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:34:59.974127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:00.160786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-63e6b6bd-c131-4c9b-8650-7ab58d4d9b74 req-edb90062-8652-493a-b603-0856e0e5a8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e9a349-fbcb-41ed-8f84-e0268134e098", "tag": "62b549be-de6d-46a2-b9ab-8edddebff6c1"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:00.177291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-63e6b6bd-c131-4c9b-8650-7ab58d4d9b74 req-edb90062-8652-493a-b603-0856e0e5a8f0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:00.178846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-63e6b6bd-c131-4c9b-8650-7ab58d4d9b74 req-edb90062-8652-493a-b603-0856e0e5a8f0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:00.179286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-63e6b6bd-c131-4c9b-8650-7ab58d4d9b74 req-edb90062-8652-493a-b603-0856e0e5a8f0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:00.218019 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-63e6b6bd-c131-4c9b-8650-7ab58d4d9b74 req-edb90062-8652-493a-b603-0856e0e5a8f0 service nova] Creating event network-changed:62b549be-de6d-46a2-b9ab-8edddebff6c1 for instance a4e9a349-fbcb-41ed-8f84-e0268134e098 on n-h1-master-1 Sep 18 01:35:00.231477 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-63e6b6bd-c131-4c9b-8650-7ab58d4d9b74 req-edb90062-8652-493a-b603-0856e0e5a8f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077422 Sep 18 01:35:00.235093 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2605/5252] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:00.474879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:00.498217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a57d751-295e-465b-acda-390f3a059db6 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.549964 Sep 18 01:35:00.499678 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2648/5253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:34:59 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:00.525780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:00.525780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:00.540685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:00.544094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:00.545324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:00.560632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:00.561731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:00.562637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:00.726122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0fe36503-fafa-4ad4-8e6f-296a6c09c8b4 req-d21b4c8a-468a-45a8-8382-cd22d513dc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-deleted", "tag": "54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:00.744577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0fe36503-fafa-4ad4-8e6f-296a6c09c8b4 req-d21b4c8a-468a-45a8-8382-cd22d513dc63 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:00.746214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0fe36503-fafa-4ad4-8e6f-296a6c09c8b4 req-d21b4c8a-468a-45a8-8382-cd22d513dc63 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:00.751715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0fe36503-fafa-4ad4-8e6f-296a6c09c8b4 req-d21b4c8a-468a-45a8-8382-cd22d513dc63 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:00.784422 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0fe36503-fafa-4ad4-8e6f-296a6c09c8b4 req-d21b4c8a-468a-45a8-8382-cd22d513dc63 service nova] Creating event network-vif-deleted:54524fde-5dfd-4eb3-8aa9-d8e13b99ab4a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:35:00.798729 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0fe36503-fafa-4ad4-8e6f-296a6c09c8b4 req-d21b4c8a-468a-45a8-8382-cd22d513dc63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076647 Sep 18 01:35:00.801151 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2649/5254] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:35:00.932505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:00.934298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:00.998040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:01.002046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:01.002750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:01.004437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:01.008390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:01.014173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:01.669341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:01.684350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:01.688865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:01.690169 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7ae6a183-0b13-45ed-8201-6801ec9c15e3 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2549 microversion: 2.42 time: 1.171523 Sep 18 01:35:01.695087 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2606/5255] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:00 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2549 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:01.699994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:01.700609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:01.728370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:01.729107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:01.731397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:01.733211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:01.735391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:01.736963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:01.835054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:01.844413 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a4e99a7-1cbb-4c1c-8814-8981f4147b22 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1375 microversion: 2.1 time: 0.930961 Sep 18 01:35:01.849761 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2650/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:00 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1375 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:35:02.249148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:02.262438 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a215d113-865b-4e08-a4a3-eaeea07b3f4a tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.566045 Sep 18 01:35:02.264942 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2607/5257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:01 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:02.270483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-940ca892-c9b7-4100-ba19-b846c7244bfd req-98b216c5-b6f1-45d1-a05f-d59575c61cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89dadc12-f4cb-4082-8806-9ee31150f1c5", "tag": "1c665775-1cf1-43ea-a9a5-c6609507aa94"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:02.301798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-940ca892-c9b7-4100-ba19-b846c7244bfd req-98b216c5-b6f1-45d1-a05f-d59575c61cdf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:02.302694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-940ca892-c9b7-4100-ba19-b846c7244bfd req-98b216c5-b6f1-45d1-a05f-d59575c61cdf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:02.303383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-940ca892-c9b7-4100-ba19-b846c7244bfd req-98b216c5-b6f1-45d1-a05f-d59575c61cdf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:02.319234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-940ca892-c9b7-4100-ba19-b846c7244bfd req-98b216c5-b6f1-45d1-a05f-d59575c61cdf service nova] Creating event network-changed:1c665775-1cf1-43ea-a9a5-c6609507aa94 for instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 on n-h1-master-1 Sep 18 01:35:02.325821 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-940ca892-c9b7-4100-ba19-b846c7244bfd req-98b216c5-b6f1-45d1-a05f-d59575c61cdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063600 Sep 18 01:35:02.327066 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2651/5258] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:02.725244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:02.727028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:02.737276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:02.740740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:02.741392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:02.742561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:02.743388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:02.744125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:02.874737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:02.876076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:02.887361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:02.888220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:02.889302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:02.891821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:02.893797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:02.894677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:03.111432 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:03.168390 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:03.219439 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:03.338658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:03.362819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:03.367834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:03.369103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8963f82-237b-400f-a7d0-3fa64cdaf5aa tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 2210 microversion: 2.42 time: 0.648477 Sep 18 01:35:03.372815 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2608/5259] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:02 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 2210 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:03.384382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1a0197aa-ebc9-41f3-bb46-297b51336ce1 req-6a09876c-28f3-4d52-b28b-20ae5297304b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-deleted", "tag": "d33135cb-c28f-4fec-bab1-a5780eba555a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:03.415293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a0197aa-ebc9-41f3-bb46-297b51336ce1 req-6a09876c-28f3-4d52-b28b-20ae5297304b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:03.416628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a0197aa-ebc9-41f3-bb46-297b51336ce1 req-6a09876c-28f3-4d52-b28b-20ae5297304b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:03.417270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a0197aa-ebc9-41f3-bb46-297b51336ce1 req-6a09876c-28f3-4d52-b28b-20ae5297304b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:03.447851 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1a0197aa-ebc9-41f3-bb46-297b51336ce1 req-6a09876c-28f3-4d52-b28b-20ae5297304b service nova] Creating event network-vif-deleted:d33135cb-c28f-4fec-bab1-a5780eba555a for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:35:03.471635 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1a0197aa-ebc9-41f3-bb46-297b51336ce1 req-6a09876c-28f3-4d52-b28b-20ae5297304b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096277 Sep 18 01:35:03.472775 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2609/5260] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:03.483980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:03.484984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:03.498674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:03.509086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:03.513883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:03.516622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:03.519989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:03.520764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:03.620008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:03.638840 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-85305ac5-e00a-4026-ac66-fc3ea20a1d30 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1375 microversion: 2.1 time: 0.768430 Sep 18 01:35:03.640932 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2652/5261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:02 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1375 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:03.989384 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:04.092831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:04.113137 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6ff933a8-7dc4-4cb0-8e4c-09ad87d75c99 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.638160 Sep 18 01:35:04.114146 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2610/5262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:03 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:04.396726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:04.397661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:04.410791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:04.411779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:04.412762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:04.415997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:04.417774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:04.418750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:04.660844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:04.680638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:04.693648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:04.694652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:04.700457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:04.704600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:04.707657 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08099886-891e-433c-afa5-b273f3bca41b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.310937 Sep 18 01:35:04.708906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:04.711814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:04.712837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:04.713544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:04.721960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:04.728978 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2653/5263] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:04 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:05.140645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:05.141819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:05.171042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:05.172057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:05.175395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:05.176510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:05.177168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:05.180882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:05.282216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:05.294821 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-489bd04f-9e23-48c1-b52c-ca9ec467b426 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1375 microversion: 2.1 time: 0.604921 Sep 18 01:35:05.296038 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2611/5264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:04 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1375 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:05.554848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e3e9363a-83a7-4a3f-8197-4a44f0e9e62d req-36e25b51-fd9b-40c9-b493-e3b78eaf6f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3389aeb-134a-425e-ac24-772e5be14cbd", "name": "network-vif-deleted", "tag": "fddbdb0d-62d9-4264-a95b-6cfdc8a06749"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:05.579883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e3e9363a-83a7-4a3f-8197-4a44f0e9e62d req-36e25b51-fd9b-40c9-b493-e3b78eaf6f9c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:05.591298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e3e9363a-83a7-4a3f-8197-4a44f0e9e62d req-36e25b51-fd9b-40c9-b493-e3b78eaf6f9c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:05.591298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e3e9363a-83a7-4a3f-8197-4a44f0e9e62d req-36e25b51-fd9b-40c9-b493-e3b78eaf6f9c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:05.631848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e3e9363a-83a7-4a3f-8197-4a44f0e9e62d req-36e25b51-fd9b-40c9-b493-e3b78eaf6f9c service nova] Creating event network-vif-deleted:fddbdb0d-62d9-4264-a95b-6cfdc8a06749 for instance e3389aeb-134a-425e-ac24-772e5be14cbd on n-h2-master-1 Sep 18 01:35:05.646517 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e3e9363a-83a7-4a3f-8197-4a44f0e9e62d req-36e25b51-fd9b-40c9-b493-e3b78eaf6f9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097518 Sep 18 01:35:05.650665 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2612/5265] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:05.655731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:05.667097 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d927a69-02fd-4659-9b41-0439a2ad1a2d tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.531944 Sep 18 01:35:05.669620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2654/5266] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:05 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:05.735007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-718dfd26-512b-406b-b463-4b8776c0149c req-aeb14923-4c8a-4d24-9742-fcf603d618f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e9a349-fbcb-41ed-8f84-e0268134e098", "name": "network-vif-plugged", "status": "completed", "tag": "62b549be-de6d-46a2-b9ab-8edddebff6c1"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:05.757265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:05.758510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:05.771288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:05.774155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:05.775781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:05.783522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:05.785085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:05.785954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:05.787973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-718dfd26-512b-406b-b463-4b8776c0149c req-aeb14923-4c8a-4d24-9742-fcf603d618f6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:05.792475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-718dfd26-512b-406b-b463-4b8776c0149c req-aeb14923-4c8a-4d24-9742-fcf603d618f6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:05.793166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-718dfd26-512b-406b-b463-4b8776c0149c req-aeb14923-4c8a-4d24-9742-fcf603d618f6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:05.796658 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:05.829684 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-718dfd26-512b-406b-b463-4b8776c0149c req-aeb14923-4c8a-4d24-9742-fcf603d618f6 service nova] Creating event network-vif-plugged:62b549be-de6d-46a2-b9ab-8edddebff6c1 for instance a4e9a349-fbcb-41ed-8f84-e0268134e098 on n-h1-master-1 Sep 18 01:35:05.839179 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-718dfd26-512b-406b-b463-4b8776c0149c req-aeb14923-4c8a-4d24-9742-fcf603d618f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110208 Sep 18 01:35:05.840421 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2613/5267] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:06.009322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:06.025912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:06.030064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:06.031883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e31cc396-f34a-465a-943b-595daa2bcef1 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.285715 Sep 18 01:35:06.033701 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2655/5268] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:05 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:35:06.325755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:06.329610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:06.359471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:06.360334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:06.361102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:06.362403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:06.363211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:06.363973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:06.703608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:06.708903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:06.713956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:06.734098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:06.734599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:06.735038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:06.735754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:06.737574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2c93d229-6f2c-4b69-89af-fc8aab286e9c tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1375 microversion: 2.1 time: 0.411161 Sep 18 01:35:06.738607 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2614/5269] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:06 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1375 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:06.739106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:06.739786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:07.069324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:07.071547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:07.092970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:07.094231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:07.095744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:07.099643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:07.103353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:07.104408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:07.119148 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:07.193325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:07.207284 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e00e80f-94b4-4a46-870c-5b469eafb328 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.517198 Sep 18 01:35:07.210842 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2656/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:06 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:07.475404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:07.506759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:07.514591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:07.518986 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-49194e56-fcff-4b45-b4de-19981fdd4741 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.461674 Sep 18 01:35:07.527161 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2615/5271] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:07 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:07.771240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:07.772983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:07.815943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:07.816446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:07.818518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:07.819277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:07.822204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:07.822902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:08.193176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:08.210049 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f4b6dc08-2f9f-476a-92e3-fa460587efec tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1547 microversion: 2.1 time: 0.447901 Sep 18 01:35:08.210916 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2657/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:07 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1547 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:08.244583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:08.246238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:08.247060 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:08.247776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:08.263077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:08.263334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:08.265083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:08.265754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:08.266389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:08.267548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:08.267777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:08.268616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:08.269138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:08.269788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:08.271912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:08.272425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:08.792097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:08.806464 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-05d1085d-004e-41ed-9594-00a4f1311838 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1547 microversion: 2.1 time: 0.572226 Sep 18 01:35:08.809418 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2658/5273] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:08 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1547 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:08.820207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:08.821089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:08.832955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:08.848165 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf31b4c1-26c7-4508-a6ab-a67e122377b8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.615571 Sep 18 01:35:08.853525 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2616/5274] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:08 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:08.853937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:08.854976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:08.855606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:08.856569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:08.857185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:08.857921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:08.938298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:08.952252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:08.954300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:08.955914 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d29510c7-2c61-4a27-a7f1-9dc0df161a4c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.143832 Sep 18 01:35:08.957421 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2659/5275] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:08 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:09.876662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:09.879504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:09.896440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:09.896941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:09.897389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:09.902265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:09.902748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:09.903187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:09.988825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:09.989443 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:10.015343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:10.016000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:10.016457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:10.017208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:10.017726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:10.018153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:10.662799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:10.697229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:10.701890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:10.710184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c4a794d2-9f74-4ac0-961f-3eaee0371c01 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.725162 Sep 18 01:35:10.713683 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2660/5276] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:09 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:10.852283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:10.872183 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-195fb266-d43b-4012-9b65-5463cd365f75 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 0.999372 Sep 18 01:35:10.875369 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2617/5277] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:09 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:11.374785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e4db1c8b-e384-4bcc-a219-cdd177743df4 req-916b9d1b-691a-4547-a049-1a81f477d7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89dadc12-f4cb-4082-8806-9ee31150f1c5", "name": "network-vif-plugged", "status": "completed", "tag": "1c665775-1cf1-43ea-a9a5-c6609507aa94"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:11.401277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e4db1c8b-e384-4bcc-a219-cdd177743df4 req-916b9d1b-691a-4547-a049-1a81f477d7dc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:11.401962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e4db1c8b-e384-4bcc-a219-cdd177743df4 req-916b9d1b-691a-4547-a049-1a81f477d7dc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:11.403984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e4db1c8b-e384-4bcc-a219-cdd177743df4 req-916b9d1b-691a-4547-a049-1a81f477d7dc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:11.440693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e4db1c8b-e384-4bcc-a219-cdd177743df4 req-916b9d1b-691a-4547-a049-1a81f477d7dc service nova] Creating event network-vif-plugged:1c665775-1cf1-43ea-a9a5-c6609507aa94 for instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 on n-h1-master-1 Sep 18 01:35:11.456825 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e4db1c8b-e384-4bcc-a219-cdd177743df4 req-916b9d1b-691a-4547-a049-1a81f477d7dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087189 Sep 18 01:35:11.459974 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2661/5278] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:11.750969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:11.751587 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:11.770509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:11.775380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:11.776087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:11.784493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:11.785344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:11.786307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:11.897648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:11.898948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:11.917271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:11.919538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:11.920206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:11.940789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:11.945159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:11.945695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:12.448290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:12.457972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:12.475497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:12.477315 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-932c7a1b-097a-4609-865d-c952b2f75fae tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.730425 Sep 18 01:35:12.490259 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2618/5279] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:11 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:12.926237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:12.939937 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-38d11178-d832-4934-9037-61c6920bdc32 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1314 microversion: 2.1 time: 1.047050 Sep 18 01:35:12.943962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2662/5280] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:11 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:13.509774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:13.511196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:13.533083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:13.533911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:13.534608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:13.540418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:13.540956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:13.541480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:13.724379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:13.740600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:13.742918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:13.744340 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c5f33e3c-35e9-4235-b278-2a0a9806c49e tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.238661 Sep 18 01:35:13.758559 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2619/5281] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:13 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:13.802478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-48903198-e1e5-4eba-85f0-3f15b82375af req-6bfd7957-bf38-483e-aac4-da3c05bf3747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e9a349-fbcb-41ed-8f84-e0268134e098", "tag": "62b549be-de6d-46a2-b9ab-8edddebff6c1"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:13.832715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-48903198-e1e5-4eba-85f0-3f15b82375af req-6bfd7957-bf38-483e-aac4-da3c05bf3747 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:13.833450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-48903198-e1e5-4eba-85f0-3f15b82375af req-6bfd7957-bf38-483e-aac4-da3c05bf3747 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:13.837182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-48903198-e1e5-4eba-85f0-3f15b82375af req-6bfd7957-bf38-483e-aac4-da3c05bf3747 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:13.876008 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-48903198-e1e5-4eba-85f0-3f15b82375af req-6bfd7957-bf38-483e-aac4-da3c05bf3747 service nova] Creating event network-changed:62b549be-de6d-46a2-b9ab-8edddebff6c1 for instance a4e9a349-fbcb-41ed-8f84-e0268134e098 on n-h1-master-1 Sep 18 01:35:13.896630 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-48903198-e1e5-4eba-85f0-3f15b82375af req-6bfd7957-bf38-483e-aac4-da3c05bf3747 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097958 Sep 18 01:35:13.903203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2663/5282] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:13.964890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:13.965729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:13.977535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:13.981975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:13.986200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:13.987125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:13.992634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:13.995893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:14.264639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:14.272896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96403764-2d4c-49c9-8457-273d5fe6a03b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1498 microversion: 2.1 time: 0.312189 Sep 18 01:35:14.281258 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2620/5283] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:13 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1498 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:14.783694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:14.786928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:14.799340 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:14.801523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:14.803989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:14.805232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:14.809161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:14.813034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:14.813891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:15.200405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:15.217140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:15.223628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:15.228308 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f2608a0b-bc5b-44d3-a01e-0d2536a225af tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.460131 Sep 18 01:35:15.230807 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2664/5284] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:14 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:35:15.512314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:15.512875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:15.518367 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:15.540340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:15.543000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:15.543863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:15.547796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:15.550134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:15.551499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:15.633090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:35:15.808684 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1da2452-06b1-41a6-8d03-9e82566f6118 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "DELETE /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 204 len: 0 microversion: 2.1 time: 0.310210 Sep 18 01:35:15.812943 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2621/5285] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:35:15 2022] DELETE /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:35:15.821863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:15.823445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:15.838811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:15.839572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:15.842177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:15.843492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:15.846981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:15.849160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:16.280984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:16.295250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:16.323194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:16.325850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:16.327817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:16.330431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:16.331551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:16.333490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:16.457214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:16.479924 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e36f6beb-9460-4c5b-ac47-51ebd8a268e5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1504 microversion: 2.1 time: 0.662361 Sep 18 01:35:16.489991 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2665/5286] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:15 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1504 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:16.511947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:16.524986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:16.527898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:16.529576 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcadc166-1dc2-4f54-b91a-852964594b1b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.273033 Sep 18 01:35:16.530709 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2622/5287] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:16 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:17.528401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:17.529061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:17.542854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:17.545995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:17.546606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:17.547412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:17.547806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:17.548241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:17.560378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:17.561731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:17.576768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:17.577673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:17.578356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:17.588803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:17.590925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:17.591632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:17.939494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:17.957840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:17.959916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:17.966400 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-225766d6-80af-442e-83e0-13c9e76d855b tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.409892 Sep 18 01:35:17.967375 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2623/5288] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:17 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:35:17.970383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:17.986233 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26bf9b51-dbdd-4460-8fc2-681cd7168f95 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1504 microversion: 2.1 time: 0.463187 Sep 18 01:35:17.987352 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2666/5289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:17 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:18.664979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a61c86ce-ddfa-48bc-9dfa-c3011d0a0ed5 req-cb9f6446-203c-422a-89bd-555a941ddbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89dadc12-f4cb-4082-8806-9ee31150f1c5", "name": "network-vif-deleted", "tag": "1c665775-1cf1-43ea-a9a5-c6609507aa94"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:18.688861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a61c86ce-ddfa-48bc-9dfa-c3011d0a0ed5 req-cb9f6446-203c-422a-89bd-555a941ddbb0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:18.689792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a61c86ce-ddfa-48bc-9dfa-c3011d0a0ed5 req-cb9f6446-203c-422a-89bd-555a941ddbb0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:18.690413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a61c86ce-ddfa-48bc-9dfa-c3011d0a0ed5 req-cb9f6446-203c-422a-89bd-555a941ddbb0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:18.728232 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a61c86ce-ddfa-48bc-9dfa-c3011d0a0ed5 req-cb9f6446-203c-422a-89bd-555a941ddbb0 service nova] Creating event network-vif-deleted:1c665775-1cf1-43ea-a9a5-c6609507aa94 for instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 on n-h1-master-1 Sep 18 01:35:18.733871 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a61c86ce-ddfa-48bc-9dfa-c3011d0a0ed5 req-cb9f6446-203c-422a-89bd-555a941ddbb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072621 Sep 18 01:35:18.734870 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2624/5290] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:18.999531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:19.000082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:19.018281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:19.019008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:19.027312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:19.027820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:19.028266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:19.028986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:19.031863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:19.032358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:19.032796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:19.033498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:19.034410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:19.042315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:19.042797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:19.043575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:19.120993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:19.121644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:19.122192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:19.122767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lazy-loading 'fault' on Instance uuid 89dadc12-f4cb-4082-8806-9ee31150f1c5 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:35:19.261212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:19.270417 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6448e66c-6434-4902-a8f4-f581ac969407 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 200 len: 1304 microversion: 2.1 time: 0.256480 Sep 18 01:35:19.270679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:19.278340 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2625/5291] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:19 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 1304 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:35:19.300866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:19.302768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:19.304272 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8350d2cb-2ca4-48ba-bd91-18d49e6d99bc tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.309995 Sep 18 01:35:19.330848 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2667/5292] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:18 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:20.305866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:20.306492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 89dadc12-f4cb-4082-8806-9ee31150f1c5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:20.325602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:20.326120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:20.326567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:20.327250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:20.327712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:20.328139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:20.339914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:20.342141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:20.362693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:20.369398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:20.372890 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] HTTP exception thrown: Instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 could not be found. Sep 18 01:35:20.373897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Request method failure captured: Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 HTTP/1.1 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnW3gWMUSIJua0IK2F4PpqW5iY-oaK9Z_O6jkLJDGQMq7CyAUKk3PFRIAC9LRMwKGJluZ3OTC2rKHpjik5qBWIonSWpSyXBnv0WqhXlPQSNtS6AYKZ59OPWrB47LRN_OFXG7pQ1gHpXDMPMtzQYgtDOPyKjdokT5dsSQXwfaX9ovkS8 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 0b2a96e1edca4a6482bacfe886221621 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesActionsTest-1627510718 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesActionsTest-1627510718 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 0b2a96e1edca4a6482bacfe886221621 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesActionsTest-1627510718 Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesActionsTest-1627510718-project Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4cf096e909804ae2a93315271fb3a38a Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesActionsTest-1627510718-project Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 could not be found. Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '89dadc12-f4cb-4082-8806-9ee31150f1c5'} Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 could not be found. Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 could not be found. Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:20.374611 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 could not be found. Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Returning 404 to user: Instance 89dadc12-f4cb-4082-8806-9ee31150f1c5 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:35:20.378993 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50471195-1399-43f6-ae1e-7d2ad02a127e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5" status: 404 len: 111 microversion: 2.1 time: 0.075073 Sep 18 01:35:20.385708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:20.386494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:20.392630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:20.394875 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2626/5293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:20 2022] GET /compute/v2.1/servers/89dadc12-f4cb-4082-8806-9ee31150f1c5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:35:20.529079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1385665800", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "4b60bdec-45b5-4962-9774-750c19fd0f30"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:20.568693 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:20.603118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:20.605408 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:20.613788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4dba1605-53f7-436a-8df5-3a484fcf8ddd tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.281383 Sep 18 01:35:20.615043 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2668/5294] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:20 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:20.654486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] validate_networks() for [('4b60bdec-45b5-4962-9774-750c19fd0f30', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:35:21.317815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:35:21.318426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:35:21.318896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:35:21.319317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:35:21.319765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:35:21.336784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:21.337281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:21.342222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:21.343212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:21.344977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:21.345645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:21.399581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Getting quotas for project 0b2a96e1edca4a6482bacfe886221621. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:35:21.406865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Getting quotas for user 4cf096e909804ae2a93315271fb3a38a and project 0b2a96e1edca4a6482bacfe886221621. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:35:21.433242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:35:21.437444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:35:21.509618 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b291a388-b684-4fc6-9ac6-653118f6afe5 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991795 Sep 18 01:35:21.510875 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2627/5295] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:35:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:35:21.522555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c1c81ce-71d9-43c9-8e46-01d07abe7e29 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:21.524203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c1c81ce-71d9-43c9-8e46-01d07abe7e29 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:21.645275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:21.646029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:21.660124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:21.660846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:21.662556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:21.664997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:21.665780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:21.667905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:21.690738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c1c81ce-71d9-43c9-8e46-01d07abe7e29 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:21.723483 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c1c81ce-71d9-43c9-8e46-01d07abe7e29 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1214 microversion: 2.1 time: 0.205399 Sep 18 01:35:21.732653 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2669/5296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:21 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:21.937318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:21.947141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:21.948603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:21.962764 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1f1b4c6-3ebf-45fd-b088-f82e1bf64330 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.309641 Sep 18 01:35:21.963985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2628/5297] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:21 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:22.759701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:22.760832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:22.776592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:22.777856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:22.778464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:22.780450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:22.782563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:22.783207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:22.913199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:22.922038 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b8fd6ade-75e5-4511-ae29-e25dd2aa62f8 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1210 microversion: 2.1 time: 0.167779 Sep 18 01:35:22.922612 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2670/5298] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:22 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:23.008508 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:23.009179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:23.025777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:23.026287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:23.026733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:23.027462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:23.030164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:23.031044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:23.226315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:23.240298 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:23.242654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:23.244347 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ad516d0-71c3-44ae-9a59-1e01a9301493 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.254913 Sep 18 01:35:23.245186 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2629/5299] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:22 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:23.956252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:23.956870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:23.964815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:23.970329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:23.971066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:23.972029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:23.972679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:23.973308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:24.199731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:24.208534 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1ff845a7-3f06-46ad-b553-6a1bae3bbabd tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1272 microversion: 2.1 time: 0.256257 Sep 18 01:35:24.229953 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2671/5300] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:23 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:24.274049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:24.275715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:24.288702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:24.294604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:24.295304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:24.296223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:24.296994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:24.297603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:24.408445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:24.427840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:24.431842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:24.435982 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6600887d-1a35-4c82-afef-5389675e2fdf tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.167392 Sep 18 01:35:24.437265 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2630/5301] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:24 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:25.245361 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:25.247051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:25.266584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:25.269247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:25.270399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:25.275353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:25.277966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:25.279043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:25.464662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:25.465500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:25.477418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:25.478628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:25.479300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:25.480460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:25.482115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:25.482804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:25.916744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:25.920737 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:25.930493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:25.932532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:25.934056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-43382455-dc18-4208-87d2-56b13984985c tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.474560 Sep 18 01:35:25.934830 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2631/5302] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:25 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:26.354341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:26.374262 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-43bcd897-c39d-4c9d-979f-2d43092cf49b tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 1.132471 Sep 18 01:35:26.375461 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2672/5303] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:25 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:26.971961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:26.973382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:27.008715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:27.009421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:27.011674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:27.012776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:27.013410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:27.014628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:27.157111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:27.182905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:27.184641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c90f881c9db4dcb9a9ecf4f8f31fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14e7fe58a1c4c0fb68a9aa803a0888f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:27.191823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2b2d1803-fa7b-4854-8fff-c0304930e599 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 200 len: 1604 microversion: 2.42 time: 0.225000 Sep 18 01:35:27.192456 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2632/5304] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:26 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:35:27.400433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:27.402731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:27.418055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:27.418812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:27.419442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:27.420322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:27.420943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:27.421531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:27.706988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-143287f7-fcfc-4eb4-b0cf-71b61ff39428 req-c43da874-354b-413c-94f9-5ea5168b86a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6432b2-5bd1-445d-9f08-177e0aa85d32", "tag": "1dbca8e4-a5e8-4c4d-bcfb-c4eed961d2cf"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:27.727188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-143287f7-fcfc-4eb4-b0cf-71b61ff39428 req-c43da874-354b-413c-94f9-5ea5168b86a6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:27.727476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:27.727693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-143287f7-fcfc-4eb4-b0cf-71b61ff39428 req-c43da874-354b-413c-94f9-5ea5168b86a6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:27.732479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-143287f7-fcfc-4eb4-b0cf-71b61ff39428 req-c43da874-354b-413c-94f9-5ea5168b86a6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:27.736100 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2a458ba-a812-4d98-bfa1-d2307c0e05ab tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 0.342242 Sep 18 01:35:27.736692 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2673/5305] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:27 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:27.776526 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-143287f7-fcfc-4eb4-b0cf-71b61ff39428 req-c43da874-354b-413c-94f9-5ea5168b86a6 service nova] Creating event network-changed:1dbca8e4-a5e8-4c4d-bcfb-c4eed961d2cf for instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 on n-h2-master-1 Sep 18 01:35:27.785151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-143287f7-fcfc-4eb4-b0cf-71b61ff39428 req-c43da874-354b-413c-94f9-5ea5168b86a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085921 Sep 18 01:35:27.788819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2633/5306] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:28.221525 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:28.222307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:28.235236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:28.235679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:28.238921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:28.241575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:28.242258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:28.242698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:28.279585 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:28.286141 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] HTTP exception thrown: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Request method failure captured: Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd HTTP/1.1 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnRJ0rzbPb9sNV-TBcC6HwydF0WmdyQuvt_GDB2tXfzlOjRRLoJV7FUsDgE-2SvRYkEMABSd_WmjGFQVeNiksEANQtax04_AuBfU4UbZmu4-Zp0m5vU8T43HqpwW1bztZf5YPGscHmDRFmZX0RqZgf-pfhASq_Mhkef8mTCHKpKUm_w Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.42 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e14e7fe58a1c4c0fb68a9aa803a0888f Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e14e7fe58a1c4c0fb68a9aa803a0888f Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TaggedBootDevicesTest_v242-965474782-project Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 6c90f881c9db4dcb9a9ecf4f8f31fc0b Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TaggedBootDevicesTest_v242-965474782-project Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e3389aeb-134a-425e-ac24-772e5be14cbd'} Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:28.289822 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:28.294621 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:28.299844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Returning 404 to user: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:35:28.300731 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-177d7257-e113-4e14-b3a2-dfc827424de9 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 404 len: 111 microversion: 2.42 time: 0.085312 Sep 18 01:35:28.301313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2674/5307] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:28 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:35:28.310924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a0582057-1fb1-4a0e-bcc5-f36c76491af2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '.version_select at 0x7f7006407ca0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:28.346254 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a0582057-1fb1-4a0e-bcc5-f36c76491af2 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332039213" status: 204 len: 0 microversion: 2.42 time: 0.039708 Sep 18 01:35:28.346929 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2634/5308] 10.222.0.25 () {60 vars in 1259 bytes} [Sun Sep 18 01:35:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332039213 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:35:28.761271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:28.762516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:28.773967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:28.775002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:28.775600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:28.776510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:28.777197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:28.778609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:29.412791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:29.425409 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bfe1e0b3-20f5-4fdb-8a51-e0a7817f18de tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 0.668944 Sep 18 01:35:29.427849 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2675/5309] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:28 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:30.453304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:30.454728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:30.483984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:30.484486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:30.484929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:30.492569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:30.505717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:30.506398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:30.897229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:30.908896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-392f4d16-2f5e-4ea0-b022-f8e41c1f6696 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 0.462182 Sep 18 01:35:30.910223 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2635/5310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:30 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:31.933580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:31.934298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:31.936511 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:31.954088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:31.954591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:31.955022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:31.956032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:31.956329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:31.956755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:32.461938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:32.470260 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55805e06-1782-44ab-80a9-f81e6ebf49ad tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 0.540543 Sep 18 01:35:32.470875 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2676/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:31 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:33.495084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:33.495981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:33.505001 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:33.507771 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:33.513461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:33.514867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:33.516634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:33.517715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:33.518486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:33.520087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:33.765112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:33.768784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:33.789995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:33.792031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:33.793145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:33.801541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:33.802735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:33.803205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:33.934125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4dc46ba0-58d7-4dc5-98d2-4a9eeb9f3411 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098/action" status: 200 len: 24571 microversion: 2.1 time: 0.180687 Sep 18 01:35:33.935441 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2677/5312] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:35:33 2022] POST /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098/action => generated 24571 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:35:35.087023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:35.105788 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1cfbece0-9acb-4432-83d5-e9bb51483e7f tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 1.616662 Sep 18 01:35:35.106820 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2636/5313] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:33 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:36.013687 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:36.014449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:36.027797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:36.028809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:36.030134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:36.031404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:36.032961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:36.033910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:36.057011 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] HTTP exception thrown: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Request method failure captured: Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd HTTP/1.1 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnRJ0rzbPb9sNV-TBcC6HwydF0WmdyQuvt_GDB2tXfzlOjRRLoJV7FUsDgE-2SvRYkEMABSd_WmjGFQVeNiksEANQtax04_AuBfU4UbZmu4-Zp0m5vU8T43HqpwW1bztZf5YPGscHmDRFmZX0RqZgf-pfhASq_Mhkef8mTCHKpKUm_w Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.42 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: e14e7fe58a1c4c0fb68a9aa803a0888f Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: e14e7fe58a1c4c0fb68a9aa803a0888f Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TaggedBootDevicesTest_v242-965474782-project Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 6c90f881c9db4dcb9a9ecf4f8f31fc0b Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TaggedBootDevicesTest_v242-965474782-project Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e3389aeb-134a-425e-ac24-772e5be14cbd'} Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:35:36.059885 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Returning 404 to user: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27eaf074-763f-438e-919e-0bfa3003fd39 tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 404 len: 111 microversion: 2.42 time: 0.063670 Sep 18 01:35:36.065035 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2678/5314] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:35:35 2022] DELETE /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:35:36.073882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:36.074885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] [instance: e3389aeb-134a-425e-ac24-772e5be14cbd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:36.082406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:36.083034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:36.083569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:36.084393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:36.085569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:36.086103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:36.105164 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] HTTP exception thrown: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Request method failure captured: Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd HTTP/1.1 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnRJ0rzbPb9sNV-TBcC6HwydF0WmdyQuvt_GDB2tXfzlOjRRLoJV7FUsDgE-2SvRYkEMABSd_WmjGFQVeNiksEANQtax04_AuBfU4UbZmu4-Zp0m5vU8T43HqpwW1bztZf5YPGscHmDRFmZX0RqZgf-pfhASq_Mhkef8mTCHKpKUm_w Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.42 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: e14e7fe58a1c4c0fb68a9aa803a0888f Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e14e7fe58a1c4c0fb68a9aa803a0888f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: e14e7fe58a1c4c0fb68a9aa803a0888f Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-965474782 Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TaggedBootDevicesTest_v242-965474782-project Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 6c90f881c9db4dcb9a9ecf4f8f31fc0b Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TaggedBootDevicesTest_v242-965474782-project Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: exception: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e3389aeb-134a-425e-ac24-772e5be14cbd'} Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.106986 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. Sep 18 01:35:36.112019 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:36.113899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] Returning 404 to user: Instance e3389aeb-134a-425e-ac24-772e5be14cbd could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:35:36.115023 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a39c5aa2-f084-4ef3-a0d6-d1f52509db4d tempest-TaggedBootDevicesTest_v242-965474782 tempest-TaggedBootDevicesTest_v242-965474782-project] 10.222.0.25 "GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd" status: 404 len: 111 microversion: 2.42 time: 0.046469 Sep 18 01:35:36.116181 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2637/5315] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:35:36 2022] GET /compute/v2.1/servers/e3389aeb-134a-425e-ac24-772e5be14cbd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:35:36.134563 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:36.135188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:36.153008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:36.153513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:36.153980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:36.154707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:36.158555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:36.160922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:36.499998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:36.508687 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4d9c7d5a-eec3-452e-88ff-8fd06b3ab1d3 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 0.379420 Sep 18 01:35:36.512901 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2679/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:36 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:36.736769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-bb420841-711f-4d25-b786-dba8760f58dc req-093d807d-ef07-4be9-90bf-be386ebe067f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6432b2-5bd1-445d-9f08-177e0aa85d32", "name": "network-vif-plugged", "status": "completed", "tag": "1dbca8e4-a5e8-4c4d-bcfb-c4eed961d2cf"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:36.757733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bb420841-711f-4d25-b786-dba8760f58dc req-093d807d-ef07-4be9-90bf-be386ebe067f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:36.758342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bb420841-711f-4d25-b786-dba8760f58dc req-093d807d-ef07-4be9-90bf-be386ebe067f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:36.759110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bb420841-711f-4d25-b786-dba8760f58dc req-093d807d-ef07-4be9-90bf-be386ebe067f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:36.776246 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-bb420841-711f-4d25-b786-dba8760f58dc req-093d807d-ef07-4be9-90bf-be386ebe067f service nova] Creating event network-vif-plugged:1dbca8e4-a5e8-4c4d-bcfb-c4eed961d2cf for instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 on n-h2-master-1 Sep 18 01:35:36.782010 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-bb420841-711f-4d25-b786-dba8760f58dc req-093d807d-ef07-4be9-90bf-be386ebe067f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049485 Sep 18 01:35:36.783148 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2638/5317] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:37.539569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:37.540254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:37.561059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:37.561917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:37.563449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:37.565624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:37.566890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:37.568522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:37.993708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:38.017194 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e40a30df-2729-4a27-9c24-88b82441d498 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1314 microversion: 2.1 time: 0.478232 Sep 18 01:35:38.018465 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2680/5318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:37 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:39.055161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:39.056120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:39.071530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:39.072832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:39.073572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:39.074547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:39.075332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:39.075870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:39.477070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:39.485824 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-282d8dda-3faf-4760-97a6-91b2dc10d6d1 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1498 microversion: 2.1 time: 0.444994 Sep 18 01:35:39.487239 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2639/5319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:39 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1498 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:40.477182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:40.477829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:40.498069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:40.500636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:40.501490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:40.503290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:40.503780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:40.511453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:40.563054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:35:40.734354 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adf9450a-4920-4927-8a20-153686efd506 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 204 len: 0 microversion: 2.1 time: 0.270069 Sep 18 01:35:40.741723 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2681/5320] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:35:40 2022] DELETE /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:35:40.750078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:40.752609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:40.787803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:40.795026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:40.796193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:40.798930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:40.800682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:40.801430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:41.037586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:41.052207 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf864d68-736a-42d7-87c7-c02835999c9e tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1504 microversion: 2.1 time: 0.306728 Sep 18 01:35:41.054193 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2640/5321] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:40 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:42.085012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:42.085786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:42.104939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:42.105565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:42.106664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:42.107547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:42.108166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:42.108755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:42.502391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:42.516992 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf74cd3d-d91b-4c3b-806d-1a758d046704 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1504 microversion: 2.1 time: 0.437818 Sep 18 01:35:42.520662 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2682/5322] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:42 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:43.545315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:43.545955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:43.563486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:43.563989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:43.564427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:43.574771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:43.575448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:43.575909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:43.742156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-dfb01d0d-2b8d-48d6-9b77-e1cd1bb15336 req-ac8e84d6-45f3-41f8-b45d-a18f4154f949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6432b2-5bd1-445d-9f08-177e0aa85d32", "name": "network-vif-deleted", "tag": "1dbca8e4-a5e8-4c4d-bcfb-c4eed961d2cf"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:43.778361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-dfb01d0d-2b8d-48d6-9b77-e1cd1bb15336 req-ac8e84d6-45f3-41f8-b45d-a18f4154f949 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:43.778897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-dfb01d0d-2b8d-48d6-9b77-e1cd1bb15336 req-ac8e84d6-45f3-41f8-b45d-a18f4154f949 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:43.779339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-dfb01d0d-2b8d-48d6-9b77-e1cd1bb15336 req-ac8e84d6-45f3-41f8-b45d-a18f4154f949 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:43.836883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-dfb01d0d-2b8d-48d6-9b77-e1cd1bb15336 req-ac8e84d6-45f3-41f8-b45d-a18f4154f949 service nova] Creating event network-vif-deleted:1dbca8e4-a5e8-4c4d-bcfb-c4eed961d2cf for instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 on n-h2-master-1 Sep 18 01:35:43.846508 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf096e909804ae2a93315271fb3a38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a96e1edca4a6482bacfe886221621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:43.855497 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-74d5675f-4548-4e14-84f5-9ecee477c5f9 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 200 len: 1462 microversion: 2.1 time: 0.314649 Sep 18 01:35:43.863114 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2641/5323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:43 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 1462 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:43.863236 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-dfb01d0d-2b8d-48d6-9b77-e1cd1bb15336 req-ac8e84d6-45f3-41f8-b45d-a18f4154f949 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121225 Sep 18 01:35:43.863236 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2683/5324] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:35:44.884400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:44.886607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] [instance: 9c6432b2-5bd1-445d-9f08-177e0aa85d32] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:44.899198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:44.900591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:44.901217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:44.902599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:44.903070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:44.903499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:44.921996 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] HTTP exception thrown: Instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 could not be found. Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Request method failure captured: Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 HTTP/1.1 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnW3gWMUSIJua0IK2F4PpqW5iY-oaK9Z_O6jkLJDGQMq7CyAUKk3PFRIAC9LRMwKGJluZ3OTC2rKHpjik5qBWIonSWpSyXBnv0WqhXlPQSNtS6AYKZ59OPWrB47LRN_OFXG7pQ1gHpXDMPMtzQYgtDOPyKjdokT5dsSQXwfaX9ovkS8 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 0b2a96e1edca4a6482bacfe886221621 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesActionsTest-1627510718 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2a96e1edca4a6482bacfe886221621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesActionsTest-1627510718 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 0b2a96e1edca4a6482bacfe886221621 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesActionsTest-1627510718 Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesActionsTest-1627510718-project Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4cf096e909804ae2a93315271fb3a38a Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesActionsTest-1627510718-project Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 could not be found. Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '9c6432b2-5bd1-445d-9f08-177e0aa85d32'} Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 could not be found. Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 could not be found. Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:35:44.923680 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 could not be found. Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] Returning 404 to user: Instance 9c6432b2-5bd1-445d-9f08-177e0aa85d32 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57bc952f-fb2f-4f2a-8b77-62d31979c304 tempest-VolumesActionsTest-1627510718 tempest-VolumesActionsTest-1627510718-project] 10.222.0.25 "GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32" status: 404 len: 111 microversion: 2.1 time: 0.049249 Sep 18 01:35:44.937426 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2642/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:44 2022] GET /compute/v2.1/servers/9c6432b2-5bd1-445d-9f08-177e0aa85d32 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:35:47.711625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b75dc18f-bd73-432b-b818-7c280471317b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'create', calling method: .version_select at 0x7f7004f991f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-549564658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3POSCuoqgdH5mbQgpKqBPIlyvXsf/An8UyBM6zR8cF443+1VreNplxIZzA58TuaWzrnVPLiIGAv11FC2x40kkroTlLR/pkgid5Ed8hj83XVHJ4cxkBP5Ve7W/OW0qm0g=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:47.734242 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:47.774708 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-b75dc18f-bd73-432b-b818-7c280471317b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for project efdad25b20bf447aa134ee525e6596e7. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:35:47.797962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-b75dc18f-bd73-432b-b818-7c280471317b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for user 9325389461a64760b4575af8a52065f5 and project efdad25b20bf447aa134ee525e6596e7. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:35:47.859985 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b75dc18f-bd73-432b-b818-7c280471317b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.155601 Sep 18 01:35:47.861413 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2684/5326] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:35:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:35:50.969905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1876371271", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "75f3808e-076b-4d76-b91d-a0946e939759"}], "key_name": "tempest-TestNetworkBasicOps-549564658", "security_groups": [{"name": "tempest-secgroup-smoke-211259542"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:35:51.047456 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:51.273257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] validate_networks() for [('75f3808e-076b-4d76-b91d-a0946e939759', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:35:52.266997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:35:52.267672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:35:52.270348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:35:52.270897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:35:52.271471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:35:52.299058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:52.300073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:52.301018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:52.302460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:52.303321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:52.303950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:52.338259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for project efdad25b20bf447aa134ee525e6596e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:35:52.345574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for user 9325389461a64760b4575af8a52065f5 and project efdad25b20bf447aa134ee525e6596e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:35:52.366705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:35:52.372607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:35:52.479069 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7659d9e-6d8b-4b36-8099-44244eb3b637 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.513263 Sep 18 01:35:52.488387 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2643/5327] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:35:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:35:52.494081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d2d2471-8a7e-4d81-9e48-319629d83ad4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:52.495420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d2d2471-8a7e-4d81-9e48-319629d83ad4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:52.737928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d2d2471-8a7e-4d81-9e48-319629d83ad4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:52.751350 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d2d2471-8a7e-4d81-9e48-319629d83ad4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1248 microversion: 2.1 time: 0.259253 Sep 18 01:35:52.757313 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2685/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:52 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1248 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:53.781967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:53.793516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:53.823235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:53.828081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:53.832167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:53.836282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:53.846419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:53.849588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:54.106646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:54.123029 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92f8a15d-57a5-4cc1-b2ca-1fc01bda8146 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1252 microversion: 2.1 time: 0.352521 Sep 18 01:35:54.140370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2644/5329] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:53 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1252 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:55.157314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:55.158608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:55.180719 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:55.192022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:55.198269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:55.202158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:55.203729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:55.207193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:55.207963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:55.614650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:55.624940 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a977ee29-f74e-4095-8194-b202ade45ba9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1318 microversion: 2.1 time: 0.478921 Sep 18 01:35:55.629178 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2686/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:55 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:56.660211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:56.663521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:56.685699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:56.693113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:56.695062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:56.696243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:56.699121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:56.700216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:57.260460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:57.277840 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=57 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:35:57.291482 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b91fe3d7-e19e-41ba-aac8-6dbad0e64fd2 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1306 microversion: 2.1 time: 0.634930 Sep 18 01:35:57.296329 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2645/5331] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:56 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1306 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:35:58.322424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:35:58.323839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:35:58.348422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:58.348987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:58.349487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:58.354185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:35:58.354663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:35:58.356662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:35:58.976880 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:35:58.985345 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-312b3b24-d29a-438b-bacc-153b80efac20 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.667402 Sep 18 01:35:58.986247 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2687/5332] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:35:58 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:00.018160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:00.022485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:00.060030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:00.062842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:00.063310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:00.064070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:00.064537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:00.065232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:00.300881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-7ccd7eb5-f809-4371-ac2b-4d0d9193df38 req-c28d2ba6-2165-47c7-9550-3690b85bf678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dba0978-3bff-4a8c-86b5-d0a7c79a97ad", "tag": "f3e403e6-05b7-4899-a0ed-1d2c73a5f04f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:36:00.339100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7ccd7eb5-f809-4371-ac2b-4d0d9193df38 req-c28d2ba6-2165-47c7-9550-3690b85bf678 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:00.340822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7ccd7eb5-f809-4371-ac2b-4d0d9193df38 req-c28d2ba6-2165-47c7-9550-3690b85bf678 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:00.341820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7ccd7eb5-f809-4371-ac2b-4d0d9193df38 req-c28d2ba6-2165-47c7-9550-3690b85bf678 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:00.448140 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-7ccd7eb5-f809-4371-ac2b-4d0d9193df38 req-c28d2ba6-2165-47c7-9550-3690b85bf678 service nova] Creating event network-changed:f3e403e6-05b7-4899-a0ed-1d2c73a5f04f for instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad on n-h2-master-1 Sep 18 01:36:00.458620 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-7ccd7eb5-f809-4371-ac2b-4d0d9193df38 req-c28d2ba6-2165-47c7-9550-3690b85bf678 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162271 Sep 18 01:36:00.463181 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2688/5333] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:36:01.357459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:01.368463 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8a43b4e-73bc-4e7c-ba44-c56d5897e69d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 1.358777 Sep 18 01:36:01.369056 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2646/5334] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:00 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:02.407307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:02.415475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:02.472180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:02.480681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:02.482082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:02.486520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:02.489686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:02.495052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:02.747188 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:03.209895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:03.219764 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e69f030-4d62-4f69-95dd-ac9dfe650c11 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.825779 Sep 18 01:36:03.220645 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2689/5335] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:02 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:04.258766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:04.259383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:04.262135 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:04.263993 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:04.299080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:04.299587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:04.300043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:04.300750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:04.301279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:04.301659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:04.958111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:04.967122 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5d861a67-dcde-40be-83ca-fe08586f4b12 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.713455 Sep 18 01:36:04.968155 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2647/5336] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:04 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:05.990501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:05.993519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:06.010503 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:06.022238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:06.023147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:06.028213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:06.038218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:06.039347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:06.584522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:06.594206 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fb9b37ef-1cbd-4479-8a8c-2357662a019d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.607508 Sep 18 01:36:06.603164 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2690/5337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:05 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:07.633418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:07.634230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:07.645586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:07.647408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:07.649242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:07.650367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:07.655545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:07.656148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:08.246212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:08.258667 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11fc1201-9121-4ac5-a0fc-8b5f28db546b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.630091 Sep 18 01:36:08.262669 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2648/5338] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:07 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:09.289088 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:09.290727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:09.300433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:09.321294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:09.323370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:09.324345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:09.326099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:09.327863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:09.869825 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:09.893168 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-272ff92f-5e05-4930-a8d1-2202b80823e5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.608997 Sep 18 01:36:09.901895 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2691/5339] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:09 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:10.924457 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:10.925924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:10.938823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:10.943877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:10.945891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:10.946980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:10.951455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:10.952210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:11.611876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:11.632674 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef0eccb9-e21e-4ac4-b4b2-1a4b06e0d1a9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.707117 Sep 18 01:36:11.650305 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2649/5340] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:10 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:12.658612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:12.659424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:12.679150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:12.684694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:12.690513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:12.693057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:12.705712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:12.706888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:12.922330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-05cbb4da-49c9-48cd-b13e-80082a67f26f req-b2014fe0-db27-493f-8ff9-6fb1d14de97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dba0978-3bff-4a8c-86b5-d0a7c79a97ad", "name": "network-vif-plugged", "status": "completed", "tag": "f3e403e6-05b7-4899-a0ed-1d2c73a5f04f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:36:12.969933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-05cbb4da-49c9-48cd-b13e-80082a67f26f req-b2014fe0-db27-493f-8ff9-6fb1d14de97d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:12.972002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-05cbb4da-49c9-48cd-b13e-80082a67f26f req-b2014fe0-db27-493f-8ff9-6fb1d14de97d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:12.978550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-05cbb4da-49c9-48cd-b13e-80082a67f26f req-b2014fe0-db27-493f-8ff9-6fb1d14de97d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:13.051609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-05cbb4da-49c9-48cd-b13e-80082a67f26f req-b2014fe0-db27-493f-8ff9-6fb1d14de97d service nova] Creating event network-vif-plugged:f3e403e6-05b7-4899-a0ed-1d2c73a5f04f for instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad on n-h2-master-1 Sep 18 01:36:13.086628 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-05cbb4da-49c9-48cd-b13e-80082a67f26f req-b2014fe0-db27-493f-8ff9-6fb1d14de97d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.592676 Sep 18 01:36:13.096329 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2692/5341] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:36:13.292275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:13.305609 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bba1b600-b629-4863-bbf3-3c945dc01ae0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.652270 Sep 18 01:36:13.308529 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2650/5342] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:12 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:14.342188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:14.344968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:14.363353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:14.366009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:14.368278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:14.373773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:14.374665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:14.375370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:14.764159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:14.778493 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fbf9835e-4157-4a69-937b-53c74d225358 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1373 microversion: 2.1 time: 0.449390 Sep 18 01:36:14.796307 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2693/5343] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:14 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1373 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:15.826030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:15.827490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:15.840125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:15.841484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:15.842762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:15.844724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:15.846292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:15.847698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:16.584303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:16.595566 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-edc15d16-e613-4210-953e-8a29c97dd3f9 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1545 microversion: 2.1 time: 0.779054 Sep 18 01:36:16.613653 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2651/5344] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:15 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1545 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:16.632558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:16.636480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:16.675618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:16.676424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:16.682278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:16.683383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:16.684097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:16.684730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:17.621370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:17.629905 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2f362f0-e19a-43bf-8373-b644a9d23cb7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1545 microversion: 2.1 time: 1.004877 Sep 18 01:36:17.637247 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2694/5345] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:16 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1545 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:40.908189 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:40.917969 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=37 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:41.172764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1817129624", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "ae224227-a275-4dce-97f8-c31466669cfb"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:36:41.357304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] validate_networks() for [('ae224227-a275-4dce-97f8-c31466669cfb', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:36:42.498590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:36:42.499127 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:36:42.501148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:36:42.501660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:36:42.502292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:36:42.523258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:42.525064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:42.525984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:42.528596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:42.530286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:42.531875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:42.597442 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Getting quotas for project d2edb53d86c049d4aa5cd19d2fcfe017. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:36:42.618757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Getting quotas for user 797b6fd984ac412b925069f3a584aa2c and project d2edb53d86c049d4aa5cd19d2fcfe017. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:36:42.644495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:36:42.651178 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:36:42.829029 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5761765b-e4ec-407e-b071-fc397595abed tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.932033 Sep 18 01:36:42.830321 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2652/5346] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:36:42.871525 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f58d7b1a-4c3a-4bd0-8925-f18626cd8d8b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:42.872153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f58d7b1a-4c3a-4bd0-8925-f18626cd8d8b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:42.892684 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:42.896270 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=46 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:43.102645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f58d7b1a-4c3a-4bd0-8925-f18626cd8d8b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:43.110983 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f58d7b1a-4c3a-4bd0-8925-f18626cd8d8b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1218 microversion: 2.1 time: 0.267798 Sep 18 01:36:43.115348 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2695/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:42 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:44.140153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:44.140778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:44.164365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:44.165811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:44.166288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:44.168675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:44.174450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:44.174871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:44.773365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:44.785150 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5867f8c6-9197-4e1e-a8c1-fdde4b063f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1222 microversion: 2.1 time: 0.647875 Sep 18 01:36:44.786530 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2653/5348] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:44 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1222 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:45.819705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:45.820345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:45.836483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:45.839839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:45.840494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:45.843848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:45.844658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:45.846489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:46.302544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:46.311894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-722444fd-7a5f-43c2-9290-a55baf259fc4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1288 microversion: 2.1 time: 0.498090 Sep 18 01:36:46.330499 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2696/5349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:45 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1288 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:47.347830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:47.349140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:47.363537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:47.368962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:47.369651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:47.370874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:47.372721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:47.373338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:47.529474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:47.540679 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b913bff-83e1-4c9f-8235-259abe269013 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1276 microversion: 2.1 time: 0.197723 Sep 18 01:36:47.553116 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2654/5350] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:47 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:36:48.576253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:48.577608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:48.597925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:48.598724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:48.599057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:48.599810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:48.600256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:48.600699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:48.873831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:48.883857 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31faabae-fb29-47f2-809e-501bfce5d2d9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1276 microversion: 2.1 time: 0.311803 Sep 18 01:36:48.884460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2697/5351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:48 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:49.908994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:49.917162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:49.932882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:49.933741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:49.934431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:49.948566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:49.953005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:49.954186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:51.148177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:51.156727 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c23831d-74a6-4039-97a2-32d941ee667b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 1.252414 Sep 18 01:36:51.159557 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2655/5352] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:49 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:52.186678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:52.188916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:52.206436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:52.207815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:52.210498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:52.212218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:52.213458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:52.217456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:52.221232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:52.222941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:52.229948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:52.240450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:52.241383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:52.243166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:52.245237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:52.245873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:52.335964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:36:52.518325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50f37524-0673-421d-99a0-c1d9fa35e218 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 204 len: 0 microversion: 2.1 time: 0.318812 Sep 18 01:36:52.521995 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2656/5353] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:36:52 2022] DELETE /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:36:52.549763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:52.551413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:52.561720 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:52.567880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:52.569703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:52.570494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:52.571885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:52.573010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:52.573751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:52.643410 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:53.111050 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:36:53.175640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:53.193163 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-214fd7f6-b69c-497d-96a5-2f185c4f7cdf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 1.013105 Sep 18 01:36:53.202361 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2698/5354] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:52 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:53.253098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:53.275092 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc7e9f0f-c067-424c-9528-d94cc107c439 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1551 microversion: 2.1 time: 0.741939 Sep 18 01:36:53.295773 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2657/5355] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:52 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1551 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:53.984795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-95c7aaef-30d6-496e-ace2-e61149cc62d7 req-22caabd9-7b3b-4c86-94c5-5f3252ea3839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58c07f9-623b-433f-a3e8-cf5ac51dcdee", "tag": "9b7d1710-8453-499f-959d-aaeaba185150"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:36:54.007899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95c7aaef-30d6-496e-ace2-e61149cc62d7 req-22caabd9-7b3b-4c86-94c5-5f3252ea3839 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:54.016289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95c7aaef-30d6-496e-ace2-e61149cc62d7 req-22caabd9-7b3b-4c86-94c5-5f3252ea3839 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:54.017700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-95c7aaef-30d6-496e-ace2-e61149cc62d7 req-22caabd9-7b3b-4c86-94c5-5f3252ea3839 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:54.228991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:54.229912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:54.249026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:54.249531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:54.250428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:54.251177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:54.251843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:54.252448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:54.756102 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-95c7aaef-30d6-496e-ace2-e61149cc62d7 req-22caabd9-7b3b-4c86-94c5-5f3252ea3839 service nova] Creating event network-changed:9b7d1710-8453-499f-959d-aaeaba185150 for instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee on n-h2-master-1 Sep 18 01:36:54.764479 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-95c7aaef-30d6-496e-ace2-e61149cc62d7 req-22caabd9-7b3b-4c86-94c5-5f3252ea3839 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.329608 Sep 18 01:36:54.765583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2699/5356] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:36:54.803733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:54.804770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:54.813312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:54.814290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:54.814954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:54.815904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:54.816609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:54.817512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:55.449458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:55.467205 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3966b8e9-5c67-4390-9650-eecfb594e9df tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 1.234936 Sep 18 01:36:55.467205 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2658/5357] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:54 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:36:55.849447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:55.907019 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2694b13f-ba08-4fee-a0c8-b205d7bc0530 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1551 microversion: 2.1 time: 1.112228 Sep 18 01:36:55.907894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2700/5358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:54 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1551 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:56.497368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:56.503139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:56.548976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:56.549985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:56.550751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:56.558372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:56.559146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:56.559771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:56.651462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b7ce8d0d-efb3-471d-9e5b-7cb91481e7b4 req-1c4e8e5d-63ac-4319-b950-5839d624667f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dba0978-3bff-4a8c-86b5-d0a7c79a97ad", "name": "network-vif-deleted", "tag": "f3e403e6-05b7-4899-a0ed-1d2c73a5f04f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:36:56.669372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b7ce8d0d-efb3-471d-9e5b-7cb91481e7b4 req-1c4e8e5d-63ac-4319-b950-5839d624667f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:56.675365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b7ce8d0d-efb3-471d-9e5b-7cb91481e7b4 req-1c4e8e5d-63ac-4319-b950-5839d624667f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:56.677892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b7ce8d0d-efb3-471d-9e5b-7cb91481e7b4 req-1c4e8e5d-63ac-4319-b950-5839d624667f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:56.710134 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b7ce8d0d-efb3-471d-9e5b-7cb91481e7b4 req-1c4e8e5d-63ac-4319-b950-5839d624667f service nova] Creating event network-vif-deleted:f3e403e6-05b7-4899-a0ed-1d2c73a5f04f for instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad on n-h2-master-1 Sep 18 01:36:56.718791 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b7ce8d0d-efb3-471d-9e5b-7cb91481e7b4 req-1c4e8e5d-63ac-4319-b950-5839d624667f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602835 Sep 18 01:36:56.719868 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2659/5359] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:36:56.938347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:56.946567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:56.958928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:56.962393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:56.963347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:56.965749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:56.968215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:56.969903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:57.322029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:57.358758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:57.361400 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9b721251-7da3-44cf-81fe-e61a59d78365 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 200 len: 1484 microversion: 2.1 time: 0.431764 Sep 18 01:36:57.362028 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2660/5360] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:56 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 1484 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:57.385778 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e757e11-f9eb-45ac-a2b3-1b72049f5f25 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 0.897214 Sep 18 01:36:57.401585 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2701/5361] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:56 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:36:58.384456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:58.385073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:58.417331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:58.418061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:58.418505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:58.419223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:58.419679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:58.422431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:58.431261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:58.431903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:58.443321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:58.444086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:58.446638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:58.447573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:58.448223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:58.451769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:58.454849 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] HTTP exception thrown: Instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad could not be found. Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Request method failure captured: Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad HTTP/1.1 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnWoem-wolW7tZT6gnCh5k_zTo1-JtKrd-XFbY8IDPkorPUjsHE060V635Beqt5ePXQhEbUiB-VU0Vh_QAdHsSWYoF0ome9JYlNVIVGWu-0Fu79QVY9sNpc_FFudXr_3ogFsHNWRDmp5yGSsGJB-814RoKXQpA_-mtgzz1gRLmednB4 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: efdad25b20bf447aa134ee525e6596e7 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestNetworkBasicOps-447704951 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestNetworkBasicOps-447704951 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: efdad25b20bf447aa134ee525e6596e7 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestNetworkBasicOps-447704951 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestNetworkBasicOps-447704951-project Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9325389461a64760b4575af8a52065f5 Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestNetworkBasicOps-447704951-project Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad could not be found. Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '0dba0978-3bff-4a8c-86b5-d0a7c79a97ad'} Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad could not be found. Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad could not be found. Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:36:58.458536 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad could not be found. Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:36:58.464168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Returning 404 to user: Instance 0dba0978-3bff-4a8c-86b5-d0a7c79a97ad could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:36:58.465423 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-82d27553-76b7-4b34-90b5-5f608bf89bc0 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad" status: 404 len: 111 microversion: 2.1 time: 0.081536 Sep 18 01:36:58.467336 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2661/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:58 2022] GET /compute/v2.1/servers/0dba0978-3bff-4a8c-86b5-d0a7c79a97ad => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:36:58.930205 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:36:58.944766 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-592f8634-9f14-4f7f-b7db-2d47b90cad18 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 0.517194 Sep 18 01:36:58.951249 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2702/5363] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:58 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:36:59.096119 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12bc2dfa-caca-409b-b2af-21f3705415d7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '.version_select at 0x7f70055d04c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:59.134737 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12bc2dfa-caca-409b-b2af-21f3705415d7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-549564658" status: 202 len: 0 microversion: 2.1 time: 0.042515 Sep 18 01:36:59.135954 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2662/5364] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Sep 18 01:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-549564658 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:36:59.969766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:36:59.971515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:36:59.986996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:59.987787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:59.991066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:36:59.992075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:36:59.993065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:36:59.993741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:00.513787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:00.526112 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ee2987c-920f-44d3-8af3-ebf187a0d8bf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 0.559369 Sep 18 01:37:00.542453 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2703/5365] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:36:59 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:01.552320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:01.552945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:01.568888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:01.570556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:01.571337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:01.572239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:01.572863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:01.573456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:01.874367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:01.888676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91a2d166-2ea7-4058-bd6d-74dede1446a7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 0.341455 Sep 18 01:37:01.890883 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2663/5366] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:01 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:02.927516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:02.932311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:02.954587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:02.958060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:02.959980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:02.963657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:02.968774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:02.969590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:03.102358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-fce42e0f-2b90-4a7d-909c-8221d32235e9 req-cde3c500-1fea-4c96-a49b-baf3e3f66750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c07f9-623b-433f-a3e8-cf5ac51dcdee", "name": "network-vif-plugged", "status": "completed", "tag": "9b7d1710-8453-499f-959d-aaeaba185150"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:03.130217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fce42e0f-2b90-4a7d-909c-8221d32235e9 req-cde3c500-1fea-4c96-a49b-baf3e3f66750 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:03.130577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fce42e0f-2b90-4a7d-909c-8221d32235e9 req-cde3c500-1fea-4c96-a49b-baf3e3f66750 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:03.136837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fce42e0f-2b90-4a7d-909c-8221d32235e9 req-cde3c500-1fea-4c96-a49b-baf3e3f66750 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:03.162747 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-fce42e0f-2b90-4a7d-909c-8221d32235e9 req-cde3c500-1fea-4c96-a49b-baf3e3f66750 service nova] Creating event network-vif-plugged:9b7d1710-8453-499f-959d-aaeaba185150 for instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee on n-h2-master-1 Sep 18 01:37:03.177231 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-fce42e0f-2b90-4a7d-909c-8221d32235e9 req-cde3c500-1fea-4c96-a49b-baf3e3f66750 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083165 Sep 18 01:37:03.178257 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2664/5367] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:03.378519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:03.391426 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4cc2b84a-e9c8-47d7-99c2-1fa84096cb3a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 0.476131 Sep 18 01:37:03.393206 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2704/5368] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:02 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:03.868426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:03.873246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:03.894906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:03.895925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:03.896770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:03.898395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:03.898986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-cc845ab8-37ad-42d7-8e69-7c1c889e5e8d req-3102468e-4e0a-4ac1-a9c8-fce3f952573a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e9a349-fbcb-41ed-8f84-e0268134e098", "tag": "62b549be-de6d-46a2-b9ab-8edddebff6c1"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:03.900592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:03.902152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:03.928006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cc845ab8-37ad-42d7-8e69-7c1c889e5e8d req-3102468e-4e0a-4ac1-a9c8-fce3f952573a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:03.929300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cc845ab8-37ad-42d7-8e69-7c1c889e5e8d req-3102468e-4e0a-4ac1-a9c8-fce3f952573a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:03.930011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-cc845ab8-37ad-42d7-8e69-7c1c889e5e8d req-3102468e-4e0a-4ac1-a9c8-fce3f952573a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:03.951424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:37:03.956249 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-cc845ab8-37ad-42d7-8e69-7c1c889e5e8d req-3102468e-4e0a-4ac1-a9c8-fce3f952573a service nova] Creating event network-changed:62b549be-de6d-46a2-b9ab-8edddebff6c1 for instance a4e9a349-fbcb-41ed-8f84-e0268134e098 on n-h1-master-1 Sep 18 01:37:03.971722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-cc845ab8-37ad-42d7-8e69-7c1c889e5e8d req-3102468e-4e0a-4ac1-a9c8-fce3f952573a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078144 Sep 18 01:37:03.974270 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2705/5369] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:04.109307 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46f1b35c-ffa5-4801-ba43-d785863d36eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 204 len: 0 microversion: 2.1 time: 0.248483 Sep 18 01:37:04.110508 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2665/5370] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:37:03 2022] DELETE /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:37:04.137382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:04.141102 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:04.171981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:04.177677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:04.179135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:04.180342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:04.181735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:04.182413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:04.429088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:04.430476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:04.447002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:04.448072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:04.449892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:04.451778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:04.452614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:04.453361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:04.710075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:04.720113 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b7aa869-80e9-4247-a782-a0fce66b4125 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1672 microversion: 2.1 time: 0.603033 Sep 18 01:37:04.740844 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2706/5371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:04 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1672 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:04.853966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:04.869323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-42573aaf-2848-4ed7-b0fd-c14b51eb8b30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1318 microversion: 2.1 time: 0.451740 Sep 18 01:37:04.887474 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2666/5372] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:04 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:05.748987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:05.750273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:05.764598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:05.766302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:05.768800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:05.771636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:05.787276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:05.788119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:05.901299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:05.901965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:05.924137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:05.924694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:05.925150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:05.925954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:05.931500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:05.931998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:06.661545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:06.672816 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c207ca80-d9cc-41da-a27f-4aeabce5ed3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1508 microversion: 2.1 time: 0.780168 Sep 18 01:37:06.677192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2667/5373] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:05 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1508 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:06.700329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:06.701234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:06.714094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:06.716138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:06.718680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:06.719624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:06.720717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:06.722128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:06.868326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:06.899815 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-837727fe-9837-4247-8486-3ca714552d10 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 200 len: 1672 microversion: 2.1 time: 1.148138 Sep 18 01:37:06.913580 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2707/5374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:05 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 1672 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:06.931131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-101274a6-6821-4266-ac6a-86079852d0a7 req-46390e74-ed60-4dcf-b417-b3d784a1870a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e9a349-fbcb-41ed-8f84-e0268134e098", "name": "network-vif-deleted", "tag": "62b549be-de6d-46a2-b9ab-8edddebff6c1"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:06.960017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-101274a6-6821-4266-ac6a-86079852d0a7 req-46390e74-ed60-4dcf-b417-b3d784a1870a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:06.960834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-101274a6-6821-4266-ac6a-86079852d0a7 req-46390e74-ed60-4dcf-b417-b3d784a1870a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:06.961457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-101274a6-6821-4266-ac6a-86079852d0a7 req-46390e74-ed60-4dcf-b417-b3d784a1870a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:06.982551 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-101274a6-6821-4266-ac6a-86079852d0a7 req-46390e74-ed60-4dcf-b417-b3d784a1870a service nova] Creating event network-vif-deleted:62b549be-de6d-46a2-b9ab-8edddebff6c1 for instance a4e9a349-fbcb-41ed-8f84-e0268134e098 on n-h1-master-1 Sep 18 01:37:06.997397 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-101274a6-6821-4266-ac6a-86079852d0a7 req-46390e74-ed60-4dcf-b417-b3d784a1870a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078158 Sep 18 01:37:06.998552 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2708/5375] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:07.100761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:07.126155 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:07.134449 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a95a2c9-c9b5-48e0-bea7-0c9c744ac1f5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1508 microversion: 2.1 time: 0.435932 Sep 18 01:37:07.139154 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2668/5376] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:06 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:07.163203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:07.168686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:07.191230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.203663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.204430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.206360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.209775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.210628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.397674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:37:07.410374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:37:07.411173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:37:07.411769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:37:07.412386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:37:07.558229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:07.586432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.590608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.594482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.600677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.604351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.605272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.682212 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bcd47b62-bbb3-47d8-8db2-aff15034ad22 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "POST /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee/action" status: 202 len: 1110 microversion: 2.1 time: 0.524238 Sep 18 01:37:07.682881 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2709/5377] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:37:07 2022] POST /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee/action => generated 1110 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 18 01:37:07.701820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:07.702673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:07.725453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.728312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.728990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.730478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.732469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.733130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.929859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:07.931251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: a4e9a349-fbcb-41ed-8f84-e0268134e098] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:07.939524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.940388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.941095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.942662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:07.947955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:07.948828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:07.997466 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] HTTP exception thrown: Instance a4e9a349-fbcb-41ed-8f84-e0268134e098 could not be found. Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Request method failure captured: Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 HTTP/1.1 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnWoem-wolW7tZT6gnCh5k_zTo1-JtKrd-XFbY8IDPkorPUjsHE060V635Beqt5ePXQhEbUiB-VU0Vh_QAdHsSWYoF0ome9JYlNVIVGWu-0Fu79QVY9sNpc_FFudXr_3ogFsHNWRDmp5yGSsGJB-814RoKXQpA_-mtgzz1gRLmednB4 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: efdad25b20bf447aa134ee525e6596e7 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestNetworkBasicOps-447704951 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestNetworkBasicOps-447704951 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: efdad25b20bf447aa134ee525e6596e7 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestNetworkBasicOps-447704951 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestNetworkBasicOps-447704951-project Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9325389461a64760b4575af8a52065f5 Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestNetworkBasicOps-447704951-project Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a4e9a349-fbcb-41ed-8f84-e0268134e098 could not be found. Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a4e9a349-fbcb-41ed-8f84-e0268134e098'} Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e9a349-fbcb-41ed-8f84-e0268134e098 could not be found. Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e9a349-fbcb-41ed-8f84-e0268134e098 could not be found. Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:37:07.999705 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:37:08.005210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:37:08.005210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:37:08.005210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:37:08.005210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:37:08.005210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:37:08.005210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e9a349-fbcb-41ed-8f84-e0268134e098 could not be found. Sep 18 01:37:08.005210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:37:08.010438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Returning 404 to user: Instance a4e9a349-fbcb-41ed-8f84-e0268134e098 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:37:08.011604 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-da2a4b52-13cf-4133-b135-2dda245a2c6e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098" status: 404 len: 111 microversion: 2.1 time: 0.087525 Sep 18 01:37:08.012422 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2710/5378] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:07 2022] GET /compute/v2.1/servers/a4e9a349-fbcb-41ed-8f84-e0268134e098 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:37:08.222084 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8716c854-3ea5-49e4-be83-455002f20af3 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '.version_select at 0x7f70050c0040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:08.230441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:08.251090 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-80f8aaec-53fc-4549-91e2-997432c69cea tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.550214 Sep 18 01:37:08.252722 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2669/5379] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:07 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:08.279412 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8716c854-3ea5-49e4-be83-455002f20af3 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1438376753" status: 202 len: 0 microversion: 2.1 time: 0.061251 Sep 18 01:37:08.280962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2711/5380] 10.222.0.25 () {58 vars in 1257 bytes} [Sun Sep 18 01:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1438376753 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:37:09.279040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:09.279763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:09.289413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:09.289884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:09.290330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:09.291059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:09.291518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:09.291951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:09.553033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:09.563887 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea366abe-c94b-4571-ae40-7a623c66ef0b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.288789 Sep 18 01:37:09.573952 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2670/5381] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:09 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:10.589350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:10.590695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:10.599964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:10.601170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:10.602118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:10.603758 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:10.617760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:10.626660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:10.839259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:10.856778 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2cf9f8dd-3da1-46fc-8294-d73769040cae tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.271059 Sep 18 01:37:10.856778 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2712/5382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:10 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:11.883578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:11.884606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:11.888958 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:11.893810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:11.895789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:11.896549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:11.897874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:11.898755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:11.899808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:12.106994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:12.117358 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a22d9b23-baff-495d-bb77-44b4967aee08 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.238132 Sep 18 01:37:12.120511 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2671/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:11 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:13.145066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:13.145731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:13.161848 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:13.163400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:13.163886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:13.164316 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:13.182650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:13.183415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:13.184028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:13.203170 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:13.580968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:13.595120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4655d4c8-7c8f-4dfe-a78f-57f6c46968d2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.454439 Sep 18 01:37:13.601634 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2713/5384] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:13 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:14.622950 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:14.626490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:14.663328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:14.664472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:14.665089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:14.666350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:14.667099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:14.667684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:15.204729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:15.224585 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-97a7b9f0-1a1e-46c8-b935-d16e665103de tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.605205 Sep 18 01:37:15.226725 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2672/5385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:14 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:16.248356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:16.249000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:16.271809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:16.272358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:16.272749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:16.273471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:16.277113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:16.279233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:16.682764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:16.697968 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50dcccf3-0cd7-4bb8-ad28-e2c8fcd6f628 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.453375 Sep 18 01:37:16.723918 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2714/5386] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:16 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:17.727477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:17.728762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:17.754799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:17.760597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:17.761371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:17.763026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:17.766488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:17.767217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:18.143239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:18.156744 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5be4319e-a7a6-4610-bda3-1f162d3118b6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.433023 Sep 18 01:37:18.158233 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2673/5387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:17 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:19.181103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:19.181797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:19.188930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:19.189391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:19.190074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:19.191612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:19.192288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:19.192940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:19.449970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:19.458712 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f81fddcf-ceef-436f-93eb-0a8393e14741 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.281771 Sep 18 01:37:19.465919 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2715/5388] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:19 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:20.492617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:20.494209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:20.507944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:20.510143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:20.513370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:20.514400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:20.515940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:20.516806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:21.365460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:21.379139 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fdb65804-c1c3-4dbf-9f3f-c8306c8f2e30 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.890028 Sep 18 01:37:21.393915 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2674/5389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:20 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:22.412448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:22.413184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:22.423476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:22.425133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:22.426389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:22.427191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:22.427730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:22.428338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:22.885485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:22.895232 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c9d3ebbd-8f54-4648-a603-adb78aa07a44 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.490032 Sep 18 01:37:22.924046 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2716/5390] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:22 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:23.927230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:23.928183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:23.956234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:23.960687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:23.965106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:23.968420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:23.969866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:23.971397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:24.318041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:24.331339 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f968e5e-f1de-407f-b6fd-facea2a80037 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.409292 Sep 18 01:37:24.348782 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2675/5391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:23 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:25.359377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:25.360922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:25.371807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:25.372267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:25.373092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:25.374420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:25.374892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:25.375328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:25.797426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:25.808184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2c3e137-f6dc-45d9-a6b5-4b58ffd6db32 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.456836 Sep 18 01:37:25.809402 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2717/5392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:25 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:26.838625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:26.842736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:26.877932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:26.880889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:26.882888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:26.885402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:26.889108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:26.894208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:27.168978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:27.185884 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7859d859-f3b6-4fdc-8f92-6afd1640fed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.351401 Sep 18 01:37:27.199054 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2676/5393] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:26 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:28.222590 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:28.223349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:28.239511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:28.240013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:28.240465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:28.241198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:28.290217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:28.290844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:28.794363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:28.803228 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-baedab2f-6f84-4590-9296-588507a2af3b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.584518 Sep 18 01:37:28.808672 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2718/5394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:28 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:29.723750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a9132a3f-c5b2-49e1-ac7c-bc402b180f72 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'create', calling method: .version_select at 0x7f700a822160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-925054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsQXKUm0shvhWnWdqk4O6pRCeldCpCoifPAdbAl3gzQYAI6RAtqBeS5dNlvBszc7LLbWaHbw76KPOW/0X/I0k6GhQLlJUCT0OpQcM8jNutLy7QJKpOFlTuwtNlX0SY78w=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:29.767737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a9132a3f-c5b2-49e1-ac7c-bc402b180f72 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for project efdad25b20bf447aa134ee525e6596e7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:37:29.810894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-a9132a3f-c5b2-49e1-ac7c-bc402b180f72 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for user 9325389461a64760b4575af8a52065f5 and project efdad25b20bf447aa134ee525e6596e7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:37:29.829155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:29.830079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:29.865432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:29.886772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:29.887773 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a9132a3f-c5b2-49e1-ac7c-bc402b180f72 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.170723 Sep 18 01:37:29.890764 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2677/5395] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:37:29 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:29.897462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:29.906963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:29.914598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:29.917816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:30.521087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:30.531176 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c1154a45-587f-44ff-bed9-e771ae4b636f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.705510 Sep 18 01:37:30.533591 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2719/5396] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:29 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:31.565230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:31.567120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:31.579233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:31.580743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:31.582227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:31.583443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:31.589061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:31.589982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:32.131912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:32.151216 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56fb4e99-ad34-4cd0-bcd0-920d09265225 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.590429 Sep 18 01:37:32.161943 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2678/5397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:31 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:32.985529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-978152567", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8a6715f1-be67-4a96-b4c8-218d6fb77551"}], "key_name": "tempest-TestNetworkBasicOps-925054", "security_groups": [{"name": "tempest-secgroup-smoke-1943039299"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:33.181002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:33.181886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:33.212078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:33.212078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:33.212078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:33.231656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:33.232266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:33.232739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:33.348356 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] validate_networks() for [('8a6715f1-be67-4a96-b4c8-218d6fb77551', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:37:33.851619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:33.860659 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-220cd7b7-58f1-46ca-8214-e41daf47ee1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.685566 Sep 18 01:37:33.884833 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2679/5398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:33 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:34.534271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1618479259", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "cb5efec9-c3b1-4a7a-a35b-0741c18feb23"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:34.617279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:37:34.617866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:37:34.618233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:37:34.618621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:37:34.619037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:37:34.629631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:34.630215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:34.630727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:34.632280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:34.632926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:34.633375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:34.661101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] validate_networks() for [('cb5efec9-c3b1-4a7a-a35b-0741c18feb23', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:37:34.667944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for project efdad25b20bf447aa134ee525e6596e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:37:34.676520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Getting quotas for user 9325389461a64760b4575af8a52065f5 and project efdad25b20bf447aa134ee525e6596e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:37:34.692433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:37:34.695221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:37:34.776053 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0f435bd0-2e7b-43ea-8607-f6bea33e1103 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.799989 Sep 18 01:37:34.783685 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2720/5399] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:37:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:37:34.789813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd45ee8f-597c-42c1-af8e-e4294bdcf47d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:34.790828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fd45ee8f-597c-42c1-af8e-e4294bdcf47d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:34.949544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd45ee8f-597c-42c1-af8e-e4294bdcf47d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:34.958032 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd45ee8f-597c-42c1-af8e-e4294bdcf47d tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1244 microversion: 2.1 time: 0.171793 Sep 18 01:37:34.973417 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2721/5400] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:34 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1244 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:34.988789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:34.989420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:35.008081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:35.008734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:35.009325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:35.010335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:35.012032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:35.012555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:35.267098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:35.279812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-98a75e74-5c1b-48cd-8235-72af63cef7a3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1515 microversion: 2.1 time: 0.308034 Sep 18 01:37:35.280424 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2722/5401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:34 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:35.609645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:37:35.611030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:37:35.611790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:37:35.613693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:37:35.613693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:37:35.624580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:35.625913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:35.626771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:35.627804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:35.629353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:35.630084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:35.656693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Getting quotas for project b04995d20aa446abae85cebada1fca2b. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:37:35.663054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Getting quotas for user 4369931aec12469bbcd0fb85b169c943 and project b04995d20aa446abae85cebada1fca2b. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:37:35.678051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:37:35.683675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:37:35.803841 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-10a160e4-d8ac-4ca6-b6e1-d3586831a17b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257746 Sep 18 01:37:35.805265 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2680/5402] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:37:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:37:35.818483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b757ef1-f6d8-40fa-a9a9-b9a129031b10 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:35.819622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b757ef1-f6d8-40fa-a9a9-b9a129031b10 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:35.981239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b757ef1-f6d8-40fa-a9a9-b9a129031b10 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:35.986873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:35.988032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:35.995909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b757ef1-f6d8-40fa-a9a9-b9a129031b10 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1219 microversion: 2.1 time: 0.182510 Sep 18 01:37:35.996639 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2723/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:35 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:36.005791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:36.006343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:36.006819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:36.007813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:36.010479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:36.010928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:36.149780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:36.172775 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a18388af-6ac8-4df1-9a31-9b87fc9cf255 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1296 microversion: 2.1 time: 0.188111 Sep 18 01:37:36.173396 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2681/5404] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:35 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1296 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:36.306018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:36.306878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:36.326454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:36.329729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:36.331403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:36.332363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:36.334306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:36.336117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:36.725359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:36.759570 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1906352a-b2f9-48ba-9374-7cf02a83da2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1521 microversion: 2.1 time: 0.458699 Sep 18 01:37:36.774184 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2724/5405] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:36 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:37.023129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:37.023756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:37.035416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:37.036320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:37.037040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:37.038109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:37.038757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:37.039451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:37.153126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:37.164001 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-110eb70d-769b-4a78-b7fb-d2bf50ef42be tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1215 microversion: 2.1 time: 0.145631 Sep 18 01:37:37.165018 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2682/5406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:37 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:37.204061 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:37.204965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:37.215055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:37.215556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:37.216007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:37.220062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:37.220569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:37.223249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:37.331264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:37.341786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-196be531-e48b-459c-8df6-f2acf1088b41 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1302 microversion: 2.1 time: 0.145071 Sep 18 01:37:37.343536 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2725/5407] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:37 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1302 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:37.810295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:37.812275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:37.823509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:37.824404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:37.825447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:37.828748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:37.830833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:37.832712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:37.841680 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=75 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:38.151023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:38.172963 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f03c0c5-4849-4b57-976b-8549c5fa9134 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1521 microversion: 2.1 time: 0.377565 Sep 18 01:37:38.191516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:38.192148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:38.198036 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2683/5408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:37 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:38.204042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:38.204489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:38.205104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:38.205681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:38.208889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:38.214098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:38.373373 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:38.374348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:38.383407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:38.384279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:38.384944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:38.385928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:38.386641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:38.387421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:38.431503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:38.444084 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9a89862-e6d5-4377-9566-1cf6e1834d13 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1277 microversion: 2.1 time: 0.258092 Sep 18 01:37:38.445694 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2726/5409] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:38 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:38.483142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:38.495114 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9cdbe80-3c0c-4fca-bf61-adc35fbd6e8e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1302 microversion: 2.1 time: 0.126971 Sep 18 01:37:38.496101 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2684/5410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:38 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:39.209950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:39.210841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:39.225278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:39.227296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:39.228464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:39.232111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:39.232708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:39.233394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:39.468766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:39.482130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:39.492376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:39.496187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:39.499196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:39.500258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:39.500897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:39.502265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:39.509790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:39.525402 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b5be9df-c469-4ae8-900c-fab399bd031e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1521 microversion: 2.1 time: 0.320498 Sep 18 01:37:39.526558 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2727/5411] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:39 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:39.531893 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:39.532776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:39.540864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:39.541712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:39.542577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:39.543301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:39.543831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:39.544265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:39.664878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:39.677109 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-762542d3-b0bd-4a4e-a7e7-ee6cebfd99b4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1277 microversion: 2.1 time: 0.212046 Sep 18 01:37:39.680383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2685/5412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:39 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:39.750330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:39.759735 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abf9d52b-d26a-4bb8-a5eb-7294cc39819b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.231816 Sep 18 01:37:39.761047 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2728/5413] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:39 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:40.548192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:40.549070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:40.564135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:40.564642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:40.565083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:40.566385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:40.566841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:40.567263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:40.712850 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:40.714135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:40.721196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:40.722119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:40.722732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:40.723620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:40.724242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:40.724895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:40.850794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:40.863595 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fa04ae65-8280-4d85-88a7-f76425d46ce6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1521 microversion: 2.1 time: 0.319189 Sep 18 01:37:40.864486 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2686/5414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:40 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:40.871617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:40.872609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:40.880499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:40.881407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:40.882129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:40.883124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:40.883871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:40.885211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:40.958783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:40.968855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f85715c-a105-4425-826f-ecc808105c22 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.260792 Sep 18 01:37:40.972294 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2729/5415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:40 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:41.219618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:41.229746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a59e28ab-ece7-4f9d-892b-2f912108a81a req-81add41d-7371-4be8-aa40-bf8474587f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c07f9-623b-433f-a3e8-cf5ac51dcdee", "name": "network-vif-plugged", "status": "completed", "tag": "9b7d1710-8453-499f-959d-aaeaba185150"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:41.240097 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-87f01782-9de4-497c-b176-a501ccc5e5a4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.374141 Sep 18 01:37:41.256386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2687/5416] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:40 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:41.270156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a59e28ab-ece7-4f9d-892b-2f912108a81a req-81add41d-7371-4be8-aa40-bf8474587f6c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:41.270914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a59e28ab-ece7-4f9d-892b-2f912108a81a req-81add41d-7371-4be8-aa40-bf8474587f6c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:41.272577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a59e28ab-ece7-4f9d-892b-2f912108a81a req-81add41d-7371-4be8-aa40-bf8474587f6c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:41.304081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a59e28ab-ece7-4f9d-892b-2f912108a81a req-81add41d-7371-4be8-aa40-bf8474587f6c service nova] Creating event network-vif-plugged:9b7d1710-8453-499f-959d-aaeaba185150 for instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee on n-h2-master-1 Sep 18 01:37:41.317245 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a59e28ab-ece7-4f9d-892b-2f912108a81a req-81add41d-7371-4be8-aa40-bf8474587f6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091026 Sep 18 01:37:41.318233 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2730/5417] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:37:41.892235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-af874bb4-0881-48f8-8938-684152cb56a7 req-6254ac5d-303b-4bd0-9f96-0de6e93b3cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83d8386-8b3b-402b-9454-388a1bf7cd9b", "tag": "58239bef-087f-421f-8ccd-1d2ca629997b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:41.901361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:41.902071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:41.924543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:41.925605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:41.926019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:41.926725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:41.927177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:41.927597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:41.931596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-af874bb4-0881-48f8-8938-684152cb56a7 req-6254ac5d-303b-4bd0-9f96-0de6e93b3cf4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:41.932070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-af874bb4-0881-48f8-8938-684152cb56a7 req-6254ac5d-303b-4bd0-9f96-0de6e93b3cf4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:41.932494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-af874bb4-0881-48f8-8938-684152cb56a7 req-6254ac5d-303b-4bd0-9f96-0de6e93b3cf4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:41.965759 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-af874bb4-0881-48f8-8938-684152cb56a7 req-6254ac5d-303b-4bd0-9f96-0de6e93b3cf4 service nova] Creating event network-changed:58239bef-087f-421f-8ccd-1d2ca629997b for instance b83d8386-8b3b-402b-9454-388a1bf7cd9b on n-h1-master-1 Sep 18 01:37:41.993474 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-af874bb4-0881-48f8-8938-684152cb56a7 req-6254ac5d-303b-4bd0-9f96-0de6e93b3cf4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098702 Sep 18 01:37:41.994196 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2731/5418] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:42.005448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:42.006400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:42.016253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:42.017851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:42.018919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:42.020284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:42.020960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:42.022404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:42.459293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:42.474860 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a80d3781-0df7-42bb-b989-de3329232faa tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1521 microversion: 2.1 time: 0.588808 Sep 18 01:37:42.495321 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2688/5419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:41 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:42.498706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:42.510124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:42.511392 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe369627-0415-4421-b71c-27d4562dc8d4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.515708 Sep 18 01:37:42.512000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:42.514797 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2732/5420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:41 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:42.515128 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:42.521979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:42.522408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:42.522856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:42.523563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:42.524024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:42.524886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:42.790114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:42.800761 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9818c68-3ba0-4e89-a3da-de8a15021b51 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.302530 Sep 18 01:37:42.801260 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2689/5421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:42 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:43.507153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:43.507786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:43.513483 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:43.520750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:43.521589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:43.522374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:43.523479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:43.524244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:43.525189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:43.531798 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:43.541038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:43.544630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:43.567100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:43.567628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:43.568081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:43.568806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:43.571272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:43.571742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:43.906243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:43.915671 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ffe5ce3-ecc1-471a-a548-04bbcedab6ab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1506 microversion: 2.1 time: 0.415852 Sep 18 01:37:43.920936 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2733/5422] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:43 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:43.926463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:43.928938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:43.947380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:43.947913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:43.948363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:43.949087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:43.952020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:43.953202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:43.980641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:43.991240 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-941ffbc2-390b-4afe-8334-ff27808220d5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.455916 Sep 18 01:37:43.992466 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2690/5423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:43 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:44.001420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:44.007422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:44.021032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:44.021578 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:44.022260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:44.023159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:44.023705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:44.024283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:44.340960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:44.355779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:44.369391 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e317436b-190a-4f3c-ae80-8c31d794bbaf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 200 len: 1506 microversion: 2.1 time: 0.358420 Sep 18 01:37:44.385588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6362bf3-c4be-4e18-86e4-d18fc53b8096 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.448274 Sep 18 01:37:44.385839 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2691/5424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:43 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:44.391584 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2734/5425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:43 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:44.398629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:44.398865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-69c717f2-6fe6-48d2-a1ed-0502b7d41137 req-2d6f0edb-dea3-4c5c-b486-2c572983a9be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cdd6db-0cfe-45d5-b4e4-20caf58baafa", "tag": "7042643c-740c-47bc-bad0-b6245e3fe573"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:44.399807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:44.407738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:44.408546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:44.409729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:44.410607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:44.411238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:44.411376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-69c717f2-6fe6-48d2-a1ed-0502b7d41137 req-2d6f0edb-dea3-4c5c-b486-2c572983a9be service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:44.411890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-69c717f2-6fe6-48d2-a1ed-0502b7d41137 req-2d6f0edb-dea3-4c5c-b486-2c572983a9be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:44.412174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:44.412393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-69c717f2-6fe6-48d2-a1ed-0502b7d41137 req-2d6f0edb-dea3-4c5c-b486-2c572983a9be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:44.451560 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-69c717f2-6fe6-48d2-a1ed-0502b7d41137 req-2d6f0edb-dea3-4c5c-b486-2c572983a9be service nova] Creating event network-changed:7042643c-740c-47bc-bad0-b6245e3fe573 for instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa on n-h1-master-1 Sep 18 01:37:44.466326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:37:44.482599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-69c717f2-6fe6-48d2-a1ed-0502b7d41137 req-2d6f0edb-dea3-4c5c-b486-2c572983a9be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090313 Sep 18 01:37:44.483863 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2692/5426] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:44.695124 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:44.703137 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3cc92ba1-41b3-42ce-b3bb-633557dbef1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 204 len: 0 microversion: 2.1 time: 0.308983 Sep 18 01:37:44.707030 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2735/5427] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:37:44 2022] DELETE /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:37:44.940383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-389892611", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "ae224227-a275-4dce-97f8-c31466669cfb"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:45.030473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:45.031991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:45.041052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] validate_networks() for [('ae224227-a275-4dce-97f8-c31466669cfb', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:37:45.067455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:45.071995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:45.076827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:45.077871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:45.078958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:45.079563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:45.583210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:45.594234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9bb4e9f-ca42-4b65-9a43-3bbbd64eb7ef tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.580167 Sep 18 01:37:45.622566 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2736/5428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:45 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:45.636934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:45.638040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:45.639841 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:45.656327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:45.656863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:45.657271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:45.658029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:45.658491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:45.658966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:45.671772 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:45.965681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:46.006391 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:46.028595 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb913d7e-daf5-498b-b72c-6df0788447b5 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.400339 Sep 18 01:37:46.031337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2737/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:45 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:46.353434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:37:46.354052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:37:46.354610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:37:46.355282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:37:46.355855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:37:46.386526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:46.387172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:46.387703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:46.388577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:46.389112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:46.389672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:46.425309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Getting quotas for project d2edb53d86c049d4aa5cd19d2fcfe017. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:37:46.477847 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Getting quotas for user 797b6fd984ac412b925069f3a584aa2c and project d2edb53d86c049d4aa5cd19d2fcfe017. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:37:46.505441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:37:46.521276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:37:46.624420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:46.626004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:46.648423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:46.650277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:46.650936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:46.653400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:46.654121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:46.657242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:46.663835 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1f519104-2ecc-4f07-8f4c-626ac907a691 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730572 Sep 18 01:37:46.668556 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2693/5430] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:37:46.680005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1158a55-d739-498e-8ccd-0e7718240aee tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:46.687795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1158a55-d739-498e-8ccd-0e7718240aee tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:47.049038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:47.059732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00b5a7a4-e5ac-45c3-9fe7-67dddf65fd76 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.439222 Sep 18 01:37:47.073210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c1158a55-d739-498e-8ccd-0e7718240aee tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:47.082292 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2738/5431] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:46 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:47.088342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:47.096323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1158a55-d739-498e-8ccd-0e7718240aee tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1217 microversion: 2.1 time: 0.420141 Sep 18 01:37:47.098286 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2694/5432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:46 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1217 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:47.100156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:47.111683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:47.113165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:47.115833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:47.116841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:47.119254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:47.119894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:47.364062 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:47.376052 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c51ae875-4d7e-4143-89fc-941cb3d2d5eb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.292204 Sep 18 01:37:47.377056 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2739/5433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:47 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:47.788230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f7b38fb6-efe6-4d80-8525-9c7f053009ca req-cbd2a4c6-6918-485d-903d-8df6f040959e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c07f9-623b-433f-a3e8-cf5ac51dcdee", "name": "network-vif-deleted", "tag": "9b7d1710-8453-499f-959d-aaeaba185150"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:47.817474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f7b38fb6-efe6-4d80-8525-9c7f053009ca req-cbd2a4c6-6918-485d-903d-8df6f040959e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:47.818131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f7b38fb6-efe6-4d80-8525-9c7f053009ca req-cbd2a4c6-6918-485d-903d-8df6f040959e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:47.818582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f7b38fb6-efe6-4d80-8525-9c7f053009ca req-cbd2a4c6-6918-485d-903d-8df6f040959e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:47.849519 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f7b38fb6-efe6-4d80-8525-9c7f053009ca req-cbd2a4c6-6918-485d-903d-8df6f040959e service nova] Creating event network-vif-deleted:9b7d1710-8453-499f-959d-aaeaba185150 for instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee on n-h2-master-1 Sep 18 01:37:47.863129 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f7b38fb6-efe6-4d80-8525-9c7f053009ca req-cbd2a4c6-6918-485d-903d-8df6f040959e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079250 Sep 18 01:37:47.864508 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2695/5434] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:48.121450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:48.122389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:48.123379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:48.131720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:48.141291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:48.141836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:48.142281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:48.142997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:48.143516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:48.153792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:48.161877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:48.162383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:48.166232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:48.172599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:48.176508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:48.178166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:48.582015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:48.591038 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6c74795-6328-4f16-92a5-ae44e37b2a9b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1213 microversion: 2.1 time: 0.474350 Sep 18 01:37:48.591862 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2696/5435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:48 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1213 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:48.597234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:48.598123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:48.605264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:48.606077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:48.606716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:48.607602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:48.608232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:48.608835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:48.657890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:48.667295 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-248848f9-86d2-433f-8167-4e0e4017361c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.569272 Sep 18 01:37:48.667888 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2740/5436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:48 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:48.978785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:49.004375 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d5fd46a-bb41-4c6b-82c7-0121f1966534 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.411072 Sep 18 01:37:49.005320 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2697/5437] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:48 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:49.620378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:49.621983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:49.641034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:49.642910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:49.644927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:49.646797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:49.649372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:49.650405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:49.694371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:49.694908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:49.734220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:49.738692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:49.739921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:49.744171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:49.746240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:49.749285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:49.829612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:49.841156 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dfb352e3-81f8-4abd-bcde-75058b23d3fb tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1277 microversion: 2.1 time: 0.225682 Sep 18 01:37:49.844404 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2741/5438] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:49 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:50.033405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:50.034522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:50.054073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:50.054682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:50.055135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:50.055886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:50.056345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:50.056773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:50.166123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:50.181984 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98804233-5a05-49aa-98ab-9bdee48618df tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.492147 Sep 18 01:37:50.183377 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2698/5439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:49 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:50.374024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:50.395251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa2b2a32-8af9-439f-8956-88612fef10db tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.364134 Sep 18 01:37:50.396675 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2742/5440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:50 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:50.874322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:50.877379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:50.907019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:50.912622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:50.913063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:50.913750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:50.914399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:50.915782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:51.036312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:51.045859 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e156c259-a053-4b54-ae66-b53f5bc11220 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1275 microversion: 2.1 time: 0.184825 Sep 18 01:37:51.047259 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2699/5441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:50 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:51.215225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:51.215890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:51.229216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:51.232001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:51.235389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:51.235986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:51.236460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:51.249699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:51.420625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:51.424404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:51.435119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:51.436028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:51.436703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:51.437809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:51.438540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:51.439207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:51.552475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:51.566459 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c89f00d5-584c-4d70-84da-ba442d730254 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.362393 Sep 18 01:37:51.567665 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2743/5442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:51 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:51.695653 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:51.712120 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61be0ce7-6d2f-4545-900f-a24413aafe99 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.295512 Sep 18 01:37:51.713462 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2700/5443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:51 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:52.076621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:52.077292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-54102d41-44bf-4e4b-a1e8-be227e901b25 req-2dc3e47e-4f46-4b12-82d4-9ec15af74728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cdd6db-0cfe-45d5-b4e4-20caf58baafa", "name": "network-vif-plugged", "status": "completed", "tag": "7042643c-740c-47bc-bad0-b6245e3fe573"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:52.078584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:52.098591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:52.101306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:52.102529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:52.104483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-54102d41-44bf-4e4b-a1e8-be227e901b25 req-2dc3e47e-4f46-4b12-82d4-9ec15af74728 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:52.105377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:52.106506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:52.106979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-54102d41-44bf-4e4b-a1e8-be227e901b25 req-2dc3e47e-4f46-4b12-82d4-9ec15af74728 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:52.107716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-54102d41-44bf-4e4b-a1e8-be227e901b25 req-2dc3e47e-4f46-4b12-82d4-9ec15af74728 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:52.109254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:52.161279 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-54102d41-44bf-4e4b-a1e8-be227e901b25 req-2dc3e47e-4f46-4b12-82d4-9ec15af74728 service nova] Creating event network-vif-plugged:7042643c-740c-47bc-bad0-b6245e3fe573 for instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa on n-h1-master-1 Sep 18 01:37:52.169355 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-54102d41-44bf-4e4b-a1e8-be227e901b25 req-2dc3e47e-4f46-4b12-82d4-9ec15af74728 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102279 Sep 18 01:37:52.172072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2744/5444] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:37:52.434696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:52.445906 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bec1a9d-f2a8-42f9-ad7f-8360e3549fa9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 0.378761 Sep 18 01:37:52.447031 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2701/5445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:52 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:52.595214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:52.596737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:52.611957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:52.614437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:52.616280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:52.619072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:52.619928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:52.620552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:52.744915 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:52.746144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:52.763766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:52.765638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:52.770546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:52.772083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:52.772755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:52.773394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:53.148965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:53.156321 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:53.175657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c7dff2d6-9568-4a96-950a-8aa086b60bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.441204 Sep 18 01:37:53.175838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:53.177161 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2702/5446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:52 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:53.201084 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3226a023-a971-4070-bf47-13a4b966ca83 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1319 microversion: 2.1 time: 0.608560 Sep 18 01:37:53.202816 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2745/5447] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:52 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:53.473406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:53.474057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:53.490572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:53.495688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:53.496520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:53.497828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:53.498518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:53.499159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:53.506269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-2533d04c-9bae-47ff-ba7e-c1fd342cf9ff req-57663825-218d-4142-8bcb-a3eaca4d7e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9540e28f-2e8f-4f7d-8906-48110cef650a", "tag": "f836697b-c25a-42e5-9aca-e557f4691247"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:53.531807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2533d04c-9bae-47ff-ba7e-c1fd342cf9ff req-57663825-218d-4142-8bcb-a3eaca4d7e08 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:53.532715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2533d04c-9bae-47ff-ba7e-c1fd342cf9ff req-57663825-218d-4142-8bcb-a3eaca4d7e08 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:53.533386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2533d04c-9bae-47ff-ba7e-c1fd342cf9ff req-57663825-218d-4142-8bcb-a3eaca4d7e08 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:53.574474 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-2533d04c-9bae-47ff-ba7e-c1fd342cf9ff req-57663825-218d-4142-8bcb-a3eaca4d7e08 service nova] Creating event network-changed:f836697b-c25a-42e5-9aca-e557f4691247 for instance 9540e28f-2e8f-4f7d-8906-48110cef650a on n-h2-master-1 Sep 18 01:37:53.606199 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-2533d04c-9bae-47ff-ba7e-c1fd342cf9ff req-57663825-218d-4142-8bcb-a3eaca4d7e08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104520 Sep 18 01:37:53.607137 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2746/5448] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:37:53.739055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:53.747749 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9db52765-a9f8-42f5-9359-9ad9f8bd3891 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 0.279166 Sep 18 01:37:53.749918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2703/5449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:53 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:54.213205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-6ddc5103-5a53-4796-8627-a517a36776f3 req-2d53b913-0af2-4967-a929-5d283a2bf07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83d8386-8b3b-402b-9454-388a1bf7cd9b", "name": "network-vif-plugged", "status": "completed", "tag": "58239bef-087f-421f-8ccd-1d2ca629997b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:37:54.222342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:54.223011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:54.229609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:54.230465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:54.231756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:54.232648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:54.233338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:54.244348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:54.245208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6ddc5103-5a53-4796-8627-a517a36776f3 req-2d53b913-0af2-4967-a929-5d283a2bf07b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:54.249092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6ddc5103-5a53-4796-8627-a517a36776f3 req-2d53b913-0af2-4967-a929-5d283a2bf07b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:54.250091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6ddc5103-5a53-4796-8627-a517a36776f3 req-2d53b913-0af2-4967-a929-5d283a2bf07b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:54.290670 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-6ddc5103-5a53-4796-8627-a517a36776f3 req-2d53b913-0af2-4967-a929-5d283a2bf07b service nova] Creating event network-vif-plugged:58239bef-087f-421f-8ccd-1d2ca629997b for instance b83d8386-8b3b-402b-9454-388a1bf7cd9b on n-h1-master-1 Sep 18 01:37:54.309632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-6ddc5103-5a53-4796-8627-a517a36776f3 req-2d53b913-0af2-4967-a929-5d283a2bf07b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101818 Sep 18 01:37:54.310517 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2704/5450] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:37:54.324342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:54.326115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:54.334071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:54.335072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:54.335749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:54.336670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:54.337312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:54.338044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:54.653730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:54.664087 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b9b17969-cb4b-436d-bc72-97cf34fc2c2f tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.464781 Sep 18 01:37:54.679335 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2747/5451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:54 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:54.686856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:54.704072 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c29100d-35ab-477a-9a41-024b5d80f361 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1507 microversion: 2.1 time: 0.387442 Sep 18 01:37:54.719812 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2705/5452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:54 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:54.787684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:54.788559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:54.795440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:54.796145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:54.796755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:54.798184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:54.799117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:54.800283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:55.123352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:55.146229 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53d52d63-151a-4c2a-aba4-c6454131fde4 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 0.369609 Sep 18 01:37:55.147154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2748/5453] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:54 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:55.701285 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:55.704281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:55.728502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:55.730529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:55.733336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:55.736870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:55.737468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:55.740115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:56.128858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:56.144711 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7de18bb1-bbe4-4c64-bcc8-480db11a1f0a tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1370 microversion: 2.1 time: 0.458974 Sep 18 01:37:56.146284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2706/5454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:55 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1370 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:56.172692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:56.174021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:56.182672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:56.182672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:56.183918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:56.183918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:56.184452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:56.184750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:56.210344 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:56.368467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:56.381452 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5ec4e9a-0ab4-4a94-af81-59f864da8cff tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 0.213038 Sep 18 01:37:56.385236 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2749/5455] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:56 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:57.176494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:57.177346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:57.183739 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:57.187070 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:37:57.189275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:57.190316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:57.190836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:57.191642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:57.192202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:57.192706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:57.412287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:57.412907 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:57.429604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:57.430590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:57.431447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:57.432932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:57.433686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:57.435261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:57.498325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:57.522455 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9dc20941-a754-4e42-965c-e96f7c004352 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1542 microversion: 2.1 time: 0.350871 Sep 18 01:37:57.526948 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2707/5456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:57 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1542 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:57.552168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:57.552790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:57.573815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:57.574555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:57.575160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:57.576042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:57.578145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:57.578787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:57.858601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:57.880115 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d273ff2f-74cf-4016-bf3f-39391061e7ca tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 0.471805 Sep 18 01:37:57.881369 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2750/5457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:57 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:37:57.944573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:57.954140 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e3277a1-c877-4924-b48c-72dcef491be4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1542 microversion: 2.1 time: 0.407335 Sep 18 01:37:57.955242 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2708/5458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:57 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1542 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:37:58.904995 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:37:58.905724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:37:58.920152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:58.920650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:58.921226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:58.922227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:37:58.922851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:37:58.928395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:37:59.279779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:37:59.294860 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-036a0d09-452c-48d8-8091-750c64d4e485 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 0.393893 Sep 18 01:37:59.295770 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2751/5459] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:37:58 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:00.320529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:00.321957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:00.337807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:00.338420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:00.338979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:00.339921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:00.340493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:00.341018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:01.139408 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-db6c6701-a1ff-4eb7-bbae-89cbc9276d80 req-692e639f-ee84-4ccf-befd-b848544a03bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83d8386-8b3b-402b-9454-388a1bf7cd9b", "tag": "58239bef-087f-421f-8ccd-1d2ca629997b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:01.163489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-db6c6701-a1ff-4eb7-bbae-89cbc9276d80 req-692e639f-ee84-4ccf-befd-b848544a03bf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:01.163988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-db6c6701-a1ff-4eb7-bbae-89cbc9276d80 req-692e639f-ee84-4ccf-befd-b848544a03bf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:01.167527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-db6c6701-a1ff-4eb7-bbae-89cbc9276d80 req-692e639f-ee84-4ccf-befd-b848544a03bf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:01.184952 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-db6c6701-a1ff-4eb7-bbae-89cbc9276d80 req-692e639f-ee84-4ccf-befd-b848544a03bf service nova] Creating event network-changed:58239bef-087f-421f-8ccd-1d2ca629997b for instance b83d8386-8b3b-402b-9454-388a1bf7cd9b on n-h1-master-1 Sep 18 01:38:01.213854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-db6c6701-a1ff-4eb7-bbae-89cbc9276d80 req-692e639f-ee84-4ccf-befd-b848544a03bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076375 Sep 18 01:38:01.219025 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2752/5460] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:01.405836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f9bd03d0-bb82-4bc6-995a-bdabc41c9753 req-9199ec75-4225-4b2f-8faf-8f6b00394b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540e28f-2e8f-4f7d-8906-48110cef650a", "name": "network-vif-plugged", "status": "completed", "tag": "f836697b-c25a-42e5-9aca-e557f4691247"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:01.490122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f9bd03d0-bb82-4bc6-995a-bdabc41c9753 req-9199ec75-4225-4b2f-8faf-8f6b00394b0d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:01.494804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f9bd03d0-bb82-4bc6-995a-bdabc41c9753 req-9199ec75-4225-4b2f-8faf-8f6b00394b0d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:01.497238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f9bd03d0-bb82-4bc6-995a-bdabc41c9753 req-9199ec75-4225-4b2f-8faf-8f6b00394b0d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:01.545240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:01.556032 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f9bd03d0-bb82-4bc6-995a-bdabc41c9753 req-9199ec75-4225-4b2f-8faf-8f6b00394b0d service nova] Creating event network-vif-plugged:f836697b-c25a-42e5-9aca-e557f4691247 for instance 9540e28f-2e8f-4f7d-8906-48110cef650a on n-h2-master-1 Sep 18 01:38:01.558865 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-27a1346c-8dc9-41c6-9505-840a602ec3c1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 1.244006 Sep 18 01:38:01.560068 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2709/5461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:00 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:01.579656 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f9bd03d0-bb82-4bc6-995a-bdabc41c9753 req-9199ec75-4225-4b2f-8faf-8f6b00394b0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182776 Sep 18 01:38:01.580346 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2753/5462] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:02.074641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1343470753", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:02.171836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:38:02.585131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:02.586633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:02.607910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:02.612719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:02.615802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:02.619328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:02.622267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:02.623603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:02.854673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:38:02.855762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:38:02.856423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:38:02.857017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:38:02.857661 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:38:02.877655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:02.878383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:02.883513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:02.884544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:02.885238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:02.889522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:02.937042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Getting quotas for project d00a84826fea4e728af1ae50f112c316. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:38:02.945831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Getting quotas for user 30b099e188b54f0baa7b46ce02587c82 and project d00a84826fea4e728af1ae50f112c316. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:38:02.964860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:38:02.967527 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:38:03.015433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:03.029161 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5cf4ce3-f38b-4dbd-a27d-f0d4390413ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1317 microversion: 2.1 time: 0.450088 Sep 18 01:38:03.030528 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2754/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:02 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:03.071804 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-53ea49be-1035-44ac-86d2-f81ce2f1fce0 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000956 Sep 18 01:38:03.072476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2710/5464] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:38:03.085099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-296c47a9-eba0-47eb-8e63-7b000ffd83b6 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:03.087482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-296c47a9-eba0-47eb-8e63-7b000ffd83b6 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:03.186038 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-296c47a9-eba0-47eb-8e63-7b000ffd83b6 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:03.201394 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-296c47a9-eba0-47eb-8e63-7b000ffd83b6 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1214 microversion: 2.1 time: 0.121522 Sep 18 01:38:03.204977 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2755/5465] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:03 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:04.062989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:04.063592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:04.070799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.071547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.072169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.073076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.073724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.074313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.240977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:04.243622 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:04.263935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.268469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.274190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.275469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.276122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.276767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.322425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:04.331612 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f52a698-0153-43dd-a0e2-cd5ced729708 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1508 microversion: 2.1 time: 0.275054 Sep 18 01:38:04.332547 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2711/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:04 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:04.355838 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:04.356763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:04.364013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.365691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.366387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.367411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.368332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.368932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.423858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:04.441424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-17cbb146-7af6-49f5-8079-ccb4124ccf7a tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1210 microversion: 2.1 time: 0.207733 Sep 18 01:38:04.442695 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2756/5467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:04 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1210 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:04.588543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:04.602964 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f360575a-5c29-4eff-a9f4-1906bb33f0a5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1508 microversion: 2.1 time: 0.247367 Sep 18 01:38:04.603713 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2712/5468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:04 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:04.636348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:04.639314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:04.647334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.647979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.648539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.649375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.650244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.650803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.746953 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c846772-dab5-4b65-bac7-ceb757bd3075 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "PUT /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1080 microversion: 2.1 time: 0.117810 Sep 18 01:38:04.748201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2757/5469] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:38:04 2022] PUT /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1080 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:04.767459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:04.769002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:04.777347 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.778177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.778842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:04.779733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:04.780353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:04.780961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.001214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:05.020835 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c05193ab-0146-40fb-baf3-2eecb8585650 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1506 microversion: 2.1 time: 0.254511 Sep 18 01:38:05.023553 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2713/5470] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:04 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:05.054185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:05.055969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:05.065790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.077515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.078843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.081903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.082399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.082858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.398200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:05.414638 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f997b5f-dafc-4972-9021-3e966d867d71 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1506 microversion: 2.1 time: 0.370979 Sep 18 01:38:05.430281 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2758/5471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:05 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:05.439103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:05.444153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:05.457991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.458919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.459580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.461493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.462251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.468632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:05.470086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:05.474871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.484565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.485160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.485718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.487081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.487672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.488167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.614774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:05.623671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:38:05.624578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:38:05.625936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:38:05.626560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:38:05.627209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:38:05.628055 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b284b5ae-40f2-41d8-988e-ed49249f8d84 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1272 microversion: 2.1 time: 0.163851 Sep 18 01:38:05.628685 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2759/5472] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:05 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:05.758316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:05.775854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.776363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.777605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.778693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.779476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.779780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.811815 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65b644f5-8684-418c-b653-3ac57e78337a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "POST /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a/action" status: 202 len: 1112 microversion: 2.1 time: 0.376332 Sep 18 01:38:05.812809 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2714/5473] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:38:05 2022] POST /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a/action => generated 1112 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 18 01:38:05.832326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:05.833082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:05.840613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.841264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.841843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:05.842633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:05.843164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:05.843593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:06.069159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:06.089082 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dbdb6c71-3fca-477b-85bb-adb809f9a9ad tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.261424 Sep 18 01:38:06.089908 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2760/5474] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:05 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:06.653679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:06.654437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:06.667184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:06.667673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:06.677747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:06.678725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:06.679213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:06.679653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:06.899252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:06.910448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd4a26fb-c26d-41fa-8c28-08d42be73d07 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1272 microversion: 2.1 time: 0.261069 Sep 18 01:38:06.911588 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2715/5475] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:06 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:07.122750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:07.131386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:07.177857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:07.178713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:07.179424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:07.186448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:07.189691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:07.191010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:07.558508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:07.573414 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f4c24593-a112-41ae-b0d3-c543e8f5e3a9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.462280 Sep 18 01:38:07.575034 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2761/5476] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:07 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:07.941978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:07.943882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:07.956922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:07.957663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:07.959310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:07.960390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:07.960853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:07.961280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:08.247213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:08.256734 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ff37c60-9098-47b2-9aac-cbbafe22a89f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.325963 Sep 18 01:38:08.258058 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2716/5477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:07 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:08.599833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:08.602017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:08.617873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:08.619413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:08.620406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:08.621701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:08.623007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:08.623630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:08.820852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:08.833999 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46b3c9bf-1f8f-4d46-9788-edfa0ea9da86 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.239881 Sep 18 01:38:08.834815 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2762/5478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:08 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:08.861874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-985af216-95c6-4431-8961-008df1eb0afb req-e1a7c283-7c3b-4484-8149-6f1c8208c250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a3a87c-a15c-4be7-a66b-fca336389415", "tag": "2e0ffb1d-1593-4ddf-943b-e7d7c0cba3a8"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:08.901343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-985af216-95c6-4431-8961-008df1eb0afb req-e1a7c283-7c3b-4484-8149-6f1c8208c250 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:08.902032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-985af216-95c6-4431-8961-008df1eb0afb req-e1a7c283-7c3b-4484-8149-6f1c8208c250 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:08.904759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-985af216-95c6-4431-8961-008df1eb0afb req-e1a7c283-7c3b-4484-8149-6f1c8208c250 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:08.964383 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-985af216-95c6-4431-8961-008df1eb0afb req-e1a7c283-7c3b-4484-8149-6f1c8208c250 service nova] Creating event network-changed:2e0ffb1d-1593-4ddf-943b-e7d7c0cba3a8 for instance 90a3a87c-a15c-4be7-a66b-fca336389415 on n-h2-master-1 Sep 18 01:38:08.982891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-985af216-95c6-4431-8961-008df1eb0afb req-e1a7c283-7c3b-4484-8149-6f1c8208c250 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127580 Sep 18 01:38:08.984186 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2717/5479] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:09.280732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:09.281368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:09.292782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:09.295094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:09.295834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:09.296761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:09.297667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:09.298288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:09.471610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:09.487499 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe7b6970-4aba-493d-81e3-5c24640ac5c9 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.210747 Sep 18 01:38:09.488306 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2763/5480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:09 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:09.865945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:09.866990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:09.875894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:09.876608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:09.878087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:09.879008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:09.879642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:09.880387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:10.100516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:10.118222 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-218deca4-0d0c-4028-a343-1446f801d766 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.255437 Sep 18 01:38:10.119299 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2718/5481] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:09 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:10.513357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:10.514351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:10.522052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:10.522569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:10.523278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:10.524003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:10.524871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:10.526256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:10.699533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:10.707643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0266098a-20e8-4015-84f0-32341e7d61ce tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.198219 Sep 18 01:38:10.724231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2764/5482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:10 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:11.145029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:11.145889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:11.160765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:11.162205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:11.163135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:11.164198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:11.164803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:11.165372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:11.190742 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:11.409452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:11.419606 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-021fa1b3-8364-420c-853e-11e423cbb711 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.279430 Sep 18 01:38:11.421427 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2719/5483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:11 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:11.732337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:11.733016 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:11.745456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:11.746013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:11.746527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:11.747147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:11.747603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:11.748116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:11.928408 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:11.941257 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac162e68-6239-4f85-a505-9edac931cc77 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.214178 Sep 18 01:38:11.942369 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2765/5484] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:11 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:12.448293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:12.448843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:12.460385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:12.460623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:12.461463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:12.462412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:12.463131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:12.463828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:12.662061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:12.670743 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-55e0627c-2969-4953-a20e-dfdb366ada1c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.226115 Sep 18 01:38:12.671717 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2720/5485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:12 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:12.974364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:12.975008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:12.993075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:12.993636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:12.994076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:12.994782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:12.995232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:12.995659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:13.200847 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:13.311823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:13.320358 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e6c03ec7-3038-4870-8180-63c1835102b2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.359483 Sep 18 01:38:13.325903 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2766/5486] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:12 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:13.706000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:13.715609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:13.737883 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:13.740693 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:13.742795 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:13.774311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:13.775422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:13.776375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:13.777488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:13.781313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:13.789392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:14.056568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:14.073790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9a5d7631-ece8-4676-963e-4c5c3a73211d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.378954 Sep 18 01:38:14.091659 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2721/5487] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:13 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:14.348392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:14.349737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:14.352714 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:14.360025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:14.360537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:14.361027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:14.361736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:14.362227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:14.362814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:14.571571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:14.575133 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:14.586361 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8e6548e7-80f2-4516-a408-69668fdfaa4f tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.242106 Sep 18 01:38:14.591427 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2767/5488] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:14 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:15.100400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:15.101740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:15.109487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:15.109997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:15.110696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:15.112056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:15.112559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:15.113139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:15.274039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:15.283779 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-132db90f-bed2-4e03-8485-719c6ceeabe8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.187480 Sep 18 01:38:15.284970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2722/5489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:15 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:15.367197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bf6a0595-1082-490c-bd53-edddd092e364 req-af2ddb93-790b-4e29-a0e2-48878813d46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a3a87c-a15c-4be7-a66b-fca336389415", "name": "network-vif-plugged", "status": "completed", "tag": "2e0ffb1d-1593-4ddf-943b-e7d7c0cba3a8"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:15.380071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bf6a0595-1082-490c-bd53-edddd092e364 req-af2ddb93-790b-4e29-a0e2-48878813d46b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:15.380930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bf6a0595-1082-490c-bd53-edddd092e364 req-af2ddb93-790b-4e29-a0e2-48878813d46b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:15.381380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bf6a0595-1082-490c-bd53-edddd092e364 req-af2ddb93-790b-4e29-a0e2-48878813d46b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:15.406005 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bf6a0595-1082-490c-bd53-edddd092e364 req-af2ddb93-790b-4e29-a0e2-48878813d46b service nova] Creating event network-vif-plugged:2e0ffb1d-1593-4ddf-943b-e7d7c0cba3a8 for instance 90a3a87c-a15c-4be7-a66b-fca336389415 on n-h2-master-1 Sep 18 01:38:15.412434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bf6a0595-1082-490c-bd53-edddd092e364 req-af2ddb93-790b-4e29-a0e2-48878813d46b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054501 Sep 18 01:38:15.413894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2768/5490] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:15.618272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:15.619727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:15.633501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:15.634958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:15.638839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:15.640402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:15.641902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:15.642876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:15.894267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:15.907808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dec1f961-fc82-48fc-b1f2-6af03aeeccbc tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.297838 Sep 18 01:38:15.909065 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2723/5491] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:15 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:16.312311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:16.313730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:16.321367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:16.322127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:16.322731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:16.323603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:16.324208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:16.324787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:16.512828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:16.528742 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70e5f52c-331e-44d9-ae12-42963e2e8bc2 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.222753 Sep 18 01:38:16.546363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2769/5492] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:16 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:16.948429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:16.950366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:16.966322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:16.966913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:16.967460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:16.968274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:16.968822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:16.969316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:17.195999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:17.206720 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ae72c82-3c2a-47bb-b492-068dfadf14e2 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1314 microversion: 2.1 time: 0.263436 Sep 18 01:38:17.217991 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2724/5493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:16 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:17.557926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:17.558446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:17.567456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:17.568222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:17.568834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:17.569976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:17.570604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:17.571222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:17.759628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:17.777571 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae1ad1ed-5ce4-429b-af3f-0271aed35e63 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.224575 Sep 18 01:38:17.778445 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2770/5494] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:17 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:18.234458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:18.235078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:18.254570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:18.255372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:18.256030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:18.257664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:18.258452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:18.258898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:18.508518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:18.525572 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6250879-2fd8-49d4-adef-64da595c2822 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1463 microversion: 2.1 time: 0.294779 Sep 18 01:38:18.526449 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2725/5495] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:18 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1463 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:18.554676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ccc650d-4458-4532-b0c4-5d8964b05b29", "device": "/dev/sdb"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:18.557332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:18.578479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:18.579107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:18.579389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:18.580640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:18.581099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:18.581515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:18.803954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:18.804850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:18.817053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:18.817974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:18.818969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:18.821042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:18.822457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:18.825015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:19.086742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:19.096536 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-089b9885-c63b-4910-9388-37356689c25c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.299041 Sep 18 01:38:19.109860 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2726/5496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:18 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:19.109966 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93c85c23-4a94-4928-97ae-61735d3c805b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "POST /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550388 Sep 18 01:38:19.113744 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2771/5497] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:38:18 2022] POST /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415/os-volume_attachments => generated 194 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:20.129645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:20.130266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:20.147553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:20.148061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:20.148507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:20.149226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:20.151946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:20.171897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:20.611252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:20.632915 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff092944-7229-4039-9423-3f3dcfb168f6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.511262 Sep 18 01:38:20.637361 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2727/5498] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:20 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:21.668948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:21.680819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:21.709068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:21.721460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:21.722942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:21.724230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:21.724774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:21.725274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:21.895290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:21.908227 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06c2d3db-ecfa-4183-98b3-6c68daea5939 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.244922 Sep 18 01:38:21.909618 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2772/5499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:21 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:22.026791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:22.030010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:22.038892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:22.039379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:22.039811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:22.040514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:22.040963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:22.041381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:22.134281 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1f62f7c3-e185-4312-aa13-69953aad08bb tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.112502 Sep 18 01:38:22.137012 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2728/5500] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:38:22 2022] POST /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b/action => generated 24573 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:38:22.936032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:22.936949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:22.952779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:22.953517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:22.955210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:22.965489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:22.966260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:22.967110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:23.157990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:23.166730 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8dd6b0c8-2ad8-4449-ba1e-0ca95733f392 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.234497 Sep 18 01:38:23.177701 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2773/5501] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:22 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:24.196744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:24.198467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:24.208894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:24.209703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:24.210366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:24.211273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:24.211921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:24.212551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:24.373782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:24.380358 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-784d84a2-1c9f-484b-97b8-11991d74eae3 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.188805 Sep 18 01:38:24.381188 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2729/5502] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:24 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:24.995179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba82514a-30eb-4a3e-b73e-2564a7cc0f01", "device": "/dev/sdb"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:24.998536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:25.011921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:25.021892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:25.023019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:25.024143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:25.025317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:25.025903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:25.404963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:25.405803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:25.422663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:25.423175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:25.423660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:25.424405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:25.424875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:25.425440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:25.656630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:25.671359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9de59e2e-e1af-4d96-bd31-3478e356aae8 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.269039 Sep 18 01:38:25.684540 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2730/5503] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:25 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:25.684731 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-216201a5-4a4d-4dc5-ac16-e038b98f7dd2 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "POST /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692399 Sep 18 01:38:25.700635 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2774/5504] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:38:24 2022] POST /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:26.700957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:26.702417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:26.710828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:26.711677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:26.712356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:26.713475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:26.714175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:26.714813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:26.922814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:26.933121 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78ce7fdb-93af-4e2e-906d-4339739d5a14 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.236343 Sep 18 01:38:26.944165 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2731/5505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:26 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:27.961285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:27.962211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:27.975634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:27.977362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:27.978091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:27.979840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:27.983336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:27.984742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:28.319666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:28.328969 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fdbe2d10-e89d-4dff-b925-a9b27c075036 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.375019 Sep 18 01:38:28.329643 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2775/5506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:27 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:29.359082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:29.360630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:29.371364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:29.371928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:29.372458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:29.379471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:29.380006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:29.382089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:29.650420 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:29.660004 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-653e1eb7-2bb1-4c73-b423-3d1431701e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.308810 Sep 18 01:38:29.661185 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2732/5507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:29 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:30.700876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:30.701788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:30.710220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:30.710720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:30.711164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:30.712039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:30.712707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:30.713140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:30.936604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:30.953190 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-278b1d0a-58df-433a-9607-d870a2b05c80 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.257705 Sep 18 01:38:30.966523 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2776/5508] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:30 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:31.996450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:31.997108 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:32.005158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:32.005680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:32.006127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:32.007027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:32.007586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:32.008648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:32.200775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:32.212452 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f1aeb65-5155-4766-9a1f-45dae34ec60d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.221884 Sep 18 01:38:32.213065 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2733/5509] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:31 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:33.106805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:33.113196 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:33.127401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:33.128148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:33.128736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:33.129983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:33.130731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:33.131641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:33.223679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-368db1d1-f6ff-4753-9e0e-b8f57eb15aa6 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "POST /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b/action" status: 200 len: 32647 microversion: 2.1 time: 0.127257 Sep 18 01:38:33.224782 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2777/5510] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:38:33 2022] POST /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b/action => generated 32647 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:38:33.243218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:33.244097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:33.254929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:33.255624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:33.256104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:33.257514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:33.258116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:33.258806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:33.469778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:33.481962 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4138cd1-0666-4560-9515-9dfb6a208909 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.245162 Sep 18 01:38:33.494328 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2734/5511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:33 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:34.508031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:34.509424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:34.518121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:34.518853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:34.519443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:34.521498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:34.522130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:34.522723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:34.663012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:34.663545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:34.679452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:34.679950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:34.680304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:34.681003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:34.683332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:34.685715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:34.732736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:34.767939 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4be484bf-e6e9-4466-8e23-153467cd3a0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.264132 Sep 18 01:38:34.774139 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2778/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:34 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:34.786848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:38:34.800197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d86fefe9-56e0-4fbc-8ba2-60469164dcc4 req-ef65d2f5-4d02-4c50-9299-cd5d66182211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83d8386-8b3b-402b-9454-388a1bf7cd9b", "tag": "58239bef-087f-421f-8ccd-1d2ca629997b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:34.812346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d86fefe9-56e0-4fbc-8ba2-60469164dcc4 req-ef65d2f5-4d02-4c50-9299-cd5d66182211 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:34.813082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d86fefe9-56e0-4fbc-8ba2-60469164dcc4 req-ef65d2f5-4d02-4c50-9299-cd5d66182211 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:34.814238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d86fefe9-56e0-4fbc-8ba2-60469164dcc4 req-ef65d2f5-4d02-4c50-9299-cd5d66182211 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:34.840697 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d86fefe9-56e0-4fbc-8ba2-60469164dcc4 req-ef65d2f5-4d02-4c50-9299-cd5d66182211 service nova] Creating event network-changed:58239bef-087f-421f-8ccd-1d2ca629997b for instance b83d8386-8b3b-402b-9454-388a1bf7cd9b on n-h1-master-1 Sep 18 01:38:34.856102 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d86fefe9-56e0-4fbc-8ba2-60469164dcc4 req-ef65d2f5-4d02-4c50-9299-cd5d66182211 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063206 Sep 18 01:38:34.869299 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2779/5513] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:34.905521 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:35.046248 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c22cd433-e398-40c1-b8ae-1787d14ed98e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 204 len: 0 microversion: 2.1 time: 0.387904 Sep 18 01:38:35.060977 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2735/5514] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:38:34 2022] DELETE /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:38:35.070835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:35.071849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:35.080700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:35.081484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:35.082355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:35.083359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:35.084544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:35.085251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:35.290055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:35.300034 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8bc5f34c-253c-445a-9f3b-cf7b25e070c7 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1667 microversion: 2.1 time: 0.234935 Sep 18 01:38:35.301075 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2780/5515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:35 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1667 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:35.809945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:35.811202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:35.822412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:35.822907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:35.823352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:35.824071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:35.824531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:35.824963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:36.142424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:36.156267 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-02d11d59-c220-438b-a3c8-6c8d2f372897 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.355253 Sep 18 01:38:36.176594 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2736/5516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:35 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:36.326222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:36.326849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:36.347495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:36.348245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:36.348859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:36.353804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:36.354445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:36.358164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:36.649378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:36.662876 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ff590a7e-52b6-4e3d-a8de-5dc0fba3f075 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1667 microversion: 2.1 time: 0.340534 Sep 18 01:38:36.665863 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2781/5517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:36 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1667 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:37.183828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:37.184523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:37.196608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:37.198892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:37.199340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:37.205250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:37.205636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:37.206094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:37.427885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:37.437727 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46bb1b59-f97c-4987-a3f6-99dc928bbe24 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.257735 Sep 18 01:38:37.438474 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2737/5518] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:37 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:37.688080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:37.689857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:37.697515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:37.698030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:37.698641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:37.699526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:37.700149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:37.700573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:38.049192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:38.062130 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-169b232b-328f-4ea2-97b0-b5c9cda15ac4 tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1667 microversion: 2.1 time: 0.377965 Sep 18 01:38:38.076396 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2782/5519] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:37 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1667 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:38.463750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:38.464299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:38.480647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:38.483850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:38.484529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:38.486640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:38.490566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:38.491034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:38.833500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:38.846157 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b73fcc11-f539-49f7-a75d-448add3c1d0f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1517 microversion: 2.1 time: 0.387006 Sep 18 01:38:38.847573 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2738/5520] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:38 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1517 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:38.859864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0f5bcea9-b83d-48ae-9968-31aa448e15aa req-733fafc8-18f4-4167-b6c5-d013e86e461e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83d8386-8b3b-402b-9454-388a1bf7cd9b", "name": "network-vif-deleted", "tag": "58239bef-087f-421f-8ccd-1d2ca629997b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:38.889089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0f5bcea9-b83d-48ae-9968-31aa448e15aa req-733fafc8-18f4-4167-b6c5-d013e86e461e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:38.890517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0f5bcea9-b83d-48ae-9968-31aa448e15aa req-733fafc8-18f4-4167-b6c5-d013e86e461e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:38.891455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0f5bcea9-b83d-48ae-9968-31aa448e15aa req-733fafc8-18f4-4167-b6c5-d013e86e461e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:38.915656 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0f5bcea9-b83d-48ae-9968-31aa448e15aa req-733fafc8-18f4-4167-b6c5-d013e86e461e service nova] Creating event network-vif-deleted:58239bef-087f-421f-8ccd-1d2ca629997b for instance b83d8386-8b3b-402b-9454-388a1bf7cd9b on n-h1-master-1 Sep 18 01:38:38.923550 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0f5bcea9-b83d-48ae-9968-31aa448e15aa req-733fafc8-18f4-4167-b6c5-d013e86e461e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067929 Sep 18 01:38:38.925162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2783/5521] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:39.088395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:39.089427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:39.106781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:39.108232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:39.109150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:39.110062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:39.111325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:39.117634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:39.197888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:39.198615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:39.199213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:39.199670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lazy-loading 'fault' on Instance uuid b83d8386-8b3b-402b-9454-388a1bf7cd9b {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:38:39.292318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9325389461a64760b4575af8a52065f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdad25b20bf447aa134ee525e6596e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:39.310445 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f094ec09-6e7f-416a-b4ab-83075893ff6b tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 200 len: 1334 microversion: 2.1 time: 0.226800 Sep 18 01:38:39.310815 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2739/5522] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:39 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 1334 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:39.883447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:39.884891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:39.894035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:39.894784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:39.895386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:39.896285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:39.896922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:39.897900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:39.944393 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:40.189612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:40.204909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5b09533-5cba-4dba-8508-56c3268c8b72 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1523 microversion: 2.1 time: 0.327900 Sep 18 01:38:40.206418 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2784/5523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:39 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:40.342117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:40.343720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] [instance: b83d8386-8b3b-402b-9454-388a1bf7cd9b] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:40.351344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:40.352088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:40.352702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:40.354011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:40.355657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:40.356265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:40.379501 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] HTTP exception thrown: Instance b83d8386-8b3b-402b-9454-388a1bf7cd9b could not be found. Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Request method failure captured: Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b HTTP/1.1 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnWoem-wolW7tZT6gnCh5k_zTo1-JtKrd-XFbY8IDPkorPUjsHE060V635Beqt5ePXQhEbUiB-VU0Vh_QAdHsSWYoF0ome9JYlNVIVGWu-0Fu79QVY9sNpc_FFudXr_3ogFsHNWRDmp5yGSsGJB-814RoKXQpA_-mtgzz1gRLmednB4 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: efdad25b20bf447aa134ee525e6596e7 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestNetworkBasicOps-447704951 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efdad25b20bf447aa134ee525e6596e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestNetworkBasicOps-447704951 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: efdad25b20bf447aa134ee525e6596e7 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestNetworkBasicOps-447704951 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestNetworkBasicOps-447704951-project Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9325389461a64760b4575af8a52065f5 Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestNetworkBasicOps-447704951-project Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: exception: Instance b83d8386-8b3b-402b-9454-388a1bf7cd9b could not be found. Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b83d8386-8b3b-402b-9454-388a1bf7cd9b'} Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83d8386-8b3b-402b-9454-388a1bf7cd9b could not be found. Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83d8386-8b3b-402b-9454-388a1bf7cd9b could not be found. Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:38:40.381901 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:38:40.386278 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:38:40.386278 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:38:40.386278 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:38:40.386278 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:38:40.386278 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:38:40.386278 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83d8386-8b3b-402b-9454-388a1bf7cd9b could not be found. Sep 18 01:38:40.386278 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:38:40.388647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Returning 404 to user: Instance b83d8386-8b3b-402b-9454-388a1bf7cd9b could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:38:40.390488 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57934532-74e8-4ba2-820a-78aaa2e29bae tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b" status: 404 len: 111 microversion: 2.1 time: 0.054244 Sep 18 01:38:40.394329 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2740/5524] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:40 2022] GET /compute/v2.1/servers/b83d8386-8b3b-402b-9454-388a1bf7cd9b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:38:40.706543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64f86731-f86b-47c8-bd46-07ba3a75d74e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] Calling method '.version_select at 0x7f700529b700>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:40.802549 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64f86731-f86b-47c8-bd46-07ba3a75d74e tempest-TestNetworkBasicOps-447704951 tempest-TestNetworkBasicOps-447704951-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-925054" status: 202 len: 0 microversion: 2.1 time: 0.113194 Sep 18 01:38:40.806112 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2785/5525] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:38:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-925054 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:38:41.234006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:41.234630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:41.251646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:41.252070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:41.252511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:41.253250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:41.253777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:41.254213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:41.533841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:41.558494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9ffb47f-3e9e-41f3-9b33-6dec5d374977 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1523 microversion: 2.1 time: 0.319247 Sep 18 01:38:41.590198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2741/5526] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:41 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:42.618685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:42.621002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:42.633164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:42.637986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:42.641421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:42.645312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:42.646640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:42.651985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:43.114249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:43.139477 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ba27b00-10ab-4f38-aedb-0313f998187a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1523 microversion: 2.1 time: 0.534237 Sep 18 01:38:43.140081 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2786/5527] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:42 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:43.659023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-bfe0057f-f171-4eb9-b473-742a191c3c86 req-763bea59-36a6-452a-92cc-53eec4597bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540e28f-2e8f-4f7d-8906-48110cef650a", "name": "network-vif-unplugged", "status": "completed", "tag": "f836697b-c25a-42e5-9aca-e557f4691247"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:43.677132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bfe0057f-f171-4eb9-b473-742a191c3c86 req-763bea59-36a6-452a-92cc-53eec4597bd7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:43.682132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bfe0057f-f171-4eb9-b473-742a191c3c86 req-763bea59-36a6-452a-92cc-53eec4597bd7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:43.682868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bfe0057f-f171-4eb9-b473-742a191c3c86 req-763bea59-36a6-452a-92cc-53eec4597bd7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:43.716215 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-bfe0057f-f171-4eb9-b473-742a191c3c86 req-763bea59-36a6-452a-92cc-53eec4597bd7 service nova] Creating event network-vif-unplugged:f836697b-c25a-42e5-9aca-e557f4691247 for instance 9540e28f-2e8f-4f7d-8906-48110cef650a on n-h2-master-1 Sep 18 01:38:43.725219 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-bfe0057f-f171-4eb9-b473-742a191c3c86 req-763bea59-36a6-452a-92cc-53eec4597bd7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072521 Sep 18 01:38:43.726429 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2742/5528] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:44.173669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:44.175054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:44.206591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:44.208972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:44.209447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:44.211774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:44.212184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:44.212631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:45.199619 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:45.213633 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d51ac78e-2637-4733-94f9-17ec1fd5a127 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1523 microversion: 2.1 time: 1.050067 Sep 18 01:38:45.239260 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2787/5529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:44 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1523 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:46.248544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:46.250008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:46.255728 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:46.273264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:46.287031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:46.287785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:46.289799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:46.297144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:46.298414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:46.648320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:46.660722 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-02e883d1-4e01-4c6e-ace4-70795758eba5 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1523 microversion: 2.1 time: 0.417697 Sep 18 01:38:46.664468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2743/5530] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:46 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:46.702543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-24e132a5-28e6-465a-9f50-94d30ca95a12 req-c1df8c26-ad21-4a7c-bd28-fd7843855b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540e28f-2e8f-4f7d-8906-48110cef650a", "name": "network-vif-plugged", "status": "completed", "tag": "f836697b-c25a-42e5-9aca-e557f4691247"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:46.709348 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:38:46.737202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-24e132a5-28e6-465a-9f50-94d30ca95a12 req-c1df8c26-ad21-4a7c-bd28-fd7843855b66 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:46.742259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-24e132a5-28e6-465a-9f50-94d30ca95a12 req-c1df8c26-ad21-4a7c-bd28-fd7843855b66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:46.742718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-24e132a5-28e6-465a-9f50-94d30ca95a12 req-c1df8c26-ad21-4a7c-bd28-fd7843855b66 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:46.784438 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-24e132a5-28e6-465a-9f50-94d30ca95a12 req-c1df8c26-ad21-4a7c-bd28-fd7843855b66 service nova] Creating event network-vif-plugged:f836697b-c25a-42e5-9aca-e557f4691247 for instance 9540e28f-2e8f-4f7d-8906-48110cef650a on n-h2-master-1 Sep 18 01:38:46.802917 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-24e132a5-28e6-465a-9f50-94d30ca95a12 req-c1df8c26-ad21-4a7c-bd28-fd7843855b66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104048 Sep 18 01:38:46.810312 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2788/5531] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:47.691642 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:47.692190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:47.714518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:47.722851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:47.726742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:47.727792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:47.728436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:47.729023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:48.340758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:48.365218 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1bc74ba5-b69d-47f0-82ba-13a885772667 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1523 microversion: 2.1 time: 0.678900 Sep 18 01:38:48.376817 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2744/5532] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:47 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1523 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:49.426403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:49.428296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:49.475848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:49.478049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:49.480386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:49.482116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:49.483834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:49.485691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:49.859307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:49.873361 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a487d45a-e7c7-4764-aaad-7a03757f0328 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1508 microversion: 2.1 time: 0.463260 Sep 18 01:38:49.882970 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2789/5533] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:49 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:49.912303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:49.914317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:49.952384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:49.953137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:49.953935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:49.957365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:49.960690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:49.961355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:50.267295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:50.306675 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-53ba73ab-2d03-486a-bb7c-abfbaf53b8f7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 200 len: 1508 microversion: 2.1 time: 0.398530 Sep 18 01:38:50.323844 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2745/5534] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:49 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:50.337988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:50.348130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:50.355654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:50.356360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:50.358001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:50.359114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:50.359483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:50.360753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:50.430483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:38:50.642745 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c9a50af-b1f0-4bf1-b83b-45d05c56a98d tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 204 len: 0 microversion: 2.1 time: 0.307028 Sep 18 01:38:50.644470 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2790/5535] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:38:50 2022] DELETE /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:38:50.880145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-907747836", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "ae224227-a275-4dce-97f8-c31466669cfb"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:51.024061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] validate_networks() for [('ae224227-a275-4dce-97f8-c31466669cfb', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:38:51.888589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:38:51.890106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:38:51.890745 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:38:51.892022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:38:51.892586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:38:51.913020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:51.915290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:51.917708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:51.919839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:51.922294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:51.924024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:52.044643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Getting quotas for project d2edb53d86c049d4aa5cd19d2fcfe017. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:38:52.077724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Getting quotas for user 797b6fd984ac412b925069f3a584aa2c and project d2edb53d86c049d4aa5cd19d2fcfe017. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:38:52.119022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:38:52.122286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:38:52.206982 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3559419-861c-405f-8a0f-ad77a7c88eab tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331311 Sep 18 01:38:52.208484 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2746/5536] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:38:52.220984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e303b5ef-6423-45e6-a35a-051ec2f7cdf7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:52.222233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e303b5ef-6423-45e6-a35a-051ec2f7cdf7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:52.425821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e303b5ef-6423-45e6-a35a-051ec2f7cdf7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:52.450227 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e303b5ef-6423-45e6-a35a-051ec2f7cdf7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1217 microversion: 2.1 time: 0.233548 Sep 18 01:38:52.457015 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2791/5537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:52 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:53.480372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:53.492313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:53.528802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:53.544128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:53.546173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:53.556701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:53.558234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:53.560435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:53.701732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:53.713780 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-168eefc4-14b8-4c5d-adb1-a7a1616f1e62 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1221 microversion: 2.1 time: 0.237611 Sep 18 01:38:53.714868 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2747/5538] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:53 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1221 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:54.196275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a55ec27a-7379-4b46-a156-1f73e0221cbc req-8fbcdea6-49f0-4fe6-90a2-de64a1f0f93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540e28f-2e8f-4f7d-8906-48110cef650a", "name": "network-vif-deleted", "tag": "f836697b-c25a-42e5-9aca-e557f4691247"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:54.220796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a55ec27a-7379-4b46-a156-1f73e0221cbc req-8fbcdea6-49f0-4fe6-90a2-de64a1f0f93f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:54.221198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a55ec27a-7379-4b46-a156-1f73e0221cbc req-8fbcdea6-49f0-4fe6-90a2-de64a1f0f93f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:54.221665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a55ec27a-7379-4b46-a156-1f73e0221cbc req-8fbcdea6-49f0-4fe6-90a2-de64a1f0f93f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:54.243554 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a55ec27a-7379-4b46-a156-1f73e0221cbc req-8fbcdea6-49f0-4fe6-90a2-de64a1f0f93f service nova] Creating event network-vif-deleted:f836697b-c25a-42e5-9aca-e557f4691247 for instance 9540e28f-2e8f-4f7d-8906-48110cef650a on n-h2-master-1 Sep 18 01:38:54.251271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a55ec27a-7379-4b46-a156-1f73e0221cbc req-8fbcdea6-49f0-4fe6-90a2-de64a1f0f93f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063276 Sep 18 01:38:54.252503 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2792/5539] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:54.755041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:54.755041 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:54.783412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:54.783917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:54.784366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:54.793250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:54.802320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:54.803197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:54.997094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:55.028920 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64c5e8f4-584f-4fc8-9e50-9687b90655f1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1287 microversion: 2.1 time: 0.296209 Sep 18 01:38:55.032256 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2748/5540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:54 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1287 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:38:56.062179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:56.063664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:56.095266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:56.095988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:56.097925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:56.098875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:56.103011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:56.103732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:56.482310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:56.496400 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-91e46b6c-bac7-4925-89d6-a5be094887b7 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1317 microversion: 2.1 time: 0.439769 Sep 18 01:38:56.497823 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2793/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:56 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:57.526772 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:57.528219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:57.547804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:57.549316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:57.550585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:57.552306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:57.552829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:57.555216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:57.622181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-369ec943-c02b-4fd1-9fcc-b326b3c9795d req-1e6388ff-d230-4f97-80e1-a55917b1e25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634c9a86-8da8-4e9c-bd05-c5983e30964c", "tag": "35542a2d-793a-4cd4-815b-f6e1121c26bb"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:38:57.659370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-369ec943-c02b-4fd1-9fcc-b326b3c9795d req-1e6388ff-d230-4f97-80e1-a55917b1e25e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:57.669621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-369ec943-c02b-4fd1-9fcc-b326b3c9795d req-1e6388ff-d230-4f97-80e1-a55917b1e25e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:57.671138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-369ec943-c02b-4fd1-9fcc-b326b3c9795d req-1e6388ff-d230-4f97-80e1-a55917b1e25e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:57.708500 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-369ec943-c02b-4fd1-9fcc-b326b3c9795d req-1e6388ff-d230-4f97-80e1-a55917b1e25e service nova] Creating event network-changed:35542a2d-793a-4cd4-815b-f6e1121c26bb for instance 634c9a86-8da8-4e9c-bd05-c5983e30964c on n-h1-master-1 Sep 18 01:38:57.740408 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-369ec943-c02b-4fd1-9fcc-b326b3c9795d req-1e6388ff-d230-4f97-80e1-a55917b1e25e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122239 Sep 18 01:38:57.752366 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2794/5542] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:38:57.937018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:57.950407 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1bd8cf9f-eb72-437e-8d91-cd15c6474161 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1317 microversion: 2.1 time: 0.429682 Sep 18 01:38:57.954617 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2749/5543] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:57 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:38:58.977715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:38:58.978460 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:38:58.992617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:58.993113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:58.993576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:58.994306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:38:58.994765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:38:58.995197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:38:59.237389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:38:59.247457 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e98b6c73-f147-493b-9ba9-73a4f67c0238 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1317 microversion: 2.1 time: 0.274323 Sep 18 01:38:59.248657 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2795/5544] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:38:58 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:00.271885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:00.273170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:00.281474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:00.282398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:00.283004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:00.296298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:00.301839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:00.302660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:00.496608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:00.504997 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1d7a8b67-819f-4fd6-9fe0-b7b3878e4ccf tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1317 microversion: 2.1 time: 0.236889 Sep 18 01:39:00.505602 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2750/5545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:00 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:00.634463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:00.635080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:00.644021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:00.644594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:00.645146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:00.645973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:00.646508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:00.649020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:00.746518 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lazy-loading 'services' on Instance uuid e2cdd6db-0cfe-45d5-b4e4-20caf58baafa {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:39:00.828577 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f346fd4-a584-460f-ae6e-c119feb76e49 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa/os-volume_attachments/ba82514a-30eb-4a3e-b73e-2564a7cc0f01" status: 202 len: 0 microversion: 2.1 time: 0.197976 Sep 18 01:39:00.829382 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2796/5546] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:39:00 2022] DELETE /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa/os-volume_attachments/ba82514a-30eb-4a3e-b73e-2564a7cc0f01 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:39:01.528170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:01.528900 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:01.539245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:01.550289 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:01.556876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:01.558528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:01.559211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:01.559818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:01.775655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:01.785544 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-38ef7722-a812-4c28-876e-6ec55a45f757 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1317 microversion: 2.1 time: 0.261533 Sep 18 01:39:01.787507 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2751/5547] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:01 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:02.810358 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:02.817214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:02.818301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:02.825055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:02.825913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:02.826866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:02.827876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:02.828549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:02.829121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:03.190989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:03.202612 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0955b20-751e-470f-ac50-88f82609de21 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1317 microversion: 2.1 time: 0.394043 Sep 18 01:39:03.203223 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2797/5548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:02 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:04.169048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1101ff64-f155-4b2e-b34f-4a3bbe60be44 req-fd6d9088-7484-47af-8fe2-d1b10ab86898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634c9a86-8da8-4e9c-bd05-c5983e30964c", "name": "network-vif-plugged", "status": "completed", "tag": "35542a2d-793a-4cd4-815b-f6e1121c26bb"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:04.180250 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:04.181626 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:04.185691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1101ff64-f155-4b2e-b34f-4a3bbe60be44 req-fd6d9088-7484-47af-8fe2-d1b10ab86898 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:04.186565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1101ff64-f155-4b2e-b34f-4a3bbe60be44 req-fd6d9088-7484-47af-8fe2-d1b10ab86898 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:04.187205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1101ff64-f155-4b2e-b34f-4a3bbe60be44 req-fd6d9088-7484-47af-8fe2-d1b10ab86898 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:04.204981 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1101ff64-f155-4b2e-b34f-4a3bbe60be44 req-fd6d9088-7484-47af-8fe2-d1b10ab86898 service nova] Creating event network-vif-plugged:35542a2d-793a-4cd4-815b-f6e1121c26bb for instance 634c9a86-8da8-4e9c-bd05-c5983e30964c on n-h1-master-1 Sep 18 01:39:04.211549 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1101ff64-f155-4b2e-b34f-4a3bbe60be44 req-fd6d9088-7484-47af-8fe2-d1b10ab86898 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046121 Sep 18 01:39:04.213378 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2752/5549] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:04.230367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:04.231690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:04.243964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:04.250052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:04.250706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:04.251597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:04.253984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:04.254439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:04.687177 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:04.702056 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7530571-23ea-4fc3-b797-7b19ff45772b tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1317 microversion: 2.1 time: 0.473621 Sep 18 01:39:04.702734 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2798/5550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:04 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:05.743220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:05.743932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:05.759674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:05.762129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:05.762770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:05.766523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:05.767519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:05.768533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:05.829571 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:06.334393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:06.349009 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b1d95ce8-dbe8-449c-a087-a3b1ac8940c6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1508 microversion: 2.1 time: 0.611745 Sep 18 01:39:06.349637 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2753/5551] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:05 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1508 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:06.375558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:06.376872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:06.383959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:06.384442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:06.384879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:06.393793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:06.394799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:06.395405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:06.822157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:06.837678 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-444c3b45-64ba-4bf6-abd8-ce36598c7955 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1508 microversion: 2.1 time: 0.466062 Sep 18 01:39:06.850810 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2799/5552] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:06 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1508 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:06.861374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:06.864868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:06.883752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:06.884560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:06.885539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:06.886598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:06.887210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:06.887965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:07.040794 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8da6b19d-4b33-4fc9-8292-601e7a8a45c9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "PUT /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1080 microversion: 2.1 time: 0.183700 Sep 18 01:39:07.057622 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2754/5553] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:39:06 2022] PUT /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1080 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:07.073748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:07.074733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:07.083049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:07.083917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:07.084511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:07.086395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:07.087178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:07.087750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:07.428752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:07.452792 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7778612-3a68-4537-963f-cac1eb8d8903 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1506 microversion: 2.1 time: 0.390385 Sep 18 01:39:07.457886 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2800/5554] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:07 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:07.484220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:07.485378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:07.497351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:07.498133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:07.498792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:07.499659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:07.502138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:07.502776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:07.831111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:07.847194 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bf9e0c8-7adc-41ea-ab93-34497672fa3f tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1506 microversion: 2.1 time: 0.367908 Sep 18 01:39:07.847820 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2755/5555] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:07 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:07.878305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:07.880935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:07.898903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:07.899405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:07.900962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:07.901765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:07.902242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:07.902680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.119070 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:08.212110 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f81e6dc-11dc-4f12-aae0-8ac5a63d6f40 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "PUT /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1082 microversion: 2.1 time: 0.337374 Sep 18 01:39:08.213768 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2801/5556] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:39:07 2022] PUT /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1082 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:08.233609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:08.234861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:08.251947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.252450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.252892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.253620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.254271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.254850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.459558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:08.469608 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-057f1c5b-745b-4192-9752-ec5cac14335c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1508 microversion: 2.1 time: 0.239399 Sep 18 01:39:08.473916 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2756/5557] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:08 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:08.493284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:08.494686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:08.505418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.506104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.506849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.507711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.508307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.508968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.725718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:08.737584 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9be87a61-e6c6-4ef7-ba7f-4b4977089c2e tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1508 microversion: 2.1 time: 0.249456 Sep 18 01:39:08.738990 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2802/5558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:08 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:08.760409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:08.761234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:08.769035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.770015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.770644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.771556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.772194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.772794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.800976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:39:08.839119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:08.839875 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:08.849147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.849675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.854344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.855118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:08.855595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:08.856053 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:08.908754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:39:08.964326 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb06b784-1bf6-42a9-96bb-1c808dc8adf1 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "DELETE /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 204 len: 0 microversion: 2.1 time: 0.207130 Sep 18 01:39:08.971696 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2757/5559] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:39:08 2022] DELETE /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:39:08.980936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:08.982290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:09.012054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:09.013424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:09.014257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:09.015044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:09.015501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:09.017332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:09.067444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:39:09.079789 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1e314b0b-5b17-4e66-8d39-70783d8dd2dd tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 204 len: 0 microversion: 2.1 time: 0.244401 Sep 18 01:39:09.080549 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2803/5560] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:39:08 2022] DELETE /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:39:09.098213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:09.098963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:09.112183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:09.112695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:09.113135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:09.113883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:09.114342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:09.115144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:09.180542 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Instance is already in deleting state, ignoring this request Sep 18 01:39:09.181393 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc7ca1f6-1fed-414c-992f-3e5102067947 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "DELETE /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 204 len: 0 microversion: 2.1 time: 0.206903 Sep 18 01:39:09.184882 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2758/5561] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:39:08 2022] DELETE /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:39:09.192407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:09.193086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:09.200225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:09.200786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:09.201224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:09.202061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:09.202518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:09.202991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:09.430223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:09.439475 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27060108-7b21-4f3d-b979-8ab3cfec2f9a tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1513 microversion: 2.1 time: 0.354108 Sep 18 01:39:09.454453 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2804/5562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:09 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:09.462340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:09.478181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c0c0c0ae-6fe0-419b-8d17-392c5e2bf5bd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1514 microversion: 2.1 time: 0.286401 Sep 18 01:39:09.478181 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2759/5563] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:09 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:10.467815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:10.470224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:10.492275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:10.494180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:10.494809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:10.500310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:10.501031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:10.501672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:10.502676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:10.503413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:10.520824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:10.530588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:10.533166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:10.534559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:10.538975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:10.540879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:10.877541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:10.888013 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8758debb-5ad7-4a85-b431-3a009b01276e tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1513 microversion: 2.1 time: 0.429193 Sep 18 01:39:10.888614 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2805/5564] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:10 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1513 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:10.954517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:10.968603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-be9d7a85-5d2b-42e0-81f0-acf17117a851 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1514 microversion: 2.1 time: 0.470235 Sep 18 01:39:10.987640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2760/5565] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:10 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:11.916364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:11.917015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:11.934821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:11.935364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:11.935852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:11.936642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:11.937110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:11.937667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:11.994850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:11.995459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:12.003342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:12.008368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:12.011579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:12.012763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:12.013380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:12.019532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:12.612025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:12.615049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:12.624233 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e41fb815-9afd-41fb-958f-c2bee9001453 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1513 microversion: 2.1 time: 0.711565 Sep 18 01:39:12.626306 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2806/5566] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:11 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1513 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:12.629523 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-446b6115-8f28-4b85-855d-3dfc1f183e83 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1514 microversion: 2.1 time: 0.638365 Sep 18 01:39:12.634271 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2761/5567] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:11 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1514 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:13.640027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-72f2e86e-1678-4642-9847-80788f1a718b req-0726d3f1-4220-4b80-a753-a9341fa53450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cdd6db-0cfe-45d5-b4e4-20caf58baafa", "name": "network-vif-deleted", "tag": "7042643c-740c-47bc-bad0-b6245e3fe573"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:13.674563 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:13.675721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:13.688171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:13.690265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:13.690870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:13.691771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:13.698030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:13.698498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:13.723794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-72f2e86e-1678-4642-9847-80788f1a718b req-0726d3f1-4220-4b80-a753-a9341fa53450 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:13.726857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-72f2e86e-1678-4642-9847-80788f1a718b req-0726d3f1-4220-4b80-a753-a9341fa53450 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:13.727452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-72f2e86e-1678-4642-9847-80788f1a718b req-0726d3f1-4220-4b80-a753-a9341fa53450 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:13.768740 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-72f2e86e-1678-4642-9847-80788f1a718b req-0726d3f1-4220-4b80-a753-a9341fa53450 service nova] Creating event network-vif-deleted:7042643c-740c-47bc-bad0-b6245e3fe573 for instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa on n-h1-master-1 Sep 18 01:39:13.784236 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-72f2e86e-1678-4642-9847-80788f1a718b req-0726d3f1-4220-4b80-a753-a9341fa53450 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148974 Sep 18 01:39:13.793590 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2807/5568] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:13.825320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:13.838880 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:13.866332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:13.870527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:13.871283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:13.872198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:13.876973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:13.877964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:14.166887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:14.175284 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f46e8f8-67c6-4fba-8a3f-947e074e553f tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 200 len: 1304 microversion: 2.1 time: 0.507796 Sep 18 01:39:14.179791 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2762/5569] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:13 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 1304 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:14.251054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797b6fd984ac412b925069f3a584aa2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2edb53d86c049d4aa5cd19d2fcfe017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:14.259851 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c0299714-2159-4c8f-8111-69a888b75d8c tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 200 len: 1472 microversion: 2.1 time: 0.465003 Sep 18 01:39:14.260431 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2808/5570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:13 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 1472 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:15.208249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:15.209918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: e2cdd6db-0cfe-45d5-b4e4-20caf58baafa] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:15.236788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.237630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.238236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.239358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.240554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.242621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.270183 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] HTTP exception thrown: Instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa could not be found. Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Request method failure captured: Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa HTTP/1.1 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnXuakxNE2j6tAbAzhB31IPuVxrynWvPZQhPHvPsPXyZ_SSTOtKarNZ9Ld5VnX_X_8FX5eMDP9Rem6ctnvePfJLUj49143SxOzLVQL9UlbOsUyI7pUFSWxmHta-vgU8Z7wqfFWATHZn1zHMAKD8OEZTbdBQWndpyVXAjE39woUscKEU Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: b04995d20aa446abae85cebada1fca2b Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesSnapshotTestJSON-532756005 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04995d20aa446abae85cebada1fca2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b04995d20aa446abae85cebada1fca2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b04995d20aa446abae85cebada1fca2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04995d20aa446abae85cebada1fca2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesSnapshotTestJSON-532756005 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: b04995d20aa446abae85cebada1fca2b Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-532756005 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesSnapshotTestJSON-532756005-project Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4369931aec12469bbcd0fb85b169c943 Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesSnapshotTestJSON-532756005-project Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: exception: Instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa could not be found. Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e2cdd6db-0cfe-45d5-b4e4-20caf58baafa'} Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa could not be found. Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa could not be found. Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.272644 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.277041 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.277041 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.277041 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.277041 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:39:15.277041 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:39:15.277041 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa could not be found. Sep 18 01:39:15.277041 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.279796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Returning 404 to user: Instance e2cdd6db-0cfe-45d5-b4e4-20caf58baafa could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:39:15.280871 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fbdfb8bf-3b04-4dde-844b-c56611fa6a69 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa" status: 404 len: 111 microversion: 2.1 time: 0.079164 Sep 18 01:39:15.287614 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2763/5571] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:15 2022] GET /compute/v2.1/servers/e2cdd6db-0cfe-45d5-b4e4-20caf58baafa => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:39:15.291570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:15.292841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 634c9a86-8da8-4e9c-bd05-c5983e30964c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:15.345397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.349119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.352058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.353042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.354196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.355688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.392732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] HTTP exception thrown: Instance 634c9a86-8da8-4e9c-bd05-c5983e30964c could not be found. Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Request method failure captured: Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c HTTP/1.1 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnYoDJqtCGm12ScXgkbm60IboECIOeuGNATMA1wWjllD2ayzyXdAMPWTqru8Tfnc3V-V9H5_phtEkuelbNoqYn5a_1OZGjjnxM_I7YjYNqTds1bajcFaNx_Jav636VJW3TAld0U3FlfEVv0L0ZfV3T9hycWm5QJBFYwxZrEEjYeLknY Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 797b6fd984ac412b925069f3a584aa2c Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 634c9a86-8da8-4e9c-bd05-c5983e30964c could not be found. Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '634c9a86-8da8-4e9c-bd05-c5983e30964c'} Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634c9a86-8da8-4e9c-bd05-c5983e30964c could not be found. Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634c9a86-8da8-4e9c-bd05-c5983e30964c could not be found. Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.397004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.402523 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.402523 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.402523 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.402523 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:39:15.402523 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:39:15.402523 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634c9a86-8da8-4e9c-bd05-c5983e30964c could not be found. Sep 18 01:39:15.402523 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.404628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Returning 404 to user: Instance 634c9a86-8da8-4e9c-bd05-c5983e30964c could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:39:15.408789 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93f5ef59-b3b8-4cb5-a9e1-45518d2301cd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c" status: 404 len: 111 microversion: 2.1 time: 0.124282 Sep 18 01:39:15.421663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:15.422897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:15.426963 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2809/5572] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:15 2022] GET /compute/v2.1/servers/634c9a86-8da8-4e9c-bd05-c5983e30964c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:39:15.432387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.434110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.436361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.440259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.440755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.447856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.488711 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] HTTP exception thrown: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Request method failure captured: Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a HTTP/1.1 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnYoDJqtCGm12ScXgkbm60IboECIOeuGNATMA1wWjllD2ayzyXdAMPWTqru8Tfnc3V-V9H5_phtEkuelbNoqYn5a_1OZGjjnxM_I7YjYNqTds1bajcFaNx_Jav636VJW3TAld0U3FlfEVv0L0ZfV3T9hycWm5QJBFYwxZrEEjYeLknY Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 797b6fd984ac412b925069f3a584aa2c Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '9540e28f-2e8f-4f7d-8906-48110cef650a'} Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:39:15.490480 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Returning 404 to user: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:39:15.494565 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b4c33f3c-4209-40a3-a1a5-1e7356a9b7fd tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 404 len: 111 microversion: 2.1 time: 0.075308 Sep 18 01:39:15.497416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2764/5573] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:39:15 2022] DELETE /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:39:15.503080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:15.503938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: 9540e28f-2e8f-4f7d-8906-48110cef650a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:15.519489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.520176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.520946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.522398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.525457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.526126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.564090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] HTTP exception thrown: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Request method failure captured: Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a HTTP/1.1 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnYoDJqtCGm12ScXgkbm60IboECIOeuGNATMA1wWjllD2ayzyXdAMPWTqru8Tfnc3V-V9H5_phtEkuelbNoqYn5a_1OZGjjnxM_I7YjYNqTds1bajcFaNx_Jav636VJW3TAld0U3FlfEVv0L0ZfV3T9hycWm5QJBFYwxZrEEjYeLknY Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 797b6fd984ac412b925069f3a584aa2c Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '9540e28f-2e8f-4f7d-8906-48110cef650a'} Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.567700 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Returning 404 to user: Instance 9540e28f-2e8f-4f7d-8906-48110cef650a could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:39:15.573407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7185a839-ab5b-4083-8827-b5016dbbbed9 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a" status: 404 len: 111 microversion: 2.1 time: 0.074198 Sep 18 01:39:15.574277 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2810/5574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:15 2022] GET /compute/v2.1/servers/9540e28f-2e8f-4f7d-8906-48110cef650a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:39:15.583012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:15.583833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:15.602304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.610742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.614610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.615380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.615977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.616272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.663726 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] HTTP exception thrown: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Request method failure captured: Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee HTTP/1.1 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnYoDJqtCGm12ScXgkbm60IboECIOeuGNATMA1wWjllD2ayzyXdAMPWTqru8Tfnc3V-V9H5_phtEkuelbNoqYn5a_1OZGjjnxM_I7YjYNqTds1bajcFaNx_Jav636VJW3TAld0U3FlfEVv0L0ZfV3T9hycWm5QJBFYwxZrEEjYeLknY Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 797b6fd984ac412b925069f3a584aa2c Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: exception: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e58c07f9-623b-433f-a3e8-cf5ac51dcdee'} Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:39:15.683666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Returning 404 to user: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:39:15.688320 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f4bfede-43b0-4f89-80a3-b7e0d14656a6 tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 404 len: 111 microversion: 2.1 time: 0.108162 Sep 18 01:39:15.689866 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2765/5575] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:39:15 2022] DELETE /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:39:15.695417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:15.696325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] [instance: e58c07f9-623b-433f-a3e8-cf5ac51dcdee] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:15.709815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.711601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.712362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.713468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.714271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.714962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.817786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] HTTP exception thrown: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Request method failure captured: Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee HTTP/1.1 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnYoDJqtCGm12ScXgkbm60IboECIOeuGNATMA1wWjllD2ayzyXdAMPWTqru8Tfnc3V-V9H5_phtEkuelbNoqYn5a_1OZGjjnxM_I7YjYNqTds1bajcFaNx_Jav636VJW3TAld0U3FlfEVv0L0ZfV3T9hycWm5QJBFYwxZrEEjYeLknY Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2edb53d86c049d4aa5cd19d2fcfe017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d2edb53d86c049d4aa5cd19d2fcfe017 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1635544064 Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 797b6fd984ac412b925069f3a584aa2c Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerDiskConfigTestJSON-1635544064-project Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e58c07f9-623b-433f-a3e8-cf5ac51dcdee'} Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:15.827909 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.837050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:15.837050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:15.837050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:15.837050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:39:15.837050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:39:15.837050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. Sep 18 01:39:15.837050 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:39:15.839738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] Returning 404 to user: Instance e58c07f9-623b-433f-a3e8-cf5ac51dcdee could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:39:15.843775 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e08bd5d4-5d9c-4469-a2dd-6965cd531e1a tempest-ServerDiskConfigTestJSON-1635544064 tempest-ServerDiskConfigTestJSON-1635544064-project] 10.222.0.25 "GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee" status: 404 len: 111 microversion: 2.1 time: 0.152337 Sep 18 01:39:15.845509 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2811/5576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:15 2022] GET /compute/v2.1/servers/e58c07f9-623b-433f-a3e8-cf5ac51dcdee => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:39:15.897500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9805dd0f-d52c-4a76-ae03-40faadfa6986 req-7e1b623b-afee-4360-aff7-a66eb2018508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634c9a86-8da8-4e9c-bd05-c5983e30964c", "name": "network-vif-deleted", "tag": "35542a2d-793a-4cd4-815b-f6e1121c26bb"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:15.920675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9805dd0f-d52c-4a76-ae03-40faadfa6986 req-7e1b623b-afee-4360-aff7-a66eb2018508 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:15.921165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9805dd0f-d52c-4a76-ae03-40faadfa6986 req-7e1b623b-afee-4360-aff7-a66eb2018508 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:15.929401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9805dd0f-d52c-4a76-ae03-40faadfa6986 req-7e1b623b-afee-4360-aff7-a66eb2018508 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:15.985404 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9805dd0f-d52c-4a76-ae03-40faadfa6986 req-7e1b623b-afee-4360-aff7-a66eb2018508 service nova] Creating event network-vif-deleted:35542a2d-793a-4cd4-815b-f6e1121c26bb for instance 634c9a86-8da8-4e9c-bd05-c5983e30964c on n-h1-master-1 Sep 18 01:39:16.031744 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9805dd0f-d52c-4a76-ae03-40faadfa6986 req-7e1b623b-afee-4360-aff7-a66eb2018508 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153567 Sep 18 01:39:16.042343 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2766/5577] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:39:22.387215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-54c80665-00ef-4280-bdda-0611ca61e8c7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Action: 'create', calling method: .version_select at 0x7f7005492ee0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1377582447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBZpIPaPRHpiOydLEUmBvLK5Ve3xHp232CAElPuRDyK2Ltx08WUSxi06qsEjIRQZ0t068UzJ1XfAYFAImQENngw3SLYF8ceGqZBa9jhBl1ULxma9dgNssjFRgLufb8VTg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:22.412413 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:22.475530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-54c80665-00ef-4280-bdda-0611ca61e8c7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Getting quotas for project 73683f3ff4a74617b8b864c2b9f25d9e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:39:22.503386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-54c80665-00ef-4280-bdda-0611ca61e8c7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Getting quotas for user 64d43f2acdf948058b064ef103ef21a7 and project 73683f3ff4a74617b8b864c2b9f25d9e. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:39:22.585319 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-54c80665-00ef-4280-bdda-0611ca61e8c7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.666960 Sep 18 01:39:22.586827 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2812/5578] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:39:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:25.696089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1835877902", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1377582447", "security_groups": [{"name": "tempest-secgroup-smoke-466408308"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "3d40c520-1ba9-49ea-a616-dcf5a81d954c"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:25.721359 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:25.980667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] validate_networks() for [('3d40c520-1ba9-49ea-a616-dcf5a81d954c', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:39:25.984818 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:26.902465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Getting quotas for project 73683f3ff4a74617b8b864c2b9f25d9e. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:39:26.909133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Getting quotas for user 64d43f2acdf948058b064ef103ef21a7 and project 73683f3ff4a74617b8b864c2b9f25d9e. Resources: dict_keys(['metadata_items']) {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:39:26.929469 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:39:26.930071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:39:26.930720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:39:26.931638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:39:26.932471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:39:26.965625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:26.966630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:26.968388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:26.970908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:26.971975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:26.973414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:26.997082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Getting quotas for project 73683f3ff4a74617b8b864c2b9f25d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:39:27.003869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Getting quotas for user 64d43f2acdf948058b064ef103ef21a7 and project 73683f3ff4a74617b8b864c2b9f25d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:39:27.026062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:39:27.033148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:39:27.134109 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9db2d6aa-181e-4f3d-9318-aa4bd7e0efe0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.445085 Sep 18 01:39:27.135085 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2767/5579] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:39:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:39:27.144553 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:27.148792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e63850b4-d808-4ced-aab1-da5661c7692c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:27.149401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e63850b4-d808-4ced-aab1-da5661c7692c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:27.277583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e63850b4-d808-4ced-aab1-da5661c7692c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:27.285175 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e63850b4-d808-4ced-aab1-da5661c7692c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1303 microversion: 2.1 time: 0.142125 Sep 18 01:39:27.285806 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2813/5580] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:27 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:28.321404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:28.322050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:28.335776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:28.341142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:28.341922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:28.342897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:28.344140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:28.344777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:28.496502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-80666554", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "cb5efec9-c3b1-4a7a-a35b-0741c18feb23"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:28.629053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] validate_networks() for [('cb5efec9-c3b1-4a7a-a35b-0741c18feb23', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:39:28.674342 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:28.692133 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2d8f1ad-7283-4fba-a6df-1d75de003fac tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1307 microversion: 2.1 time: 0.375194 Sep 18 01:39:28.692264 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2768/5581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:28 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:29.707715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:39:29.708133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:39:29.708605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:39:29.709021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:39:29.709437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:39:29.715286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:29.716496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:29.725855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:29.726352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:29.726794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:29.727526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:29.727985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:29.728210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:29.728411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:29.729062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:29.738305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:29.739393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:29.740135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:29.740761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:29.822024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Getting quotas for project b04995d20aa446abae85cebada1fca2b. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:39:29.841702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Getting quotas for user 4369931aec12469bbcd0fb85b169c943 and project b04995d20aa446abae85cebada1fca2b. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:39:29.887152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:39:29.891449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:39:29.913274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:29.923542 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d1c7099-0e29-442f-8497-70e4b09022d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1361 microversion: 2.1 time: 0.212085 Sep 18 01:39:29.924667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2769/5582] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:29 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:30.033077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b525bab-d7d3-4d98-bfd2-09cc17bb3b06 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.537864 Sep 18 01:39:30.036178 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2814/5583] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:39:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:39:30.050232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a18b12b-2021-4325-8208-864531780bb4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:30.050870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8a18b12b-2021-4325-8208-864531780bb4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:30.156835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8a18b12b-2021-4325-8208-864531780bb4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:30.164123 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a18b12b-2021-4325-8208-864531780bb4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1217 microversion: 2.1 time: 0.119589 Sep 18 01:39:30.185993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2770/5584] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:30 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:30.954943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:30.956001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:30.983157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:30.984692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:30.986312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:30.987821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:30.988655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:30.989295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:31.089158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:31.099340 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-260a8723-f8fb-438c-aee2-66e2aa784ee8 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1361 microversion: 2.1 time: 0.151945 Sep 18 01:39:31.106882 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2815/5585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:30 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:31.190445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:31.191684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:31.203014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:31.203522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:31.203965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:31.204859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:31.206436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:31.206872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:31.285417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:31.299591 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1e684ba1-3b65-4fc1-be61-485554b55692 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1213 microversion: 2.1 time: 0.110450 Sep 18 01:39:31.300461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2771/5586] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:31 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:31.515680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-143737608", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:31.606488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] validate_networks() for None {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:39:31.924803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:39:31.925596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:39:31.926543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:39:31.927155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:39:31.927770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:39:31.937930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:31.938728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:31.939371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:31.940327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:31.941395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:31.942141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:31.977264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Getting quotas for project b0f7287c428b47b6a0227e81747bd508. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:39:32.000743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Getting quotas for user c604df2835af4a2cb278eb23584bb608 and project b0f7287c428b47b6a0227e81747bd508. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:39:32.018532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:39:32.021728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:39:32.122961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:32.124830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:32.141808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:32.145452 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f09b720a-5a1d-41b3-b0c8-8db07bd070c7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635810 Sep 18 01:39:32.146345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:32.147061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:32.149229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:32.150276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:32.150940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:32.163182 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2816/5587] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:39:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:39:32.187778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41a0c452-388c-4b1b-b29e-625d0d879aef tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:32.188671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41a0c452-388c-4b1b-b29e-625d0d879aef tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:32.393006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-41a0c452-388c-4b1b-b29e-625d0d879aef tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:32.402996 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41a0c452-388c-4b1b-b29e-625d0d879aef tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1214 microversion: 2.1 time: 0.232445 Sep 18 01:39:32.418788 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2817/5588] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:32 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:32.433394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:32.434122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:32.449224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:32.449825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:32.450172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:32.450878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:32.451329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:32.451751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:32.557211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:32.573003 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-37a13356-4df6-430f-accc-f7b02e7dbc38 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.453565 Sep 18 01:39:32.573832 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2772/5589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:32 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:32.660197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:32.688192 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-77c02dbb-8a0d-4744-891e-65b440b02197 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1275 microversion: 2.1 time: 0.253561 Sep 18 01:39:32.689590 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2818/5590] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:32 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:33.442878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:33.443495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:33.451642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:33.452370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:33.453535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:33.454429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:33.455063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:33.455686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:33.580887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:33.589356 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33f7ace8-0b88-4bd6-8848-607c93fc98d7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1266 microversion: 2.1 time: 0.152415 Sep 18 01:39:33.601575 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2773/5591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:33 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:33.614589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:33.615223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:33.621824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:33.622541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:33.623297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:33.624154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:33.624901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:33.625249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:33.711064 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:33.712191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:33.719752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:33.720536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:33.721153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:33.722301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:33.722888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:33.724250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:33.886450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:33.895945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:33.898786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae57f699-729b-42b2-b5d3-6c2110dd02cb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.295248 Sep 18 01:39:33.900307 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2819/5592] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:33 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:33.918384 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cbc388e3-60c3-4313-8c8a-d37d16addbd7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1275 microversion: 2.1 time: 0.205689 Sep 18 01:39:33.933845 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2774/5593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:33 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:34.614684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:34.615310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:34.623015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:34.623510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:34.623953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:34.625207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:34.625703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:34.626135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:34.694226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:34.709859 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-10be8092-0fd9-4562-bf97-ba7654ef8651 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1272 microversion: 2.1 time: 0.098912 Sep 18 01:39:34.720460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2820/5594] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:34 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:34.926760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:34.927431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:34.934565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:34.935075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:34.935499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:34.936218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:34.936675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:34.939340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:34.945539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:34.946978 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:34.954594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:34.955435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:34.956041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:34.957041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:34.957741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:34.958554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:35.193668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:35.205420 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5094ef30-46a7-481d-bc3c-9c6c85272c1b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.282284 Sep 18 01:39:35.206965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:35.219100 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42ecaee9-e145-4dc3-8ef5-b42d8cfa4b77 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.278202 Sep 18 01:39:35.220312 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2821/5595] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:34 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:35.221438 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2775/5596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:34 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:35.736538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:35.737759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:35.752478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:35.752967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:35.753404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:35.759360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:35.771574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:35.772213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:35.932477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:35.965867 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e25a4f82-8d54-44e9-87f1-69db8039f19a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1272 microversion: 2.1 time: 0.226909 Sep 18 01:39:35.981670 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2822/5597] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:35 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:36.094028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2eb0fb96-850e-4b8e-a4a7-d0006c6886dc req-1476dfc6-7de2-439c-b5e7-7d3898d0270a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bd398c-9a38-46d2-9e73-e0b8d38f7bfd", "tag": "34ed18a3-c454-4f26-a302-ede9daf66812"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:36.114137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2eb0fb96-850e-4b8e-a4a7-d0006c6886dc req-1476dfc6-7de2-439c-b5e7-7d3898d0270a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:36.116538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2eb0fb96-850e-4b8e-a4a7-d0006c6886dc req-1476dfc6-7de2-439c-b5e7-7d3898d0270a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:36.122429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2eb0fb96-850e-4b8e-a4a7-d0006c6886dc req-1476dfc6-7de2-439c-b5e7-7d3898d0270a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:36.146210 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2eb0fb96-850e-4b8e-a4a7-d0006c6886dc req-1476dfc6-7de2-439c-b5e7-7d3898d0270a service nova] Creating event network-changed:34ed18a3-c454-4f26-a302-ede9daf66812 for instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd on n-h1-master-1 Sep 18 01:39:36.167483 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2eb0fb96-850e-4b8e-a4a7-d0006c6886dc req-1476dfc6-7de2-439c-b5e7-7d3898d0270a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077475 Sep 18 01:39:36.168520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2776/5598] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:36.230246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:36.231194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:36.243169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:36.244219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:36.250951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:36.254640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:36.255454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:36.256237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:36.256879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:36.257523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:36.258487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:36.259407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:36.260074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:36.260746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:36.261389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:36.262045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:36.894505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:36.915700 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1203e97b-9031-455f-a0ab-3e7bcdae667d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.689353 Sep 18 01:39:36.920485 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2823/5599] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:36 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:36.981658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:36.985895 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:36.991628 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a6390d0-f429-4ce0-b556-32d0b981842c tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.752404 Sep 18 01:39:36.998488 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2777/5600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:36 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:37.008931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:37.009568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:37.026156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:37.026941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:37.027771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:37.028864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:37.029585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:37.030233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:37.397009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:37.409198 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02660788-cde1-4f18-9485-eee067b36cdb tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.407569 Sep 18 01:39:37.414408 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2824/5601] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:37 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:37.941893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:37.942501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:37.961842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:37.962335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:37.966767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:37.967625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:37.968144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:37.968575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:38.025324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:38.026419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:38.044462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:38.044895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:38.045339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:38.057132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:38.058526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:38.058987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:38.719817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:38.745492 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea22845a-5822-41cb-91e1-8243c60b76ab tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.808475 Sep 18 01:39:38.746610 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2778/5602] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:37 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:38.766487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2ac482b6-6d32-4a45-8de0-5d036bd5ffb0 req-a0250907-ae1a-44b1-ac61-505e33ff3cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397cb269-1fd6-4d30-8fc4-679d1bc67fbb", "tag": "5737ea3e-5bf3-48a9-ad92-9e5bad960335"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:38.780937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2ac482b6-6d32-4a45-8de0-5d036bd5ffb0 req-a0250907-ae1a-44b1-ac61-505e33ff3cdc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:38.781410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2ac482b6-6d32-4a45-8de0-5d036bd5ffb0 req-a0250907-ae1a-44b1-ac61-505e33ff3cdc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:38.781864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2ac482b6-6d32-4a45-8de0-5d036bd5ffb0 req-a0250907-ae1a-44b1-ac61-505e33ff3cdc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:38.814239 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2ac482b6-6d32-4a45-8de0-5d036bd5ffb0 req-a0250907-ae1a-44b1-ac61-505e33ff3cdc service nova] Creating event network-changed:5737ea3e-5bf3-48a9-ad92-9e5bad960335 for instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb on n-h2-master-1 Sep 18 01:39:38.814576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:38.820573 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2ac482b6-6d32-4a45-8de0-5d036bd5ffb0 req-a0250907-ae1a-44b1-ac61-505e33ff3cdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071643 Sep 18 01:39:38.821817 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2779/5603] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:38.830735 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e196745a-03d5-419b-89a0-2641edb014d3 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.813505 Sep 18 01:39:38.831342 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2825/5604] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:38 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:38.834195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:38.834892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:38.851411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:38.851910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:38.852340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:38.853043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:38.853498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:38.853951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:39.162458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:39.178652 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0698ddd8-d94c-4c7f-9296-9ba55306a000 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.353843 Sep 18 01:39:39.180974 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2780/5605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:38 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:39.777127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:39.778386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:39.814483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:39.819446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:39.820517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:39.824447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:39.825137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:39.826397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:39.857631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:39.858421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:39.907990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:39.910175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:39.910884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:39.915350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:39.916098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:39.916795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:40.164601 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:40.284208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:40.298680 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d2c5ace-ada0-4450-a328-31fcf69f7f4b tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.527015 Sep 18 01:39:40.299615 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2826/5606] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:39 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:40.345422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:40.354006 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09d1bb93-d802-4706-a6fb-ef9cc38df2c7 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.503449 Sep 18 01:39:40.355647 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2781/5607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:39 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:40.361217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:40.361854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:40.372413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:40.373239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:40.373906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:40.375558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:40.376481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:40.377644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:40.560964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-606935241", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "61d7e896-baf1-4a9b-ac69-e9ebb6cda821"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:40.639474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] validate_networks() for [('61d7e896-baf1-4a9b-ac69-e9ebb6cda821', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:39:40.732743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:40.744921 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-18de76c6-e820-403c-abf0-6bb43073aef7 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.388093 Sep 18 01:39:40.745529 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2782/5608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:40 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:40.873083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ffb8eddc-5532-4b70-9cee-770a3ed20bbc req-2cbb8885-e787-42c1-b70e-57e35c0c358d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137fe63a-5fbe-455c-b3f6-2d9a70baabf3", "tag": "f0b06117-4ed6-455a-8a6e-87da0159f3ab"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:40.888907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffb8eddc-5532-4b70-9cee-770a3ed20bbc req-2cbb8885-e787-42c1-b70e-57e35c0c358d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:40.889860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffb8eddc-5532-4b70-9cee-770a3ed20bbc req-2cbb8885-e787-42c1-b70e-57e35c0c358d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:40.890545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffb8eddc-5532-4b70-9cee-770a3ed20bbc req-2cbb8885-e787-42c1-b70e-57e35c0c358d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:40.905946 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ffb8eddc-5532-4b70-9cee-770a3ed20bbc req-2cbb8885-e787-42c1-b70e-57e35c0c358d service nova] Creating event network-changed:f0b06117-4ed6-455a-8a6e-87da0159f3ab for instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 on n-h1-master-1 Sep 18 01:39:40.912085 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ffb8eddc-5532-4b70-9cee-770a3ed20bbc req-2cbb8885-e787-42c1-b70e-57e35c0c358d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043085 Sep 18 01:39:40.914383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2783/5609] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:41.192780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:39:41.193811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:39:41.194304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:39:41.194757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:39:41.195169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:39:41.213683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.214580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.218595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.219615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.220276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.220927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.254904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Getting quotas for project 740c1bef37cf420fb12aa7d5d4d63873. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:39:41.261410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Getting quotas for user e374ca10bce647d1929b3d5a3999ee13 and project 740c1bef37cf420fb12aa7d5d4d63873. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:39:41.275336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:39:41.277525 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:39:41.334210 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033288 Sep 18 01:39:41.334949 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2827/5610] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:39:41.336769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:41.338207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:41.347322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04da140c-50bc-48fb-8db9-17d3e7fbdd83 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:41.347929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.348045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04da140c-50bc-48fb-8db9-17d3e7fbdd83 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:41.348786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.350081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.351087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.365798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.366667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.458580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-04da140c-50bc-48fb-8db9-17d3e7fbdd83 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:41.467546 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04da140c-50bc-48fb-8db9-17d3e7fbdd83 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1216 microversion: 2.1 time: 0.124791 Sep 18 01:39:41.468739 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2828/5611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:41 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:41.485405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:41.486260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:41.497647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.498587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.499836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.500912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.501732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.502941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.743197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:41.755396 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc6f858c-0f66-4b20-808f-2472b0aa4892 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.429636 Sep 18 01:39:41.758646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2784/5612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:41 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:41.777156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:41.778354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:41.805664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:41.808532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.809385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.811202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.813396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:41.815099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:41.817166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:41.838776 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-061ad686-2b5a-43f2-a342-66cf8020f7d8 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.365991 Sep 18 01:39:41.839558 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2829/5613] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:41 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:42.087066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:42.096184 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2b4d127d-ead9-4320-aee2-6c28d3e86659 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.331788 Sep 18 01:39:42.098521 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2785/5614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:41 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:42.495512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:42.496743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:42.504916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:42.505718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:42.506592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:42.507522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:42.508284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:42.508930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:42.602078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:42.616067 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-544df713-eb85-4432-82c2-31d8fbddb64a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1268 microversion: 2.1 time: 0.124523 Sep 18 01:39:42.617157 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2830/5615] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:42 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1268 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:42.788921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:42.791088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:42.798796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:42.799384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:42.800029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:42.800769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:42.801247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:42.801840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:42.867824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:42.868983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:42.878519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:42.878878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:42.879507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:42.880386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:42.880840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:42.881262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:43.073727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:43.089288 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d482d55e-fe4c-4bb7-88bf-67faa97b07d4 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.305345 Sep 18 01:39:43.090204 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2786/5616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:42 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:43.119509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:43.120811 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:43.121437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:43.138675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:43.139175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:43.142641 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e5439cf-5b57-4b7e-83ed-4dbbcbf73b51 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.279124 Sep 18 01:39:43.145911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:43.146906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:43.147771 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2831/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:42 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:43.155675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:43.160909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:43.180127 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:43.418812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:43.427749 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d83d6330-c902-4fc3-abba-577c448a17a6 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.310879 Sep 18 01:39:43.428602 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2787/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:43 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:43.640370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:43.641699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:43.650117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:43.650855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:43.651512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:43.652471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:43.653141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:43.654123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:43.748755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:43.762311 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dc661e66-aeae-4470-8b08-cc79992957e9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1274 microversion: 2.1 time: 0.126243 Sep 18 01:39:43.763463 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2832/5619] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:43 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:44.122796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:44.123523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:44.136512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.142110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.142863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.143860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.144523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.145142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.165389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:44.166092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:44.168135 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:44.182172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.182671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.183116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.183823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.184281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.184715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.543248 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:44.556320 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-636e3e0f-b2e1-4d4a-bb8e-b867d3c3a4bf tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.394721 Sep 18 01:39:44.558251 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2833/5620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:44 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:44.566677 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:44.570283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:44.580559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.581267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.581893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.583026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.583669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.584257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.589916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:44.600795 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7d9602f3-3efc-430e-a281-7ce41bb1a631 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.481902 Sep 18 01:39:44.601777 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2788/5621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:44 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:44.613589 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=100 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:44.792075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:44.795524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:44.795524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:44.808424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-58958a66-1750-4818-b310-0f0e0d7e2a8f tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.248829 Sep 18 01:39:44.809073 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2834/5622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:44 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:44.810916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.811628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.812210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.813099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.814564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.815207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.916606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6fe548dd-7a2c-454a-ad57-8293cee03c7c req-3fc955b2-e828-478d-a9f5-7130b6c8396b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bd398c-9a38-46d2-9e73-e0b8d38f7bfd", "name": "network-vif-plugged", "status": "completed", "tag": "34ed18a3-c454-4f26-a302-ede9daf66812"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:44.941600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6fe548dd-7a2c-454a-ad57-8293cee03c7c req-3fc955b2-e828-478d-a9f5-7130b6c8396b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:44.942092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6fe548dd-7a2c-454a-ad57-8293cee03c7c req-3fc955b2-e828-478d-a9f5-7130b6c8396b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:44.942524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6fe548dd-7a2c-454a-ad57-8293cee03c7c req-3fc955b2-e828-478d-a9f5-7130b6c8396b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:44.971493 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6fe548dd-7a2c-454a-ad57-8293cee03c7c req-3fc955b2-e828-478d-a9f5-7130b6c8396b service nova] Creating event network-vif-plugged:34ed18a3-c454-4f26-a302-ede9daf66812 for instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd on n-h1-master-1 Sep 18 01:39:44.977994 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6fe548dd-7a2c-454a-ad57-8293cee03c7c req-3fc955b2-e828-478d-a9f5-7130b6c8396b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068931 Sep 18 01:39:44.979321 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2835/5623] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:45.037936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:45.048059 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c13bb76a-e7c1-4d37-98f4-92b3d8eb6679 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1316 microversion: 2.1 time: 0.263482 Sep 18 01:39:45.049137 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2789/5624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:44 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:45.473481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-9ebb7a7b-bc4f-45eb-931c-315aa22f16a9 req-d8f09816-a8dc-4c88-81db-4eae749f0b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab783ac-ce86-47c7-9fa3-b623aa574c12", "tag": "e6ced49f-4605-45fd-9522-afb07396f4ce"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:45.496678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9ebb7a7b-bc4f-45eb-931c-315aa22f16a9 req-d8f09816-a8dc-4c88-81db-4eae749f0b30 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:45.497488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9ebb7a7b-bc4f-45eb-931c-315aa22f16a9 req-d8f09816-a8dc-4c88-81db-4eae749f0b30 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:45.497622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9ebb7a7b-bc4f-45eb-931c-315aa22f16a9 req-d8f09816-a8dc-4c88-81db-4eae749f0b30 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:45.521048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-9ebb7a7b-bc4f-45eb-931c-315aa22f16a9 req-d8f09816-a8dc-4c88-81db-4eae749f0b30 service nova] Creating event network-changed:e6ced49f-4605-45fd-9522-afb07396f4ce for instance cab783ac-ce86-47c7-9fa3-b623aa574c12 on n-h2-master-1 Sep 18 01:39:45.527283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-9ebb7a7b-bc4f-45eb-931c-315aa22f16a9 req-d8f09816-a8dc-4c88-81db-4eae749f0b30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060346 Sep 18 01:39:45.528276 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2836/5625] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:45.579798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:45.580413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:45.589866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:45.590563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:45.591077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:45.592046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:45.592574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:45.593793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:45.634228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:45.634956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:45.642900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:45.643384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:45.643818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:45.644523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:45.644978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:45.645399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:45.826823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:45.837037 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcfecedc-8a96-417a-a5a7-ccbb3883b356 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.261879 Sep 18 01:39:45.842383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2790/5626] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:45 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:45.855868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:45.856804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:45.873432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:45.874823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:45.875454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:45.876363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:45.877009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:45.877686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:45.879792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:45.889528 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b9b073a4-3bea-41fb-bbf3-71ab18629564 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1428 microversion: 2.1 time: 0.263707 Sep 18 01:39:45.891071 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2837/5627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:45 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1428 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:46.052471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:46.063634 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf073bac-139d-4e6a-93e8-9b147dcfdb7d tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.223486 Sep 18 01:39:46.064238 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2791/5628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:45 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:46.085306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:46.086121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:46.093675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:46.094274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:46.094847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:46.095634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:46.096183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:46.097155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:46.269958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:46.285278 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f068ce3-a1cb-4d0f-be24-dcf59c084f66 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1316 microversion: 2.1 time: 0.203737 Sep 18 01:39:46.303488 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2838/5629] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:46 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:46.865364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:46.866398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:46.877361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:46.878145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:46.878826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:46.879998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:46.880742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:46.881436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:46.919010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:46.922229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:46.932919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:46.933835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:46.934485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:46.935450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:46.936145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:46.936835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.145737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:47.159389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-774d62c7-5f9f-4a0b-b58f-6c8b68c05e70 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.301131 Sep 18 01:39:47.161784 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2792/5630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:46 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:47.163240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:47.167010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-849dfb6d-7116-4ac7-b217-246b57d7d270 req-a682eece-75b7-4002-aa0f-70aab73eb6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137fe63a-5fbe-455c-b3f6-2d9a70baabf3", "name": "network-vif-plugged", "status": "completed", "tag": "f0b06117-4ed6-455a-8a6e-87da0159f3ab"}, {"server_uuid": "397cb269-1fd6-4d30-8fc4-679d1bc67fbb", "name": "network-vif-plugged", "status": "completed", "tag": "5737ea3e-5bf3-48a9-ad92-9e5bad960335"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:47.171801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd49d3cf-373a-4963-998a-8340412e95f7 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1609 microversion: 2.1 time: 0.261578 Sep 18 01:39:47.172728 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2839/5631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:46 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1609 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:47.178000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:47.178621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:47.180035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-849dfb6d-7116-4ac7-b217-246b57d7d270 req-a682eece-75b7-4002-aa0f-70aab73eb6ac service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.180725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-849dfb6d-7116-4ac7-b217-246b57d7d270 req-a682eece-75b7-4002-aa0f-70aab73eb6ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.181312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-849dfb6d-7116-4ac7-b217-246b57d7d270 req-a682eece-75b7-4002-aa0f-70aab73eb6ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.188599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.189190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.189664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.190389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.190853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.191288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.201497 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-849dfb6d-7116-4ac7-b217-246b57d7d270 req-a682eece-75b7-4002-aa0f-70aab73eb6ac service nova] Creating event network-vif-plugged:f0b06117-4ed6-455a-8a6e-87da0159f3ab for instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 on n-h1-master-1 Sep 18 01:39:47.202658 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-849dfb6d-7116-4ac7-b217-246b57d7d270 req-a682eece-75b7-4002-aa0f-70aab73eb6ac service nova] Creating event network-vif-plugged:5737ea3e-5bf3-48a9-ad92-9e5bad960335 for instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb on n-h2-master-1 Sep 18 01:39:47.219800 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-849dfb6d-7116-4ac7-b217-246b57d7d270 req-a682eece-75b7-4002-aa0f-70aab73eb6ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058083 Sep 18 01:39:47.220955 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2793/5632] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:47.226399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:47.227133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:47.234765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.235266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.235716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.236438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.236909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.237343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.459213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:47.471080 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb5f4548-e883-471a-8417-123d5f9e56b1 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.296499 Sep 18 01:39:47.473100 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2840/5633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:47 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:47.480862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:47.482337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:47.491024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.491769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.492444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.493546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.494737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.495369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.554852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:47.565695 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-538fa399-7459-42f8-8dd6-1e62d924912f tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1609 microversion: 2.1 time: 0.343357 Sep 18 01:39:47.566424 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2794/5634] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:47 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1609 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:47.588628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:47.589239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:47.596732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.597326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.599019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.599019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:47.599271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:47.599783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:47.698923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:47.709370 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5133302e-4729-4552-ab21-2d2946bac750 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1316 microversion: 2.1 time: 0.234833 Sep 18 01:39:47.710286 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2841/5635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:47 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:47.763904 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:47.771960 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b5f8010a-4603-41cf-a514-68710f342482 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1609 microversion: 2.1 time: 0.187185 Sep 18 01:39:47.772546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2795/5636] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:47 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1609 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:39:48.187592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:48.188829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:48.197047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:48.197565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:48.198161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:48.198875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:48.199351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:48.199767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:48.463642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:48.475125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92646db4-cbcc-4f9d-92d1-676e4582c6af tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1317 microversion: 2.1 time: 0.291905 Sep 18 01:39:48.476676 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2842/5637] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:48 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:48.504936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:48.505634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:48.517982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:48.521105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:48.523057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:48.524209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:48.526563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:48.529402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:48.736524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:48.740006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:48.750408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:48.751194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:48.751786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:48.752657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:48.753262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:48.753859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:48.806973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:48.819571 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f487d9e6-8f3e-4a4b-8fcb-ec0e0dfeef76 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1314 microversion: 2.1 time: 0.322837 Sep 18 01:39:48.839711 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2796/5638] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:48 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:49.078389 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:49.087187 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3fe358ec-62b8-40a8-a666-a71e080d0e30 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1316 microversion: 2.1 time: 0.356177 Sep 18 01:39:49.087800 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2843/5639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:48 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:49.507518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:49.508123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:49.515263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:49.515742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:49.516171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:49.516936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:49.517392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:49.517834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:49.850059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:49.850679 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:49.860425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:49.861048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:49.861544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:49.862378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:49.862908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:49.863546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.047729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:50.058170 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90ac8fa2-d0d1-4282-9aa7-3e59d9e5b470 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1505 microversion: 2.1 time: 0.554244 Sep 18 01:39:50.059394 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2797/5640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:49 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:50.083181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e0a577-f741-4f5b-a3b3-7000e8772c12", "device": "/dev/sdb"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:50.086700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:50.094281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.094985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.095616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.096489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.097107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.097818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.153439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:50.172177 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3100b3e-6ea5-49e3-b8a1-9a374f22add8 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1463 microversion: 2.1 time: 0.326518 Sep 18 01:39:50.176620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2844/5641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:49 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1463 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:50.198959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:50.199616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:50.208780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.209265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.209754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.210670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.211263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.211866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.429402 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-858d9832-d5a5-487d-b763-2e8394901d2b tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "POST /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349798 Sep 18 01:39:50.442728 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2798/5642] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 01:39:50 2022] POST /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:39:50.454709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-51d22527-a214-4286-a8a2-45a7a6b8b84e req-0d0c579c-bc46-4f27-96c1-26a82c6ac519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab783ac-ce86-47c7-9fa3-b623aa574c12", "name": "network-vif-plugged", "status": "completed", "tag": "e6ced49f-4605-45fd-9522-afb07396f4ce"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:50.466622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-51d22527-a214-4286-a8a2-45a7a6b8b84e req-0d0c579c-bc46-4f27-96c1-26a82c6ac519 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.467468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-51d22527-a214-4286-a8a2-45a7a6b8b84e req-0d0c579c-bc46-4f27-96c1-26a82c6ac519 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.468636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-51d22527-a214-4286-a8a2-45a7a6b8b84e req-0d0c579c-bc46-4f27-96c1-26a82c6ac519 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.484084 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-51d22527-a214-4286-a8a2-45a7a6b8b84e req-0d0c579c-bc46-4f27-96c1-26a82c6ac519 service nova] Creating event network-vif-plugged:e6ced49f-4605-45fd-9522-afb07396f4ce for instance cab783ac-ce86-47c7-9fa3-b623aa574c12 on n-h2-master-1 Sep 18 01:39:50.490189 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-51d22527-a214-4286-a8a2-45a7a6b8b84e req-0d0c579c-bc46-4f27-96c1-26a82c6ac519 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045108 Sep 18 01:39:50.494155 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2799/5643] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:50.500978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:50.502809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:50.517705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.518412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.519972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.520928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.521601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:50.521762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.521847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.533133 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80f3ca55-d980-4c8c-9c18-c604a7265eb8 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1316 microversion: 2.1 time: 0.338249 Sep 18 01:39:50.533766 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2845/5644] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:50 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:50.585070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:39:50.704772 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b8e7804-39f2-430a-a3bd-30a7947f7865 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 204 len: 0 microversion: 2.1 time: 0.211339 Sep 18 01:39:50.706970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2800/5645] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:39:50 2022] DELETE /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:39:50.715968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:50.716583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:50.723877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.723877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.724280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:50.726814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:50.727542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:50.728360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:51.006001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:51.017333 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-15127c94-b2af-4243-a456-9181efc758e5 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1469 microversion: 2.1 time: 0.305426 Sep 18 01:39:51.018513 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2846/5646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:50 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:51.149216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-069ec3ab-ec63-4b48-b501-9294f40e730f req-e3fca3a1-4b3b-4bd0-877c-edde45e1e5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bd398c-9a38-46d2-9e73-e0b8d38f7bfd", "tag": "34ed18a3-c454-4f26-a302-ede9daf66812"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:51.156797 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:51.185746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-069ec3ab-ec63-4b48-b501-9294f40e730f req-e3fca3a1-4b3b-4bd0-877c-edde45e1e5c7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:51.186355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-069ec3ab-ec63-4b48-b501-9294f40e730f req-e3fca3a1-4b3b-4bd0-877c-edde45e1e5c7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:51.186787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-069ec3ab-ec63-4b48-b501-9294f40e730f req-e3fca3a1-4b3b-4bd0-877c-edde45e1e5c7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:51.200710 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-069ec3ab-ec63-4b48-b501-9294f40e730f req-e3fca3a1-4b3b-4bd0-877c-edde45e1e5c7 service nova] Creating event network-changed:34ed18a3-c454-4f26-a302-ede9daf66812 for instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd on n-h1-master-1 Sep 18 01:39:51.206015 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-069ec3ab-ec63-4b48-b501-9294f40e730f req-e3fca3a1-4b3b-4bd0-877c-edde45e1e5c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062165 Sep 18 01:39:51.206947 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2801/5647] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:51.558724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:51.560199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:51.568146 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:51.569773 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=28 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:51.572266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:51.573515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:51.574326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:51.575494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:51.576029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:51.576525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:51.750973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:51.759756 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fd7b4af-1bfa-48e6-8d66-7c0a76cb995b tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1316 microversion: 2.1 time: 0.205966 Sep 18 01:39:51.760631 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2847/5648] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:51 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:52.046624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:52.047744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:52.058336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:52.058838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:52.059271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:52.060096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:52.060651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:52.062470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:52.304783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:52.309031 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:52.316701 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-930ee219-5e4e-4927-b0ee-5c663b35d393 tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1469 microversion: 2.1 time: 0.277123 Sep 18 01:39:52.317484 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2802/5649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:52 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:52.786903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:52.787813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:52.816342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:52.820234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:52.821077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:52.822991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:52.826741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:52.827312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.071426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:53.085860 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d420406-8578-4bab-aae4-9cf9dd34296c tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1505 microversion: 2.1 time: 0.304966 Sep 18 01:39:53.100812 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2848/5650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:52 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:53.115436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:53.115966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:53.134868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.135535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.136120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.136864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.137352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.137844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.185487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:53.186895 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ec7256e-89bf-4c62-a381-6a887bada46d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12/os-instance-actions/req-7bd7e541-b425-4e42-9eb9-ca894e8ca362" status: 200 len: 313 microversion: 2.1 time: 0.076676 Sep 18 01:39:53.188047 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2803/5651] 10.222.0.25 () {58 vars in 1419 bytes} [Sun Sep 18 01:39:53 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12/os-instance-actions/req-7bd7e541-b425-4e42-9eb9-ca894e8ca362 => generated 313 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:53.203657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:53.207369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:53.221216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.222480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.223906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.225063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.225773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.226496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.343118 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c5de0c6-8ffc-41b8-8fd3-385e573e4c1d tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "POST /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12/action" status: 202 len: 0 microversion: 2.1 time: 0.145375 Sep 18 01:39:53.344708 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2849/5652] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:39:53 2022] POST /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:39:53.356440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:53.357786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:53.376697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.377399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.378171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.379019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.379486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.384189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.408057 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:53.410437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:53.446753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.456932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.459136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.461076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.462898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.464794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.587590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c604df2835af4a2cb278eb23584bb608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f7287c428b47b6a0227e81747bd508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:53.600749 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7df3e9e-6769-4bf9-a346-d6c0c36e415e tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 200 len: 1427 microversion: 2.1 time: 0.261596 Sep 18 01:39:53.602541 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2804/5653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:53 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 1427 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:53.609030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-00628c05-4a1f-4fb6-9959-5c38bd6f590b req-3fee7044-6f32-4693-9a43-ef1cfb1767e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137fe63a-5fbe-455c-b3f6-2d9a70baabf3", "name": "network-vif-deleted", "tag": "f0b06117-4ed6-455a-8a6e-87da0159f3ab"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:39:53.621614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-00628c05-4a1f-4fb6-9959-5c38bd6f590b req-3fee7044-6f32-4693-9a43-ef1cfb1767e3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:53.622514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-00628c05-4a1f-4fb6-9959-5c38bd6f590b req-3fee7044-6f32-4693-9a43-ef1cfb1767e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:53.624252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-00628c05-4a1f-4fb6-9959-5c38bd6f590b req-3fee7044-6f32-4693-9a43-ef1cfb1767e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:53.640311 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-00628c05-4a1f-4fb6-9959-5c38bd6f590b req-3fee7044-6f32-4693-9a43-ef1cfb1767e3 service nova] Creating event network-vif-deleted:f0b06117-4ed6-455a-8a6e-87da0159f3ab for instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 on n-h1-master-1 Sep 18 01:39:53.646330 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-00628c05-4a1f-4fb6-9959-5c38bd6f590b req-3fee7044-6f32-4693-9a43-ef1cfb1767e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041592 Sep 18 01:39:53.647153 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2805/5654] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:53.825810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:53.836705 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e31ae7f-5af9-4480-b98c-ce8166bada20 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1507 microversion: 2.1 time: 0.475308 Sep 18 01:39:53.838404 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2850/5655] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:53 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:54.631171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:54.631877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] [instance: 137fe63a-5fbe-455c-b3f6-2d9a70baabf3] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:54.638833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:54.639844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:54.640331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:54.641048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:54.641605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:54.642040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:54.658249 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] HTTP exception thrown: Instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 could not be found. Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Request method failure captured: Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 HTTP/1.1 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnbQUOYX4iKVSOex3ha7FgKlJyNSuLR_pt46zHOXc7Mb9VryLfDJ6XQnvBJsvL3XW3g0MaGBJtS6SkD1Oz_t3pPPR9IurGrfonAKrwRtepXFq-5cY2BPh8KirRtCCakTwukf0QnBgTnK5lWgLw98NVn7tWXtR0Rasji4vIQikYtI1qw Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: b0f7287c428b47b6a0227e81747bd508 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesNegativeTest-1799032502 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f7287c428b47b6a0227e81747bd508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0f7287c428b47b6a0227e81747bd508"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0f7287c428b47b6a0227e81747bd508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f7287c428b47b6a0227e81747bd508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesNegativeTest-1799032502 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: b0f7287c428b47b6a0227e81747bd508 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesNegativeTest-1799032502 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesNegativeTest-1799032502-project Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: c604df2835af4a2cb278eb23584bb608 Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesNegativeTest-1799032502-project Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 could not be found. Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '137fe63a-5fbe-455c-b3f6-2d9a70baabf3'} Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 could not be found. Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 could not be found. Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:39:54.661138 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 could not be found. Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] Returning 404 to user: Instance 137fe63a-5fbe-455c-b3f6-2d9a70baabf3 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca6f8858-d301-48e8-8d46-b921fe2b274a tempest-VolumesNegativeTest-1799032502 tempest-VolumesNegativeTest-1799032502-project] 10.222.0.25 "GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3" status: 404 len: 111 microversion: 2.1 time: 0.037144 Sep 18 01:39:54.670249 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2806/5656] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:54 2022] GET /compute/v2.1/servers/137fe63a-5fbe-455c-b3f6-2d9a70baabf3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:39:54.864894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:54.871821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:54.908455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:54.908946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:54.909388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:54.910134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:54.910597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:54.911063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:55.003150 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:39:55.201395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:55.211898 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3e11db3-6e63-4902-8fa0-eeab8a5c242a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1512 microversion: 2.1 time: 0.350829 Sep 18 01:39:55.213898 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2851/5657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:54 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:56.248146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:56.248952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:56.258462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.258965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.259410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:56.260173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.260657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.261095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:56.529199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:56.538896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75ab7e68-b9b8-4ac1-a9f6-b4046b76498e tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1505 microversion: 2.1 time: 0.295161 Sep 18 01:39:56.541475 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2807/5658] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:56 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:56.564069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '.version_select at 0x7f7005432b80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:56.564641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:56.582190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.582756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.583129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:56.583855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.584319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.584772 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:56.675902 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7f89ecd-4f2e-4fd5-848e-4e760dbfe8e6 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.116431 Sep 18 01:39:56.677613 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2852/5659] 10.222.0.25 () {58 vars in 1296 bytes} [Sun Sep 18 01:39:56 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12/os-instance-actions => generated 611 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:39:56.696034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:56.696807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:56.705544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.706874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.707730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:56.708600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.712807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.713303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:56.763710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:39:56.919893 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7951f2f5-a854-46ee-994f-dd5f00102f7a tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 204 len: 0 microversion: 2.1 time: 0.231057 Sep 18 01:39:56.921899 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2808/5660] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:39:56 2022] DELETE /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:39:56.930276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:56.931092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:56.957006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.957977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.958686 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:56.959688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:56.960356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:56.960984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:57.203031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:57.215783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-460e144e-c7ee-4dcb-93d9-fe20ebca51d2 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1511 microversion: 2.1 time: 0.289890 Sep 18 01:39:57.233820 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2853/5661] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:56 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:57.343106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:57.344720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:57.355175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:57.356071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:57.356719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:57.357675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:57.358548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:57.359437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:57.512813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lazy-loading 'services' on Instance uuid 90a3a87c-a15c-4be7-a66b-fca336389415 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:39:57.642395 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-805bbc98-b63b-4478-a0d2-d18febd05417 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415/os-volume_attachments/3ccc650d-4458-4532-b0c4-5d8964b05b29" status: 202 len: 0 microversion: 2.1 time: 0.307067 Sep 18 01:39:57.651999 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2809/5662] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:39:57 2022] DELETE /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415/os-volume_attachments/3ccc650d-4458-4532-b0c4-5d8964b05b29 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:39:58.242828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:58.244559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:58.254665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:58.255846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:58.256904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:58.258164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:58.258919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:58.259807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:58.488533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:58.513359 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ed2e6b8-1ae7-45d3-9f7f-6923909b93c4 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1511 microversion: 2.1 time: 0.274570 Sep 18 01:39:58.518364 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2854/5663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:58 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:39:59.542349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:39:59.543318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:39:59.553774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:59.554368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:59.554880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:59.555670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:39:59.556251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:39:59.556728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:39:59.716170 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:39:59.738448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c7472e2-a95b-465e-b460-12d9db02f453 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1511 microversion: 2.1 time: 0.200915 Sep 18 01:39:59.750524 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2810/5664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:39:59 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:00.033223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b99206ad-bfb3-45ce-ba36-851b5420ae3f req-b3700d56-fb34-4f4c-bf67-dd1cf180ebe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab783ac-ce86-47c7-9fa3-b623aa574c12", "name": "network-vif-deleted", "tag": "e6ced49f-4605-45fd-9522-afb07396f4ce"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:00.063876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b99206ad-bfb3-45ce-ba36-851b5420ae3f req-b3700d56-fb34-4f4c-bf67-dd1cf180ebe5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:00.064365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b99206ad-bfb3-45ce-ba36-851b5420ae3f req-b3700d56-fb34-4f4c-bf67-dd1cf180ebe5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:00.064799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b99206ad-bfb3-45ce-ba36-851b5420ae3f req-b3700d56-fb34-4f4c-bf67-dd1cf180ebe5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:00.083035 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b99206ad-bfb3-45ce-ba36-851b5420ae3f req-b3700d56-fb34-4f4c-bf67-dd1cf180ebe5 service nova] Creating event network-vif-deleted:e6ced49f-4605-45fd-9522-afb07396f4ce for instance cab783ac-ce86-47c7-9fa3-b623aa574c12 on n-h2-master-1 Sep 18 01:40:00.090548 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b99206ad-bfb3-45ce-ba36-851b5420ae3f req-b3700d56-fb34-4f4c-bf67-dd1cf180ebe5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061617 Sep 18 01:40:00.091163 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2855/5665] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:40:00.765932 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:00.766895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:00.775470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:00.776097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:00.777348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:00.778719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:00.779707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:00.781321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:00.825886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:00.827486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:00.828138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:00.829034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lazy-loading 'fault' on Instance uuid cab783ac-ce86-47c7-9fa3-b623aa574c12 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:40:00.909094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e374ca10bce647d1929b3d5a3999ee13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740c1bef37cf420fb12aa7d5d4d63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:00.918561 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff2dc211-b678-46cd-9994-8e941de3c154 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 200 len: 1306 microversion: 2.1 time: 0.157430 Sep 18 01:40:00.922473 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2811/5666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:00 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:01.954022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:01.955466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] [instance: cab783ac-ce86-47c7-9fa3-b623aa574c12] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:01.964376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:01.965215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:01.965889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:01.966790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:01.968073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:01.968692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:01.987588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] HTTP exception thrown: Instance cab783ac-ce86-47c7-9fa3-b623aa574c12 could not be found. Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Request method failure captured: Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 HTTP/1.1 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnbbL0s7104SX_HEnSS4pmaq2EdCmxO_KM_1RNOgrY_kWDvG8auF4lbQMIIWM3nXaPR8kLS0CF9D9oSJadal-wgYBrw79yEALg3j3a3XNDgyZWEKvngrIutaXkeMAkoEQqsVrUKnTg9AxbxhicxX_QMMs9_KQa7Vsb1m77lYZyqnmVw Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 740c1bef37cf420fb12aa7d5d4d63873 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-InstanceActionsTestJSON-272395466 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/740c1bef37cf420fb12aa7d5d4d63873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/740c1bef37cf420fb12aa7d5d4d63873"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_740c1bef37cf420fb12aa7d5d4d63873"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/740c1bef37cf420fb12aa7d5d4d63873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-InstanceActionsTestJSON-272395466 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 740c1bef37cf420fb12aa7d5d4d63873 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-InstanceActionsTestJSON-272395466 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-InstanceActionsTestJSON-272395466-project Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: e374ca10bce647d1929b3d5a3999ee13 Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-InstanceActionsTestJSON-272395466-project Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: exception: Instance cab783ac-ce86-47c7-9fa3-b623aa574c12 could not be found. Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'cab783ac-ce86-47c7-9fa3-b623aa574c12'} Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab783ac-ce86-47c7-9fa3-b623aa574c12 could not be found. Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab783ac-ce86-47c7-9fa3-b623aa574c12 could not be found. Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:01.989586 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:01.994227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:01.994227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:01.994227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:01.994227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:40:01.994227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:40:01.994227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab783ac-ce86-47c7-9fa3-b623aa574c12 could not be found. Sep 18 01:40:01.994227 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:01.996168 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] Returning 404 to user: Instance cab783ac-ce86-47c7-9fa3-b623aa574c12 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:40:01.997467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca9695a6-3908-4278-aa26-65dd04d4dad9 tempest-InstanceActionsTestJSON-272395466 tempest-InstanceActionsTestJSON-272395466-project] 10.222.0.25 "GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12" status: 404 len: 111 microversion: 2.1 time: 0.053077 Sep 18 01:40:02.002516 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2856/5667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:01 2022] GET /compute/v2.1/servers/cab783ac-ce86-47c7-9fa3-b623aa574c12 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:40:03.971952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aeef81ea-425f-4094-a939-77930e5a6b7a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: .version_select at 0x7f7005277af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-554634503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxPJoZxquHTyNAKi/WrbSNocOAKLPGTsXk07z2O3f4Tg39NBZAkqNRlNG6ZeVxytdV5dAAYmxZgVHGDEuYST2OzwanzK4Tc+Ib+t78NUTiS+0+XdS6nZ3nesWL7yIhjBw=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:03.998022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-aeef81ea-425f-4094-a939-77930e5a6b7a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:40:04.007948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-aeef81ea-425f-4094-a939-77930e5a6b7a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:40:04.038027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aeef81ea-425f-4094-a939-77930e5a6b7a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.334483 Sep 18 01:40:04.039100 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2812/5668] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:40:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:40:05.400447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:05.401015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:05.418950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:05.419445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:05.420022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:05.421945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:05.422842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:05.423281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:05.463695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:40:05.651292 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55e1f8a9-9dcf-42b8-bdea-166081ba118c tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 204 len: 0 microversion: 2.1 time: 0.254161 Sep 18 01:40:05.654515 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2857/5669] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:40:05 2022] DELETE /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:40:05.664976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:05.665971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:05.674281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:05.674919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:05.675465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:05.676445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:05.677056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:05.677614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:06.028343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:06.038516 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ad0d11d0-e159-4cc4-8eda-af41e92b2e6b tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1469 microversion: 2.1 time: 0.378066 Sep 18 01:40:06.052213 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2813/5670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:05 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1469 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:07.078802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:07.085249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:07.108221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:07.108221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:07.108221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:07.108582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:07.108773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:07.109363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:07.515964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:07.526108 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8775b259-aaf1-4435-8933-78837001aded tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1469 microversion: 2.1 time: 0.466847 Sep 18 01:40:07.526914 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2858/5671] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:07 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1469 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:08.563066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:08.564757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:08.587884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:08.589303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:08.590809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:08.593803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:08.595142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:08.596228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:09.067245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b099e188b54f0baa7b46ce02587c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00a84826fea4e728af1ae50f112c316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:09.079608 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb1bec6d-61b3-4341-b90e-f72987094429 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 200 len: 1469 microversion: 2.1 time: 0.530661 Sep 18 01:40:09.080790 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2814/5672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:08 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 1469 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:09.118947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c8157d70-04d6-40db-9919-d9e7f3029dc6 req-d81a1dd0-23cd-48b0-946f-0f38f64729a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a3a87c-a15c-4be7-a66b-fca336389415", "name": "network-vif-deleted", "tag": "2e0ffb1d-1593-4ddf-943b-e7d7c0cba3a8"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:09.138497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c8157d70-04d6-40db-9919-d9e7f3029dc6 req-d81a1dd0-23cd-48b0-946f-0f38f64729a8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:09.141890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c8157d70-04d6-40db-9919-d9e7f3029dc6 req-d81a1dd0-23cd-48b0-946f-0f38f64729a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:09.142657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c8157d70-04d6-40db-9919-d9e7f3029dc6 req-d81a1dd0-23cd-48b0-946f-0f38f64729a8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:09.167558 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c8157d70-04d6-40db-9919-d9e7f3029dc6 req-d81a1dd0-23cd-48b0-946f-0f38f64729a8 service nova] Creating event network-vif-deleted:2e0ffb1d-1593-4ddf-943b-e7d7c0cba3a8 for instance 90a3a87c-a15c-4be7-a66b-fca336389415 on n-h2-master-1 Sep 18 01:40:09.174386 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c8157d70-04d6-40db-9919-d9e7f3029dc6 req-d81a1dd0-23cd-48b0-946f-0f38f64729a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059767 Sep 18 01:40:09.175714 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2859/5673] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:40:10.106942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:10.108665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] [instance: 90a3a87c-a15c-4be7-a66b-fca336389415] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:10.123075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:10.126338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:10.127002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:10.127914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:10.130219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:10.130707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:10.165708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] HTTP exception thrown: Instance 90a3a87c-a15c-4be7-a66b-fca336389415 could not be found. Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Request method failure captured: Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 HTTP/1.1 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnZ2Fhqy7ruf-bKG0lrkPrPfJBkoSEsA8TXuOuDhCyv5hg1ezLbLFKCNdr_PxHv1yB54UKND8PJnqA6iEicLoa1aU9sIrq-GkNxfal5NwYRRAMg2Y73Gny4XxwvAgXYHYvU4o1nQN1OV8FbsfAf-YOMEeJgMc9P6NybT6YRW3SJ7Mmo Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: d00a84826fea4e728af1ae50f112c316 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesBackupsTest-1428015520 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d00a84826fea4e728af1ae50f112c316"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d00a84826fea4e728af1ae50f112c316"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d00a84826fea4e728af1ae50f112c316"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d00a84826fea4e728af1ae50f112c316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesBackupsTest-1428015520 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: d00a84826fea4e728af1ae50f112c316 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesBackupsTest-1428015520 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesBackupsTest-1428015520-project Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 30b099e188b54f0baa7b46ce02587c82 Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesBackupsTest-1428015520-project Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 90a3a87c-a15c-4be7-a66b-fca336389415 could not be found. Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '90a3a87c-a15c-4be7-a66b-fca336389415'} Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a3a87c-a15c-4be7-a66b-fca336389415 could not be found. Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a3a87c-a15c-4be7-a66b-fca336389415 could not be found. Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:10.178487 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:10.183363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:10.183363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:10.183363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:10.183363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:40:10.183363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:40:10.183363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a3a87c-a15c-4be7-a66b-fca336389415 could not be found. Sep 18 01:40:10.183363 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:10.186166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] Returning 404 to user: Instance 90a3a87c-a15c-4be7-a66b-fca336389415 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:40:10.189697 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7536e10d-b664-42a8-ab15-8879beac9db3 tempest-VolumesBackupsTest-1428015520 tempest-VolumesBackupsTest-1428015520-project] 10.222.0.25 "GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415" status: 404 len: 111 microversion: 2.1 time: 0.086952 Sep 18 01:40:10.190502 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2815/5674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:10 2022] GET /compute/v2.1/servers/90a3a87c-a15c-4be7-a66b-fca336389415 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:40:15.942268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-99203563", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "87d1952a-2944-4722-8ca1-3aefca4da09d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-554634503", "security_groups": [{"name": "tempest-secgroup-smoke-1865600133"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:15.969863 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:16.377000 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] validate_networks() for [('87d1952a-2944-4722-8ca1-3aefca4da09d', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:40:17.676215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:40:17.677617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:40:17.678908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:40:17.679506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:40:17.680089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:40:17.700810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:17.701820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:17.702439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:17.707751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:17.710200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:17.710860 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:17.772724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:40:17.795613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:40:17.852488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:40:17.865083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:40:17.992234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37c768e7-fc11-404c-afec-4491f3eb87cb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.062325 Sep 18 01:40:17.992919 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2860/5675] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:40:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:40:18.005473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-216d65c7-2974-4433-87dc-7c45f80075ae tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:18.006122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-216d65c7-2974-4433-87dc-7c45f80075ae tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:18.010286 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:18.210395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-216d65c7-2974-4433-87dc-7c45f80075ae tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:18.242108 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-216d65c7-2974-4433-87dc-7c45f80075ae tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1264 microversion: 2.1 time: 0.234845 Sep 18 01:40:18.242776 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2816/5676] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:18 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:19.266113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:19.267458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:19.282302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:19.283050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:19.283644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:19.284509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:19.285415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:19.287637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:19.420487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:19.469741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fd8dc392-8324-4020-a528-9526d4696ff3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1268 microversion: 2.1 time: 0.201021 Sep 18 01:40:19.471952 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2817/5677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:19 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:19.650054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1531033440", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "118d8ad5-0f78-41fd-bab1-43630980a616"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:19.782390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] validate_networks() for [('118d8ad5-0f78-41fd-bab1-43630980a616', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:40:20.506074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:20.507612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:20.520772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:40:20.521204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:40:20.522141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:40:20.522569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:40:20.522993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:40:20.537804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:20.540066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:20.542435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:20.544610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:20.548244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:20.549074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:20.549703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:20.551261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:20.551737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:20.552559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:20.553924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:20.554506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:20.575943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Getting quotas for project 0476cdeec9124a2a9f858d8736351036. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:40:20.581956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Getting quotas for user 45df8101101e45828c0e47b33559e953 and project 0476cdeec9124a2a9f858d8736351036. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:40:20.598754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:40:20.601140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:40:20.672745 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ecbc435e-9575-43bb-a5ab-900efb7b2999 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.468861 Sep 18 01:40:20.683779 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2861/5678] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:40:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:40:20.696207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c31c0cbe-bf46-4af2-8a2c-44bd300eef78 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:20.696987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:20.697282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c31c0cbe-bf46-4af2-8a2c-44bd300eef78 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:20.706098 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77b7652f-7219-4fda-8372-70cbe7ac6ce0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1322 microversion: 2.1 time: 0.208983 Sep 18 01:40:20.712139 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2818/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:20 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:20.884423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c31c0cbe-bf46-4af2-8a2c-44bd300eef78 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:20.903142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c31c0cbe-bf46-4af2-8a2c-44bd300eef78 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:20.906112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c31c0cbe-bf46-4af2-8a2c-44bd300eef78 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:20.907407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c31c0cbe-bf46-4af2-8a2c-44bd300eef78 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1259 microversion: 2.21 time: 0.222562 Sep 18 01:40:20.911328 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2862/5680] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:20 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:21.734591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:21.735211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:21.747198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:21.749002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:21.750893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:21.752657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:21.753311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:21.755993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:21.945478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:21.947817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:21.992875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:21.993740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:21.995204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:22.003495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:22.007979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:22.009456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:22.109260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:22.125696 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-35bb1761-e8d2-44de-a078-9b34f562d6c9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.389533 Sep 18 01:40:22.127920 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2819/5681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:21 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:22.213218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:22.243803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:22.248599 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:22.252750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4c62256e-0623-4604-aff9-6e2c53c28c72 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1255 microversion: 2.21 time: 0.313838 Sep 18 01:40:22.256941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2863/5682] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:21 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1255 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:23.159173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:23.159973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:23.163340 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:23.180900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:23.182165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:23.182980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:23.184053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:23.190556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:23.191546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:23.195848 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:23.283303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:23.285448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:23.314528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:23.316620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:23.318390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:23.321437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:23.323505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:23.324199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:23.519250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:23.527532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:23.534410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:23.539024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:23.539423 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-39392806-fb12-4932-815b-c2216c2a6bb9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.383374 Sep 18 01:40:23.540667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2820/5683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:23 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:23.551997 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16b49a27-cbb1-406e-854a-54dba3fa9fa5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1317 microversion: 2.21 time: 0.274942 Sep 18 01:40:23.553096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2864/5684] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:23 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:40:24.583579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:24.589604 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:24.590240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:24.597314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:24.600020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:24.603334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:24.604239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:24.612443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:24.613119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:24.613600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:24.614828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:24.615597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:24.616330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:24.617357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:24.618573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:24.619581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:24.772049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:24.787543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:24.790057 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:24.791667 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4f83a1b-6eef-4cb4-b443-022aebc40fce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1317 microversion: 2.21 time: 0.206282 Sep 18 01:40:24.792738 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2865/5685] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:24 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:24.938889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:24.952936 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3460aba9-9353-4db0-b67a-3c68a1be1ba2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.372331 Sep 18 01:40:24.952936 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2821/5686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:24 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:24.983906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-123aa07d-14a9-47ae-9025-c2e6a13f512d req-60a29eb2-2d8c-452c-9242-39456e5fe70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:25.006805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-123aa07d-14a9-47ae-9025-c2e6a13f512d req-60a29eb2-2d8c-452c-9242-39456e5fe70a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:25.007653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-123aa07d-14a9-47ae-9025-c2e6a13f512d req-60a29eb2-2d8c-452c-9242-39456e5fe70a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:25.008447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-123aa07d-14a9-47ae-9025-c2e6a13f512d req-60a29eb2-2d8c-452c-9242-39456e5fe70a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:25.026321 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-123aa07d-14a9-47ae-9025-c2e6a13f512d req-60a29eb2-2d8c-452c-9242-39456e5fe70a service nova] Creating event network-changed:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h1-master-1 Sep 18 01:40:25.034816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-123aa07d-14a9-47ae-9025-c2e6a13f512d req-60a29eb2-2d8c-452c-9242-39456e5fe70a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066877 Sep 18 01:40:25.036501 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2866/5687] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:40:25.179852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:25.180349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:25.187809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:25.188608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:25.189047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:25.189775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:25.190385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:25.191253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:25.299168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lazy-loading 'services' on Instance uuid 397cb269-1fd6-4d30-8fc4-679d1bc67fbb {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:40:25.425645 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bee696a-6430-4df3-8ce0-5b98d5901233 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "DELETE /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb/os-volume_attachments/89e0a577-f741-4f5b-a3b3-7000e8772c12" status: 202 len: 0 microversion: 2.1 time: 0.239149 Sep 18 01:40:25.425645 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2822/5688] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 01:40:25 2022] DELETE /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb/os-volume_attachments/89e0a577-f741-4f5b-a3b3-7000e8772c12 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:40:25.838497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:25.842906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:25.878753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:25.879284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:25.883388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:25.903594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:25.906033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:25.908273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:25.914481 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:25.979379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:25.980105 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:26.000155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:26.003360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:26.004060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:26.005810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:26.013299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:26.014444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:26.528897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:26.547629 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b17c159a-71d2-4d9a-a2ca-4d57938f94a4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.575354 Sep 18 01:40:26.565579 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2823/5689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:25 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:26.618313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:26.636725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:26.640793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:26.640793 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca0ab10c-4ad7-42bd-85dd-b8c3b28c09b7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.814686 Sep 18 01:40:26.653983 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2867/5690] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:25 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:27.372518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d1ffaab0-7586-467e-bdfa-780576c718ee req-830bd523-5e04-465f-88dc-300dd19935d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ec6515-4706-42eb-81de-ba3df2a2bf95", "tag": "e1806415-9fb8-4090-ac4f-91e95233e230"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:27.406473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d1ffaab0-7586-467e-bdfa-780576c718ee req-830bd523-5e04-465f-88dc-300dd19935d8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:27.425793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d1ffaab0-7586-467e-bdfa-780576c718ee req-830bd523-5e04-465f-88dc-300dd19935d8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:27.427930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d1ffaab0-7586-467e-bdfa-780576c718ee req-830bd523-5e04-465f-88dc-300dd19935d8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:27.444315 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d1ffaab0-7586-467e-bdfa-780576c718ee req-830bd523-5e04-465f-88dc-300dd19935d8 service nova] Creating event network-changed:e1806415-9fb8-4090-ac4f-91e95233e230 for instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 on n-h2-master-1 Sep 18 01:40:27.454078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:27.454719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:27.472348 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d1ffaab0-7586-467e-bdfa-780576c718ee req-830bd523-5e04-465f-88dc-300dd19935d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103911 Sep 18 01:40:27.485105 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2824/5691] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:40:27.487605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:27.488249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:27.488752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:27.490039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:27.490710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:27.491389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:27.548884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bc36a1ed-0e1e-4538-87d7-e2219fb8122c tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.099255 Sep 18 01:40:27.550130 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2868/5692] 10.222.0.25 () {58 vars in 1293 bytes} [Sun Sep 18 01:40:27 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd/os-server-password => generated 116 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:40:27.585264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:27.586113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:27.600395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:27.603004 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:27.605197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:27.607705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:27.609644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:27.610567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:27.674802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:27.676282 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:27.689056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:27.691387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:27.692702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:27.694457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:27.697175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:27.698571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:27.887898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:27.910620 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-daf5737b-d81e-487a-befd-479a5b85064b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.330020 Sep 18 01:40:27.913866 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2825/5693] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:27 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:28.006228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:28.019826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:28.022012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:28.023409 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ca7b91c4-dbb0-4661-b9e8-112e395e8088 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.359092 Sep 18 01:40:28.024492 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2869/5694] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:27 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:28.940895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:28.942146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:28.944459 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:28.951651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:28.952397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:28.952998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:28.953915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:28.954374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:28.954794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:29.050421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:29.052342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:29.073722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:29.074759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:29.075633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:29.076968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:29.077899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:29.078747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:29.213813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:29.223731 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c6bc81b9-8107-4b7f-8d8e-3e0bcf1c04a7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.286254 Sep 18 01:40:29.226946 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2826/5695] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:28 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:40:29.309232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:29.322421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:29.324238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:29.325891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a8d2a8e-7331-4cb4-b9c6-52f4f1176e68 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.279523 Sep 18 01:40:29.326634 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2870/5696] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:29 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:30.248312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:30.248930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:30.256991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:30.258138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:30.258753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:30.260288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:30.260911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:30.261570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:30.351750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:30.352570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:30.359601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:30.361871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:30.363185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:30.367485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:30.374433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:30.375115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:30.440516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:30.455417 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe79cea1-cabc-43be-88ff-a9c849792cd1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.211598 Sep 18 01:40:30.456181 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2827/5697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:30 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:30.567870 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:30.606758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:30.617218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:30.619001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:30.620152 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f8a1db4a-cba0-4e79-8992-797c6a8c0154 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.272326 Sep 18 01:40:30.620722 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2871/5698] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:30 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:31.481296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:31.481945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:31.489097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:31.489612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:31.490053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:31.490752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:31.491207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:31.491633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:31.631656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:31.640349 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7d404031-0d7e-475c-8599-d551b01cf633 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.163831 Sep 18 01:40:31.641156 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2828/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:31 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:31.653792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:31.653792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:31.653792 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=14 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:31.657699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:31.658774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:31.659152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:31.659880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:31.660341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:31.660769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:31.803303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:31.812010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:31.813470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:31.814676 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba52331f-b20a-42dc-8e4f-b05c658daed7 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.172232 Sep 18 01:40:31.815248 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2872/5700] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:31 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:32.075551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:32.076824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:32.082950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.083436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.083889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.084572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.085031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.085457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.113923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:40:32.218774 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94046c1f-d2f2-4c25-88c2-1d07e68357ab tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "DELETE /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 204 len: 0 microversion: 2.1 time: 0.143688 Sep 18 01:40:32.220639 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2829/5701] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:40:32 2022] DELETE /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:40:32.228908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:32.229577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:32.236399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.237178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.237922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.238668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.239142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.239576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.447500 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:32.457310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-41f2e4e1-7e83-4f8b-b7df-7cf3cabd2c97 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1511 microversion: 2.1 time: 0.232407 Sep 18 01:40:32.457944 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2873/5702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:32 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:32.516025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9a15e787-4c90-4fcf-ab5f-d62c1918f265 req-d51f6ae3-da0d-49e7-a0cd-c1381febbd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "name": "network-vif-plugged", "status": "completed", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:32.528998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9a15e787-4c90-4fcf-ab5f-d62c1918f265 req-d51f6ae3-da0d-49e7-a0cd-c1381febbd0c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.529478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9a15e787-4c90-4fcf-ab5f-d62c1918f265 req-d51f6ae3-da0d-49e7-a0cd-c1381febbd0c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.529949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9a15e787-4c90-4fcf-ab5f-d62c1918f265 req-d51f6ae3-da0d-49e7-a0cd-c1381febbd0c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.542594 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9a15e787-4c90-4fcf-ab5f-d62c1918f265 req-d51f6ae3-da0d-49e7-a0cd-c1381febbd0c service nova] Creating event network-vif-plugged:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h1-master-1 Sep 18 01:40:32.550884 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9a15e787-4c90-4fcf-ab5f-d62c1918f265 req-d51f6ae3-da0d-49e7-a0cd-c1381febbd0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041860 Sep 18 01:40:32.552118 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2830/5703] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:40:32.679904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:32.682170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:32.702397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.702908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.703484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.704297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.704875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.705951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.840116 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:32.841206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:32.848391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.848975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.849480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.850296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:32.850832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:32.851315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:32.874440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:32.887927 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b5cecfad-73c6-4646-b222-6f04f864a9eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1390 microversion: 2.1 time: 0.222384 Sep 18 01:40:32.888827 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2874/5704] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:32 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:33.041274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:33.051418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:33.053668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:33.054850 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c24d4306-5e2f-443b-ba81-a05c058b55ce tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.219077 Sep 18 01:40:33.055438 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2831/5705] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:32 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:40:33.482892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:33.484195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:33.490971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:33.491462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:33.491896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:33.492595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:33.493047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:33.493476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:33.648577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:33.657682 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5136d2b-bb9e-4d11-87bd-9e4ece4b10c5 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1511 microversion: 2.1 time: 0.180235 Sep 18 01:40:33.658272 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2875/5706] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:33 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:33.913376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:33.914051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:33.921394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:33.921924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:33.922361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:33.923074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:33.923529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:33.923950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.081742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:34.083146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:34.091828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.092710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.093201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.097007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.097688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.098117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.102876 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:34.112550 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a14eb58e-4515-4db2-b976-a0db5d258e50 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1562 microversion: 2.1 time: 0.203415 Sep 18 01:40:34.113474 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2832/5707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:33 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1562 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:34.135741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:34.136397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:34.143102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.144273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.144817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.145810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.146802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.147296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.352839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:34.361452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:34.366778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:34.369029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:34.370625 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-22522aee-395a-4294-827a-022ac8170e55 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1562 microversion: 2.1 time: 0.239147 Sep 18 01:40:34.371076 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be46e8be-71f5-4cdd-b807-797db1d45de8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.293073 Sep 18 01:40:34.372325 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2833/5708] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:34 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:40:34.387100 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2876/5709] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:34 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:40:34.576367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0ae4df22-ee44-428e-a172-884db67a6f51 req-76b166ff-2894-4ba3-b227-4b4684cce567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ec6515-4706-42eb-81de-ba3df2a2bf95", "name": "network-vif-plugged", "status": "completed", "tag": "e1806415-9fb8-4090-ac4f-91e95233e230"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:34.592708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0ae4df22-ee44-428e-a172-884db67a6f51 req-76b166ff-2894-4ba3-b227-4b4684cce567 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.595784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0ae4df22-ee44-428e-a172-884db67a6f51 req-76b166ff-2894-4ba3-b227-4b4684cce567 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.599499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0ae4df22-ee44-428e-a172-884db67a6f51 req-76b166ff-2894-4ba3-b227-4b4684cce567 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.625633 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0ae4df22-ee44-428e-a172-884db67a6f51 req-76b166ff-2894-4ba3-b227-4b4684cce567 service nova] Creating event network-vif-plugged:e1806415-9fb8-4090-ac4f-91e95233e230 for instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 on n-h2-master-1 Sep 18 01:40:34.636048 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0ae4df22-ee44-428e-a172-884db67a6f51 req-76b166ff-2894-4ba3-b227-4b4684cce567 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063592 Sep 18 01:40:34.644606 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2834/5710] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:40:34.681768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:34.682732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:34.690450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.691412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.692930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.693984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.694675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.695329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.833070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-13676382-b80d-46f5-8086-9f29e7bf3b2a req-dc46febc-8d2f-40a4-84c9-f454517c95c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397cb269-1fd6-4d30-8fc4-679d1bc67fbb", "name": "network-vif-deleted", "tag": "5737ea3e-5bf3-48a9-ad92-9e5bad960335"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:34.845406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-13676382-b80d-46f5-8086-9f29e7bf3b2a req-dc46febc-8d2f-40a4-84c9-f454517c95c3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:34.846626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-13676382-b80d-46f5-8086-9f29e7bf3b2a req-dc46febc-8d2f-40a4-84c9-f454517c95c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:34.846626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-13676382-b80d-46f5-8086-9f29e7bf3b2a req-dc46febc-8d2f-40a4-84c9-f454517c95c3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:34.861063 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-13676382-b80d-46f5-8086-9f29e7bf3b2a req-dc46febc-8d2f-40a4-84c9-f454517c95c3 service nova] Creating event network-vif-deleted:5737ea3e-5bf3-48a9-ad92-9e5bad960335 for instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb on n-h2-master-1 Sep 18 01:40:34.867817 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-13676382-b80d-46f5-8086-9f29e7bf3b2a req-dc46febc-8d2f-40a4-84c9-f454517c95c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038208 Sep 18 01:40:34.868766 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2835/5711] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:40:35.051731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:35.072145 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50a07be4-3734-42d0-bf81-588bf8c421ce tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1469 microversion: 2.1 time: 0.394387 Sep 18 01:40:35.074748 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2877/5712] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:34 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:35.415094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:35.416662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:35.427905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:35.432468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:35.433132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:35.434118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:35.434772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:35.435920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:35.694151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:35.704984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:35.707412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:35.708073 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-745fc0b5-107f-4836-847f-cbfa413bb94a tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.297237 Sep 18 01:40:35.708635 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2836/5713] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:35 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:36.102932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:36.105196 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:36.113950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:36.114450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:36.115082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:36.123841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:36.124351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:36.124795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:36.163762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:36.164138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:36.164583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:36.165139 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lazy-loading 'fault' on Instance uuid 397cb269-1fd6-4d30-8fc4-679d1bc67fbb {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:40:36.235643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4369931aec12469bbcd0fb85b169c943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04995d20aa446abae85cebada1fca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:36.252425 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2085449d-d275-48dc-bd6c-9f93336d7574 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 200 len: 1307 microversion: 2.1 time: 0.156931 Sep 18 01:40:36.253842 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2878/5714] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:36 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:36.734844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:36.736109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:36.750219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:36.750996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:36.751660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:36.752547 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:36.753180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:36.753660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:36.763649 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:36.961510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:36.962474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:36.970507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:36.971253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:36.972024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:36.972910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:36.973531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:36.974139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:36.978683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:36.988518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:36.990394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:36.991674 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-893af420-e7b2-4a61-81af-f30c951d7a57 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1359 microversion: 2.21 time: 0.262025 Sep 18 01:40:36.992250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2837/5715] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:36 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:37.005800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-61b4a4b8-7360-418a-b7d1-ebadb4fa4e91 req-670661c6-a24e-4331-b2e2-5b43d8895b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:37.009190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-61b4a4b8-7360-418a-b7d1-ebadb4fa4e91 req-670661c6-a24e-4331-b2e2-5b43d8895b96 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:37.009703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-61b4a4b8-7360-418a-b7d1-ebadb4fa4e91 req-670661c6-a24e-4331-b2e2-5b43d8895b96 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:37.010136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-61b4a4b8-7360-418a-b7d1-ebadb4fa4e91 req-670661c6-a24e-4331-b2e2-5b43d8895b96 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:37.022446 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-61b4a4b8-7360-418a-b7d1-ebadb4fa4e91 req-670661c6-a24e-4331-b2e2-5b43d8895b96 service nova] Creating event network-changed:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h1-master-1 Sep 18 01:40:37.030029 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-61b4a4b8-7360-418a-b7d1-ebadb4fa4e91 req-670661c6-a24e-4331-b2e2-5b43d8895b96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035909 Sep 18 01:40:37.034229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2838/5716] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:40:37.174143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:37.188677 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6825dbfc-427b-4864-b4c2-044fdef3fee6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1562 microversion: 2.1 time: 0.230942 Sep 18 01:40:37.189928 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2879/5717] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:36 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:40:37.277996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:37.280023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] [instance: 397cb269-1fd6-4d30-8fc4-679d1bc67fbb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:37.292375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:37.292885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:37.293332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:37.295218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:37.295703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:37.299002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:37.323372 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] HTTP exception thrown: Instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb could not be found. Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Request method failure captured: Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb HTTP/1.1 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnXuakxNE2j6tAbAzhB31IPuVxrynWvPZQhPHvPsPXyZ_SSTOtKarNZ9Ld5VnX_X_8FX5eMDP9Rem6ctnvePfJLUj49143SxOzLVQL9UlbOsUyI7pUFSWxmHta-vgU8Z7wqfFWATHZn1zHMAKD8OEZTbdBQWndpyVXAjE39woUscKEU Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: b04995d20aa446abae85cebada1fca2b Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesSnapshotTestJSON-532756005 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04995d20aa446abae85cebada1fca2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b04995d20aa446abae85cebada1fca2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b04995d20aa446abae85cebada1fca2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04995d20aa446abae85cebada1fca2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesSnapshotTestJSON-532756005 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: b04995d20aa446abae85cebada1fca2b Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-532756005 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesSnapshotTestJSON-532756005-project Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 4369931aec12469bbcd0fb85b169c943 Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesSnapshotTestJSON-532756005-project Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb could not be found. Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '397cb269-1fd6-4d30-8fc4-679d1bc67fbb'} Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb could not be found. Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb could not be found. Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:37.325353 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:37.329951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:37.329951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:37.329951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:37.329951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:40:37.329951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:40:37.329951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb could not be found. Sep 18 01:40:37.329951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:37.332489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] Returning 404 to user: Instance 397cb269-1fd6-4d30-8fc4-679d1bc67fbb could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:40:37.333622 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6b647355-14c2-45e0-8ac7-bb8c37594ab4 tempest-VolumesSnapshotTestJSON-532756005 tempest-VolumesSnapshotTestJSON-532756005-project] 10.222.0.25 "GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb" status: 404 len: 111 microversion: 2.1 time: 0.060102 Sep 18 01:40:37.337950 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2839/5718] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:37 2022] GET /compute/v2.1/servers/397cb269-1fd6-4d30-8fc4-679d1bc67fbb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:40:38.024539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:38.025543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:38.035535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:38.036056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:38.036505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:38.037235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:38.037729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:38.038165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:38.256727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:38.273166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:38.274936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:38.276197 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b8cc8434-daa0-4566-87f7-5cfea7795dc5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1552 microversion: 2.21 time: 0.255768 Sep 18 01:40:38.298233 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2880/5719] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:38 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1552 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:38.313418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:38.315025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:38.333904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:38.334667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:38.335465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:38.337178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:38.340526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:38.341812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:38.425907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:40:38.576199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a49adeec-623a-4163-899a-392997b41af3 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 204 len: 0 microversion: 2.21 time: 0.269013 Sep 18 01:40:38.577963 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2840/5720] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:40:38 2022] DELETE /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:40:38.591316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:38.592576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:38.599738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:38.600229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:38.602023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:38.603730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:38.604384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:38.604970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:38.901583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:38.901583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:38.901583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:38.901583 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be32a334-2cb0-4cec-b06e-df3565e35778 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1558 microversion: 2.21 time: 0.313468 Sep 18 01:40:38.901583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2881/5721] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:38 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1558 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:39.930173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:39.931535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:39.943579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:39.944403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:39.945225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:39.946770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:39.947833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:39.948582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:40.164125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:40.174690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:40.176512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:40.178190 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fcae3954-77a4-4012-bbee-ca10313a4b3c tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1558 microversion: 2.21 time: 0.254741 Sep 18 01:40:40.179010 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2841/5722] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:39 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:40.930094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-de805071-1556-4c1a-a46e-f86d137bfb0a req-eaa0e533-8e9d-42ba-8242-161e7f43ad1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ec6515-4706-42eb-81de-ba3df2a2bf95", "name": "network-vif-deleted", "tag": "e1806415-9fb8-4090-ac4f-91e95233e230"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:40.943568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-de805071-1556-4c1a-a46e-f86d137bfb0a req-eaa0e533-8e9d-42ba-8242-161e7f43ad1b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:40.944073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-de805071-1556-4c1a-a46e-f86d137bfb0a req-eaa0e533-8e9d-42ba-8242-161e7f43ad1b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:40.944500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-de805071-1556-4c1a-a46e-f86d137bfb0a req-eaa0e533-8e9d-42ba-8242-161e7f43ad1b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:40.958337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-de805071-1556-4c1a-a46e-f86d137bfb0a req-eaa0e533-8e9d-42ba-8242-161e7f43ad1b service nova] Creating event network-vif-deleted:e1806415-9fb8-4090-ac4f-91e95233e230 for instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 on n-h2-master-1 Sep 18 01:40:40.966002 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-de805071-1556-4c1a-a46e-f86d137bfb0a req-eaa0e533-8e9d-42ba-8242-161e7f43ad1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040521 Sep 18 01:40:40.970467 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2882/5723] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:40:41.204706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:41.206073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:41.215486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:41.216445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:41.216976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:41.217954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:41.218643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:41.219276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:41.262501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:41.263504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:41.263948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:41.264401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lazy-loading 'fault' on Instance uuid 80ec6515-4706-42eb-81de-ba3df2a2bf95 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:40:41.325239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:41.336076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:41.337685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45df8101101e45828c0e47b33559e953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0476cdeec9124a2a9f858d8736351036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:41.338947 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cbbdbaa3-52df-48c3-9c82-c131c422ac3b tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 200 len: 1349 microversion: 2.21 time: 0.138451 Sep 18 01:40:41.339620 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2842/5724] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:41 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 1349 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:40:42.365635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:42.366335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:42.373291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.374051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.374492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.375200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.375656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.376082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.390034 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] HTTP exception thrown: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Request method failure captured: Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 HTTP/1.1 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJncCADbgRVCFriuYhj-IE5ucJhvyOJt9wi8XHYLBlMFiZ2dsYo9J09kIGUiMD7L9mGKRSkve83cKXA08BaCGU_g_8r4Ak6k8TRWHv5RySYWzxw-7QUzbGss1DlhztiU82kcAvax2pl0kODAWdY84bevL41sK4jhBEHcCUBd1SLCfBQc Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.21 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 0476cdeec9124a2a9f858d8736351036 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0476cdeec9124a2a9f858d8736351036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 0476cdeec9124a2a9f858d8736351036 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-InstanceActionsV221TestJSON-374387416-project Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 45df8101101e45828c0e47b33559e953 Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-InstanceActionsV221TestJSON-374387416-project Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '80ec6515-4706-42eb-81de-ba3df2a2bf95'} Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.391735 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Returning 404 to user: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e7cef21b-5caa-4d3e-9f34-28508e8f0303 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 404 len: 111 microversion: 2.21 time: 0.032784 Sep 18 01:40:42.397512 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2883/5725] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:42 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:40:42.405308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '.version_select at 0x7f7005082dc0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:42.406153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:42.416299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.416779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.417212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.417934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.418386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.418939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.489751 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7915783d-602c-44fa-9eb5-bdcff5dbe770 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.088951 Sep 18 01:40:42.493049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2843/5726] 10.222.0.25 () {60 vars in 1337 bytes} [Sun Sep 18 01:40:42 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95/os-instance-actions => generated 611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:40:42.503819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:42.504315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:42.510332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.510878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.511378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.512156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.512679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.513739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.528043 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] HTTP exception thrown: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Request method failure captured: Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 HTTP/1.1 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJncCADbgRVCFriuYhj-IE5ucJhvyOJt9wi8XHYLBlMFiZ2dsYo9J09kIGUiMD7L9mGKRSkve83cKXA08BaCGU_g_8r4Ak6k8TRWHv5RySYWzxw-7QUzbGss1DlhztiU82kcAvax2pl0kODAWdY84bevL41sK4jhBEHcCUBd1SLCfBQc Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Openstack-Nova-Api-Version: 2.21 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 0476cdeec9124a2a9f858d8736351036 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0476cdeec9124a2a9f858d8736351036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 0476cdeec9124a2a9f858d8736351036 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-InstanceActionsV221TestJSON-374387416-project Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 45df8101101e45828c0e47b33559e953 Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-InstanceActionsV221TestJSON-374387416-project Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '80ec6515-4706-42eb-81de-ba3df2a2bf95'} Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:40:42.530287 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Returning 404 to user: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:40:42.534916 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d5e3c0f7-8d9c-4dc5-be53-df93669087b8 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 404 len: 111 microversion: 2.21 time: 0.033228 Sep 18 01:40:42.539286 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2884/5727] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:40:42 2022] DELETE /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:40:42.545763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:42.547198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] [instance: 80ec6515-4706-42eb-81de-ba3df2a2bf95] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:42.554959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.555677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.556278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.557178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:42.557901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:42.558494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:42.574100 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] HTTP exception thrown: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Request method failure captured: Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 HTTP/1.1 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJncCADbgRVCFriuYhj-IE5ucJhvyOJt9wi8XHYLBlMFiZ2dsYo9J09kIGUiMD7L9mGKRSkve83cKXA08BaCGU_g_8r4Ak6k8TRWHv5RySYWzxw-7QUzbGss1DlhztiU82kcAvax2pl0kODAWdY84bevL41sK4jhBEHcCUBd1SLCfBQc Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.21 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 0476cdeec9124a2a9f858d8736351036 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0476cdeec9124a2a9f858d8736351036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0476cdeec9124a2a9f858d8736351036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 0476cdeec9124a2a9f858d8736351036 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-374387416 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-InstanceActionsV221TestJSON-374387416-project Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 45df8101101e45828c0e47b33559e953 Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-InstanceActionsV221TestJSON-374387416-project Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '80ec6515-4706-42eb-81de-ba3df2a2bf95'} Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.576224 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] Returning 404 to user: Instance 80ec6515-4706-42eb-81de-ba3df2a2bf95 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:40:42.580099 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60b526ad-15af-4bbe-b1ff-8302f44283b5 tempest-InstanceActionsV221TestJSON-374387416 tempest-InstanceActionsV221TestJSON-374387416-project] 10.222.0.25 "GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95" status: 404 len: 111 microversion: 2.21 time: 0.037295 Sep 18 01:40:42.585728 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2844/5728] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:40:42 2022] GET /compute/v2.1/servers/80ec6515-4706-42eb-81de-ba3df2a2bf95 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:40:54.151856 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:54.162007 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:54.316464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-918737299", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "7029d781-7c9e-4f03-a9f7-3852b3783b9d"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:54.401200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] validate_networks() for [('7029d781-7c9e-4f03-a9f7-3852b3783b9d', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:40:54.931464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:40:54.931903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:40:54.932467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:40:54.932958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:40:54.933675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:40:54.949626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:54.953321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:54.957861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:54.959089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:54.959787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:54.960468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:55.001105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Getting quotas for project 45feb23406ec49ae851b97a3c51d0923. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:40:55.009435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Getting quotas for user cbd3d678ec3e420e856e13787e270edc and project 45feb23406ec49ae851b97a3c51d0923. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:40:55.037214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:40:55.039750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:40:55.096766 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64c3cc4c-6459-46ab-9be0-28a9178731d8 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963017 Sep 18 01:40:55.098021 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2885/5729] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:40:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:40:55.110782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6387fb4c-3f38-439d-9710-b530cc4e425a tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:55.111449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6387fb4c-3f38-439d-9710-b530cc4e425a tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:55.134476 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:55.135248 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:40:55.246744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6387fb4c-3f38-439d-9710-b530cc4e425a tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:55.254146 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6387fb4c-3f38-439d-9710-b530cc4e425a tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1224 microversion: 2.1 time: 0.149047 Sep 18 01:40:55.270170 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2845/5730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:55 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1224 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:56.280435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:56.280872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:56.294160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:56.294717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:56.295211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:56.295976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:56.296438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:56.296855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:56.378089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:56.390084 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a385f33-4c3b-4fdc-8227-599d976893b3 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1276 microversion: 2.1 time: 0.115559 Sep 18 01:40:56.397297 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2886/5731] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:56 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:57.417819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:57.419707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:57.431476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:57.432276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:57.433038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:57.433999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:57.435356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:57.436098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:57.531091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:57.562314 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-29319dbe-f4c8-4794-b09e-3e73a4a5cfee tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1282 microversion: 2.1 time: 0.149038 Sep 18 01:40:57.575948 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2846/5732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:57 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:58.593878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:58.595123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:58.602304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:58.603249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:58.603249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:58.604090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:58.604613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:58.607305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:58.858462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:40:58.866751 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fce54dc9-6d65-4327-9e88-1073379034e0 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1324 microversion: 2.1 time: 0.276907 Sep 18 01:40:58.867543 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2887/5733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:58 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:40:59.102462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f91170b1-ef47-4f33-bc5e-485022e1a2de req-7e9bb02b-d66d-4c6e-9113-1c889928fcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b82b57-4633-4882-af00-fd29b7d70dc5", "tag": "af079416-f898-4fb0-b116-41a0969a001a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:59.115325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f91170b1-ef47-4f33-bc5e-485022e1a2de req-7e9bb02b-d66d-4c6e-9113-1c889928fcf9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:59.115943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f91170b1-ef47-4f33-bc5e-485022e1a2de req-7e9bb02b-d66d-4c6e-9113-1c889928fcf9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:59.116623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f91170b1-ef47-4f33-bc5e-485022e1a2de req-7e9bb02b-d66d-4c6e-9113-1c889928fcf9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:59.134043 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f91170b1-ef47-4f33-bc5e-485022e1a2de req-7e9bb02b-d66d-4c6e-9113-1c889928fcf9 service nova] Creating event network-changed:af079416-f898-4fb0-b116-41a0969a001a for instance 98b82b57-4633-4882-af00-fd29b7d70dc5 on n-h2-master-1 Sep 18 01:40:59.143217 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f91170b1-ef47-4f33-bc5e-485022e1a2de req-7e9bb02b-d66d-4c6e-9113-1c889928fcf9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044900 Sep 18 01:40:59.145354 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2847/5734] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:40:59.585753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:40:59.591790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:59.604435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:59.605694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:59.606933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:59.607897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:59.608576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:59.609226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:59.697588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ba1e3fc7-b81e-4997-85bb-f6de920c7f5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action" status: 200 len: 24572 microversion: 2.1 time: 0.117499 Sep 18 01:40:59.707450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2888/5735] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:40:59 2022] POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action => generated 24572 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:40:59.891043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:40:59.891749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:40:59.898841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:59.899336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:59.900043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:40:59.900822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:40:59.901285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:40:59.901740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:00.051251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:00.060825 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e7f5f260-73dc-4a70-bd08-86d72328f390 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1324 microversion: 2.1 time: 0.174484 Sep 18 01:41:00.061427 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2848/5736] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:40:59 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:01.091129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:01.091849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:01.099283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:01.100028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:01.100467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:01.101163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:01.101783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:01.102543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:01.341471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:01.349794 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-245f5c36-b8ff-4086-af4b-e2bf88d6868c tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1324 microversion: 2.1 time: 0.263492 Sep 18 01:41:01.350756 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2889/5737] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:01 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:02.374102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:02.374620 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:02.388924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:02.390052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:02.390777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:02.391846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:02.392665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:02.393257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:02.552982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:02.560875 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4776f744-14cf-404c-a6c9-81081892d977 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1324 microversion: 2.1 time: 0.191034 Sep 18 01:41:02.573818 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2849/5738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:02 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1324 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:03.587861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:03.588479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:03.596401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:03.596898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:03.597337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:03.598064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:03.598578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:03.599010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:04.066265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:04.074628 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16467b8e-d9cb-41d7-86a5-931e58f77fce tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1324 microversion: 2.1 time: 0.490715 Sep 18 01:41:04.075274 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2890/5739] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:03 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1324 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:04.565762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-fe444e06-27b7-4200-ac37-d270a58563ba req-d1e4e3f9-4aa6-4b62-9265-cd27384a3d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b82b57-4633-4882-af00-fd29b7d70dc5", "name": "network-vif-plugged", "status": "completed", "tag": "af079416-f898-4fb0-b116-41a0969a001a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:04.594230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fe444e06-27b7-4200-ac37-d270a58563ba req-d1e4e3f9-4aa6-4b62-9265-cd27384a3d55 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:04.595338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fe444e06-27b7-4200-ac37-d270a58563ba req-d1e4e3f9-4aa6-4b62-9265-cd27384a3d55 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:04.597087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fe444e06-27b7-4200-ac37-d270a58563ba req-d1e4e3f9-4aa6-4b62-9265-cd27384a3d55 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:04.612807 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-fe444e06-27b7-4200-ac37-d270a58563ba req-d1e4e3f9-4aa6-4b62-9265-cd27384a3d55 service nova] Creating event network-vif-plugged:af079416-f898-4fb0-b116-41a0969a001a for instance 98b82b57-4633-4882-af00-fd29b7d70dc5 on n-h2-master-1 Sep 18 01:41:04.619433 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-fe444e06-27b7-4200-ac37-d270a58563ba req-d1e4e3f9-4aa6-4b62-9265-cd27384a3d55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061381 Sep 18 01:41:04.620630 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2850/5740] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:05.101179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:05.102590 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:05.110157 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:05.111010 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:05.112985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:05.114213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:05.114995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:05.115939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:05.116551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:05.117194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:05.273603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:05.282723 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dfee284f-b8ba-49ef-8b06-14dd1d5671f1 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1324 microversion: 2.1 time: 0.188132 Sep 18 01:41:05.283315 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2891/5741] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:05 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1324 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:06.129064 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:06.135640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:06.136845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:06.144884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.145679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.146452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.147485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.148189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.148883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.311801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:06.312995 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:06.322882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.323712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.324706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.326250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.326996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.327675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.435015 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3bf7e9b2-44d8-4c34-984e-1f281d2b4a51 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1832 microversion: 2.1 time: 0.307014 Sep 18 01:41:06.459318 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2851/5742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:06 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1832 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:06.471860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:06.472404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:06.480888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.480888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.480888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.480888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.480888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.486032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.691131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:06.699417 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7689eeba-b4fd-4ed2-97f3-3583060a78bc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1521 microversion: 2.1 time: 0.392529 Sep 18 01:41:06.701702 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2892/5743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:06 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:06.728625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:06.729363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:06.737705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.738462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.739062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.739940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.740550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.741151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.789340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:06.796803 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] HTTP exception thrown: Action 999 not found Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Request method failure captured: Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5/os-instance-actions/999 HTTP/1.1 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJncliIgOV89p1DfAPsKGV_pQFkqEtOtFQxJOvxWv80fPlzfK84qQpnaqdnFWoqngfkqvcIBnF50dt9RcZjjCPOzoArOn3Y_N7Q1cvFYz72XM1VKDpWhpKU45x0Ahgr00GyayI3-9Gqd9PTXRzPkTc08FSOihEM8t_v5W7yQF6aUQibo Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 45feb23406ec49ae851b97a3c51d0923 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 45feb23406ec49ae851b97a3c51d0923 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-InstanceActionsNegativeTestJSON-1907217889-project Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: cbd3d678ec3e420e856e13787e270edc Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1907217889-project Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: exception: Action 999 not found Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '98b82b57-4633-4882-af00-fd29b7d70dc5', 'id': '999'} Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 18 01:41:06.805469 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.810425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Returning 404 to user: Action 999 not found {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:41:06.810736 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d08e324b-400b-4126-9428-c0aaa9eace6c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1681 microversion: 2.1 time: 0.345297 Sep 18 01:41:06.811520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2852/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:06 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1681 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:06.822788 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d3d76a1c-08cc-4380-9023-05b655decb12 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.103443 Sep 18 01:41:06.824235 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2893/5745] 10.222.0.25 () {58 vars in 1308 bytes} [Sun Sep 18 01:41:06 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5/os-instance-actions/999 => generated 66 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:41:06.841325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a082c7c9-dabe-450d-8a62-4376a4fe88fc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '.version_select at 0x7f700509bd30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:06.841968 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a082c7c9-dabe-450d-8a62-4376a4fe88fc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 6ff90116-9029-4da9-84d9-f89b31d24a37] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:06.848496 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a082c7c9-dabe-450d-8a62-4376a4fe88fc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] HTTP exception thrown: Instance 6ff90116-9029-4da9-84d9-f89b31d24a37 could not be found. Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a082c7c9-dabe-450d-8a62-4376a4fe88fc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Request method failure captured: Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6ff90116-9029-4da9-84d9-f89b31d24a37/os-instance-actions HTTP/1.1 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJncliIgOV89p1DfAPsKGV_pQFkqEtOtFQxJOvxWv80fPlzfK84qQpnaqdnFWoqngfkqvcIBnF50dt9RcZjjCPOzoArOn3Y_N7Q1cvFYz72XM1VKDpWhpKU45x0Ahgr00GyayI3-9Gqd9PTXRzPkTc08FSOihEM8t_v5W7yQF6aUQibo Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 45feb23406ec49ae851b97a3c51d0923 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 45feb23406ec49ae851b97a3c51d0923 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-InstanceActionsNegativeTestJSON-1907217889-project Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cbd3d678ec3e420e856e13787e270edc Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1907217889-project Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6ff90116-9029-4da9-84d9-f89b31d24a37 could not be found. Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '6ff90116-9029-4da9-84d9-f89b31d24a37'} Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff90116-9029-4da9-84d9-f89b31d24a37 could not be found. Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:41:06.850478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff90116-9029-4da9-84d9-f89b31d24a37 could not be found. Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff90116-9029-4da9-84d9-f89b31d24a37 could not be found. Sep 18 01:41:06.855143 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:06.857531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a082c7c9-dabe-450d-8a62-4376a4fe88fc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Returning 404 to user: Instance 6ff90116-9029-4da9-84d9-f89b31d24a37 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:41:06.858638 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a082c7c9-dabe-450d-8a62-4376a4fe88fc tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/6ff90116-9029-4da9-84d9-f89b31d24a37/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.023816 Sep 18 01:41:06.863914 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2853/5746] 10.222.0.25 () {58 vars in 1296 bytes} [Sun Sep 18 01:41:06 2022] GET /compute/v2.1/servers/6ff90116-9029-4da9-84d9-f89b31d24a37/os-instance-actions => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:41:06.882082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:06.882840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:06.893520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.894040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.894485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.895201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.895666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.896092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.963533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:06.966028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:06.973543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:41:06.981707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.982181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.982816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:06.983698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:06.984474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:06.984804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:07.082336 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c8ee981b-c612-46e5-b4dc-f2e2de68e3ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action" status: 200 len: 32639 microversion: 2.1 time: 0.122372 Sep 18 01:41:07.083414 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2854/5747] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:41:06 2022] POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action => generated 32639 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:41:07.175232 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8388255a-e3df-408c-a909-ab04b4ea7bfa tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 204 len: 0 microversion: 2.1 time: 0.309735 Sep 18 01:41:07.175970 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2894/5748] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:41:06 2022] DELETE /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:41:07.185975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:07.186938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:07.194913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:07.195917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:07.196864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:07.197952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:07.198618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:07.199553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:07.276064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:07.277407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:07.298334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:07.299544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:07.300373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:07.301812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:07.305815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:07.307071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:07.452426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6a4cfb3953842b9b48d4bb328c46877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989967c539e94ce5a90a77cef6c3faf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:07.454378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] flavor_id is None. Assuming migration. {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 18 01:41:07.456287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:41:07.468138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:07.481673 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b011ba9-ee42-4521-8bbd-1406191ae69d tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1527 microversion: 2.1 time: 0.300465 Sep 18 01:41:07.483074 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2855/5749] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:07 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1527 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:07.867845 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-94faeffa-f6c4-4bf2-8829-c58fb8edc639 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action" status: 202 len: 0 microversion: 2.1 time: 0.600283 Sep 18 01:41:07.868589 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2895/5750] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:41:07 2022] POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:41:07.878165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:07.878746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:07.892279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:07.893386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:07.895643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:07.896784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:07.897698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:07.898461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:08.169791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:08.183529 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-85105487-b343-4cb6-bb1b-59c9ba734a6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1690 microversion: 2.1 time: 0.309630 Sep 18 01:41:08.184744 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2856/5751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:07 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1690 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:08.515283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:08.517690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:08.531759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:08.531759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:08.531759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:08.531759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:08.531759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:08.531759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:08.722156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:08.750930 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee157739-1eb5-4e6d-aa42-790ff56e65e9 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1527 microversion: 2.1 time: 0.243662 Sep 18 01:41:08.752788 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2896/5752] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:08 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1527 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:09.213175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:09.213817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:09.234525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:09.235031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:09.235480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:09.236200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:09.243856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:09.244655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:09.596155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:09.610601 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3bb95f72-aa9b-4c4c-b1f9-fd7d7a917781 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1690 microversion: 2.1 time: 0.405051 Sep 18 01:41:09.615288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2857/5753] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:09 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1690 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:09.783182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:09.783831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:09.801092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:09.801619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:09.802061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:09.802771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:09.803222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:09.803712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:09.904054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c4870c7c-81e8-45d0-8b34-4b01152e4ee4 req-ddab05ee-d03b-4440-9fe2-b79e18924e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b82b57-4633-4882-af00-fd29b7d70dc5", "name": "network-vif-deleted", "tag": "af079416-f898-4fb0-b116-41a0969a001a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:09.934455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c4870c7c-81e8-45d0-8b34-4b01152e4ee4 req-ddab05ee-d03b-4440-9fe2-b79e18924e95 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:09.934939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c4870c7c-81e8-45d0-8b34-4b01152e4ee4 req-ddab05ee-d03b-4440-9fe2-b79e18924e95 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:09.935539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c4870c7c-81e8-45d0-8b34-4b01152e4ee4 req-ddab05ee-d03b-4440-9fe2-b79e18924e95 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:09.942402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd3d678ec3e420e856e13787e270edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45feb23406ec49ae851b97a3c51d0923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:09.952597 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60ec3e3f-6957-47f6-892c-59a1de3898f2 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 200 len: 1485 microversion: 2.1 time: 0.174959 Sep 18 01:41:09.955892 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2897/5754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:09 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 1485 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:09.964319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c4870c7c-81e8-45d0-8b34-4b01152e4ee4 req-ddab05ee-d03b-4440-9fe2-b79e18924e95 service nova] Creating event network-vif-deleted:af079416-f898-4fb0-b116-41a0969a001a for instance 98b82b57-4633-4882-af00-fd29b7d70dc5 on n-h2-master-1 Sep 18 01:41:09.972082 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c4870c7c-81e8-45d0-8b34-4b01152e4ee4 req-ddab05ee-d03b-4440-9fe2-b79e18924e95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072894 Sep 18 01:41:09.976296 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2858/5755] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:10.640127 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:10.641008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:10.647387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:10.648166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:10.648776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:10.650175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:10.650789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:10.651589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:10.903312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:10.914598 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a08f880-20ee-4a21-83db-01cf56f82fd8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1690 microversion: 2.1 time: 0.278983 Sep 18 01:41:10.929586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2898/5756] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:10 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1690 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:10.986213 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:10.987686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] [instance: 98b82b57-4633-4882-af00-fd29b7d70dc5] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:11.002344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:11.002954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:11.003610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:11.004323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:11.004788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:11.005220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:11.020673 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] HTTP exception thrown: Instance 98b82b57-4633-4882-af00-fd29b7d70dc5 could not be found. Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Request method failure captured: Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 HTTP/1.1 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJncliIgOV89p1DfAPsKGV_pQFkqEtOtFQxJOvxWv80fPlzfK84qQpnaqdnFWoqngfkqvcIBnF50dt9RcZjjCPOzoArOn3Y_N7Q1cvFYz72XM1VKDpWhpKU45x0Ahgr00GyayI3-9Gqd9PTXRzPkTc08FSOihEM8t_v5W7yQF6aUQibo Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 45feb23406ec49ae851b97a3c51d0923 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45feb23406ec49ae851b97a3c51d0923"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 45feb23406ec49ae851b97a3c51d0923 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1907217889 Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-InstanceActionsNegativeTestJSON-1907217889-project Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cbd3d678ec3e420e856e13787e270edc Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1907217889-project Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 98b82b57-4633-4882-af00-fd29b7d70dc5 could not be found. Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '98b82b57-4633-4882-af00-fd29b7d70dc5'} Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b82b57-4633-4882-af00-fd29b7d70dc5 could not be found. Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b82b57-4633-4882-af00-fd29b7d70dc5 could not be found. Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:11.022375 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b82b57-4633-4882-af00-fd29b7d70dc5 could not be found. Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] Returning 404 to user: Instance 98b82b57-4633-4882-af00-fd29b7d70dc5 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8bcff7af-b7b9-47b1-b517-e860e5f71619 tempest-InstanceActionsNegativeTestJSON-1907217889 tempest-InstanceActionsNegativeTestJSON-1907217889-project] 10.222.0.25 "GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5" status: 404 len: 111 microversion: 2.1 time: 0.045126 Sep 18 01:41:11.029383 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2859/5757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:10 2022] GET /compute/v2.1/servers/98b82b57-4633-4882-af00-fd29b7d70dc5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:41:11.942485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:11.943991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:11.953403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:11.954073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:11.954570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:11.955290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:11.955773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:11.956201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:11.962034 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:12.196694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:12.207003 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cdf3203e-b7db-4976-ada6-240b7aeb158f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.269976 Sep 18 01:41:12.212652 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2899/5758] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:11 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:13.238603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:13.239978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:13.250791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:13.257288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:13.257971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:13.258981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:13.259853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:13.260293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:13.472315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:13.483536 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7143c623-b417-4e66-9db1-2b85067d3bb5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.248710 Sep 18 01:41:13.484234 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2860/5759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:13 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:14.514332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:14.515681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:14.564490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:14.565003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:14.565403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:14.568622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:14.569111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:14.569573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:14.954780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:14.968515 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fed71cf0-a794-4e8c-af6c-326219cd6338 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.459684 Sep 18 01:41:14.969137 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2900/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:14 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:15.993919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:15.995632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:16.005157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:16.006010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:16.006621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:16.007763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:16.008392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:16.008980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:16.187686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:16.201668 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4dffa524-1d7e-4862-b417-71b4f5e2de2c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.212882 Sep 18 01:41:16.202917 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2861/5761] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:15 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:17.226999 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:17.227617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:17.245070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:17.245603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:17.246191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:17.246779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:17.247239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:17.247668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:17.487919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:17.512773 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-340d5dbb-10e0-4bca-a9a3-1eb7e319f03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.287511 Sep 18 01:41:17.518846 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2901/5762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:17 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:18.540163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:18.540931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:18.549354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:18.549861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:18.550307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:18.551045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:18.551505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:18.551934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:18.775621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:18.785174 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5456718-852f-406d-ba13-3789218033b4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.249948 Sep 18 01:41:18.785826 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2862/5763] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:18 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:19.809683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:19.810489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:19.820996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:19.823029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:19.824751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:19.825417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:19.827074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:19.827638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:20.159417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:20.172823 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-24a0bf2b-39c9-415b-ab81-a7c74eea7e31 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.363353 Sep 18 01:41:20.173947 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2902/5764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:19 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:21.202326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:21.202993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:21.216533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:21.217068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:21.217511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:21.218255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:21.218708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:21.219128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:21.420183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:21.433615 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2e70829-bde5-4e82-a779-c54d153a3da1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.236780 Sep 18 01:41:21.435031 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2863/5765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:21 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:22.460656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:22.461283 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:22.463411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1213863741", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8cce45f3-fd67-4989-be92-4b9c4d8c8cff"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:22.470114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:22.470854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:22.471629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:22.472562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:22.473590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:22.474266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:22.525815 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:41:22.730115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:22.740334 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13a87b7a-aa2d-4c74-81f3-ca03733e71a1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.284301 Sep 18 01:41:22.741633 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2864/5766] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:22 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:23.083479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:41:23.084020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:41:23.084377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:41:23.084791 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:41:23.085831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:41:23.094914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:23.095419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:23.095867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:23.096607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:23.097139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:23.097609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:23.137033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:41:23.149337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:41:23.170621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:41:23.173023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:41:23.229320 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3ac2f133-db23-4e1e-9bf7-e72f3ee46f26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928605 Sep 18 01:41:23.236745 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2903/5767] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:41:23.242008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-001cb941-8d71-4c0b-9492-ae4f2f4ec476 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:23.242630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-001cb941-8d71-4c0b-9492-ae4f2f4ec476 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:23.339730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-001cb941-8d71-4c0b-9492-ae4f2f4ec476 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:23.350695 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-001cb941-8d71-4c0b-9492-ae4f2f4ec476 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1193 microversion: 2.1 time: 0.112302 Sep 18 01:41:23.352266 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2865/5768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:23 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:23.769026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:23.769879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:23.778898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:23.780851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:23.781306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:23.786525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:23.787013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:23.793841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:24.035899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:24.046919 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e66f9422-8460-4efc-a6a4-c3137ad36ec3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.281689 Sep 18 01:41:24.061578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2904/5769] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:23 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:24.377519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:24.378159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:24.385253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:24.386088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:24.387423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:24.388354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:24.389039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:24.389586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:24.467150 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:24.477647 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb857992-4c52-4fee-bfae-5ab958ba268a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1245 microversion: 2.1 time: 0.103987 Sep 18 01:41:24.478812 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2866/5770] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:24 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:25.087921 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:25.088819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:25.093897 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:25.105295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:25.106990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:25.107662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:25.108642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:25.109313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:25.109977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:25.501821 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:25.502424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:25.510517 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=49 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:25.513417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:25.514082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:25.514695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:25.515568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:25.516331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:25.516949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:25.543586 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:25.921439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:25.925374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:25.934946 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2661576-a648-47b4-ba0a-5309fcd8bbfa tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.851000 Sep 18 01:41:25.935331 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e68641b-378f-459f-81bb-ad893d43da01 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1251 microversion: 2.1 time: 0.437011 Sep 18 01:41:25.939382 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2905/5771] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:25 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:25.940646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2867/5772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:25 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1251 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:26.984387 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:26.988317 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:26.989635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:26.990484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:27.006769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:27.007836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:27.008649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:27.009625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:27.009872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:27.010368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:27.010770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:27.010884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:27.011493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:27.011793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:27.022601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:27.023180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:27.529258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:27.538205 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-73a82627-58fe-4aa8-8151-48ac08250941 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1293 microversion: 2.1 time: 0.559796 Sep 18 01:41:27.542677 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2868/5773] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:26 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1293 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:27.571359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:27.583531 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-191c5163-5c98-48e5-a4ca-58e1da3e0b33 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1695 microversion: 2.1 time: 0.607901 Sep 18 01:41:27.586098 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2906/5774] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:26 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1695 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:27.765307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c124551b-79de-498c-8828-73f7ed715254 req-beb7db31-4efa-4091-92a9-d76e6edc1d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b86678-f69e-4493-bb5c-a1673387cd1f", "tag": "177a5215-934a-4c9a-851c-32e8f66196cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:27.793294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c124551b-79de-498c-8828-73f7ed715254 req-beb7db31-4efa-4091-92a9-d76e6edc1d11 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:27.794763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c124551b-79de-498c-8828-73f7ed715254 req-beb7db31-4efa-4091-92a9-d76e6edc1d11 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:27.799275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c124551b-79de-498c-8828-73f7ed715254 req-beb7db31-4efa-4091-92a9-d76e6edc1d11 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:27.826049 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c124551b-79de-498c-8828-73f7ed715254 req-beb7db31-4efa-4091-92a9-d76e6edc1d11 service nova] Creating event network-changed:177a5215-934a-4c9a-851c-32e8f66196cd for instance b0b86678-f69e-4493-bb5c-a1673387cd1f on n-h2-master-1 Sep 18 01:41:27.837521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c124551b-79de-498c-8828-73f7ed715254 req-beb7db31-4efa-4091-92a9-d76e6edc1d11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082202 Sep 18 01:41:27.840543 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2869/5775] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:41:28.566695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:28.567943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:28.575958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:28.576748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:28.577358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:28.578269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:28.578927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:28.579506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:28.634710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:28.636622 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:28.656146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:28.660288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:28.660859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:28.664282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:28.665254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:28.666181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:28.927951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:28.937771 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-481ec000-17f3-47ed-ae0f-0c56d0f5100a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1293 microversion: 2.1 time: 0.375360 Sep 18 01:41:28.953042 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2907/5776] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:28 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1293 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:29.059232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:29.074808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dddb500b-b083-4b69-95fb-6ef3bc3b3c13 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1694 microversion: 2.1 time: 0.466544 Sep 18 01:41:29.075876 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2870/5777] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:28 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1694 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:29.960397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:29.961021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:29.981222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:29.982013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:29.982654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:29.983542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:29.984160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:29.984756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:30.101531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:30.102516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:30.122710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:30.123229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:30.123667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:30.124833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:30.125458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:30.126136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:30.378711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:30.384123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:30.396136 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61315abb-63e8-43ea-96d3-d72bd793b0e3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1694 microversion: 2.1 time: 0.298982 Sep 18 01:41:30.398691 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a60fa78c-036b-42aa-a664-2d8b5d6e5eaf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1293 microversion: 2.1 time: 0.442157 Sep 18 01:41:30.401106 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2908/5778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:29 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1293 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:30.401753 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2871/5779] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:30 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1694 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:30.408075 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-24c0e732-04be-4293-9707-83087967a219 req-7afd9762-d351-4245-a03e-64cb91c19108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "name": "network-vif-unplugged", "status": "completed", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:30.428928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-24c0e732-04be-4293-9707-83087967a219 req-7afd9762-d351-4245-a03e-64cb91c19108 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:30.429161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-24c0e732-04be-4293-9707-83087967a219 req-7afd9762-d351-4245-a03e-64cb91c19108 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:30.429515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-24c0e732-04be-4293-9707-83087967a219 req-7afd9762-d351-4245-a03e-64cb91c19108 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:30.447298 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-24c0e732-04be-4293-9707-83087967a219 req-7afd9762-d351-4245-a03e-64cb91c19108 service nova] Creating event network-vif-unplugged:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h2-master-1 Sep 18 01:41:30.456382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-24c0e732-04be-4293-9707-83087967a219 req-7afd9762-d351-4245-a03e-64cb91c19108 service nova] Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:41:30.473340 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-24c0e732-04be-4293-9707-83087967a219 req-7afd9762-d351-4245-a03e-64cb91c19108 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068977 Sep 18 01:41:30.474207 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2872/5780] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:31.425404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:31.426781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:31.440140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:31.440329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:31.440885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:31.440989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:31.441075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:31.441826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:31.442289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:31.442763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:31.458556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:31.460545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:31.461177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:31.464277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:31.464992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:31.465630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:31.780916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:31.790518 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a130b9c-5696-4706-b1e2-4a533fed11c6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1694 microversion: 2.1 time: 0.368099 Sep 18 01:41:31.791134 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2909/5781] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:31 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1694 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:31.805044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:31.832636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-994af91c-8e77-4b10-bc99-b3edf4adac92 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1293 microversion: 2.1 time: 0.399694 Sep 18 01:41:31.833236 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2873/5782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:31 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1293 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:32.504430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e9b5ffd1-9675-4724-b503-2876976af666 req-8848e958-37ac-4c23-ac93-c0a6c80bac68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:32.515784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9b5ffd1-9675-4724-b503-2876976af666 req-8848e958-37ac-4c23-ac93-c0a6c80bac68 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:32.516516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9b5ffd1-9675-4724-b503-2876976af666 req-8848e958-37ac-4c23-ac93-c0a6c80bac68 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:32.517088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9b5ffd1-9675-4724-b503-2876976af666 req-8848e958-37ac-4c23-ac93-c0a6c80bac68 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:32.530262 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e9b5ffd1-9675-4724-b503-2876976af666 req-8848e958-37ac-4c23-ac93-c0a6c80bac68 service nova] Creating event network-changed:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h2-master-1 Sep 18 01:41:32.536027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-e9b5ffd1-9675-4724-b503-2876976af666 req-8848e958-37ac-4c23-ac93-c0a6c80bac68 service nova] Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:41:32.548048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e9b5ffd1-9675-4724-b503-2876976af666 req-8848e958-37ac-4c23-ac93-c0a6c80bac68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047778 Sep 18 01:41:32.552676 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2910/5783] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:32.826051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:32.832858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:32.846460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:32.849148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:32.851673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:32.852854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:32.856820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:32.859359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:32.910286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5ac3dcd2-9a85-4b95-8396-33121343e8b6 req-d85fe396-a5ce-4f43-895d-6eee6060d742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b86678-f69e-4493-bb5c-a1673387cd1f", "name": "network-vif-plugged", "status": "completed", "tag": "177a5215-934a-4c9a-851c-32e8f66196cd"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:32.941421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ac3dcd2-9a85-4b95-8396-33121343e8b6 req-d85fe396-a5ce-4f43-895d-6eee6060d742 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:32.942471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ac3dcd2-9a85-4b95-8396-33121343e8b6 req-d85fe396-a5ce-4f43-895d-6eee6060d742 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:32.943071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ac3dcd2-9a85-4b95-8396-33121343e8b6 req-d85fe396-a5ce-4f43-895d-6eee6060d742 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:32.995049 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5ac3dcd2-9a85-4b95-8396-33121343e8b6 req-d85fe396-a5ce-4f43-895d-6eee6060d742 service nova] Creating event network-vif-plugged:177a5215-934a-4c9a-851c-32e8f66196cd for instance b0b86678-f69e-4493-bb5c-a1673387cd1f on n-h2-master-1 Sep 18 01:41:33.004019 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5ac3dcd2-9a85-4b95-8396-33121343e8b6 req-d85fe396-a5ce-4f43-895d-6eee6060d742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262333 Sep 18 01:41:33.006050 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2874/5784] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:33.020500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:33.021350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:33.032280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:33.032963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:33.033419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:33.034321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:33.034975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:33.035640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:33.118842 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:33.164479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:33.185986 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:33.189281 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c0a4fff-2fc8-4ae4-a583-56332b361bb1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1692 microversion: 2.1 time: 0.374414 Sep 18 01:41:33.193655 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2911/5785] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:32 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1692 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:33.254332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:33.264711 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f2157a94-fcd6-4dad-a64e-229997504048 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1293 microversion: 2.1 time: 0.256568 Sep 18 01:41:33.266312 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2875/5786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:33 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:34.226195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:34.227433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:34.238361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.238855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.239297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:34.240009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.240462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.240888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:34.290239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:34.291697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:34.294302 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:34.301298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.301801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.302406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:34.303261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.303863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.304436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:34.532882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:34.555210 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-688c9529-4ba8-484b-b639-bf391b940227 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1689 microversion: 2.1 time: 0.333457 Sep 18 01:41:34.558711 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2912/5787] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:34 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1689 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:34.569791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:34.582419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:34.583512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:34.596251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.597766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.599210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:34.600327 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac2271c0-82d1-4d3f-9791-aec857ccbabc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1293 microversion: 2.1 time: 0.314209 Sep 18 01:41:34.600941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2876/5788] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:34 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1293 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:34.601574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.602685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.606017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:34.765261 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8b08f008-6602-4f90-848b-f9b2a037e3bf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action" status: 204 len: 0 microversion: 2.1 time: 0.187157 Sep 18 01:41:34.768804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2913/5789] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:41:34 2022] POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:41:34.778562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:34.779460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:34.790991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.791781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.793900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:34.794882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:34.796497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:34.799129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:35.156818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:35.175162 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8f6535c9-c1b6-4f3a-bc91-133309cff073 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1689 microversion: 2.1 time: 0.401424 Sep 18 01:41:35.193593 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2877/5790] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:34 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1689 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:35.629420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:35.630171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:35.641979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:35.642474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:35.642919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:35.643637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:35.644099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:35.644529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:35.830624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:35.858343 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a1873e6-4270-483b-af3a-0d64e7c0e810 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1473 microversion: 2.1 time: 0.232771 Sep 18 01:41:35.860248 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2914/5791] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:35 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:35.983369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-79443382", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:36.209007 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:36.209935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:36.234875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:36.238203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:36.238940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:36.239949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:36.240896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:36.244294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:36.419798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:41:36.444617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:36.451478 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:36.465242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c926afd0-c6d6-41c0-80f0-a1ff43353d4f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1689 microversion: 2.1 time: 0.259864 Sep 18 01:41:36.466535 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2915/5792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:36 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1689 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:36.747093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-2fd6c819-81c0-4380-9233-645eeae82c28 req-c0b3c0e3-58a5-486f-94dc-171c03105df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "name": "network-vif-plugged", "status": "completed", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:36.765530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2fd6c819-81c0-4380-9233-645eeae82c28 req-c0b3c0e3-58a5-486f-94dc-171c03105df8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:36.766740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2fd6c819-81c0-4380-9233-645eeae82c28 req-c0b3c0e3-58a5-486f-94dc-171c03105df8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:36.767734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-2fd6c819-81c0-4380-9233-645eeae82c28 req-c0b3c0e3-58a5-486f-94dc-171c03105df8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:36.785513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-2fd6c819-81c0-4380-9233-645eeae82c28 req-c0b3c0e3-58a5-486f-94dc-171c03105df8 service nova] Creating event network-vif-plugged:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h2-master-1 Sep 18 01:41:36.792953 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-2fd6c819-81c0-4380-9233-645eeae82c28 req-c0b3c0e3-58a5-486f-94dc-171c03105df8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050447 Sep 18 01:41:36.793900 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2916/5793] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:41:36.924607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:41:36.925037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:41:36.925499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:41:36.925996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:41:36.926349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:41:36.936981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:36.937475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:36.938002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:36.938875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:36.939239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:36.939862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:36.960489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:41:36.966887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:41:36.981133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:41:36.983905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:41:37.050962 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ab21d93-1010-4722-add6-86293ef86589 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075596 Sep 18 01:41:37.054639 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2878/5794] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:41:37.067229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7f708ea9-0b14-40b5-b2e8-64e2640f932f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:37.068027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7f708ea9-0b14-40b5-b2e8-64e2640f932f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:37.091371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7f708ea9-0b14-40b5-b2e8-64e2640f932f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:41:37.257426 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7f708ea9-0b14-40b5-b2e8-64e2640f932f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f" status: 204 len: 0 microversion: 2.1 time: 0.194527 Sep 18 01:41:37.258340 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2917/5795] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:41:37 2022] DELETE /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:41:37.267542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0adcb26-6c91-498d-977f-0aed7adef47f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:37.268215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0adcb26-6c91-498d-977f-0aed7adef47f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:37.290467 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e0adcb26-6c91-498d-977f-0aed7adef47f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0adcb26-6c91-498d-977f-0aed7adef47f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f HTTP/1.1 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '074876a0-ddcf-4c3b-ba35-7068f9ec3e6f'} Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:37.312377 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0adcb26-6c91-498d-977f-0aed7adef47f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0adcb26-6c91-498d-977f-0aed7adef47f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f" status: 404 len: 111 microversion: 2.1 time: 0.051643 Sep 18 01:41:37.317580 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2879/5796] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:37 2022] GET /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:41:37.422123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-76820538", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "8cce45f3-fd67-4989-be92-4b9c4d8c8cff"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:37.494164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:37.494871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:37.500799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:41:37.502687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:37.503246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:37.503859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:37.504992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:37.505703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:37.506404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:37.831521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:37.842641 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-59107bd1-2a82-4955-a933-7a77f9054850 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1681 microversion: 2.1 time: 0.354088 Sep 18 01:41:37.843881 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2880/5797] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:37 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1681 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:38.250072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:41:38.250976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:41:38.252916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:41:38.254541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:41:38.255559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:41:38.296958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:38.299370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:38.299834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:38.300610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:38.301080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:38.301513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:38.347439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:41:38.358360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:41:38.389179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:41:38.394635 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:41:38.476899 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be6e203f-7b13-456f-9ffe-e45d55f80c0c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060655 Sep 18 01:41:38.478298 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2918/5798] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:41:38.498738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-63aa75c9-f170-407f-8d64-d9843fc06764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:38.500079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-63aa75c9-f170-407f-8d64-d9843fc06764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:38.634061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-63aa75c9-f170-407f-8d64-d9843fc06764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:38.643602 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-63aa75c9-f170-407f-8d64-d9843fc06764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1219 microversion: 2.1 time: 0.154007 Sep 18 01:41:38.644235 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2881/5799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:38 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:39.669403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:39.670131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:39.679416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:39.680018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:39.680538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:39.681329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:39.681878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:39.682294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:39.761884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:39.771702 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-67fa7830-be23-4021-83d3-75eec5a871fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1271 microversion: 2.1 time: 0.107604 Sep 18 01:41:39.772384 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2919/5800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:39 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:40.811351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:40.813441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:40.859118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:40.863877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:40.864885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:40.866370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:40.867238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:40.868060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:41.071388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:41.081485 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea83f0e9-0e93-434a-bb70-dcfebae26945 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1319 microversion: 2.1 time: 0.282101 Sep 18 01:41:41.094857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2882/5801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:40 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:41.739183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8498dce0-9cf3-47b9-84cf-6174e75e608a req-3c97c428-2750-4c06-b3d0-69964f25a804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7130e6-c12f-41ca-b8aa-6157fdd1edf8", "tag": "b7e3d6e2-a17a-41e5-9aba-3cf4641aea86"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:41.761546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8498dce0-9cf3-47b9-84cf-6174e75e608a req-3c97c428-2750-4c06-b3d0-69964f25a804 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:41.762191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8498dce0-9cf3-47b9-84cf-6174e75e608a req-3c97c428-2750-4c06-b3d0-69964f25a804 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:41.762620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8498dce0-9cf3-47b9-84cf-6174e75e608a req-3c97c428-2750-4c06-b3d0-69964f25a804 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:41.775609 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8498dce0-9cf3-47b9-84cf-6174e75e608a req-3c97c428-2750-4c06-b3d0-69964f25a804 service nova] Creating event network-changed:b7e3d6e2-a17a-41e5-9aba-3cf4641aea86 for instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 on n-h1-master-1 Sep 18 01:41:41.781912 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8498dce0-9cf3-47b9-84cf-6174e75e608a req-3c97c428-2750-4c06-b3d0-69964f25a804 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046111 Sep 18 01:41:41.784199 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2920/5802] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:42.111136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:42.112050 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:42.122126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:42.123419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:42.123575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:42.124492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:42.125169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:42.125838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:42.296288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:42.304033 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3fb8ba7e-5c81-4cfe-8896-86e0497d2b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1319 microversion: 2.1 time: 0.200038 Sep 18 01:41:42.304592 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2883/5803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:42 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:43.329860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:43.330407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:43.338136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:43.338753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:43.339350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:43.340135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:43.340595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:43.341030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:43.486045 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:43.494619 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aff7870c-d82c-4ba4-8583-8457d767adb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1319 microversion: 2.1 time: 0.170539 Sep 18 01:41:43.495343 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2921/5804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:43 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:44.518396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:44.519035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:44.526417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:44.526938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:44.527376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:44.528080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:44.528590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:44.528965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:44.711206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:44.719507 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8b19686-8bab-46c9-a85b-a0e3e642d7fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1319 microversion: 2.1 time: 0.204941 Sep 18 01:41:44.720185 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2884/5805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:44 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:45.755834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:45.756434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:45.759731 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:41:45.759875 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:41:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 (ip 10.222.0.25) !!! Sep 18 01:41:45.768625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:45.769114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:45.769631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:45.770333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:45.770799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:45.771219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:45.952364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:45.960419 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b1777bb3-b585-4a75-89cd-d082273111a2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1319 microversion: 2.1 time: 0.208546 Sep 18 01:41:45.961014 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2922/5806] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:45 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:46.735085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d3588fa1-01eb-4505-9756-75e913dbe250 req-98cd27d0-4f87-4607-a01c-2ed178c375df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7130e6-c12f-41ca-b8aa-6157fdd1edf8", "name": "network-vif-plugged", "status": "completed", "tag": "b7e3d6e2-a17a-41e5-9aba-3cf4641aea86"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:46.750339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d3588fa1-01eb-4505-9756-75e913dbe250 req-98cd27d0-4f87-4607-a01c-2ed178c375df service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:46.751110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d3588fa1-01eb-4505-9756-75e913dbe250 req-98cd27d0-4f87-4607-a01c-2ed178c375df service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:46.751943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d3588fa1-01eb-4505-9756-75e913dbe250 req-98cd27d0-4f87-4607-a01c-2ed178c375df service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:46.767091 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d3588fa1-01eb-4505-9756-75e913dbe250 req-98cd27d0-4f87-4607-a01c-2ed178c375df service nova] Creating event network-vif-plugged:b7e3d6e2-a17a-41e5-9aba-3cf4641aea86 for instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 on n-h1-master-1 Sep 18 01:41:46.772281 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d3588fa1-01eb-4505-9756-75e913dbe250 req-98cd27d0-4f87-4607-a01c-2ed178c375df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041026 Sep 18 01:41:46.772871 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2885/5807] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:46.985912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:46.987827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:46.994753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:46.995375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:46.995885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:46.997010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:46.997669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:46.998131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:47.168537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:47.177496 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a397efb-a67f-4447-986a-b4308e8e2c2a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1319 microversion: 2.1 time: 0.196900 Sep 18 01:41:47.178440 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2923/5808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:46 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:48.198029 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:48.203856 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:48.204568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:48.211459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.211950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.212377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.213074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.213524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.213967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.374088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:48.385784 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8096954b-6329-4662-97e7-be71be58f3c3 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1498 microversion: 2.1 time: 0.188297 Sep 18 01:41:48.386935 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2886/5809] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:48 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:48.415401 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:48.416054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:48.419327 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:48.419997 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:48.426203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.426723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.427156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.427882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.428331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.428752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.585586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:48.593914 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd26ca84-d78e-4afa-9661-2f8120a5cd00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1498 microversion: 2.1 time: 0.182928 Sep 18 01:41:48.596103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2924/5810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:48 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:48.619591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:48.620092 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:48.627125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.627603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.628035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.628753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.629199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.629644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.644868 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:48.657122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:41:48.694605 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:48.773733 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52ce0be4-7858-4841-9660-f65873d560e9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 204 len: 0 microversion: 2.1 time: 0.157857 Sep 18 01:41:48.775199 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2887/5811] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:41:48 2022] DELETE /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:41:48.784498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:48.785119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:48.791701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.792300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.792785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.794787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:48.794787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:48.794787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:48.953876 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:48.962559 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d81559fc-c7d1-49ad-962d-47edbfd0a98e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1504 microversion: 2.1 time: 0.182433 Sep 18 01:41:48.963148 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2925/5812] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:48 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:49.988155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:49.988933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:49.996267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:49.996757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:49.997201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:49.998512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:49.999336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:50.000069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:50.147840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:50.160493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ead4c1a-962e-4688-bb2a-8f443afc6d28 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1504 microversion: 2.1 time: 0.177930 Sep 18 01:41:50.161038 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2888/5813] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:49 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:50.736014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e9863bf1-74a5-4f72-a222-58b70cf336e0 req-8192c96a-fa48-4ee6-a917-893d40d8e2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7130e6-c12f-41ca-b8aa-6157fdd1edf8", "name": "network-vif-deleted", "tag": "b7e3d6e2-a17a-41e5-9aba-3cf4641aea86"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:50.756283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9863bf1-74a5-4f72-a222-58b70cf336e0 req-8192c96a-fa48-4ee6-a917-893d40d8e2d0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:50.766867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9863bf1-74a5-4f72-a222-58b70cf336e0 req-8192c96a-fa48-4ee6-a917-893d40d8e2d0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:50.767299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9863bf1-74a5-4f72-a222-58b70cf336e0 req-8192c96a-fa48-4ee6-a917-893d40d8e2d0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:50.788948 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e9863bf1-74a5-4f72-a222-58b70cf336e0 req-8192c96a-fa48-4ee6-a917-893d40d8e2d0 service nova] Creating event network-vif-deleted:b7e3d6e2-a17a-41e5-9aba-3cf4641aea86 for instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 on n-h1-master-1 Sep 18 01:41:50.797062 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e9863bf1-74a5-4f72-a222-58b70cf336e0 req-8192c96a-fa48-4ee6-a917-893d40d8e2d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064705 Sep 18 01:41:50.808551 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2926/5814] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:51.190903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:51.191458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:51.201927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:51.202828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:51.203629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:51.204483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:51.204955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:51.205389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:51.241250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:51.241865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:51.242312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:51.242773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lazy-loading 'fault' on Instance uuid 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:41:51.286710 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:51.301874 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d5f5bc2d-e752-4b5f-88bd-7a5fa0093d27 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 200 len: 1309 microversion: 2.1 time: 0.114864 Sep 18 01:41:51.302478 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2889/5815] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:51 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:52.336272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:52.337199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:52.343464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:52.343947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:52.344390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:52.345084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:52.345539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:52.345989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:52.360442 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 HTTP/1.1 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4d7130e6-c12f-41ca-b8aa-6157fdd1edf8'} Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:41:52.362156 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c99a852-5b4d-4fb5-8070-f43374dd7c08 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 404 len: 111 microversion: 2.1 time: 0.042252 Sep 18 01:41:52.375350 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2927/5816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:52 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:41:52.381091 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-58759687-5d16-435b-a3d7-2db3a81a4587 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: .version_select at 0x7f700516b670>, body: {"keypair": {"name": "tempest-key-1865917563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJREaNj1SVXLPz4Y4JGSzs4h600mqrTpz3unEYVozhkWH1q/dEAFGtQYzqJhwX+zQoQk4SQ1neCQUsE7bTOufo7o7sSSbUUYKNzu9o02Wsav7V2fhwUxUwJHCBhDhIki6w=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:52.398681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-58759687-5d16-435b-a3d7-2db3a81a4587 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:41:52.406535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-58759687-5d16-435b-a3d7-2db3a81a4587 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:41:52.435143 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-58759687-5d16-435b-a3d7-2db3a81a4587 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.058313 Sep 18 01:41:52.435762 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2890/5817] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:41:52 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:41:52.446558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7a62cb1-d9e8-4e21-a607-fb23cfd032bc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '.version_select at 0x7f70061dfca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:52.453106 n-d-master-1 devstack@n-api.service[122374]: WARNING oslo_db.sqlalchemy.utils [None req-d7a62cb1-d9e8-4e21-a607-fb23cfd032bc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 18 01:41:52.459076 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7a62cb1-d9e8-4e21-a607-fb23cfd032bc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.016292 Sep 18 01:41:52.470660 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2928/5818] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 18 01:41:52 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:52.583269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1641119826", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-key-1865917563", "networks": [{"uuid": "8cce45f3-fd67-4989-be92-4b9c4d8c8cff"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:52.642430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:41:53.382956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:41:53.383559 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:41:53.383851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:41:53.384263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:41:53.384677 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:41:53.395035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:53.395530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:53.395995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:53.396731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:53.397200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:53.397874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:53.416369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:41:53.422695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:41:53.436685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:41:53.439074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:41:53.450040 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:53.494757 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2fcf73eb-aa57-45e2-9ff7-88cc3164860e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915419 Sep 18 01:41:53.495795 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2891/5819] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:41:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:41:53.508822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-693988a1-1e9b-496f-b9f6-5743c7e4d444 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:53.509767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-693988a1-1e9b-496f-b9f6-5743c7e4d444 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:53.588668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-693988a1-1e9b-496f-b9f6-5743c7e4d444 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:53.603423 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-693988a1-1e9b-496f-b9f6-5743c7e4d444 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1229 microversion: 2.1 time: 0.097830 Sep 18 01:41:53.604003 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2929/5820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:53 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:54.628503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:54.629515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:54.646096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:54.646659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:54.647366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:54.648424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:54.649230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:54.650276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:54.722032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:54.741214 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f900579a-3a98-494d-8806-6d975fd3e764 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1281 microversion: 2.1 time: 0.116863 Sep 18 01:41:54.748608 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2892/5821] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:54 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:55.770593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:55.771423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:55.776014 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:41:55.794391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:55.795421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:55.795917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:55.797142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:55.797142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:55.797142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:56.035310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:56.046417 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-166a98b8-bdec-47ad-a6dc-4a184e564b00 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1329 microversion: 2.1 time: 0.282689 Sep 18 01:41:56.047086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2930/5822] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:55 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1329 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:57.075587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:57.076241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:57.086889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:57.087890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:57.089071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:57.091403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:57.092105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:57.092848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:57.201632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-cbaf2761-729b-4ae8-945e-35283e589331 req-44ed24d8-5375-4c28-b41d-7c9f47ca2533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdb8951-232a-4a15-81f0-2981ec7c657a", "tag": "a7b78444-7073-49f7-b381-7d9682a35a59"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:41:57.215190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cbaf2761-729b-4ae8-945e-35283e589331 req-44ed24d8-5375-4c28-b41d-7c9f47ca2533 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:57.216020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cbaf2761-729b-4ae8-945e-35283e589331 req-44ed24d8-5375-4c28-b41d-7c9f47ca2533 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:57.216718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cbaf2761-729b-4ae8-945e-35283e589331 req-44ed24d8-5375-4c28-b41d-7c9f47ca2533 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:57.231116 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-cbaf2761-729b-4ae8-945e-35283e589331 req-44ed24d8-5375-4c28-b41d-7c9f47ca2533 service nova] Creating event network-changed:a7b78444-7073-49f7-b381-7d9682a35a59 for instance bfdb8951-232a-4a15-81f0-2981ec7c657a on n-h2-master-1 Sep 18 01:41:57.237898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-cbaf2761-729b-4ae8-945e-35283e589331 req-44ed24d8-5375-4c28-b41d-7c9f47ca2533 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255714 Sep 18 01:41:57.238758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2893/5823] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:41:57.277747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:57.292709 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ab0b570-4aff-41d0-8b8c-32feff68ca9e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1329 microversion: 2.1 time: 0.221523 Sep 18 01:41:57.305275 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2931/5824] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:57 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:41:58.321471 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:58.322156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:58.329245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:58.329824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:58.330225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:58.330937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:58.331396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:58.331824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:58.517295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:58.533229 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc5e06ff-5d3e-4147-847f-2e590587162e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1329 microversion: 2.1 time: 0.218003 Sep 18 01:41:58.533872 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2894/5825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:58 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1329 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:41:59.559449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:41:59.560138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:41:59.568245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:59.568746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:59.569190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:59.570144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:41:59.570779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:41:59.572358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:41:59.738638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:41:59.747452 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b6a0f0b4-c68a-4fff-a3da-5a52c0de4308 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1329 microversion: 2.1 time: 0.193185 Sep 18 01:41:59.748048 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2932/5826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:41:59 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1329 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:00.771278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:00.772143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:00.781143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:00.782065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:00.782683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:00.783665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:00.784325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:00.784928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:00.960746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:00.972348 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8f6ed615-b686-43e1-b2e1-cd44be3ec770 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1329 microversion: 2.1 time: 0.205486 Sep 18 01:42:00.972941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2895/5827] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:00 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1329 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:02.001229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:02.001884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:02.008576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:02.009027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:02.009425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:02.010264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:02.010720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:02.011145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:02.164758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:02.180950 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e951259d-a342-4742-b844-2762784d483c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1329 microversion: 2.1 time: 0.186507 Sep 18 01:42:02.181847 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2933/5828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:01 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1329 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:02.832200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-71ac1c4e-e783-4c70-99aa-680630240522 req-6ebac82e-b5c0-4f11-86fe-864df5063ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdb8951-232a-4a15-81f0-2981ec7c657a", "name": "network-vif-plugged", "status": "completed", "tag": "a7b78444-7073-49f7-b381-7d9682a35a59"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:02.843846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-71ac1c4e-e783-4c70-99aa-680630240522 req-6ebac82e-b5c0-4f11-86fe-864df5063ac0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:02.844260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-71ac1c4e-e783-4c70-99aa-680630240522 req-6ebac82e-b5c0-4f11-86fe-864df5063ac0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:02.844758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-71ac1c4e-e783-4c70-99aa-680630240522 req-6ebac82e-b5c0-4f11-86fe-864df5063ac0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:02.863665 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-71ac1c4e-e783-4c70-99aa-680630240522 req-6ebac82e-b5c0-4f11-86fe-864df5063ac0 service nova] Creating event network-vif-plugged:a7b78444-7073-49f7-b381-7d9682a35a59 for instance bfdb8951-232a-4a15-81f0-2981ec7c657a on n-h2-master-1 Sep 18 01:42:02.870155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-71ac1c4e-e783-4c70-99aa-680630240522 req-6ebac82e-b5c0-4f11-86fe-864df5063ac0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041453 Sep 18 01:42:02.871226 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2896/5829] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:03.207113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:03.208218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:03.218775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:03.219555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:03.220166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:03.221218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:03.221849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:03.222448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:03.383279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:03.391881 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b4a20f7-e439-4d76-b5d9-1fc30d873b96 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1329 microversion: 2.1 time: 0.190613 Sep 18 01:42:03.392468 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2934/5830] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:03 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1329 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:04.177367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:04.179644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:04.184668 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:04.185127 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:04.192969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.193468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.194042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.194798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.195271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.195709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.415842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:04.416462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:04.421152 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:04.436831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.437925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.439091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.440255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.441300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.442152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.479803 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d76a152-9ef3-48cd-921c-e8737b206afc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action" status: 200 len: 24579 microversion: 2.1 time: 0.305960 Sep 18 01:42:04.482634 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2897/5831] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:42:04 2022] POST /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73/action => generated 24579 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:42:04.628616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:04.637963 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a33995a4-9105-419c-b47b-781d167cf7a6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1508 microversion: 2.1 time: 0.225913 Sep 18 01:42:04.638883 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2935/5832] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:04 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:04.665925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:04.666643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:04.679615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.680114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.680637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.681882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.683023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.683653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.868980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:04.881726 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fa14db38-a483-439e-863b-f0cbf93dc157 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1508 microversion: 2.1 time: 0.220320 Sep 18 01:42:04.882267 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2898/5833] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:04 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:04.907942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:04.908472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:04.918596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.919100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.919549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.920406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:04.921022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:04.921436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:04.957935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:42:05.051370 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b44b4329-bcf1-4585-9be3-a8d5f0d813d7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 204 len: 0 microversion: 2.1 time: 0.147433 Sep 18 01:42:05.052201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2936/5834] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:42:04 2022] DELETE /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:42:05.064132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:05.064966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:05.075601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:05.076100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:05.076545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:05.077302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:05.077792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:05.078370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:05.253312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:05.267934 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e587750-fca8-411c-9ced-e26cfc69b681 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1514 microversion: 2.1 time: 0.210571 Sep 18 01:42:05.268901 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2899/5835] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:05 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:06.295750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:06.296508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:06.303886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:06.304374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:06.304812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:06.305591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:06.306085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:06.306609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:06.310756 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:06.484222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:06.493894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7082041-50c0-4217-b73f-9bb4ba45a6cd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1514 microversion: 2.1 time: 0.203321 Sep 18 01:42:06.496318 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2937/5836] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:06 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:07.525394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:07.529109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-7b06e9c1-1b15-48c1-b461-3f4248b94616 req-87b6cc16-a98d-418a-b7eb-57b19fef964b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdb8951-232a-4a15-81f0-2981ec7c657a", "name": "network-vif-deleted", "tag": "a7b78444-7073-49f7-b381-7d9682a35a59"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:07.531549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:07.561100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:07.561792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:07.562335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:07.565095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:07.565795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:07.566549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7b06e9c1-1b15-48c1-b461-3f4248b94616 req-87b6cc16-a98d-418a-b7eb-57b19fef964b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:07.567108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:07.568648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7b06e9c1-1b15-48c1-b461-3f4248b94616 req-87b6cc16-a98d-418a-b7eb-57b19fef964b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:07.569364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7b06e9c1-1b15-48c1-b461-3f4248b94616 req-87b6cc16-a98d-418a-b7eb-57b19fef964b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:07.610420 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-7b06e9c1-1b15-48c1-b461-3f4248b94616 req-87b6cc16-a98d-418a-b7eb-57b19fef964b service nova] Creating event network-vif-deleted:a7b78444-7073-49f7-b381-7d9682a35a59 for instance bfdb8951-232a-4a15-81f0-2981ec7c657a on n-h2-master-1 Sep 18 01:42:07.629667 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-7b06e9c1-1b15-48c1-b461-3f4248b94616 req-87b6cc16-a98d-418a-b7eb-57b19fef964b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119817 Sep 18 01:42:07.631992 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2900/5837] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:07.678270 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:07.692970 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5fbe7797-e431-4511-b38f-48a71e03b9a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 200 len: 1472 microversion: 2.1 time: 0.176224 Sep 18 01:42:07.712030 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2938/5838] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:07 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:08.721707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:08.722609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:08.729210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:08.729756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:08.730355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:08.731704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:08.732288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:08.732655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:08.747696 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a HTTP/1.1 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: exception: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'bfdb8951-232a-4a15-81f0-2981ec7c657a'} Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:08.749371 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b4f18475-4b72-4ed1-ad6d-92163168594c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 404 len: 111 microversion: 2.1 time: 0.034819 Sep 18 01:42:08.761470 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2901/5839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:08 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:42:08.763729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc644a58-b093-4ee8-a5f9-d6732fd8f36d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '.version_select at 0x7f700a7c9e50>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:08.787701 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc644a58-b093-4ee8-a5f9-d6732fd8f36d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-1865917563" status: 202 len: 0 microversion: 2.1 time: 0.030498 Sep 18 01:42:08.788323 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2939/5840] 10.222.0.25 () {58 vars in 1209 bytes} [Sun Sep 18 01:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1865917563 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:42:08.944923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-452341174", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8cce45f3-fd67-4989-be92-4b9c4d8c8cff"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:09.017202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:42:09.435354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:42:09.435806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:42:09.436714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:42:09.436714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:42:09.437128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:42:09.448017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:09.448502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:09.448937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:09.449764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:09.450220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:09.450640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:09.468329 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:42:09.473786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:42:09.487568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:42:09.489803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:42:09.537056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c067a91e-f076-4666-bc21-4987f2bbf1e2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597474 Sep 18 01:42:09.544756 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2902/5841] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:42:09.550260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3010c32c-28ef-463b-a2fa-d615b6b17ae6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:09.551109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3010c32c-28ef-463b-a2fa-d615b6b17ae6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:09.612721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3010c32c-28ef-463b-a2fa-d615b6b17ae6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:09.621076 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3010c32c-28ef-463b-a2fa-d615b6b17ae6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1208 microversion: 2.1 time: 0.074837 Sep 18 01:42:09.622593 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2940/5842] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:09 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1208 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:10.654023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:10.654792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:10.665032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:10.665678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:10.666300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:10.667034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:10.667499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:10.667948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:10.737271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:10.747160 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e1692c46-de6e-4b6d-8237-8e0e99e8f8e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1260 microversion: 2.1 time: 0.100618 Sep 18 01:42:10.747535 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2903/5843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:10 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1260 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:10.779969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:10.780949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:10.792060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:10.792720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:10.793386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:10.794408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:10.795002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:10.795596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:10.974592 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3a64b01-688f-4bd6-9a5e-8579a9f8514a tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1832 microversion: 2.1 time: 0.200777 Sep 18 01:42:10.975200 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2941/5844] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:10 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1832 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:11.857250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:11.943951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:11.970840 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f71abc2-df58-4912-ad9a-f21d1830ccb9 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1266 microversion: 2.1 time: 0.198501 Sep 18 01:42:11.972533 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2904/5845] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:11 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:12.464113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:12.465244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:12.487894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:12.488404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:12.489313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:12.491832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:12.492327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:12.492841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:12.574667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:42:12.623368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-68f1794c-deee-425c-ad7e-3ef0dc782a29 req-af166ca8-5fcd-466d-bb09-59272e422672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:12.671320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-68f1794c-deee-425c-ad7e-3ef0dc782a29 req-af166ca8-5fcd-466d-bb09-59272e422672 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:12.672160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-68f1794c-deee-425c-ad7e-3ef0dc782a29 req-af166ca8-5fcd-466d-bb09-59272e422672 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:12.673218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-68f1794c-deee-425c-ad7e-3ef0dc782a29 req-af166ca8-5fcd-466d-bb09-59272e422672 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:12.711366 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-68f1794c-deee-425c-ad7e-3ef0dc782a29 req-af166ca8-5fcd-466d-bb09-59272e422672 service nova] Creating event network-changed:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h2-master-1 Sep 18 01:42:12.728130 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-68f1794c-deee-425c-ad7e-3ef0dc782a29 req-af166ca8-5fcd-466d-bb09-59272e422672 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245314 Sep 18 01:42:12.730337 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2905/5846] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:12.784168 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a8a29d7-cfb4-47e7-b445-673815498378 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 204 len: 0 microversion: 2.1 time: 0.324956 Sep 18 01:42:12.785357 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2942/5847] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:42:12 2022] DELETE /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:42:12.795844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:12.797062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:12.815713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:12.819541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:12.820277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:12.821878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:12.822595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:12.824706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:12.996694 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:12.997452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:13.011911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:13.012668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:13.013134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:13.018734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:13.019322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:13.019861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:13.280285 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:13.296316 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-724f976e-28bf-4f02-b523-7a07e86bff9e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1687 microversion: 2.1 time: 0.506105 Sep 18 01:42:13.297671 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2906/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:12 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1687 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:13.341810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:13.368824 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b396ce2a-3e47-47d0-b9dc-11f4def8f794 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.377287 Sep 18 01:42:13.370066 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2943/5849] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:12 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:13.551441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-df554b61-05a3-475e-b1c9-2a115c5e9af3 req-bca77ca7-50f5-4a81-b0eb-f7e33799f0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7cfe5e-2945-48c9-9e27-35317f17adc9", "tag": "29499df8-41ee-4a4e-9e6f-f084bce99be6"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:13.571372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-df554b61-05a3-475e-b1c9-2a115c5e9af3 req-bca77ca7-50f5-4a81-b0eb-f7e33799f0ee service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:13.572188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-df554b61-05a3-475e-b1c9-2a115c5e9af3 req-bca77ca7-50f5-4a81-b0eb-f7e33799f0ee service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:13.573422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-df554b61-05a3-475e-b1c9-2a115c5e9af3 req-bca77ca7-50f5-4a81-b0eb-f7e33799f0ee service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:13.590084 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-df554b61-05a3-475e-b1c9-2a115c5e9af3 req-bca77ca7-50f5-4a81-b0eb-f7e33799f0ee service nova] Creating event network-changed:29499df8-41ee-4a4e-9e6f-f084bce99be6 for instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 on n-h2-master-1 Sep 18 01:42:13.595557 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-df554b61-05a3-475e-b1c9-2a115c5e9af3 req-bca77ca7-50f5-4a81-b0eb-f7e33799f0ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049774 Sep 18 01:42:13.596878 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2907/5850] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:14.328181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:14.328181 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:14.336175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:14.336673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:14.337135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:14.337927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:14.338948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:14.339542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:14.398453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:14.400432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:14.410492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:14.411268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:14.411727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:14.412464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:14.413001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:14.413330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:14.665464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:14.681686 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5c02ab6-9576-43cb-b943-c77b1824b109 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1687 microversion: 2.1 time: 0.358731 Sep 18 01:42:14.683265 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2944/5851] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:14 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1687 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:14.794549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:14.803672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6d16de3-d390-414f-8c65-d8d7e6b3affb tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.410045 Sep 18 01:42:14.804300 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2908/5852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:14 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:15.707200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:15.707900 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:15.719737 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:15.720165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:15.731908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:15.734254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:15.734949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:15.735567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:15.737896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-05255a25-44a0-48c3-8e46-7b366e19f411 req-4d35265c-a606-4e45-b20b-530670de97e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2046da7a-6cf4-4abf-9677-a1d23c01fa73", "name": "network-vif-deleted", "tag": "901fb25b-0038-40fa-afaf-dca87ec73017"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:15.752367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-05255a25-44a0-48c3-8e46-7b366e19f411 req-4d35265c-a606-4e45-b20b-530670de97e7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:15.753822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-05255a25-44a0-48c3-8e46-7b366e19f411 req-4d35265c-a606-4e45-b20b-530670de97e7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:15.754432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-05255a25-44a0-48c3-8e46-7b366e19f411 req-4d35265c-a606-4e45-b20b-530670de97e7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:15.775260 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-05255a25-44a0-48c3-8e46-7b366e19f411 req-4d35265c-a606-4e45-b20b-530670de97e7 service nova] Creating event network-vif-deleted:901fb25b-0038-40fa-afaf-dca87ec73017 for instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 on n-h2-master-1 Sep 18 01:42:15.781675 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-05255a25-44a0-48c3-8e46-7b366e19f411 req-4d35265c-a606-4e45-b20b-530670de97e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047167 Sep 18 01:42:15.782678 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2909/5853] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:42:15.826656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:15.835359 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0605368a-e42f-4c68-8303-4d69b793b504 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1500 microversion: 2.1 time: 0.132473 Sep 18 01:42:15.837210 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2945/5854] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:15 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1500 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:15.843685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:15.844628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:15.851617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:15.853102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:15.853807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:15.854863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:15.855517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:15.856132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:16.012212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:16.019692 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:16.022648 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed0a4983-305c-43e3-a8b0-58fcbc2b666f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.193990 Sep 18 01:42:16.024586 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2910/5855] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:15 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:16.874206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:16.874949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:16.884209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:16.884805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:16.885284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:16.886034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:16.886489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:16.886916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:16.981714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:16.990255 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2c6c0b65-1ceb-4d14-a8e5-a4c001053a27 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 200 len: 1349 microversion: 2.1 time: 0.121498 Sep 18 01:42:16.990801 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2946/5856] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:16 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 1349 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:17.048387 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:17.048999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:17.057775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:17.058330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:17.058711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:17.059423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:17.060072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:17.060674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:17.243478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:17.253062 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78cfbec3-4146-42f1-84b5-fca93506c2f5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.208970 Sep 18 01:42:17.256624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2911/5857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:17 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:18.015186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:18.015796 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 2046da7a-6cf4-4abf-9677-a1d23c01fa73] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:18.023797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:18.024101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:18.024414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:18.025423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:18.026574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:18.027063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:18.043611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] HTTP exception thrown: Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 could not be found. Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Request method failure captured: Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 HTTP/1.1 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnbyk5s0dRRAabvkMBwA_LP2vJUd_Q5hjvjpPddO70XgVKwdaPyUXiB9cCjfcYFRppjLgCrsUwFQKRWZZf_FtW7ok49SJDalWxps012yn7ohGXMzX4A07Ecf2_5KAzVkxyB1I14F4f2c_IEKdWF_O6ffKflIC9mNPHg5YUoKxuxhkRc Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/534af518a54843d9b0288bc79448de27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_534af518a54843d9b0288bc79448de27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 50ef9fd3ac384cfe907975caddd403a2 Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 could not be found. Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '2046da7a-6cf4-4abf-9677-a1d23c01fa73'} Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 could not be found. Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 could not be found. Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:42:18.045473 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 could not be found. Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:42:18.051907 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Returning 404 to user: Instance 2046da7a-6cf4-4abf-9677-a1d23c01fa73 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:42:18.052701 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c84f20b2-943f-4419-a46d-8e2ae9e3267e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73" status: 404 len: 111 microversion: 2.1 time: 0.041687 Sep 18 01:42:18.053812 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2947/5858] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:18 2022] GET /compute/v2.1/servers/2046da7a-6cf4-4abf-9677-a1d23c01fa73 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:42:18.278078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:18.278737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:18.286351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:18.287050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:18.287451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:18.288454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:18.289050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:18.289421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:18.746638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:18.759192 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3fc30381-ff55-4759-bb88-77341889d29c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.485398 Sep 18 01:42:18.760198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2912/5859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:18 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:19.783623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:19.785202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:19.795164 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:19.797100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:19.797643 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:19.799780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:19.799780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:19.799780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:19.800337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:20.038082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:20.047544 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-328b8805-e838-48a4-9072-f7cdaa2b20fe tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.268277 Sep 18 01:42:20.058145 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2948/5860] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:19 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:21.072410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:21.080224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:21.084256 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:21.085519 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:21.092139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:21.093263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:21.097486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:21.098594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:21.100118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:21.100896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:21.292447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:21.301164 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-78917a0f-54e8-4e8a-9688-0283af68d4a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.232642 Sep 18 01:42:21.302567 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2913/5861] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:21 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:21.692559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-21fd93a9-017e-4555-b34a-4a499397af3c req-49e5fba3-ca73-4d48-af24-e9f2d7d1cbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7cfe5e-2945-48c9-9e27-35317f17adc9", "name": "network-vif-plugged", "status": "completed", "tag": "29499df8-41ee-4a4e-9e6f-f084bce99be6"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:21.703671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-21fd93a9-017e-4555-b34a-4a499397af3c req-49e5fba3-ca73-4d48-af24-e9f2d7d1cbf1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:21.704440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-21fd93a9-017e-4555-b34a-4a499397af3c req-49e5fba3-ca73-4d48-af24-e9f2d7d1cbf1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:21.705040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-21fd93a9-017e-4555-b34a-4a499397af3c req-49e5fba3-ca73-4d48-af24-e9f2d7d1cbf1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:21.724649 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-21fd93a9-017e-4555-b34a-4a499397af3c req-49e5fba3-ca73-4d48-af24-e9f2d7d1cbf1 service nova] Creating event network-vif-plugged:29499df8-41ee-4a4e-9e6f-f084bce99be6 for instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 on n-h2-master-1 Sep 18 01:42:21.731164 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-21fd93a9-017e-4555-b34a-4a499397af3c req-49e5fba3-ca73-4d48-af24-e9f2d7d1cbf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042031 Sep 18 01:42:21.732162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2949/5862] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:22.331746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:22.333019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:22.355585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:22.357061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:22.358311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:22.360060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:22.361336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:22.362617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:22.581129 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:22.598118 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-63dc7811-ee33-49e4-b882-1af51268bc35 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1308 microversion: 2.1 time: 0.275569 Sep 18 01:42:22.598695 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2914/5863] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:22 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:22.613459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7fe35b2b-e250-4cb2-a114-059749f62779 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '.version_select at 0x7f7006b43790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:22.639550 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7fe35b2b-e250-4cb2-a114-059749f62779 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-554634503" status: 202 len: 0 microversion: 2.1 time: 0.030770 Sep 18 01:42:22.640559 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2950/5864] 10.222.0.25 () {58 vars in 1281 bytes} [Sun Sep 18 01:42:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-554634503 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:42:22.669368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cfc50dae-1272-45f1-b6c7-15388fc2067b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: .version_select at 0x7f700536b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-206835295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+yA1KqBGEYwpUCVDUI7r2D4LYnEjLBjQUL9Myx4tcP2TTgpeW73a8DJvNjJXfB4B2A4bG8DGdVeFSzccVtV24cyqqdS8j4pDgagsjkui2HQiZOhibpyMkCrVyEcSXW8g=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:22.688015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cfc50dae-1272-45f1-b6c7-15388fc2067b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:42:22.694764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-cfc50dae-1272-45f1-b6c7-15388fc2067b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:42:22.729506 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cfc50dae-1272-45f1-b6c7-15388fc2067b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065384 Sep 18 01:42:22.730440 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2915/5865] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:42:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:23.625263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:23.626025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:23.639131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:23.639955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:23.640332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:23.641834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:23.642282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:23.642712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:23.843199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:23.852040 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f5d35a2-0e69-4654-bca6-c7ed0f49dfad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1487 microversion: 2.1 time: 0.231451 Sep 18 01:42:23.852485 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2951/5866] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:23 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1487 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:23.918881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-452341174", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8cce45f3-fd67-4989-be92-4b9c4d8c8cff"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:24.008990 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:42:24.620683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:42:24.621037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:42:24.621465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:42:24.621895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:42:24.622302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:42:24.646833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:24.647325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:24.647760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:24.648483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:24.648936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:24.649356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:24.661910 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=73 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:24.669139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:42:24.675625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:42:24.690809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:42:24.693463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:42:24.745590 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3be7130a-d6da-4ebc-ba26-f02572cd2721 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831447 Sep 18 01:42:24.746673 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2916/5867] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:42:24.757818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-72b2efb9-2da2-4fad-9c46-c8b0c5dd99ca tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:24.758969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72b2efb9-2da2-4fad-9c46-c8b0c5dd99ca tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:24.833871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-72b2efb9-2da2-4fad-9c46-c8b0c5dd99ca tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:24.842193 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-72b2efb9-2da2-4fad-9c46-c8b0c5dd99ca tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1208 microversion: 2.1 time: 0.088722 Sep 18 01:42:24.843355 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2952/5868] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:24 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:25.873434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:25.874791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:25.889531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:25.890060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:25.890504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:25.891233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:25.891881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:25.892511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:25.967892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:25.977110 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88a35890-b870-41af-8141-235d7fc1a9b0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1260 microversion: 2.1 time: 0.110147 Sep 18 01:42:25.978051 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2917/5869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:25 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1260 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:27.002090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:27.004255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:27.010716 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:27.027800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:27.030881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:27.031577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:27.036719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:27.037839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:27.038872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:27.387066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:27.404378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf7f7ff8-79cd-4938-9765-f6160713c1d6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.405093 Sep 18 01:42:27.423352 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2953/5870] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:26 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:28.433574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:28.433574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:28.453571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:28.454106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:28.454558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:28.455366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:28.478095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:28.500280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:28.780536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:28.827773 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ef3e416-fd88-4899-a9ea-12e9b8d41b94 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.399582 Sep 18 01:42:28.832402 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2918/5871] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:28 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:29.815841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3c944f5c-2127-4dc9-82b8-d31d55a9a3a2 req-9a932b3f-9c10-4a51-a302-2d9337e60878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f063d40-0621-48ff-a100-7cd9b45ad675", "tag": "3dcafb53-446f-49af-8096-2d1eb776d29a"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:29.850820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:29.851361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:29.857172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3c944f5c-2127-4dc9-82b8-d31d55a9a3a2 req-9a932b3f-9c10-4a51-a302-2d9337e60878 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:29.860328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3c944f5c-2127-4dc9-82b8-d31d55a9a3a2 req-9a932b3f-9c10-4a51-a302-2d9337e60878 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:29.863507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3c944f5c-2127-4dc9-82b8-d31d55a9a3a2 req-9a932b3f-9c10-4a51-a302-2d9337e60878 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:29.871104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:29.885308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:29.887811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:29.888716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:29.891151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:29.892060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:29.897351 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3c944f5c-2127-4dc9-82b8-d31d55a9a3a2 req-9a932b3f-9c10-4a51-a302-2d9337e60878 service nova] Creating event network-changed:3dcafb53-446f-49af-8096-2d1eb776d29a for instance 4f063d40-0621-48ff-a100-7cd9b45ad675 on n-h1-master-1 Sep 18 01:42:29.913544 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3c944f5c-2127-4dc9-82b8-d31d55a9a3a2 req-9a932b3f-9c10-4a51-a302-2d9337e60878 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117312 Sep 18 01:42:29.916337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2954/5872] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:30.104126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:30.115412 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-513d20c7-f211-4baf-b304-c4395509fb1b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.268573 Sep 18 01:42:30.120918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2919/5873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:29 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:31.140785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:31.141691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:31.153145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:31.154193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:31.156514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:31.162925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:31.165054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:31.166016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:31.404505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:31.414911 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d858ba3-98ce-41b7-94e9-ccd464433178 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.278426 Sep 18 01:42:31.437545 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2955/5874] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:31 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:31.610046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-266336901", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "84e1a429-a92b-42c9-938b-a8bfbef0b33e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-206835295", "security_groups": [{"name": "tempest-secgroup-smoke-1420871856"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:31.740831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] validate_networks() for [('84e1a429-a92b-42c9-938b-a8bfbef0b33e', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:42:32.219541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:42:32.219971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:42:32.220676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:42:32.221096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:42:32.221533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:42:32.234803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:32.235327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:32.235956 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:32.237205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:32.237978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:32.238595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:32.267164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:42:32.274372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:42:32.302874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:42:32.306936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:42:32.369258 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-131a9064-e8e7-4653-a8af-5cc0e7a47464 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764774 Sep 18 01:42:32.372023 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2920/5875] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:42:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:42:32.383627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c54b841-75c9-42d7-948c-e003c50d7ced tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:32.384242 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c54b841-75c9-42d7-948c-e003c50d7ced tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:32.438998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:32.446650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:32.452443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:32.452947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:32.459437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:32.460503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:32.461205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:32.461988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:32.469989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c54b841-75c9-42d7-948c-e003c50d7ced tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:32.481620 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c54b841-75c9-42d7-948c-e003c50d7ced tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1265 microversion: 2.1 time: 0.101684 Sep 18 01:42:32.482689 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2956/5876] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:32 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:33.014200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:33.026164 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-852cae4b-ff79-4da6-9ba1-fb96e420e164 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.590330 Sep 18 01:42:33.027394 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2921/5877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:32 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:33.504258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:33.505034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:33.512990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:33.513573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:33.514210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:33.514952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:33.515412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:33.515839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:33.581996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:33.590189 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c1c61f81-68a8-46c8-a7c3-f72e9585ed6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1317 microversion: 2.1 time: 0.089755 Sep 18 01:42:33.590905 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2957/5878] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:33 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1317 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:34.067889 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:34.068506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:34.076870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:34.077635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:34.078237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:34.079135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:34.079757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:34.080360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:34.276211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:34.286213 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30d9c575-f3fc-4c8d-8efc-e4da088b029f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.222111 Sep 18 01:42:34.287024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2922/5879] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:34 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:34.616206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:34.621029 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:34.628208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:34.628697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:34.629136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:34.629959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:34.630604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:34.631041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:34.708400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:34.717891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5265130d-4d27-4130-88f3-9264ae99e541 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1323 microversion: 2.1 time: 0.107417 Sep 18 01:42:34.719249 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2958/5880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:34 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1323 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:35.311313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:35.312628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:35.327798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:35.328642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:35.329878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:35.331605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:35.332323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:35.332994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:35.498075 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:35.508593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0ad9c6e-b43b-45e3-bc7f-0729c6dff213 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.203759 Sep 18 01:42:35.509947 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2923/5881] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:35 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:35.744280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:35.746678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:35.764239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:35.765014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:35.765670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:35.765814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-6f49f887-e7ac-488a-924c-5294792e4a3b req-e777c624-8d14-4158-816f-9e0e8ef24382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:35.767357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:35.768861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:35.770707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:35.784425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6f49f887-e7ac-488a-924c-5294792e4a3b req-e777c624-8d14-4158-816f-9e0e8ef24382 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:35.785085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6f49f887-e7ac-488a-924c-5294792e4a3b req-e777c624-8d14-4158-816f-9e0e8ef24382 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:35.786136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6f49f887-e7ac-488a-924c-5294792e4a3b req-e777c624-8d14-4158-816f-9e0e8ef24382 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:35.806886 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-6f49f887-e7ac-488a-924c-5294792e4a3b req-e777c624-8d14-4158-816f-9e0e8ef24382 service nova] Creating event network-changed:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:42:35.809815 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:35.812661 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-6f49f887-e7ac-488a-924c-5294792e4a3b req-e777c624-8d14-4158-816f-9e0e8ef24382 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058214 Sep 18 01:42:35.813290 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2924/5882] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:42:35.954750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:35.964379 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-674e6d0e-7e6f-4d4c-8219-318cad284596 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1391 microversion: 2.1 time: 0.226885 Sep 18 01:42:35.964982 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2959/5883] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:35 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:36.536180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:36.536883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:36.544355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:36.544839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:36.545274 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:36.546013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:36.546475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:36.546903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:36.694494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:36.702315 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c88755c0-8490-4254-bfb6-7c1f30d4bfb8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.171350 Sep 18 01:42:36.702894 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2925/5884] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:36 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:36.988573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:36.989277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:36.998606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:36.999104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:36.999551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:37.000264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:37.000727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:37.001211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:37.041396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b057a404-7cf1-4007-82cc-a46d8ed0921a req-3d568c3c-9174-47c2-af7a-e6939af8c4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f063d40-0621-48ff-a100-7cd9b45ad675", "name": "network-vif-plugged", "status": "completed", "tag": "3dcafb53-446f-49af-8096-2d1eb776d29a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:37.055145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b057a404-7cf1-4007-82cc-a46d8ed0921a req-3d568c3c-9174-47c2-af7a-e6939af8c4e7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:37.056918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b057a404-7cf1-4007-82cc-a46d8ed0921a req-3d568c3c-9174-47c2-af7a-e6939af8c4e7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:37.057367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b057a404-7cf1-4007-82cc-a46d8ed0921a req-3d568c3c-9174-47c2-af7a-e6939af8c4e7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:37.073854 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b057a404-7cf1-4007-82cc-a46d8ed0921a req-3d568c3c-9174-47c2-af7a-e6939af8c4e7 service nova] Creating event network-vif-plugged:3dcafb53-446f-49af-8096-2d1eb776d29a for instance 4f063d40-0621-48ff-a100-7cd9b45ad675 on n-h1-master-1 Sep 18 01:42:37.080359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b057a404-7cf1-4007-82cc-a46d8ed0921a req-3d568c3c-9174-47c2-af7a-e6939af8c4e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043257 Sep 18 01:42:37.081895 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2926/5885] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:37.173960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:37.186570 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-234b6cdb-f235-4b66-8598-0fa6c695e149 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1391 microversion: 2.1 time: 0.201913 Sep 18 01:42:37.193295 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2960/5886] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:36 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1391 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:37.725720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:37.727296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:37.735263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:37.735754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:37.736187 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:37.737054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:37.737646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:37.738016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:37.884211 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:37.901193 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5e7c6bd9-2037-4b32-a49f-93ff47954970 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1308 microversion: 2.1 time: 0.178490 Sep 18 01:42:37.903177 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2927/5887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:37 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:38.218646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:38.219999 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:38.229153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:38.230231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:38.230841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:38.231726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:38.232426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:38.232855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:38.413236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:38.425221 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c723d4fe-465c-4af9-a713-19e01688f5db tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1391 microversion: 2.1 time: 0.212357 Sep 18 01:42:38.426596 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2961/5888] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:38 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:38.925207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:38.925850 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:38.934469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:38.935146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:38.935680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:38.936772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:38.937362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:38.938117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.227282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:39.236086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f55be7c3-c305-4212-8f97-19cb2c1c7e8e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1488 microversion: 2.1 time: 0.314751 Sep 18 01:42:39.236687 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2928/5889] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:38 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1488 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:39.260835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:39.262553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:39.270385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.270881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.271389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.272177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.272728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.273058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.450371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:39.451514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:39.461702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.463060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.464013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.465502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.466141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.466946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.495111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:39.507441 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a71942da-3fa9-4b2c-b7e8-30ee83945f22 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1487 microversion: 2.1 time: 0.250993 Sep 18 01:42:39.508097 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2962/5890] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:39 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1487 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:39.536593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:39.539286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:39.558746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.559519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.560172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.561124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.561851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.562694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.749511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:39.761832 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cbbdeead-19b7-4a05-a85d-2f6278fee90f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1391 microversion: 2.1 time: 0.316168 Sep 18 01:42:39.776582 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2929/5891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:39 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:39.811084 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:39.824879 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2c0c34ac-13bb-405b-a0cc-5bb502965009 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1488 microversion: 2.1 time: 0.296356 Sep 18 01:42:39.838578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2963/5892] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:39 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1488 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:39.848995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:39.850722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:39.863621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.864705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.865255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.866203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:39.866681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:39.867133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:39.913917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:42:39.952606 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:40.076382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ebaa3570-eaab-4f7f-bdb5-f8e3fd1773c2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 204 len: 0 microversion: 2.1 time: 0.231103 Sep 18 01:42:40.076730 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2930/5893] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:42:39 2022] DELETE /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:42:40.100879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:40.101645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:40.112044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:40.112346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:40.112770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:40.113494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:40.114217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:40.114406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:40.281292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:40.291564 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a610033-488d-4659-9804-b319f3791aed tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1494 microversion: 2.1 time: 0.208016 Sep 18 01:42:40.292161 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2964/5894] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:40 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1494 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:40.799297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:40.800032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:40.809246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:40.811087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:40.811087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:40.811357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:40.811756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:40.812188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:40.968088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:40.976199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8323908c-6339-4a92-9e10-062bf0d7f0f6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1391 microversion: 2.1 time: 0.181411 Sep 18 01:42:40.976779 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2931/5895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:40 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:41.061542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4e4aaf3c-704d-47c5-baed-ff65b61bd621 req-fd05446f-7838-4a60-81e2-b892fe2cd22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "name": "network-vif-plugged", "status": "completed", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:41.071533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4e4aaf3c-704d-47c5-baed-ff65b61bd621 req-fd05446f-7838-4a60-81e2-b892fe2cd22c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:41.072703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4e4aaf3c-704d-47c5-baed-ff65b61bd621 req-fd05446f-7838-4a60-81e2-b892fe2cd22c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:41.073204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4e4aaf3c-704d-47c5-baed-ff65b61bd621 req-fd05446f-7838-4a60-81e2-b892fe2cd22c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:41.085015 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4e4aaf3c-704d-47c5-baed-ff65b61bd621 req-fd05446f-7838-4a60-81e2-b892fe2cd22c service nova] Creating event network-vif-plugged:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:42:41.090653 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4e4aaf3c-704d-47c5-baed-ff65b61bd621 req-fd05446f-7838-4a60-81e2-b892fe2cd22c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 Sep 18 01:42:41.091257 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2965/5896] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:41.315950 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:41.316568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:41.323552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:41.324044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:41.324483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:41.325191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:41.325706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:41.326138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:41.463515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:41.471313 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4bd56627-cb23-4c5d-a7b1-de877e658ec7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1494 microversion: 2.1 time: 0.159336 Sep 18 01:42:41.471896 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2932/5897] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:41 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1494 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:42.001981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:42.002772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:42.010008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:42.010676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:42.011206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:42.011974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:42.012579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:42.013079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:42.178600 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:42.188362 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76aa36ff-4281-4312-9ccc-2164cdb5c5f4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1391 microversion: 2.1 time: 0.192311 Sep 18 01:42:42.189585 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2966/5898] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:41 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:42.376369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-25f6e6dc-81cf-49cb-99d7-68b920af137e req-da69f20e-b06b-406e-8cd7-da3b39dbee57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f063d40-0621-48ff-a100-7cd9b45ad675", "name": "network-vif-deleted", "tag": "3dcafb53-446f-49af-8096-2d1eb776d29a"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:42.389285 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:42.393276 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=16 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:42.396908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-25f6e6dc-81cf-49cb-99d7-68b920af137e req-da69f20e-b06b-406e-8cd7-da3b39dbee57 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:42.398106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-25f6e6dc-81cf-49cb-99d7-68b920af137e req-da69f20e-b06b-406e-8cd7-da3b39dbee57 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:42.398812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-25f6e6dc-81cf-49cb-99d7-68b920af137e req-da69f20e-b06b-406e-8cd7-da3b39dbee57 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:42.420202 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-25f6e6dc-81cf-49cb-99d7-68b920af137e req-da69f20e-b06b-406e-8cd7-da3b39dbee57 service nova] Creating event network-vif-deleted:3dcafb53-446f-49af-8096-2d1eb776d29a for instance 4f063d40-0621-48ff-a100-7cd9b45ad675 on n-h1-master-1 Sep 18 01:42:42.428444 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-25f6e6dc-81cf-49cb-99d7-68b920af137e req-da69f20e-b06b-406e-8cd7-da3b39dbee57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055883 Sep 18 01:42:42.429858 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2933/5899] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:42.495625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:42.496277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:42.499214 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:42.510750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:42.511521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:42.511958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:42.512838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:42.513461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:42.514067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:42.559048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:42.560010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:42.560611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:42.561227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lazy-loading 'fault' on Instance uuid 4f063d40-0621-48ff-a100-7cd9b45ad675 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:42:42.620834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:42.629273 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4fa37f4-2b1b-478e-96b3-fbaa69b509f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 200 len: 1298 microversion: 2.1 time: 0.137780 Sep 18 01:42:42.631546 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2967/5900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:42 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:43.220402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:43.221128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:43.232560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.233065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.233485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.234446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.234878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.235303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.387358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:43.396446 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47c03b87-a38e-47d8-80a4-fcb100aab03f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1563 microversion: 2.1 time: 0.181730 Sep 18 01:42:43.397729 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2934/5901] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:43 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:43.420994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:43.421725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:43.430415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.430898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.431863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.432563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.433019 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.433441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.588123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:43.595939 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d2afb3e2-ecca-45be-bf0c-ea4382e81444 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1563 microversion: 2.1 time: 0.179945 Sep 18 01:42:43.596520 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2968/5902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:43 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:43.654741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:43.655360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:43.661896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.662467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.663146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.664088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.668231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.668231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.682169 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 HTTP/1.1 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4f063d40-0621-48ff-a100-7cd9b45ad675'} Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:43.683987 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40948f7b-f2eb-4a74-9541-b3e27671b788 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 404 len: 111 microversion: 2.1 time: 0.035276 Sep 18 01:42:43.688446 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2935/5903] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:43 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:42:43.695648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:43.696154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:43.706538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.709016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.709721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.710669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.711859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.712543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.744292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:42:43.838524 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eac3fc13-ece0-4d73-97ed-435b216dadf4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 204 len: 0 microversion: 2.1 time: 0.146439 Sep 18 01:42:43.839172 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2969/5904] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:42:43 2022] DELETE /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:42:43.850601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:43.851504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:43.858541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.859073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.859718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:43.860418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:43.860878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:43.861333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:44.110095 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:44.120086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-63db07c9-a23f-47ea-a6b4-fc6d1cac81fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1493 microversion: 2.1 time: 0.276145 Sep 18 01:42:44.121038 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2936/5905] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:43 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1493 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:45.148126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:45.148820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:45.158163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:45.158750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:45.159275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:45.160529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:45.161047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:45.161782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:45.438589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:45.449154 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f5df1b4-843b-4ca6-9668-24e8744bd3f7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1493 microversion: 2.1 time: 0.305043 Sep 18 01:42:45.450202 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2970/5906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:45 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1493 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:45.746863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:45.748155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:45.755523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:45.756304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:45.756982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:45.757930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:45.758623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:45.759345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:45.778445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1effa486-37bc-4a63-b2d4-9507c56efd72 req-79072a4a-f1dd-43d0-8cd4-db6b734f5e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:45.801169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1effa486-37bc-4a63-b2d4-9507c56efd72 req-79072a4a-f1dd-43d0-8cd4-db6b734f5e83 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:45.801685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1effa486-37bc-4a63-b2d4-9507c56efd72 req-79072a4a-f1dd-43d0-8cd4-db6b734f5e83 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:45.802111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1effa486-37bc-4a63-b2d4-9507c56efd72 req-79072a4a-f1dd-43d0-8cd4-db6b734f5e83 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:45.814003 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1effa486-37bc-4a63-b2d4-9507c56efd72 req-79072a4a-f1dd-43d0-8cd4-db6b734f5e83 service nova] Creating event network-changed:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:42:45.824122 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1effa486-37bc-4a63-b2d4-9507c56efd72 req-79072a4a-f1dd-43d0-8cd4-db6b734f5e83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049705 Sep 18 01:42:45.825119 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2971/5907] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:42:46.125657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:46.139045 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0eeaebcf-0f2e-49e2-b1b9-59592c0d8bff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1563 microversion: 2.1 time: 0.395843 Sep 18 01:42:46.154643 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2937/5908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:45 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1563 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:46.475479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:46.477191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:46.492706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:46.493208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:46.494217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:46.494933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:46.513409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:46.518957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:46.626112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:46.635368 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-22f8ed9e-2b11-489c-9e2f-0a3cae3052ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 200 len: 1293 microversion: 2.1 time: 0.165218 Sep 18 01:42:46.653148 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2972/5909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:46 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:47.660656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:47.661281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:47.667936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:47.668419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:47.668855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:47.669579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:47.670038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:47.670461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:47.684868 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 HTTP/1.1 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8b7cfe5e-2945-48c9-9e27-35317f17adc9'} Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:42:47.686433 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:42:47.691027 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f023830c-4590-47cb-968a-d3fd75e38c12 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 404 len: 111 microversion: 2.1 time: 0.031450 Sep 18 01:42:47.692433 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2938/5910] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:47 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:42:47.742509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-469779604", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8cce45f3-fd67-4989-be92-4b9c4d8c8cff"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:47.799194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:42:47.862262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-220d5d57-48c6-465b-9f0e-a9f24077845b req-18594338-dad6-4c32-b153-d22f954a3c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7cfe5e-2945-48c9-9e27-35317f17adc9", "name": "network-vif-deleted", "tag": "29499df8-41ee-4a4e-9e6f-f084bce99be6"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:47.873854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-220d5d57-48c6-465b-9f0e-a9f24077845b req-18594338-dad6-4c32-b153-d22f954a3c86 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:47.874664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-220d5d57-48c6-465b-9f0e-a9f24077845b req-18594338-dad6-4c32-b153-d22f954a3c86 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:47.875307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-220d5d57-48c6-465b-9f0e-a9f24077845b req-18594338-dad6-4c32-b153-d22f954a3c86 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:47.906606 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-220d5d57-48c6-465b-9f0e-a9f24077845b req-18594338-dad6-4c32-b153-d22f954a3c86 service nova] Creating event network-vif-deleted:29499df8-41ee-4a4e-9e6f-f084bce99be6 for instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 on n-h2-master-1 Sep 18 01:42:47.915942 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-220d5d57-48c6-465b-9f0e-a9f24077845b req-18594338-dad6-4c32-b153-d22f954a3c86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056934 Sep 18 01:42:47.916859 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2939/5911] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:42:48.614464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:42:48.614901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:42:48.615423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:42:48.615868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:42:48.616285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:42:48.628377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:48.630386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:48.630894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:48.631652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:48.632109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:48.632534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:48.663542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:42:48.668747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:42:48.681454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:42:48.683756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:42:48.728576 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-da3bf928-02f0-4573-a78d-9f0d62b313ef tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989870 Sep 18 01:42:48.729152 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2973/5912] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:42:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:42:48.740655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d7b6fdce-d5f1-460e-9382-3a94050a73a5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:48.741506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d7b6fdce-d5f1-460e-9382-3a94050a73a5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:48.800887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d7b6fdce-d5f1-460e-9382-3a94050a73a5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:48.810428 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d7b6fdce-d5f1-460e-9382-3a94050a73a5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1208 microversion: 2.1 time: 0.073876 Sep 18 01:42:48.811033 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2940/5913] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:48 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1208 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:42:49.834549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:49.835079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:49.842610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:49.843110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:49.843549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:49.844251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:49.844712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:49.845138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:49.921254 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:49.929419 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c719163-c84a-4804-bc7a-1493867a1677 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1260 microversion: 2.1 time: 0.099676 Sep 18 01:42:49.930410 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2974/5914] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:49 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1260 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:50.954847 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:50.955583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:50.969699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:50.972770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:50.973748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:50.974813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:50.975307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:50.975740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:51.243251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:51.256876 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b02139ae-d213-4c83-88ca-e6e452ce0f44 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1308 microversion: 2.1 time: 0.304724 Sep 18 01:42:51.256876 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2941/5915] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:50 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:51.698212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-7ef5ae5b-c798-4729-9da3-5183404fdf31 req-3beb4285-0638-45e0-90b5-978ed46e5da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbdd61f-b80f-438a-a12a-63d46ccfe34d", "tag": "d9088297-b707-4d95-a040-6af2096cde6e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:51.751836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7ef5ae5b-c798-4729-9da3-5183404fdf31 req-3beb4285-0638-45e0-90b5-978ed46e5da0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:51.752374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7ef5ae5b-c798-4729-9da3-5183404fdf31 req-3beb4285-0638-45e0-90b5-978ed46e5da0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:51.752755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7ef5ae5b-c798-4729-9da3-5183404fdf31 req-3beb4285-0638-45e0-90b5-978ed46e5da0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:51.768840 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-7ef5ae5b-c798-4729-9da3-5183404fdf31 req-3beb4285-0638-45e0-90b5-978ed46e5da0 service nova] Creating event network-changed:d9088297-b707-4d95-a040-6af2096cde6e for instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d on n-h2-master-1 Sep 18 01:42:51.779140 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-7ef5ae5b-c798-4729-9da3-5183404fdf31 req-3beb4285-0638-45e0-90b5-978ed46e5da0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093168 Sep 18 01:42:51.780008 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2975/5916] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:52.276818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:52.277483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:52.284791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:52.285398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:52.285886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:52.286599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:52.287310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:52.287608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:52.430319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:52.440048 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-738a7f42-8bc1-41a2-8f8d-a4c1e1e791ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1308 microversion: 2.1 time: 0.167551 Sep 18 01:42:52.440856 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2942/5917] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:52 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:53.481121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:53.481981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:53.488672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:53.489181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:53.489654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:53.490429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:53.490891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:53.491382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:53.507991 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:53.702740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:53.715371 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc626ccd-01ae-44f0-95ef-b29a9cc213c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1308 microversion: 2.1 time: 0.246922 Sep 18 01:42:53.715970 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2976/5918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:53 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:54.738720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:54.739326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:54.742487 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:54.748372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:54.748871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:54.749532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:54.750480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:54.750944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:54.751406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:54.901141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:54.909106 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2a607bd0-5bac-4f90-8738-27bff06bad87 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1308 microversion: 2.1 time: 0.174366 Sep 18 01:42:54.909704 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2943/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:54 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:55.934367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:55.935087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:55.942919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:55.943405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:55.943840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:55.944551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:55.945007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:55.945448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:56.123362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:56.132403 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f784f962-60eb-4a8a-bb0e-f1fcc1f67800 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1308 microversion: 2.1 time: 0.202529 Sep 18 01:42:56.133033 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2977/5920] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:55 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:57.155367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:57.155970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:57.162872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:57.163363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:57.163805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:57.164504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:57.165489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:57.165943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:57.304443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:57.313470 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f2e58ce-da59-409e-b7e0-a49ded0b8030 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1308 microversion: 2.1 time: 0.161965 Sep 18 01:42:57.314887 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2944/5921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:57 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:57.442749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-41ec4dd8-6bec-444b-bb01-32f8b5ce0833 req-592139b0-1d98-483e-a773-1413264fcd03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbdd61f-b80f-438a-a12a-63d46ccfe34d", "name": "network-vif-plugged", "status": "completed", "tag": "d9088297-b707-4d95-a040-6af2096cde6e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:57.452044 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:57.455975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41ec4dd8-6bec-444b-bb01-32f8b5ce0833 req-592139b0-1d98-483e-a773-1413264fcd03 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:57.456459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41ec4dd8-6bec-444b-bb01-32f8b5ce0833 req-592139b0-1d98-483e-a773-1413264fcd03 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:57.456894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41ec4dd8-6bec-444b-bb01-32f8b5ce0833 req-592139b0-1d98-483e-a773-1413264fcd03 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:57.470822 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-41ec4dd8-6bec-444b-bb01-32f8b5ce0833 req-592139b0-1d98-483e-a773-1413264fcd03 service nova] Creating event network-vif-plugged:d9088297-b707-4d95-a040-6af2096cde6e for instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d on n-h2-master-1 Sep 18 01:42:57.476163 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-41ec4dd8-6bec-444b-bb01-32f8b5ce0833 req-592139b0-1d98-483e-a773-1413264fcd03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037883 Sep 18 01:42:57.476773 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2978/5922] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:42:58.339352 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:58.340269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:58.346683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:58.347221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:58.347778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:58.348450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:58.348917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:58.349431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:58.491545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:58.501750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1877d100-99ab-47a3-8c45-8f89b0058d2f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1308 microversion: 2.1 time: 0.166280 Sep 18 01:42:58.502435 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2945/5923] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:58 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:59.523720 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:59.525505 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:59.530034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:59.530739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:59.538146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:59.538631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:59.539069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:59.539769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:59.540224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:59.540647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:59.686229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:42:59.694296 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d7c3e40-ba25-48cd-a7e6-24285b787a2b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1487 microversion: 2.1 time: 0.172478 Sep 18 01:42:59.694896 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2979/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:59 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1487 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:59.717024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:42:59.720049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:59.722091 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:42:59.728887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:59.729390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:59.729868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:59.730596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:59.731158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:59.731603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:59.800553 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-979cfac2-7db8-4bcc-9263-ebade320a924 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "PUT /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1082 microversion: 2.1 time: 0.087438 Sep 18 01:42:59.801748 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2946/5925] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:42:59 2022] PUT /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1082 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:42:59.820202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:42:59.820824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:42:59.841785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:59.847455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:59.848083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:42:59.849097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:42:59.851622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:42:59.852265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:00.001817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:00.010665 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-026b6a19-a0c8-4df4-8779-ea069dfb39b5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1508 microversion: 2.1 time: 0.194424 Sep 18 01:43:00.011343 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2980/5926] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:42:59 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:00.034203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:00.035061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:00.042779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:00.043894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:00.044613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:00.046130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:00.046816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:00.054207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:00.199151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:00.207853 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-35b7d3d7-6d96-49d3-b40e-316de580d48a tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1508 microversion: 2.1 time: 0.178846 Sep 18 01:43:00.208536 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2947/5927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:00 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:00.230170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:00.230695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:00.236855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:00.237334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:00.237796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:00.238494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:00.238943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:00.239372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:00.264950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:43:00.349602 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c452dfb8-55d6-41bb-b3a2-4f43c0dcd254 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 204 len: 0 microversion: 2.1 time: 0.123591 Sep 18 01:43:00.350592 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2981/5928] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:00 2022] DELETE /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:43:00.363761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:00.366289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:00.373732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:00.374225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:00.374869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:00.376312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:00.376786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:00.377203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:00.528288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:00.536785 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ded6ca8f-c597-42a6-8ec5-00f99e9763fa tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1514 microversion: 2.1 time: 0.179998 Sep 18 01:43:00.537461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2948/5929] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:00 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:01.561713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:01.563644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:01.570691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:01.571284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:01.571963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:01.572685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:01.573146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:01.573636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:01.730634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:01.738897 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07d22e13-d893-48aa-b6e3-aa6cee5adb0b tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1514 microversion: 2.1 time: 0.181499 Sep 18 01:43:01.739500 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2982/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:01 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:02.418369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-93df635f-83a5-4232-be2e-760d8ae04467 req-676a0c00-8c3e-4691-860d-119c9c58c673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbdd61f-b80f-438a-a12a-63d46ccfe34d", "name": "network-vif-deleted", "tag": "d9088297-b707-4d95-a040-6af2096cde6e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:02.433614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-93df635f-83a5-4232-be2e-760d8ae04467 req-676a0c00-8c3e-4691-860d-119c9c58c673 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:02.434446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-93df635f-83a5-4232-be2e-760d8ae04467 req-676a0c00-8c3e-4691-860d-119c9c58c673 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:02.435143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-93df635f-83a5-4232-be2e-760d8ae04467 req-676a0c00-8c3e-4691-860d-119c9c58c673 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:02.449865 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:02.453843 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-93df635f-83a5-4232-be2e-760d8ae04467 req-676a0c00-8c3e-4691-860d-119c9c58c673 service nova] Creating event network-vif-deleted:d9088297-b707-4d95-a040-6af2096cde6e for instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d on n-h2-master-1 Sep 18 01:43:02.471404 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-93df635f-83a5-4232-be2e-760d8ae04467 req-676a0c00-8c3e-4691-860d-119c9c58c673 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057949 Sep 18 01:43:02.472976 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2949/5931] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:43:02.763461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:02.764079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:02.773934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:02.774774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:02.775281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:02.776077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:02.776663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:02.777210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:02.813459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:02.813980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:02.814448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:02.814906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lazy-loading 'fault' on Instance uuid 1fbdd61f-b80f-438a-a12a-63d46ccfe34d {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:43:02.866316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:02.875348 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d96b7d6c-19e8-4496-9ced-b9cece3e1434 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 200 len: 1319 microversion: 2.1 time: 0.115767 Sep 18 01:43:02.875944 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2983/5932] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:02 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 1319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:03.901941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:03.903339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:03.910704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:03.911192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:03.911644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:03.912344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:03.912796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:03.913222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:03.932692 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d HTTP/1.1 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '1fbdd61f-b80f-438a-a12a-63d46ccfe34d'} Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:03.934401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:03.941456 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ed160e7f-cd4c-4ea1-ac5e-df6a132217a8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 404 len: 111 microversion: 2.1 time: 0.039462 Sep 18 01:43:03.946178 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2950/5933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:03 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:03.987351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1478381785", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "8cce45f3-fd67-4989-be92-4b9c4d8c8cff"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:04.045115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] validate_networks() for [('8cce45f3-fd67-4989-be92-4b9c4d8c8cff', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:43:04.426647 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:43:04.427076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:43:04.427554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:43:04.427968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:43:04.428416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:43:04.437795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:04.438286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:04.438747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:04.439480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:04.439940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:04.440369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:04.457318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:43:04.463531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Getting quotas for user 708cbba2f5044c419e02f1c6620f5dba and project c99f6a0ac6fc4712aac500be191494b7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:43:04.476793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:43:04.479721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:43:04.523727 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f31c3ae2-a55c-466d-a21e-580d4b430686 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540312 Sep 18 01:43:04.529602 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2984/5934] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:43:04.536897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9b29d06c-0522-4a9b-9036-51419a483ce7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:04.537867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9b29d06c-0522-4a9b-9036-51419a483ce7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:04.599555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9b29d06c-0522-4a9b-9036-51419a483ce7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:04.607999 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9b29d06c-0522-4a9b-9036-51419a483ce7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1209 microversion: 2.1 time: 0.075240 Sep 18 01:43:04.608827 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2951/5935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:04 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1209 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:05.632479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:05.634134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:05.642067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:05.642635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:05.643342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:05.644174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:05.644700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:05.645211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:05.759221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:05.768825 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f01eeb5e-e3f8-4878-b397-4b91129edcad tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1269 microversion: 2.1 time: 0.141504 Sep 18 01:43:05.770018 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2985/5936] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:05 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:06.798551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:06.800234 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:06.809166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:06.810399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:06.810399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:06.811209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:06.811697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:06.812129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:07.088714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:07.099861 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-66931175-ddf8-4290-aa37-03a7f2c62678 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1309 microversion: 2.1 time: 0.306702 Sep 18 01:43:07.107960 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2952/5937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:06 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1309 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:07.301959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-85cdd5c6-ed5a-4359-8bf9-6e2969b42518 req-b7faaca4-de8e-4437-9420-428e196461a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba88149-d34c-4263-a5ec-f90c274184f4", "tag": "20fd4044-fbf7-4af2-a0db-546f0f483d72"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:07.314724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85cdd5c6-ed5a-4359-8bf9-6e2969b42518 req-b7faaca4-de8e-4437-9420-428e196461a5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:07.315419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85cdd5c6-ed5a-4359-8bf9-6e2969b42518 req-b7faaca4-de8e-4437-9420-428e196461a5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:07.315852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-85cdd5c6-ed5a-4359-8bf9-6e2969b42518 req-b7faaca4-de8e-4437-9420-428e196461a5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:07.337446 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-85cdd5c6-ed5a-4359-8bf9-6e2969b42518 req-b7faaca4-de8e-4437-9420-428e196461a5 service nova] Creating event network-changed:20fd4044-fbf7-4af2-a0db-546f0f483d72 for instance dba88149-d34c-4263-a5ec-f90c274184f4 on n-h2-master-1 Sep 18 01:43:07.350555 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-85cdd5c6-ed5a-4359-8bf9-6e2969b42518 req-b7faaca4-de8e-4437-9420-428e196461a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052498 Sep 18 01:43:07.351179 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2986/5938] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:43:07.464833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:07.467432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:07.473997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:07.474481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:07.474922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:07.475835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:07.476283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:07.476929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:07.552675 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-970cbd6c-a300-422a-86cb-b71ca93aa79b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action" status: 200 len: 24570 microversion: 2.1 time: 0.091715 Sep 18 01:43:07.554336 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2953/5939] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:43:07 2022] POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:43:08.124683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:08.125780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:08.133249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:08.133964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:08.134558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:08.135523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:08.135993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:08.136417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:08.297533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:08.308894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c06170ab-8c09-43fd-a0b0-a73565f699a7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1309 microversion: 2.1 time: 0.185389 Sep 18 01:43:08.308894 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2987/5940] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:08 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:09.328908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:09.329848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:09.338160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:09.338676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:09.339119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:09.339851 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:09.340303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:09.340727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:09.571052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:09.581777 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7bfc10cd-9321-4564-8102-475c2be490d4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1309 microversion: 2.1 time: 0.257156 Sep 18 01:43:09.582448 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2954/5941] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:09 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:10.604624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:10.605240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:10.612341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:10.612816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:10.613247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:10.613953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:10.614402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:10.614816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:10.751583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:10.760625 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7e8e0c2-a575-4249-aadc-2a841d6fd280 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1309 microversion: 2.1 time: 0.159945 Sep 18 01:43:10.761215 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2988/5942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:10 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:11.783736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:11.784358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:11.791837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:11.792328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:11.792773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:11.793495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:11.793987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:11.794423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:11.941230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:11.949896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c7cbfa3-a10b-41b3-86c9-a882f8125b46 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1309 microversion: 2.1 time: 0.170248 Sep 18 01:43:11.950481 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2955/5943] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:11 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:12.972849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:12.973468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:12.981104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:12.981635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:12.982253 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:12.982971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:12.983436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:12.984463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:13.127884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:13.136971 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0c5aa337-adc3-4dcc-a984-be81912be506 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1309 microversion: 2.1 time: 0.168484 Sep 18 01:43:13.137664 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2989/5944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:12 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:13.529314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e471b080-3fae-4953-b009-d02384738c8e req-afa0b9fd-1378-4011-9614-ca4d9430a4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba88149-d34c-4263-a5ec-f90c274184f4", "name": "network-vif-plugged", "status": "completed", "tag": "20fd4044-fbf7-4af2-a0db-546f0f483d72"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:13.540929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e471b080-3fae-4953-b009-d02384738c8e req-afa0b9fd-1378-4011-9614-ca4d9430a4cf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:13.541658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e471b080-3fae-4953-b009-d02384738c8e req-afa0b9fd-1378-4011-9614-ca4d9430a4cf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:13.542275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e471b080-3fae-4953-b009-d02384738c8e req-afa0b9fd-1378-4011-9614-ca4d9430a4cf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:13.555597 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e471b080-3fae-4953-b009-d02384738c8e req-afa0b9fd-1378-4011-9614-ca4d9430a4cf service nova] Creating event network-vif-plugged:20fd4044-fbf7-4af2-a0db-546f0f483d72 for instance dba88149-d34c-4263-a5ec-f90c274184f4 on n-h2-master-1 Sep 18 01:43:13.561570 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e471b080-3fae-4953-b009-d02384738c8e req-afa0b9fd-1378-4011-9614-ca4d9430a4cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037740 Sep 18 01:43:13.562543 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2956/5945] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:43:14.161032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:14.161674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:14.170704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:14.171200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:14.171645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:14.172354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:14.172813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:14.173245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:14.309928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:14.318094 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-76fb719b-2900-4d41-88df-20b6b740a687 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1309 microversion: 2.1 time: 0.161404 Sep 18 01:43:14.318702 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2990/5946] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:14 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:15.341485 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:15.345769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:15.346465 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:15.353944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.354432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.354866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.355566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.356019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.356440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.493542 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:15.501509 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d2108d9-6b17-4e2b-95f5-28c7d1399f52 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1489 microversion: 2.1 time: 0.161786 Sep 18 01:43:15.502116 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2957/5947] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:15 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1489 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:15.524675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1570898313"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:15.527236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:15.529509 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:15.530199 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:15.536567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.537049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.537487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.538208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.538661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.539637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.610641 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b8c7fb7d-9229-45f5-b583-0dbcca654e79 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "PUT /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1074 microversion: 2.1 time: 0.090559 Sep 18 01:43:15.611299 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2991/5948] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:43:15 2022] PUT /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1074 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:15.630490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:15.631256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:15.639270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.639864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.640376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.641353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.641919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.642361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.777786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:15.785522 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6e5fb347-3040-4346-b305-bd94b3e56e16 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1500 microversion: 2.1 time: 0.159138 Sep 18 01:43:15.786112 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2958/5949] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:15 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:15.808144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:15.808782 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:15.814944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.815582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.815896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.816510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:15.817000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:15.817361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:15.834701 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:15.964717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:15.972925 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-272ffaec-116b-45ae-9e84-216e9cb689d2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1500 microversion: 2.1 time: 0.168983 Sep 18 01:43:15.973436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2992/5950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:15 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:15.994545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c8de7b2-6293-4725-82e3-0f2cf2edfa0d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:16.000608 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8de7b2-6293-4725-82e3-0f2cf2edfa0d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:16.001150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8de7b2-6293-4725-82e3-0f2cf2edfa0d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:16.001637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c8de7b2-6293-4725-82e3-0f2cf2edfa0d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:16.045451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c8de7b2-6293-4725-82e3-0f2cf2edfa0d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Going to try to stop instance {{(pid=122373) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 01:43:16.088689 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c8de7b2-6293-4725-82e3-0f2cf2edfa0d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "POST /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4/action" status: 202 len: 0 microversion: 2.1 time: 0.097944 Sep 18 01:43:16.089837 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2959/5951] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:43:15 2022] POST /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:43:16.098614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:16.099488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:16.106537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:16.107325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:16.107933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:16.109192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:16.109688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:16.110291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:16.260891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:16.269208 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-945e93db-b97f-4042-9dda-b1922f35b6f4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.174668 Sep 18 01:43:16.269829 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2993/5952] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:16 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:17.294516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:17.295272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:17.301771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:17.302252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:17.302682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:17.303367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:17.303818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:17.304237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:17.443477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:17.451756 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c2ed371-95cb-4cc2-a3a8-28a19505ac68 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.163000 Sep 18 01:43:17.452334 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2960/5953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:17 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:18.474251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:18.474865 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:18.482311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:18.482784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:18.483180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:18.483824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:18.484277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:18.484693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:18.594616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:18.595378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:18.603182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:18.604105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:18.604575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:18.605282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:18.606058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:18.606496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:18.623006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:18.631187 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0547f98c-32fe-4809-b2bd-d64a658e982c tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.160749 Sep 18 01:43:18.631700 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2994/5954] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:18 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:18.754373 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1e75a195-53b2-47f8-98e2-46e4acf4aeda tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1833 microversion: 2.1 time: 0.163909 Sep 18 01:43:18.754951 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2961/5955] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:18 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1833 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:18.778674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:18.779294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:18.785385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:18.785922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:18.786343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:18.787040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:18.787491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:18.787917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:18.935616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:18.943996 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70c5b51f-def9-40d2-81a1-ac4aaedbcc6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1682 microversion: 2.1 time: 0.169512 Sep 18 01:43:18.944667 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2995/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:18 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:19.060614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:19.063404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:19.070963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.071449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.071895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.072917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.073383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.073841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.144277 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd22e7b2-a97c-4c49-b01c-1bc64f25ff1c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action" status: 200 len: 32639 microversion: 2.1 time: 0.091073 Sep 18 01:43:19.144950 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2962/5957] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:43:19 2022] POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action => generated 32639 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:43:19.315842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:19.316420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:19.323273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.323752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.324192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.324886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.325341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.325795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.355478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6a4cfb3953842b9b48d4bb328c46877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989967c539e94ce5a90a77cef6c3faf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:19.356189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] flavor_id is None. Assuming migration. {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 18 01:43:19.357081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:43:19.494317 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63598434-a650-4523-bd03-edeead374c1e tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action" status: 202 len: 0 microversion: 2.1 time: 0.184572 Sep 18 01:43:19.495425 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2996/5958] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:43:19 2022] POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:43:19.505101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:19.505948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:19.516778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.517975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.518869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.519966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.520745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.521357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.658589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:19.660341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:19.673969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.675018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.675989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.677364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:19.678405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:19.679893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:19.701796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:19.717589 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1d24089e-e908-4c19-a4bd-36c9a1c6ec37 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1691 microversion: 2.1 time: 0.217535 Sep 18 01:43:19.732159 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2963/5959] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:19 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1691 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:19.857906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:19.867622 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f424161-45ca-4afa-9ffb-15a46c9040a0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.215730 Sep 18 01:43:19.868230 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2997/5960] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:19 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:20.745660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:20.746693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:20.755505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:20.756092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:20.756718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:20.758105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:20.758666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:20.759173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:20.891770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:20.892417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:20.900228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:20.900700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:20.901346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:20.902280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:20.902732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:20.903163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:20.914798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:20.924583 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-513318f0-13da-4fed-b339-ead2654015b2 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1691 microversion: 2.1 time: 0.184007 Sep 18 01:43:20.932799 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2964/5961] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:20 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:21.066547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:21.088648 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f0d48416-400e-4ee5-92ac-2ace94e32dd0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.199128 Sep 18 01:43:21.091721 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2998/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:20 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:21.949631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:21.950361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:21.957738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:21.958273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:21.958644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:21.959642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:21.960068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:21.960495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:22.118142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:22.126815 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6ea36db4-3589-4239-bcff-1fcd0402150b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.181160 Sep 18 01:43:22.127929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:22.128961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:22.137385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:22.138046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:22.138585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:22.138867 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2965/5963] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:21 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:22.139499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:22.140061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:22.140588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:22.296175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:22.304077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-adf4c776-538e-44f1-8789-bfb384d7d0f0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.180347 Sep 18 01:43:22.304630 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 2999/5964] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:22 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:23.152555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:23.153301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:23.160138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:23.160625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:23.161066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:23.161797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:23.162257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:23.162687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:23.299833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:23.308578 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96ad8ca9-7666-4874-866b-a6eb33265ded tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.160205 Sep 18 01:43:23.309160 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2966/5965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:23 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:23.326731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:23.327461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:23.334281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:23.334760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:23.335192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:23.335912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:23.336365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:23.336784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:23.468585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:23.477358 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-24f26d0f-4c74-48f6-aebf-31c44be5c2bd tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.154462 Sep 18 01:43:23.477972 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3000/5966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:23 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:24.333123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:24.333676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:24.341658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:24.342157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:24.342629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:24.343331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:24.343795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:24.344233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:24.484330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:24.492708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-785c5522-0893-48a6-b285-478080139cce tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.163556 Sep 18 01:43:24.493288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2967/5967] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:24 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:24.501147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:24.501790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:24.510826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:24.511117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:24.511547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:24.512225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:24.512679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:24.513093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:24.647360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:24.655651 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-262bbb58-562e-438a-bcd6-c6127dd376c7 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.158398 Sep 18 01:43:24.656237 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3001/5968] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:24 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:25.516490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:25.517004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:25.519980 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=52 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:25.526167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:25.526659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:25.527101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:25.527828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:25.528282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:25.528709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:25.545033 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:25.670383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:25.678665 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b1eba358-c88c-450b-855f-c6a04f31d001 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.166171 Sep 18 01:43:25.679191 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2968/5969] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:25 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:25.679846 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:25.680757 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:25.688417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:25.689113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:25.689679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:25.690659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:25.691202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:25.691732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:25.843773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:25.866101 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-581c652a-6539-49de-9af3-7d393f1dbb64 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.190372 Sep 18 01:43:25.867088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3002/5970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:25 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:26.713851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:26.714462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:26.721427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:26.721938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:26.722379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:26.723080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:26.723541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:26.723975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:26.873599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:26.882296 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fabe471-f82c-4500-a7fb-fa6977df0f66 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.172879 Sep 18 01:43:26.890701 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2969/5971] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:26 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:26.890867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:26.890867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:26.898517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:26.899416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:26.899857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:26.900565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:26.901025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:26.901449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:27.037901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:27.046766 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31b76bbe-4501-47f3-8a85-e2608defaa21 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.160390 Sep 18 01:43:27.047358 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3003/5972] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:26 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:27.906701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:27.907301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:27.916746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:27.917254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:27.917736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:27.918441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:27.918917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:27.919338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:28.054434 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:28.063905 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-92efa9de-69e6-4d57-b99a-db7b91a2e1a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.161086 Sep 18 01:43:28.064858 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2970/5973] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:27 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:28.071808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:28.072548 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:28.083161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:28.084080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:28.084871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:28.086267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:28.087077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:28.087523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:28.231271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:28.239299 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d760ff43-b49a-4348-bede-8d95f26cf3c0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.171720 Sep 18 01:43:28.239891 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3004/5974] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:28 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:29.089076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:29.089972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:29.097679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:29.098185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:29.098624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:29.099349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:29.099806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:29.100230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:29.262830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:29.263483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:29.264042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:29.271102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:29.271861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:29.272305 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e3adcc3-45e1-4f02-b9c5-3d1b0f17472a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.188119 Sep 18 01:43:29.272999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:29.273453 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2971/5975] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:29 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:29.273731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:29.274449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:29.274883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:29.423224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:29.433381 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee668416-a79c-4814-b469-c1c3c38d90c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.174590 Sep 18 01:43:29.434296 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3005/5976] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:29 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:30.297790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:30.298335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:30.306091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:30.306583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:30.307025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:30.307734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:30.308198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:30.308627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:30.452190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:30.458353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:30.458968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:30.460990 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-55b6645c-23bf-4394-9752-d4c3924c2ff5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.167154 Sep 18 01:43:30.461866 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:30.462256 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2972/5977] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:30 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:30.475710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:30.476865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:30.477295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:30.478024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:30.478487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:30.478909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:30.622916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:30.631166 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7c82bb43-5628-4f0e-a215-dc6e190b333e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.176877 Sep 18 01:43:30.631693 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3006/5978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:30 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:31.488377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:31.488970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:31.495962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:31.496449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:31.496890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:31.497599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:31.498059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:31.498513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:31.639485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:31.647666 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f96992c-0452-44d1-8a18-f641e0cacd72 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.163172 Sep 18 01:43:31.648249 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2973/5979] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:31 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:31.654771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:31.655382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:31.662189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:31.662675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:31.663145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:31.663845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:31.664297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:31.664725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:31.679748 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:31.799869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:31.807781 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-97d30211-04be-4ef7-b9e6-226cfddbf379 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.156971 Sep 18 01:43:31.808367 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3007/5980] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:31 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:32.675692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:32.675692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:32.681748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:32.682104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:32.682876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:32.683209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:32.683661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:32.684083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:32.832352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:32.832971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:32.840564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:32.841058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:32.841489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:32.842237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:32.842690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:32.843113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:32.844165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:32.852911 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94f87482-c8d7-45c0-aa80-62d114149103 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.184484 Sep 18 01:43:32.857979 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2974/5981] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:32 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:32.995193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:33.003158 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4670b319-771a-492b-988a-1172173ca054 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.174785 Sep 18 01:43:33.003742 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3008/5982] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:32 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:33.878419 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:33.879100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:33.887204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:33.887890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:33.888528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:33.889407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:33.890390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:33.890975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:34.037714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:34.039730 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:34.053762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:34.054829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:34.055846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:34.056296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:34.057155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:34.058059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:34.059166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:34.065573 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1726be7e-2c2a-470f-8490-057d735ead53 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1696 microversion: 2.1 time: 0.191590 Sep 18 01:43:34.067118 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2975/5983] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:33 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:34.327491 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:34.335750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-555f1b94-43d2-45f4-b77d-91a986d8dff4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.308761 Sep 18 01:43:34.336610 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3009/5984] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:34 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:34.661728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2bd64c81-c19e-40db-8601-8591f9386bb7 req-5d90b616-874d-4b78-80eb-cd2ee46852a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "name": "network-vif-unplugged", "status": "completed", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:34.673220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2bd64c81-c19e-40db-8601-8591f9386bb7 req-5d90b616-874d-4b78-80eb-cd2ee46852a6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:34.673973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2bd64c81-c19e-40db-8601-8591f9386bb7 req-5d90b616-874d-4b78-80eb-cd2ee46852a6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:34.674409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2bd64c81-c19e-40db-8601-8591f9386bb7 req-5d90b616-874d-4b78-80eb-cd2ee46852a6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:34.689182 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2bd64c81-c19e-40db-8601-8591f9386bb7 req-5d90b616-874d-4b78-80eb-cd2ee46852a6 service nova] Creating event network-vif-unplugged:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h2-master-1 Sep 18 01:43:34.696467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-2bd64c81-c19e-40db-8601-8591f9386bb7 req-5d90b616-874d-4b78-80eb-cd2ee46852a6 service nova] Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:43:34.708328 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2bd64c81-c19e-40db-8601-8591f9386bb7 req-5d90b616-874d-4b78-80eb-cd2ee46852a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050426 Sep 18 01:43:34.708949 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2976/5985] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:43:35.103040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:35.104018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:35.110747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:35.111151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:35.111600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:35.112313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:35.112774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:35.113200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:35.361296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:35.362238 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:35.369640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:35.370201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:35.370767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:35.371583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:35.372284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:35.373196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:35.375871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:35.393021 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-035bc047-d872-4617-8c25-30ed33b1b2f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1695 microversion: 2.1 time: 0.295381 Sep 18 01:43:35.394200 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3010/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:35 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1695 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:35.674339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:35.685679 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bcd5bcbb-e6bc-4238-bfb9-29150b67364e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.329726 Sep 18 01:43:35.686948 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2977/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:35 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:36.420384 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:36.421426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:36.431160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:36.431870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:36.432481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:36.433768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:36.435165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:36.435616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:36.632449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:36.640828 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-efc2219d-72b6-468a-9d12-2a5ebefee200 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1695 microversion: 2.1 time: 0.225302 Sep 18 01:43:36.641434 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3011/5988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:36 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:36.713721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:36.714390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:36.721399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:36.721927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:36.722377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:36.723169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:36.723662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:36.724096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:36.747035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-67a02f1f-16bc-4d21-b882-dfb47183d9b8 req-e5d9d543-c1f1-46a9-8f10-ec97b126b6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:36.757605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67a02f1f-16bc-4d21-b882-dfb47183d9b8 req-e5d9d543-c1f1-46a9-8f10-ec97b126b6e1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:36.758096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67a02f1f-16bc-4d21-b882-dfb47183d9b8 req-e5d9d543-c1f1-46a9-8f10-ec97b126b6e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:36.758527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67a02f1f-16bc-4d21-b882-dfb47183d9b8 req-e5d9d543-c1f1-46a9-8f10-ec97b126b6e1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:36.771740 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-67a02f1f-16bc-4d21-b882-dfb47183d9b8 req-e5d9d543-c1f1-46a9-8f10-ec97b126b6e1 service nova] Creating event network-changed:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h2-master-1 Sep 18 01:43:36.779458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-67a02f1f-16bc-4d21-b882-dfb47183d9b8 req-e5d9d543-c1f1-46a9-8f10-ec97b126b6e1 service nova] Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:43:36.797726 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-67a02f1f-16bc-4d21-b882-dfb47183d9b8 req-e5d9d543-c1f1-46a9-8f10-ec97b126b6e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054533 Sep 18 01:43:36.798705 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3012/5989] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:43:36.927557 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:36.939311 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f837b18-77e6-48a0-aecf-4dc74b835e84 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.230198 Sep 18 01:43:36.954160 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2978/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:36 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:37.667812 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:37.668547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:37.675672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:37.676177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:37.676626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:37.677348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:37.677847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:37.678305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:37.837637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:37.847309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c9851c86-4a99-4bc4-ba76-1e7d7974d8d5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1693 microversion: 2.1 time: 0.184480 Sep 18 01:43:37.848139 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3013/5991] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:37 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:37.966403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:37.967032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:37.974471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:37.974966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:37.975423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:37.976133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:37.976592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:37.977014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:38.252676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:38.262893 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ce454794-e88b-4f06-a3c1-4f2dbeaf21c4 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.301404 Sep 18 01:43:38.264044 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2979/5992] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:37 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:38.871973 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:38.872589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:38.888951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:38.889437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:38.889902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:38.890610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:38.891066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:38.891492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:39.076593 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:39.088522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53d36235-32f9-4dda-9d64-bb40061cf8bc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1690 microversion: 2.1 time: 0.220358 Sep 18 01:43:39.089258 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3014/5993] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:38 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:39.112070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:39.112989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:39.125320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:39.129091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:39.129666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:39.130439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:39.130917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:39.131885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:39.270731 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e5b29ed-df74-4574-bd2a-9db2b9468284 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action" status: 202 len: 0 microversion: 2.1 time: 0.161489 Sep 18 01:43:39.271107 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2980/5994] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:43:39 2022] POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:43:39.284644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:39.285268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:39.292301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:39.292301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:39.292680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:39.293367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:39.293863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:39.294897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:39.299760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:39.301059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:39.310729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:39.311464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:39.312048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:39.312837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:39.313358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:39.313882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:39.683895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:39.698474 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a32af5de-2bdf-4122-9ca3-cf3dcc8885d0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.411471 Sep 18 01:43:39.700106 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2981/5995] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:39 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:39.730405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:39.750144 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-14ebc33e-2ba1-4db1-b3d9-5c73177a0eb7 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1689 microversion: 2.1 time: 0.473137 Sep 18 01:43:39.777960 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3015/5996] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:39 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1689 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:40.726664 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:40.727847 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:40.742946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:40.743597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:40.744348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:40.745401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:40.746973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:40.746973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:40.806402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:40.808224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:40.819693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:40.820366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:40.821155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:40.822500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:40.824062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:40.824797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:41.020405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:41.030227 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-358d347b-0cd5-4403-bbda-ff880928a30d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.308642 Sep 18 01:43:41.031367 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2982/5997] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:40 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:41.064379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:41.075950 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b274c05-d701-4aea-86e1-becf7f2797bd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1689 microversion: 2.1 time: 0.277334 Sep 18 01:43:41.076534 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3016/5998] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:40 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:41.751005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-412f6676-83fc-414e-8286-d2ada7fc2c4f req-c285ae09-6030-4459-b02e-df8d39681e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "name": "network-vif-plugged", "status": "completed", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:41.765318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-412f6676-83fc-414e-8286-d2ada7fc2c4f req-c285ae09-6030-4459-b02e-df8d39681e2e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:41.765836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-412f6676-83fc-414e-8286-d2ada7fc2c4f req-c285ae09-6030-4459-b02e-df8d39681e2e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:41.766393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-412f6676-83fc-414e-8286-d2ada7fc2c4f req-c285ae09-6030-4459-b02e-df8d39681e2e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:41.781348 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-412f6676-83fc-414e-8286-d2ada7fc2c4f req-c285ae09-6030-4459-b02e-df8d39681e2e service nova] Creating event network-vif-plugged:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h2-master-1 Sep 18 01:43:41.784402 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:41.788714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-412f6676-83fc-414e-8286-d2ada7fc2c4f req-c285ae09-6030-4459-b02e-df8d39681e2e service nova] Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:43:41.804278 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-412f6676-83fc-414e-8286-d2ada7fc2c4f req-c285ae09-6030-4459-b02e-df8d39681e2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058007 Sep 18 01:43:41.804895 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2983/5999] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:43:42.056452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:42.057123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:42.067288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:42.068294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:42.069029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:42.070326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:42.071139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:42.072029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:42.104159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:42.105643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:42.115308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:42.116736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:42.117573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:42.119606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:42.121777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:42.123026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:42.347482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:42.356522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e11cfaea-e78e-4644-9814-5801d1be570f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.306447 Sep 18 01:43:42.357318 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3017/6000] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:42 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:42.380731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:42.389806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-14a0d6b8-5111-4414-8fb9-b6723ba09a58 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1689 microversion: 2.1 time: 0.292792 Sep 18 01:43:42.393904 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2984/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:42 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1689 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:43.381207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:43.381207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:43.388367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:43.388790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:43.389221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:43.389945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:43.390400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:43.390818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:43.417581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:43.418210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:43.427279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:43.427971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:43.428223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:43.429175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:43.429679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:43.430126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:43.615950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:43.628518 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0494fa73-7f1b-4fc2-a90a-3280f93c9eec tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.251898 Sep 18 01:43:43.641696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:43.642157 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3018/6002] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:43 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:43.661607 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7b1b4599-efab-47ef-ad62-fbeea6ded682 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1689 microversion: 2.1 time: 0.242658 Sep 18 01:43:43.675734 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2985/6003] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:43 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:44.488809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8d381a93-78e1-4ef9-8062-d3edd0e135b9 req-2c789cdd-774e-4f92-8f9f-6fb5cdfa6935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "name": "network-vif-unplugged", "status": "completed", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:44.500707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8d381a93-78e1-4ef9-8062-d3edd0e135b9 req-2c789cdd-774e-4f92-8f9f-6fb5cdfa6935 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:44.501301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8d381a93-78e1-4ef9-8062-d3edd0e135b9 req-2c789cdd-774e-4f92-8f9f-6fb5cdfa6935 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:44.502015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8d381a93-78e1-4ef9-8062-d3edd0e135b9 req-2c789cdd-774e-4f92-8f9f-6fb5cdfa6935 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:44.515390 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8d381a93-78e1-4ef9-8062-d3edd0e135b9 req-2c789cdd-774e-4f92-8f9f-6fb5cdfa6935 service nova] Creating event network-vif-unplugged:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:43:44.521231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-8d381a93-78e1-4ef9-8062-d3edd0e135b9 req-2c789cdd-774e-4f92-8f9f-6fb5cdfa6935 service nova] Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:43:44.533134 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8d381a93-78e1-4ef9-8062-d3edd0e135b9 req-2c789cdd-774e-4f92-8f9f-6fb5cdfa6935 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048649 Sep 18 01:43:44.534819 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3019/6004] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:43:44.655163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:44.656427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:44.664550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:44.665047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:44.665488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:44.666239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:44.666694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:44.667138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:44.686225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:44.686835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:44.698689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:44.699602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:44.700295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:44.701825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:44.702607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:44.703787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:44.854591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:44.869164 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f390b5c-6c00-439c-888a-7890eea109c5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.218153 Sep 18 01:43:44.870301 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2986/6005] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:44 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:44.912218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:44.921513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2b3d3fe-e184-4cb1-8d00-212fab1c724b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1689 microversion: 2.1 time: 0.239589 Sep 18 01:43:44.922212 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3020/6006] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:44 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1689 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:45.892490 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:45.893112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:45.900436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:45.900925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:45.901371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:45.902106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:45.902569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:45.903002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:45.944897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:45.946171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:45.953443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:45.954101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:45.954547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:45.955255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:45.955711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:45.956137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:46.104131 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:46.113267 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72b99bcf-b41b-479d-bb80-53e4b9302e26 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1510 microversion: 2.1 time: 0.224751 Sep 18 01:43:46.113899 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2987/6007] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:45 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:46.131372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:46.139791 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-506f8e59-56ad-408a-a236-c03e1711c8ef tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1689 microversion: 2.1 time: 0.199306 Sep 18 01:43:46.140376 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3021/6008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:45 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:46.551981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5b6243da-c00c-4168-8d38-93ceccd8f8e3 req-3532cfba-5c1a-4cd5-b55a-751148db6fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:46.563120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5b6243da-c00c-4168-8d38-93ceccd8f8e3 req-3532cfba-5c1a-4cd5-b55a-751148db6fca service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:46.563663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5b6243da-c00c-4168-8d38-93ceccd8f8e3 req-3532cfba-5c1a-4cd5-b55a-751148db6fca service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:46.564254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5b6243da-c00c-4168-8d38-93ceccd8f8e3 req-3532cfba-5c1a-4cd5-b55a-751148db6fca service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:46.581139 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5b6243da-c00c-4168-8d38-93ceccd8f8e3 req-3532cfba-5c1a-4cd5-b55a-751148db6fca service nova] Creating event network-changed:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:43:46.589057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-5b6243da-c00c-4168-8d38-93ceccd8f8e3 req-3532cfba-5c1a-4cd5-b55a-751148db6fca service nova] Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 01:43:46.607030 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5b6243da-c00c-4168-8d38-93ceccd8f8e3 req-3532cfba-5c1a-4cd5-b55a-751148db6fca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058906 Sep 18 01:43:46.607840 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2988/6009] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:43:47.137454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:47.138723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:47.148187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.154593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.155260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.156190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.156814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.157444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.163495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:47.164805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:47.183235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.183740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.184189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.184911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.185374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.185827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.478266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:47.480025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:47.488251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-35bcc890-6e58-4638-a09a-d8dd2c2b3848 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1689 microversion: 2.1 time: 0.328963 Sep 18 01:43:47.497632 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f870a15e-863e-4b14-9d41-d0dc4730e8fc tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1487 microversion: 2.1 time: 0.355492 Sep 18 01:43:47.497632 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3022/6010] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:47 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1487 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:47.498062 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2989/6011] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:47 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1689 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:47.512903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1569630486"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:47.515685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:47.522656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.523142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.523840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.524587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.525039 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.525458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.594507 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3585032-d868-48d2-9896-235c37709410 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "PUT /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1060 microversion: 2.1 time: 0.085730 Sep 18 01:43:47.595181 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3023/6012] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 01:43:47 2022] PUT /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1060 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:47.614396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:47.614941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:47.622055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.622537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.622979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.623678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.624138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.624567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.762636 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:47.770718 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ea1f7a3-d754-495e-bbe5-da8474d9e442 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1487 microversion: 2.1 time: 0.160365 Sep 18 01:43:47.771308 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2990/6013] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:47 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1487 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:47.793814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:47.794428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:47.800526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.801010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.801445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.802161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.802616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.803070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.805799 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:47.952404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:47.961272 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4835a0d-fe9f-4c35-810a-216aaa1165e8 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1487 microversion: 2.1 time: 0.171348 Sep 18 01:43:47.961912 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3024/6014] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:47 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1487 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:47.982934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:47.983424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:47.989843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.990866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.991301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:47.991990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:47.992445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:47.992864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:48.020282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:43:48.101905 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-753928dd-f62c-44b1-8d57-013d9b521216 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 204 len: 0 microversion: 2.1 time: 0.122529 Sep 18 01:43:48.102595 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2991/6015] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:47 2022] DELETE /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:43:48.111765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:48.112418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:48.119089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:48.119576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:48.120011 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:48.120752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:48.121201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:48.121685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:48.265243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:48.274783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb089021-2e03-4a65-b30f-9298869c060e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1493 microversion: 2.1 time: 0.167570 Sep 18 01:43:48.275421 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3025/6016] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:48 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1493 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:48.513647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:48.514454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:48.521479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:48.521954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:48.522390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:48.523088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:48.523799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:48.524216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:48.661376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:48.669611 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6bb3025d-bffd-4189-95e0-2bbd1ebb9778 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1682 microversion: 2.1 time: 0.160295 Sep 18 01:43:48.670212 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2992/6017] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:48 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:49.301072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:49.301924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:49.309971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:49.310468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:49.310907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:49.311625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:49.312085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:49.312514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:49.455557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:49.464125 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c42f0a72-0c4f-49bb-8b87-2d08cf90f5ba tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1493 microversion: 2.1 time: 0.167089 Sep 18 01:43:49.464987 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3026/6018] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:49 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1493 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:50.071466 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-50fe5eee-0ff8-4be7-8180-e7b9f4758566 req-0f259763-acb4-48f6-8a1d-1fd08cc3b610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba88149-d34c-4263-a5ec-f90c274184f4", "name": "network-vif-deleted", "tag": "20fd4044-fbf7-4af2-a0db-546f0f483d72"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:50.083314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-50fe5eee-0ff8-4be7-8180-e7b9f4758566 req-0f259763-acb4-48f6-8a1d-1fd08cc3b610 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:50.084227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-50fe5eee-0ff8-4be7-8180-e7b9f4758566 req-0f259763-acb4-48f6-8a1d-1fd08cc3b610 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:50.084671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-50fe5eee-0ff8-4be7-8180-e7b9f4758566 req-0f259763-acb4-48f6-8a1d-1fd08cc3b610 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:50.097576 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-50fe5eee-0ff8-4be7-8180-e7b9f4758566 req-0f259763-acb4-48f6-8a1d-1fd08cc3b610 service nova] Creating event network-vif-deleted:20fd4044-fbf7-4af2-a0db-546f0f483d72 for instance dba88149-d34c-4263-a5ec-f90c274184f4 on n-h2-master-1 Sep 18 01:43:50.102745 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-50fe5eee-0ff8-4be7-8180-e7b9f4758566 req-0f259763-acb4-48f6-8a1d-1fd08cc3b610 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036158 Sep 18 01:43:50.103678 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2993/6019] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:43:50.492744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:50.494101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:50.501533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:50.502195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:50.502929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:50.504137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:50.505010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:50.505620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:50.540831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:50.541323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:50.541808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:50.542293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lazy-loading 'fault' on Instance uuid dba88149-d34c-4263-a5ec-f90c274184f4 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:43:50.586136 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:50.595303 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3f26793a-7ab9-4daf-b8c1-bdd6b62b5ef1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 200 len: 1310 microversion: 2.1 time: 0.110533 Sep 18 01:43:50.595893 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3027/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:50 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 1310 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:51.383976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ff54d40d-43e0-4315-ad26-4648b094ab81 req-b02a08a5-81ba-404d-bc2e-d4f97786ae46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "name": "network-vif-plugged", "status": "completed", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:51.394544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ff54d40d-43e0-4315-ad26-4648b094ab81 req-b02a08a5-81ba-404d-bc2e-d4f97786ae46 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.395834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ff54d40d-43e0-4315-ad26-4648b094ab81 req-b02a08a5-81ba-404d-bc2e-d4f97786ae46 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.396986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ff54d40d-43e0-4315-ad26-4648b094ab81 req-b02a08a5-81ba-404d-bc2e-d4f97786ae46 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.408811 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ff54d40d-43e0-4315-ad26-4648b094ab81 req-b02a08a5-81ba-404d-bc2e-d4f97786ae46 service nova] Creating event network-vif-plugged:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:43:51.414999 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ff54d40d-43e0-4315-ad26-4648b094ab81 req-b02a08a5-81ba-404d-bc2e-d4f97786ae46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035949 Sep 18 01:43:51.415610 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2994/6021] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:43:51.619621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.620145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.627304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.627893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.628334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.629044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.629506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.630002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.646110 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 HTTP/1.1 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: exception: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'dba88149-d34c-4263-a5ec-f90c274184f4'} Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.648301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-decbda47-bc30-44dd-b9d1-8bbef694707e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 404 len: 111 microversion: 2.1 time: 0.034560 Sep 18 01:43:51.654511 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3028/6022] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:51 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.668770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.669528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.676177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.676673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.677111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.677859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.678318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.678748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.693455 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 HTTP/1.1 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: exception: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'dba88149-d34c-4263-a5ec-f90c274184f4'} Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.695193 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-37dab7e3-89da-458a-98ee-7f6ac7266f9f tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 404 len: 111 microversion: 2.1 time: 0.032323 Sep 18 01:43:51.699973 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2995/6023] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:51 2022] DELETE /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.705802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.706566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: dba88149-d34c-4263-a5ec-f90c274184f4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.713444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.713996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.714433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.715134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.715588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.716014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.732164 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 HTTP/1.1 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: exception: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'dba88149-d34c-4263-a5ec-f90c274184f4'} Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.733763 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance dba88149-d34c-4263-a5ec-f90c274184f4 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8bdf12e0-dd8b-4d7f-bba5-656769f7aadf tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4" status: 404 len: 111 microversion: 2.1 time: 0.033319 Sep 18 01:43:51.738565 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3029/6024] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:51 2022] GET /compute/v2.1/servers/dba88149-d34c-4263-a5ec-f90c274184f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.747714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.748164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.754583 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.755070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.755506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.756194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.756643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.757062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.772332 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d HTTP/1.1 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '1fbdd61f-b80f-438a-a12a-63d46ccfe34d'} Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.774219 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c352377-e1e0-48a7-b3e9-8bafb595c518 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 404 len: 111 microversion: 2.1 time: 0.031914 Sep 18 01:43:51.778366 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2996/6025] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:51 2022] DELETE /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.784486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.785098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 1fbdd61f-b80f-438a-a12a-63d46ccfe34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.795403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.795891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.796457 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.797191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.797734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.798140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.812186 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d HTTP/1.1 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1fbdd61f-b80f-438a-a12a-63d46ccfe34d'} Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.814077 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 1fbdd61f-b80f-438a-a12a-63d46ccfe34d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c801f7d3-99ca-44dc-b46e-0e1fd020de3d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d" status: 404 len: 111 microversion: 2.1 time: 0.034806 Sep 18 01:43:51.818929 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3030/6026] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:51 2022] GET /compute/v2.1/servers/1fbdd61f-b80f-438a-a12a-63d46ccfe34d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.825017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.825513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.831683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.832161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.832591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.833282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.833776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.834831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.848633 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 HTTP/1.1 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4f063d40-0621-48ff-a100-7cd9b45ad675'} Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.850277 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac2068ed-3bbd-4864-9a18-4f1b5d0bb046 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 404 len: 111 microversion: 2.1 time: 0.030546 Sep 18 01:43:51.854939 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2997/6027] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:51 2022] DELETE /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.860145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.860753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4f063d40-0621-48ff-a100-7cd9b45ad675] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.866855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.867335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.867765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.868451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.868899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.869404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.884186 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 HTTP/1.1 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4f063d40-0621-48ff-a100-7cd9b45ad675'} Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.885753 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 4f063d40-0621-48ff-a100-7cd9b45ad675 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4541465e-e5dc-4a8f-b2ef-3e480eb44801 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675" status: 404 len: 111 microversion: 2.1 time: 0.030836 Sep 18 01:43:51.891587 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3031/6028] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:51 2022] GET /compute/v2.1/servers/4f063d40-0621-48ff-a100-7cd9b45ad675 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.895854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.897033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.903458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.903939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.904377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.905063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.905519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.905972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.919489 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 HTTP/1.1 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8b7cfe5e-2945-48c9-9e27-35317f17adc9'} Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.921043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3acf75bb-53f0-4dc8-a2d4-847d81b6117e tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 404 len: 111 microversion: 2.1 time: 0.030421 Sep 18 01:43:51.926288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2998/6029] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:51 2022] DELETE /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:43:51.932419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.933106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 8b7cfe5e-2945-48c9-9e27-35317f17adc9] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.939311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.939729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.940161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.940841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.941291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.941742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.955971 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 HTTP/1.1 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8b7cfe5e-2945-48c9-9e27-35317f17adc9'} Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.957471 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 8b7cfe5e-2945-48c9-9e27-35317f17adc9 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-97cd53b8-dbb7-4a1b-9c92-e20b891e6d58 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9" status: 404 len: 111 microversion: 2.1 time: 0.030275 Sep 18 01:43:51.962312 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3032/6030] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:51 2022] GET /compute/v2.1/servers/8b7cfe5e-2945-48c9-9e27-35317f17adc9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:51.967964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:51.968452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:51.974532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.975011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.975436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.976121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:51.976567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:51.976987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:51.991078 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a HTTP/1.1 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: exception: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'bfdb8951-232a-4a15-81f0-2981ec7c657a'} Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:51.992652 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-260b7553-cf6e-46a3-b4e8-6a993e953ac5 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 404 len: 111 microversion: 2.1 time: 0.029936 Sep 18 01:43:51.997013 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 2999/6031] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:51 2022] DELETE /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:43:52.003313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:52.003944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: bfdb8951-232a-4a15-81f0-2981ec7c657a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:52.010687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.011175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.011615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.012307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.012768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.013196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.028129 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a HTTP/1.1 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: exception: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'bfdb8951-232a-4a15-81f0-2981ec7c657a'} Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.029724 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance bfdb8951-232a-4a15-81f0-2981ec7c657a could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a359188-8409-4848-b84d-9dd6ce80393d tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a" status: 404 len: 111 microversion: 2.1 time: 0.031725 Sep 18 01:43:52.034952 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3033/6032] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:51 2022] GET /compute/v2.1/servers/bfdb8951-232a-4a15-81f0-2981ec7c657a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:52.040297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:52.040789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:52.046929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.047413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.047841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.048545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.048975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.049391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.062983 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 HTTP/1.1 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '4d7130e6-c12f-41ca-b8aa-6157fdd1edf8'} Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:52.064545 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d52bc9e-b9fa-46c7-869f-a81c9458cb93 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 404 len: 111 microversion: 2.1 time: 0.029727 Sep 18 01:43:52.070107 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3000/6033] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:52 2022] DELETE /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:52.075914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:52.076559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:52.082714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.083203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.083646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.085169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.085476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.085929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.100989 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 HTTP/1.1 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '4d7130e6-c12f-41ca-b8aa-6157fdd1edf8'} Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.102538 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd8b4783-9122-4909-be66-c433d88a15c6 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8" status: 404 len: 111 microversion: 2.1 time: 0.031920 Sep 18 01:43:52.106904 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3034/6034] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:52 2022] GET /compute/v2.1/servers/4d7130e6-c12f-41ca-b8aa-6157fdd1edf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:52.112585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88992996-3304-4e91-8feb-54ba8ab08ff2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:52.113086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-88992996-3304-4e91-8feb-54ba8ab08ff2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:52.118815 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-88992996-3304-4e91-8feb-54ba8ab08ff2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88992996-3304-4e91-8feb-54ba8ab08ff2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f HTTP/1.1 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '074876a0-ddcf-4c3b-ba35-7068f9ec3e6f'} Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.120318 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88992996-3304-4e91-8feb-54ba8ab08ff2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88992996-3304-4e91-8feb-54ba8ab08ff2 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f" status: 404 len: 111 microversion: 2.1 time: 0.013236 Sep 18 01:43:52.125133 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3001/6035] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:52 2022] DELETE /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:43:52.130470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4eb15f6-9acc-4fdb-b300-b8e7f25bec56 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:52.131568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a4eb15f6-9acc-4fdb-b300-b8e7f25bec56 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:52.137045 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-a4eb15f6-9acc-4fdb-b300-b8e7f25bec56 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4eb15f6-9acc-4fdb-b300-b8e7f25bec56 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f HTTP/1.1 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '074876a0-ddcf-4c3b-ba35-7068f9ec3e6f'} Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:52.138546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4eb15f6-9acc-4fdb-b300-b8e7f25bec56 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance 074876a0-ddcf-4c3b-ba35-7068f9ec3e6f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a4eb15f6-9acc-4fdb-b300-b8e7f25bec56 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f" status: 404 len: 111 microversion: 2.1 time: 0.013334 Sep 18 01:43:52.143561 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3035/6036] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:52 2022] GET /compute/v2.1/servers/074876a0-ddcf-4c3b-ba35-7068f9ec3e6f => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:43:52.149423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:52.149952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:52.159076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.159576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.160017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.160733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.161195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.161659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.188975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:43:52.275715 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9a003489-51cc-4b16-8716-00f7647b2ad0 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 204 len: 0 microversion: 2.1 time: 0.130688 Sep 18 01:43:52.276787 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3002/6037] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:43:52 2022] DELETE /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:43:52.285030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:52.285793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:52.294627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.295287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.296032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.296823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:52.297296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:52.297762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:52.447704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:52.455964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-85db561b-b3ff-441a-b27d-826e1535b951 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1479 microversion: 2.1 time: 0.174774 Sep 18 01:43:52.456569 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3036/6038] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:52 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1479 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:53.480025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:53.482463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:53.490733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:53.491256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:53.491697 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:53.492425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:53.492871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:53.493297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:53.673705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:53.678142 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:43:53.685054 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fa9cc81a-c3a7-4db8-9127-c7eb00e459e1 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1479 microversion: 2.1 time: 0.210443 Sep 18 01:43:53.685824 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3003/6039] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:53 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1479 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:43:54.367117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e7219b1a-5620-4b35-b73f-ddb7cb2dd1de req-bf5dde22-489a-4540-968f-6f51cb9f4a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b86678-f69e-4493-bb5c-a1673387cd1f", "name": "network-vif-deleted", "tag": "177a5215-934a-4c9a-851c-32e8f66196cd"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:43:54.380648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e7219b1a-5620-4b35-b73f-ddb7cb2dd1de req-bf5dde22-489a-4540-968f-6f51cb9f4a5e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:54.381196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e7219b1a-5620-4b35-b73f-ddb7cb2dd1de req-bf5dde22-489a-4540-968f-6f51cb9f4a5e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:54.381661 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e7219b1a-5620-4b35-b73f-ddb7cb2dd1de req-bf5dde22-489a-4540-968f-6f51cb9f4a5e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:54.398933 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e7219b1a-5620-4b35-b73f-ddb7cb2dd1de req-bf5dde22-489a-4540-968f-6f51cb9f4a5e service nova] Creating event network-vif-deleted:177a5215-934a-4c9a-851c-32e8f66196cd for instance b0b86678-f69e-4493-bb5c-a1673387cd1f on n-h2-master-1 Sep 18 01:43:54.404633 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e7219b1a-5620-4b35-b73f-ddb7cb2dd1de req-bf5dde22-489a-4540-968f-6f51cb9f4a5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041555 Sep 18 01:43:54.405725 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3037/6040] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:43:54.711792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:54.712500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:54.721610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:54.722171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:54.722609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:54.723524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:54.723985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:54.725002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:54.760612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:54.761660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:54.761660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:54.761873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lazy-loading 'fault' on Instance uuid b0b86678-f69e-4493-bb5c-a1673387cd1f {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:43:54.829651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708cbba2f5044c419e02f1c6620f5dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99f6a0ac6fc4712aac500be191494b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:43:54.838904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-53844767-3c25-4dc1-b30d-30eeb39ce889 tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 200 len: 1283 microversion: 2.1 time: 0.134158 Sep 18 01:43:54.839680 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3004/6041] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:54 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 1283 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:43:55.864147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:43:55.866041 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] [instance: b0b86678-f69e-4493-bb5c-a1673387cd1f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:43:55.874324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:55.874961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:55.875239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:55.876964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:43:55.877781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:43:55.878369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:43:55.893866 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] HTTP exception thrown: Instance b0b86678-f69e-4493-bb5c-a1673387cd1f could not be found. Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Request method failure captured: Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f HTTP/1.1 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJndCpcWvL81JdRfRKnUXmRIH8Vyyd8-TsIuYuBKheYZRHTPgfkkiSNoXJ5jmhNrMuAwm5_4ro06iq88lNAxiPjAqaNat9ijFOktQLbiTK4MoyrUevLw2oWcpWMOjp796zLZivwy91I2mThd1PMtSpKc5CP29QeP2EIdUW9ciky75yjM Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99f6a0ac6fc4712aac500be191494b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersTestJSON-1716080534 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: c99f6a0ac6fc4712aac500be191494b7 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersTestJSON-1716080534 Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 708cbba2f5044c419e02f1c6620f5dba Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersTestJSON-1716080534-project Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: exception: Instance b0b86678-f69e-4493-bb5c-a1673387cd1f could not be found. Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'b0b86678-f69e-4493-bb5c-a1673387cd1f'} Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b86678-f69e-4493-bb5c-a1673387cd1f could not be found. Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b86678-f69e-4493-bb5c-a1673387cd1f could not be found. Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:43:55.895532 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b86678-f69e-4493-bb5c-a1673387cd1f could not be found. Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] Returning 404 to user: Instance b0b86678-f69e-4493-bb5c-a1673387cd1f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd69f2c4-db34-44c6-943b-35448d4189ce tempest-ServersTestJSON-1716080534 tempest-ServersTestJSON-1716080534-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f" status: 404 len: 111 microversion: 2.1 time: 0.038528 Sep 18 01:43:55.901210 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3038/6042] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:43:55 2022] GET /compute/v2.1/servers/b0b86678-f69e-4493-bb5c-a1673387cd1f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:44:01.229926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1366757823", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": "none"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:01.237305 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:01.287818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:44:01.288242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:44:01.288719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:44:01.289130 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:44:01.289539 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:44:01.298413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:01.298903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:01.299342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:01.300074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:01.300535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:01.300966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:01.319061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Getting quotas for project 5f74a75e5e304fd186afaf45fb7426d2. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:44:01.324376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Getting quotas for user 49235f403f5e42ec9e2d0ccc5685f37a and project 5f74a75e5e304fd186afaf45fb7426d2. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:44:01.336813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:44:01.339159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:44:01.387936 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4155a290-51d4-4163-bd79-5a472202a82d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.293222 Sep 18 01:44:01.388809 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3005/6043] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 18 01:44:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:44:01.399919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-715ac261-0afd-40e8-a123-00faefcb284a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:01.400535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-715ac261-0afd-40e8-a123-00faefcb284a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:01.403177 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=68 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:01.466031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-715ac261-0afd-40e8-a123-00faefcb284a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:01.474450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-715ac261-0afd-40e8-a123-00faefcb284a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:01.475907 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-715ac261-0afd-40e8-a123-00faefcb284a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:01.477047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-715ac261-0afd-40e8-a123-00faefcb284a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1278 microversion: 2.54 time: 0.081405 Sep 18 01:44:01.477627 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3039/6044] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:01 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:02.503702 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:02.504353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:02.513272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:02.513813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:02.514262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:02.523802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:02.524326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:02.524778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:02.598042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:02.607910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:02.609384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:02.610660 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b471587f-60f5-486b-a876-230f5cd39353 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1338 microversion: 2.54 time: 0.111590 Sep 18 01:44:02.611406 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3006/6045] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:02 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:03.642442 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:03.644171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:03.655252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:03.657094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:03.658145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:03.659222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:03.660986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:03.662614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:03.748050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:03.758186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:03.759666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:03.761023 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f822a5ad-9dd5-49b4-b5c4-d96ea95ee315 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1336 microversion: 2.54 time: 0.126120 Sep 18 01:44:03.761737 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3040/6046] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:03 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:04.791133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:04.791754 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:04.815394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:04.815903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:04.816480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:04.817448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:04.818053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:04.820318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:04.896483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:04.906857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:04.908333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:04.909572 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-945eccdb-eff5-47d6-bd47-295e34269204 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1336 microversion: 2.54 time: 0.122311 Sep 18 01:44:04.910149 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3007/6047] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:04 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:05.938166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:05.938774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:05.946565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:05.946948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:05.947378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:05.948069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:05.948517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:05.948933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:06.017940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:06.028819 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:06.030359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:06.031546 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a6cf011-7dc5-4010-8a35-f389c717cd66 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1357 microversion: 2.54 time: 0.097311 Sep 18 01:44:06.032128 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3041/6048] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:05 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:06.060245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac170c0b-53dd-4e91-ab2a-949a766f2400 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Action: 'create', calling method: .version_select at 0x7f700532c160>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1640942763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLaiR8zN56Vk+ydKTe3epj47r3tPCxvFSpkAQnGF/1itfKq820p5XSyMYdbYMXbzeoOH51TWmaDeE1VJzNorO7sFxxQgnhixFsH04i53MCGal/uE5r3SUU/y+nVM0kK1w=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:06.076388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ac170c0b-53dd-4e91-ab2a-949a766f2400 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Getting quotas for project 5f74a75e5e304fd186afaf45fb7426d2. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:44:06.085617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-ac170c0b-53dd-4e91-ab2a-949a766f2400 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Getting quotas for user 49235f403f5e42ec9e2d0ccc5685f37a and project 5f74a75e5e304fd186afaf45fb7426d2. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:44:06.112737 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac170c0b-53dd-4e91-ab2a-949a766f2400 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.056338 Sep 18 01:44:06.113350 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3008/6049] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 18 01:44:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:44:06.125044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1640942763", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:06.128058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:06.134442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:06.134741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:06.135170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:06.135858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:06.136305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:06.136722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:06.222320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:44:06.222744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:44:06.223221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:44:06.224170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:44:06.224587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:44:06.302809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:06.312602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:06.313341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:06.313832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:06.314559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:06.315023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:06.315492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:06.346250 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-520bdd63-74e2-4120-a8be-f26ee985e924 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "POST /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7/action" status: 202 len: 1140 microversion: 2.54 time: 0.225130 Sep 18 01:44:06.347054 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3042/6050] 10.222.0.25 () {62 vars in 1320 bytes} [Sun Sep 18 01:44:06 2022] POST /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7/action => generated 1140 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 18 01:44:06.373254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:06.374376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:06.381692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:06.382760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:06.383489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:06.384508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:06.385270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:06.385972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:06.456827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:06.466152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:06.467654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:06.470374 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-162f1809-83a8-4e39-8a5f-66d0e0ba38a3 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.102466 Sep 18 01:44:06.471162 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3009/6051] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:06 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:07.498993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:07.500399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:07.508301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:07.508798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:07.509240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:07.510264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:07.510733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:07.511355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:07.588586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:07.604616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:07.606487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:07.607991 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4843aba7-7aa1-41a1-a0dd-2bbd28404783 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.114276 Sep 18 01:44:07.618394 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3043/6052] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:07 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:08.637350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:08.638052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:08.645131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:08.646619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:08.646770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:08.647494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:08.647953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:08.648633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:08.728586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:08.737444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:08.739658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:08.740703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4dac8127-26fb-4191-9fa3-6dc9245a04e8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.107598 Sep 18 01:44:08.741845 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3010/6053] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:08 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:09.770143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:09.771861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:09.782367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:09.782861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:09.783301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:09.784027 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:09.784500 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:09.784932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:09.891517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:09.900970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:09.903546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:09.904959 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c80715b8-6928-43f1-82a7-f5d66907313d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.139648 Sep 18 01:44:09.923610 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3044/6054] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:09 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:10.932143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:10.932909 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:10.944685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:10.945171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:10.945819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:10.946714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:10.947336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:10.947939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:11.031331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:11.042455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:11.044284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:11.045510 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fe97e3a-ff50-4931-8cfa-2e3e4b8e2fe2 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.117336 Sep 18 01:44:11.061610 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3011/6055] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:10 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:12.072696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:12.073629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:12.080531 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:12.082948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:12.083616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:12.084143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:12.084932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:12.085751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:12.085993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:12.159627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:12.168621 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:12.170246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:12.171437 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9cc5e0d9-64ee-4909-b5be-c25aed3bb602 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.103342 Sep 18 01:44:12.172189 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3045/6056] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:12 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:12.890849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:12.893925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:12.896792 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:12.910302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:12.911365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:12.913961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:12.915543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:12.916506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:12.917857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:13.013503 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1059878b-0404-4d61-baae-d05285ae5655 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action" status: 200 len: 63161 microversion: 2.1 time: 0.138428 Sep 18 01:44:13.014231 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3012/6057] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:44:12 2022] POST /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab/action => generated 63161 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:44:13.200461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:13.201761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:13.215359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:13.216144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:13.216577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:13.221337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:13.222132 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:13.222733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:13.265180 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:13.358801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:13.368916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:13.371917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:13.374205 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-86990c0b-d984-45bb-9046-0cc34b19f7c8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.177095 Sep 18 01:44:13.377170 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3046/6058] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:13 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:14.409004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:14.410795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:14.424390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:14.424877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:14.425315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:14.426059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:14.426551 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:14.428095 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:14.545985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:14.556566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:14.562560 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:14.563951 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-007c2d0b-eaa9-4765-9155-c9503d62811d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.160173 Sep 18 01:44:14.565048 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3013/6059] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:14 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:15.599077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:15.601811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:15.613698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:15.614226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:15.615082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:15.616255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:15.616730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:15.617365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:15.744932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:15.757699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:15.760031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:15.761467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a8f42c2-b754-44a4-80da-853f61a2f4ae tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.170974 Sep 18 01:44:15.762591 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3047/6060] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:15 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:16.295497 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=10 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:16.432166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:16.434072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:16.434589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:16.435026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:16.435741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:16.437115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:16.437561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:16.461968 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a6498a54-c770-415d-a85c-854629b0c331 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.168581 Sep 18 01:44:16.462569 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3014/6061] 10.222.0.25 () {58 vars in 1185 bytes} [Sun Sep 18 01:44:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:16.605914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1980422505", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "7c624113-ee54-41e5-8546-5693767050fc"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:16.675570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] validate_networks() for [('7c624113-ee54-41e5-8546-5693767050fc', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:44:16.792616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:16.793270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:16.800240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:16.800734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:16.801174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:16.802454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:16.803098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:16.803530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:16.905910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:16.917251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:16.921046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:16.922334 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-acc7d581-908b-444c-af8f-d0d057c930cf tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.133871 Sep 18 01:44:16.923024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3015/6062] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:16 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:44:17.181748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:44:17.182249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:44:17.182798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:44:17.183299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:44:17.183785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:44:17.193764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:17.194285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:17.194749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:17.195689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:17.196147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:17.196602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:17.216095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Getting quotas for project c50aa5467486451582c9105d0a098aec. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:44:17.221724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Getting quotas for user cdfffd38e02c4661b0f4fc9344bdef23 and project c50aa5467486451582c9105d0a098aec. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:44:17.235350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:44:17.237785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:44:17.290037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f31efa42-20da-4cd7-bf5b-5a300be6daad tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687655 Sep 18 01:44:17.290858 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3048/6063] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:44:17.302120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-afe9482c-a00e-4c04-b6db-3faf44607f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:17.302812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-afe9482c-a00e-4c04-b6db-3faf44607f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:17.367318 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-afe9482c-a00e-4c04-b6db-3faf44607f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1329 microversion: 2.1 time: 0.069011 Sep 18 01:44:17.367905 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3016/6064] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:17 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1329 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:17.951823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:17.952714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:17.960990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:17.961510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:17.962060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:17.962708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:17.963171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:17.963599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:18.033724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:18.042623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:18.044290 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:18.045581 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-30b131ae-c94a-4a4a-b27e-97520b41fd8a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.098994 Sep 18 01:44:18.046486 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3049/6065] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:17 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:18.390601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:18.391125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:18.402218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:18.402618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:18.402975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:18.403688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:18.404158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:18.404589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:18.477808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4701befc-5fc4-4503-9348-741735c2e455 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1416 microversion: 2.1 time: 0.090970 Sep 18 01:44:18.479171 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3017/6066] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:18 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1416 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:19.072423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:19.073870 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:19.082774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:19.083662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:19.084808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:19.085810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:19.086501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:19.087150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:19.162239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:19.172607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:19.174594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:19.175846 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab61ecfb-9878-4228-af01-c217f10d0fbc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.107340 Sep 18 01:44:19.177309 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3050/6067] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:19 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:19.502993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:19.503596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:19.512275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:19.512776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:19.513218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:19.514173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:19.514631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:19.515071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:19.608494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:19.609472 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:19.622238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:19.623164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:19.623935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:19.625524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:19.626302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:19.627197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:19.693620 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-43596843-c6e7-42c8-8e70-efbfdf8c8b90 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1464 microversion: 2.1 time: 0.194500 Sep 18 01:44:19.706632 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3018/6068] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:19 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:19.816567 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4fb0457a-3fd5-4863-b023-0cb31065e847 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1833 microversion: 2.1 time: 0.216333 Sep 18 01:44:19.830716 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3051/6069] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:19 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1833 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:44:20.161848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5aa51b3f-543e-4291-8b9f-434a965221ab req-21da033e-09d1-4d7d-9de7-3c4bc36c4079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f706c376-5085-4369-aa9c-c849746cfd8e", "tag": "7f3fafa6-3624-4968-a695-e736882d5d80"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:20.188785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5aa51b3f-543e-4291-8b9f-434a965221ab req-21da033e-09d1-4d7d-9de7-3c4bc36c4079 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:20.192933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5aa51b3f-543e-4291-8b9f-434a965221ab req-21da033e-09d1-4d7d-9de7-3c4bc36c4079 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:20.193428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5aa51b3f-543e-4291-8b9f-434a965221ab req-21da033e-09d1-4d7d-9de7-3c4bc36c4079 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:20.206620 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:20.207576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:20.216831 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5aa51b3f-543e-4291-8b9f-434a965221ab req-21da033e-09d1-4d7d-9de7-3c4bc36c4079 service nova] Creating event network-changed:7f3fafa6-3624-4968-a695-e736882d5d80 for instance f706c376-5085-4369-aa9c-c849746cfd8e on n-h1-master-1 Sep 18 01:44:20.217649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:20.218922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:20.219705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:20.221168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:20.221826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:20.222423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:20.225975 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5aa51b3f-543e-4291-8b9f-434a965221ab req-21da033e-09d1-4d7d-9de7-3c4bc36c4079 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070119 Sep 18 01:44:20.227959 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3019/6070] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:20.323150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:20.333420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:20.342090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:20.347090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2edc5e01-43e0-4607-b4d7-cf37ac16f79b tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.146049 Sep 18 01:44:20.352550 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3052/6071] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:20 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:20.721429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:20.722189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:20.729707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:20.730213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:20.730666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:20.731422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:20.731891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:20.732330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:20.900702 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ff6aefc-54b6-4cb0-9802-d971dd19e0a5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1464 microversion: 2.1 time: 0.184322 Sep 18 01:44:20.901785 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3020/6072] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:20 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:21.372866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:21.373396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:21.374510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:21.375133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:21.381725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.382504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.383185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.383967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.384120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.384564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.384763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.385208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.385324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.385950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.386413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.386844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.416495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:44:21.457573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:21.467005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:21.469787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:21.471018 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-586e067f-1a88-4f91-8fe0-67e770874339 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.100448 Sep 18 01:44:21.471592 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3021/6073] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:21 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:21.476779 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ffeaa5cc-aaec-437b-82d5-b554989b1960 req-9e2205e7-8460-4018-b50d-dbb0eaedd8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:21.487505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffeaa5cc-aaec-437b-82d5-b554989b1960 req-9e2205e7-8460-4018-b50d-dbb0eaedd8f2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.488256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffeaa5cc-aaec-437b-82d5-b554989b1960 req-9e2205e7-8460-4018-b50d-dbb0eaedd8f2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.489349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ffeaa5cc-aaec-437b-82d5-b554989b1960 req-9e2205e7-8460-4018-b50d-dbb0eaedd8f2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.501443 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ffeaa5cc-aaec-437b-82d5-b554989b1960 req-9e2205e7-8460-4018-b50d-dbb0eaedd8f2 service nova] Creating event network-changed:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:44:21.507826 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ffeaa5cc-aaec-437b-82d5-b554989b1960 req-9e2205e7-8460-4018-b50d-dbb0eaedd8f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034848 Sep 18 01:44:21.508423 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3022/6074] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:21.515258 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f63ccdd2-0f2a-48da-85de-a7670c41dbf4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 204 len: 0 microversion: 2.1 time: 0.146039 Sep 18 01:44:21.515960 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3053/6075] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:44:21 2022] DELETE /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:44:21.525231 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:21.525952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:21.532769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.533263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.533833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.534544 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.535009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.535480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.687944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:21.696483 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-81a897a0-311a-4803-b6e8-45f675b91039 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1688 microversion: 2.1 time: 0.175889 Sep 18 01:44:21.697072 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3023/6076] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:21 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:21.924398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:21.925371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:21.932052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.932529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.932958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:21.933670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:21.934120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:21.934543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:22.080929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-231f17d5-018b-4d17-a8cf-bb4ea443835b tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1464 microversion: 2.1 time: 0.160629 Sep 18 01:44:22.082564 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3054/6077] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:21 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:22.498982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:22.499562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:22.507456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:22.507944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:22.508387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:22.509093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:22.509577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:22.510015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:22.576468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:22.584741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:22.586245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:22.587414 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-99e3d006-2def-42a5-846a-39b2b7c68c7f tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.092598 Sep 18 01:44:22.587976 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3024/6078] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:22 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:22.720292 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:22.720959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:22.728825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:22.729307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:22.729844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:22.730545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:22.731265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:22.731697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:22.869305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:22.877377 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dcce7112-37f7-4081-beee-7388418bfd7f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1688 microversion: 2.1 time: 0.160915 Sep 18 01:44:22.878064 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3055/6079] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:22 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:23.104984 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:23.105784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:23.111903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:23.112396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:23.112865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:23.113673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:23.114133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:23.114561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:23.118585 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:23.250243 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7274cc02-6a95-495d-a74e-17f74f6be949 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1464 microversion: 2.1 time: 0.148858 Sep 18 01:44:23.250848 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3025/6080] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:23 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:23.616820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:23.618261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:23.624721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:23.625236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:23.627647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:23.628507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:23.629609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:23.630306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:23.701890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:23.710479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:23.711952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:23.713120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55c0a420-f70b-45a2-9733-ef131b50e16a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.103529 Sep 18 01:44:23.713708 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3056/6081] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:23 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:23.901473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:23.902140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:23.909227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:23.909764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:23.910209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:23.910916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:23.911384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:23.911813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:24.068580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:24.078002 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1ae5c76e-94d0-4b30-8f09-2e2bc0a63345 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1688 microversion: 2.1 time: 0.180527 Sep 18 01:44:24.086987 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3026/6082] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:23 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:24.273419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:24.275168 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:24.281763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:24.282339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:24.282805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:24.283535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:24.283984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:24.284405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:24.363068 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1058658c-e179-4605-9e56-2030b451f921 req-e0c33d69-b850-4165-b095-7abf6a578bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24d92c4-fccf-49f7-96b8-453e8c8355ab", "name": "network-vif-deleted", "tag": "ee15a59d-4a7f-4ed6-8372-25b18c0bee2d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:24.380096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1058658c-e179-4605-9e56-2030b451f921 req-e0c33d69-b850-4165-b095-7abf6a578bff service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:24.380856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1058658c-e179-4605-9e56-2030b451f921 req-e0c33d69-b850-4165-b095-7abf6a578bff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:24.381316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1058658c-e179-4605-9e56-2030b451f921 req-e0c33d69-b850-4165-b095-7abf6a578bff service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:24.396494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1058658c-e179-4605-9e56-2030b451f921 req-e0c33d69-b850-4165-b095-7abf6a578bff service nova] Creating event network-vif-deleted:ee15a59d-4a7f-4ed6-8372-25b18c0bee2d for instance b24d92c4-fccf-49f7-96b8-453e8c8355ab on n-h1-master-1 Sep 18 01:44:24.402039 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1058658c-e179-4605-9e56-2030b451f921 req-e0c33d69-b850-4165-b095-7abf6a578bff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043478 Sep 18 01:44:24.402651 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3027/6083] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:24.451650 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-447cb098-1f61-4686-a9d0-ec5ca29ea395 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1464 microversion: 2.1 time: 0.182154 Sep 18 01:44:24.452225 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3057/6084] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:24 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1464 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:24.739341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:24.740059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:24.747015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:24.747510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:24.748153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:24.748858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:24.749311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:24.749925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:24.823885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:24.832841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:24.834665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:24.835839 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-22552e5a-02e6-49f4-9d5f-82690a92eb9d tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.100926 Sep 18 01:44:24.836464 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3028/6085] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:24 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:25.102641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:25.103250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:25.110262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.110911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.111397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.112117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.112765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.113231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.146879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.147357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.148046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.148540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lazy-loading 'fault' on Instance uuid b24d92c4-fccf-49f7-96b8-453e8c8355ab {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:44:25.198482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:25.205909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dfe1d013-4588-49ea-a732-0681f55964ff tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 200 len: 1355 microversion: 2.1 time: 0.107222 Sep 18 01:44:25.206489 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3058/6086] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:25 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:25.475236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:25.475973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:25.483190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.483696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.484127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.484833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.485296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.485818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.577357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-aa26b521-6e9c-403c-aecc-7b23332d5c7c req-6da4afd0-855f-4727-85ae-b87a90094308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f706c376-5085-4369-aa9c-c849746cfd8e", "name": "network-vif-plugged", "status": "completed", "tag": "7f3fafa6-3624-4968-a695-e736882d5d80"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:25.592326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aa26b521-6e9c-403c-aecc-7b23332d5c7c req-6da4afd0-855f-4727-85ae-b87a90094308 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.592948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aa26b521-6e9c-403c-aecc-7b23332d5c7c req-6da4afd0-855f-4727-85ae-b87a90094308 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.593668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-aa26b521-6e9c-403c-aecc-7b23332d5c7c req-6da4afd0-855f-4727-85ae-b87a90094308 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.607428 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-aa26b521-6e9c-403c-aecc-7b23332d5c7c req-6da4afd0-855f-4727-85ae-b87a90094308 service nova] Creating event network-vif-plugged:7f3fafa6-3624-4968-a695-e736882d5d80 for instance f706c376-5085-4369-aa9c-c849746cfd8e on n-h1-master-1 Sep 18 01:44:25.615271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-aa26b521-6e9c-403c-aecc-7b23332d5c7c req-6da4afd0-855f-4727-85ae-b87a90094308 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043030 Sep 18 01:44:25.617086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3059/6087] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:25.651650 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3611f36-ea4f-410a-8f80-718e97c1cce2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1464 microversion: 2.1 time: 0.180451 Sep 18 01:44:25.652316 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3029/6088] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:25 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1464 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:44:25.862271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:25.862998 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:25.870256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.870748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.871189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.871916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:25.872371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:25.872793 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:25.940215 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:25.948642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:25.950143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:25.951313 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce429b73-20b4-4884-bb1d-f1731ff7c300 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.093780 Sep 18 01:44:25.951884 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3060/6089] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:25 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:26.230254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:26.230870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: b24d92c4-fccf-49f7-96b8-453e8c8355ab] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:26.236969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:26.237453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:26.237918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:26.238610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:26.239064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:26.239488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:26.253251 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] HTTP exception thrown: Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab could not be found. Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Request method failure captured: Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab HTTP/1.1 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnbyk5s0dRRAabvkMBwA_LP2vJUd_Q5hjvjpPddO70XgVKwdaPyUXiB9cCjfcYFRppjLgCrsUwFQKRWZZf_FtW7ok49SJDalWxps012yn7ohGXMzX4A07Ecf2_5KAzVkxyB1I14F4f2c_IEKdWF_O6ffKflIC9mNPHg5YUoKxuxhkRc Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/534af518a54843d9b0288bc79448de27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_534af518a54843d9b0288bc79448de27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 50ef9fd3ac384cfe907975caddd403a2 Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: exception: Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab could not be found. Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b24d92c4-fccf-49f7-96b8-453e8c8355ab'} Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab could not be found. Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab could not be found. Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:26.254945 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab could not be found. Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Returning 404 to user: Instance b24d92c4-fccf-49f7-96b8-453e8c8355ab could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-120e32e3-7781-4682-b670-b81a6e2ad03b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab" status: 404 len: 111 microversion: 2.1 time: 0.030057 Sep 18 01:44:26.259607 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3030/6090] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:26 2022] GET /compute/v2.1/servers/b24d92c4-fccf-49f7-96b8-453e8c8355ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:44:26.676808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:26.677411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:26.684498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:26.684978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:26.685414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:26.686155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:26.686615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:26.687036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:26.909069 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b20ebb15-2cf1-4688-a5c4-4136f7aa9f02 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1464 microversion: 2.1 time: 0.236495 Sep 18 01:44:26.927131 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3061/6091] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:26 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1464 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:26.980650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:26.981406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:26.983603 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:26.991190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:26.991828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:26.992358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:26.993165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:26.993794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:26.994766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:27.081813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:27.090148 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:27.091630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:27.092806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-506bc27f-0c00-4dd8-be83-944bf80d3838 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.118091 Sep 18 01:44:27.093366 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3031/6092] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:26 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:27.932861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:27.933485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:27.935842 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:27.936934 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:27.944090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:27.944588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:27.945029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:27.945767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:27.946225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:27.946653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:27.949350 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:28.122660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:28.124520 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:28.126760 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:28.134636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:28.135804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:28.136353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:28.137439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:28.138003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:28.138495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:28.187624 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-df7a75d7-8a8b-4a88-a006-43194ea88f58 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1649 microversion: 2.1 time: 0.258520 Sep 18 01:44:28.188668 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3062/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:27 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1649 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:28.211762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:28.212731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:28.221200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:28.222382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:28.232664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:28.233620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:28.234298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:28.235080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:28.255045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:28.266853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:28.268826 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:28.270900 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b61b4543-d0ec-429c-b2cb-8d54a4f8629e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.154248 Sep 18 01:44:28.285685 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3032/6094] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:28 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:28.388177 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16762b8b-feea-46b1-9502-38cd97d328a7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1649 microversion: 2.1 time: 0.181554 Sep 18 01:44:28.389391 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3063/6095] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:28 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1649 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:28.412453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:28.413250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:28.420178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:28.420864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:28.421356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:28.422166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:28.422642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:28.423132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:28.589336 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d336426-2215-4253-9ae2-6689757150a2 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1649 microversion: 2.1 time: 0.181294 Sep 18 01:44:28.591228 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3033/6096] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:28 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1649 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:28.656882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-501115965", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "7c624113-ee54-41e5-8546-5693767050fc"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:28.722656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] validate_networks() for [('7c624113-ee54-41e5-8546-5693767050fc', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:44:29.193731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:44:29.194396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:44:29.194579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:44:29.194986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:44:29.195553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:44:29.213633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:29.214343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:29.214958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:29.215883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:29.216692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:29.217286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:29.240714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Getting quotas for project c50aa5467486451582c9105d0a098aec. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:44:29.253542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Getting quotas for user cdfffd38e02c4661b0f4fc9344bdef23 and project c50aa5467486451582c9105d0a098aec. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:44:29.276302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:44:29.282095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:44:29.298013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:29.299154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:29.311796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:29.312546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:29.313174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:29.314877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:29.315592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:29.316219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:29.418345 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8e39736-e078-4252-ae22-355717829b95 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764906 Sep 18 01:44:29.419721 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3064/6097] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:44:29.427090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:29.431521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-43ad9e7e-c356-46a8-ae87-fb588829311a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:29.432387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-43ad9e7e-c356-46a8-ae87-fb588829311a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:29.436064 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:29.436750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:29.442569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:29.444577 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b4753e3e-ed8e-410f-a346-8d968dbe619a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.150903 Sep 18 01:44:29.447408 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3034/6098] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:29 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:29.523663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-43ad9e7e-c356-46a8-ae87-fb588829311a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1328 microversion: 2.1 time: 0.096190 Sep 18 01:44:29.533447 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3065/6099] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:29 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:29.928055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7dece546-576d-4032-87fb-0dd632591520 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '.version_select at 0x7f7005572ee0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:29.976460 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7dece546-576d-4032-87fb-0dd632591520 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-206835295" status: 202 len: 0 microversion: 2.1 time: 0.053652 Sep 18 01:44:29.980611 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3035/6100] 10.222.0.25 () {58 vars in 1281 bytes} [Sun Sep 18 01:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-206835295 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:44:30.011645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80bb1add-44aa-42c6-ab25-53ccb5282b6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: .version_select at 0x7f7006273ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-298279531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGE8cdT/fy9ArMOijWsu+1DtEbfT4bdxKpdfOFe+6jfjWBSN7rf9pO4mUuhz3SVWvAcykf8dHNKVswprTEIW+UAPVyzCOvQfz0H9tRVPTWzYxbvFzIhr5F4xpouKojTd6w=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:30.031745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-80bb1add-44aa-42c6-ab25-53ccb5282b6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:44:30.038868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-80bb1add-44aa-42c6-ab25-53ccb5282b6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:44:30.066947 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80bb1add-44aa-42c6-ab25-53ccb5282b6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059445 Sep 18 01:44:30.067554 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3066/6101] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:44:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:30.476624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:30.477406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:30.486944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:30.488370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:30.488983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:30.490451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:30.490924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:30.491424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:30.554263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:30.554911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:30.562711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:30.563196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:30.563626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:30.564329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:30.564779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:30.565211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:30.576936 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:30.591891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:30.593751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:30.595213 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb257eab-2e26-4a61-ac0e-f7b8ccb1a39a tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.124928 Sep 18 01:44:30.596184 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3036/6102] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:30 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:30.645169 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a6dcf38d-6b91-4ad5-a762-97502732ae68 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1415 microversion: 2.1 time: 0.098564 Sep 18 01:44:30.645808 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3067/6103] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:30 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1415 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:31.310605 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:31.311110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:31.312999 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:31.320164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.321207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.321911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:31.322870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.323489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.323923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:31.356117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:44:31.448323 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7cb840b3-3285-4f82-81bb-0033e9814438 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "DELETE /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 204 len: 0 microversion: 2.1 time: 0.263687 Sep 18 01:44:31.449149 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3037/6104] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:44:31 2022] DELETE /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:44:31.459026 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:31.459890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:31.466085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.466734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.467383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:31.468285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.468913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.469509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:31.625026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:31.625931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:31.638678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.639595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.640270 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:31.641242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.641971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.642635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:31.766822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:31.775755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:31.777167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:31.778389 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d38e6ceb-463a-4e70-9aee-a0505ea31bca tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.157814 Sep 18 01:44:31.778971 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3038/6105] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:31 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:44:31.794445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:31.807555 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50aca919-8bc8-4117-be4d-c77957dddab0 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1733 microversion: 2.1 time: 0.354219 Sep 18 01:44:31.808243 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3068/6106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:31 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1733 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:31.814397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:31.815026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:31.821770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.822253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.822686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:31.823684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:31.824143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:31.824558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:32.218651 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dfef314d-d170-4615-90e7-f40746ac9c59 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.416251 Sep 18 01:44:32.233796 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3039/6107] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:31 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:32.805183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:32.805767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:32.813028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:32.813519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:32.813984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:32.814691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:32.815145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:32.815569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:32.834253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:32.835261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:32.842868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:32.843661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:32.844097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:32.844806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:32.845430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:32.846047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:32.927184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:32.936754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:32.940358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:32.941977 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f5cf2d2-cd43-49f1-a872-f5d4b79aae71 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1409 microversion: 2.54 time: 0.141393 Sep 18 01:44:32.942442 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3069/6108] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:32 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:33.078530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:33.087737 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cca77cb9-6422-4dd9-b5e5-32a3b5822b1d tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1733 microversion: 2.1 time: 0.257419 Sep 18 01:44:33.088355 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3040/6109] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:32 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1733 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:33.243892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:33.244501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:33.250802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:33.251281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:33.251715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:33.252399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:33.252846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:33.253459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:33.642892 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-192be783-f8a0-4e3e-a333-2393fcffe79e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.402107 Sep 18 01:44:33.645266 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3070/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:33 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:44:33.933753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-cc7766a8-ebfb-4195-a9fc-b5b10aacad15 req-40b966c0-f696-4de3-b4e0-0ad08ed5d2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bd398c-9a38-46d2-9e73-e0b8d38f7bfd", "name": "network-vif-deleted", "tag": "34ed18a3-c454-4f26-a302-ede9daf66812"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:33.946750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cc7766a8-ebfb-4195-a9fc-b5b10aacad15 req-40b966c0-f696-4de3-b4e0-0ad08ed5d2d7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:33.947411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cc7766a8-ebfb-4195-a9fc-b5b10aacad15 req-40b966c0-f696-4de3-b4e0-0ad08ed5d2d7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:33.948071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cc7766a8-ebfb-4195-a9fc-b5b10aacad15 req-40b966c0-f696-4de3-b4e0-0ad08ed5d2d7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:33.969644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:33.971032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:33.974210 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-cc7766a8-ebfb-4195-a9fc-b5b10aacad15 req-40b966c0-f696-4de3-b4e0-0ad08ed5d2d7 service nova] Creating event network-vif-deleted:34ed18a3-c454-4f26-a302-ede9daf66812 for instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd on n-h1-master-1 Sep 18 01:44:33.991091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:33.991856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:33.992140 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-cc7766a8-ebfb-4195-a9fc-b5b10aacad15 req-40b966c0-f696-4de3-b4e0-0ad08ed5d2d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054812 Sep 18 01:44:33.993621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:33.994563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:33.995103 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3041/6111] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:44:33.996547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:33.997774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:34.127556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:34.129521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:34.146581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:34.147164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:34.147935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:34.148820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:34.149415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:34.150398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:34.244467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:34.245345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:34.248116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:34.249942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:34.251366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lazy-loading 'fault' on Instance uuid 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:44:34.257296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:34.261977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:34.264041 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-39412360-69b5-4bc9-862e-077084b2e5de tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1415 microversion: 2.54 time: 0.298684 Sep 18 01:44:34.278712 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3071/6112] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:33 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1415 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:44:34.360216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d43f2acdf948058b064ef103ef21a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73683f3ff4a74617b8b864c2b9f25d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:34.365584 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:34.373592 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ed01789-bf29-474d-877b-289624121291 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 200 len: 1389 microversion: 2.1 time: 0.264251 Sep 18 01:44:34.375231 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3042/6113] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:34 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 1389 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:44:34.671425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:34.671959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:34.681546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:34.686263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:34.686717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:34.687657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:34.687899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:34.688527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:34.752255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-6863cec6-a495-4b93-9223-cecdc98f293f req-c8ba57bc-b0c8-4024-bab8-bbfe5cf2a8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f404d1c5-ab5d-43b2-9e53-4f3d498b2059", "tag": "7d3f91de-9f5b-455b-9c6c-c4f64524d5b9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:34.769772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6863cec6-a495-4b93-9223-cecdc98f293f req-c8ba57bc-b0c8-4024-bab8-bbfe5cf2a8df service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:34.770717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6863cec6-a495-4b93-9223-cecdc98f293f req-c8ba57bc-b0c8-4024-bab8-bbfe5cf2a8df service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:34.771560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6863cec6-a495-4b93-9223-cecdc98f293f req-c8ba57bc-b0c8-4024-bab8-bbfe5cf2a8df service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:34.798319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-6863cec6-a495-4b93-9223-cecdc98f293f req-c8ba57bc-b0c8-4024-bab8-bbfe5cf2a8df service nova] Creating event network-changed:7d3f91de-9f5b-455b-9c6c-c4f64524d5b9 for instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 on n-h2-master-1 Sep 18 01:44:34.805671 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-6863cec6-a495-4b93-9223-cecdc98f293f req-c8ba57bc-b0c8-4024-bab8-bbfe5cf2a8df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058098 Sep 18 01:44:34.806973 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3043/6114] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:34.986053 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b916def8-c9df-4617-a87d-0c4bfec9c7a8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.318717 Sep 18 01:44:34.989628 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3072/6115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:34 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:35.308556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:35.311744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:35.320811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:35.321713 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:35.322348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:35.323269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:35.323926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:35.324711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:35.399252 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:35.400147 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:35.407018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:35.408636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:35.409228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:35.410683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:35.411154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:35.411760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:35.433011 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] HTTP exception thrown: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Request method failure captured: Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd HTTP/1.1 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJna-AsuTJ-u6aMPYz41FWyuCABqT9sCxFBO2wkg9yBi5uOUZiPuHpZFG3kO3cHcSHcmCeA9OIxBCTdxwsiHRk3-4Uek9P4MI1ELL0WXnFNYLtv_9993JdXokUnBpljZN_yLiqcT9-qc0u5g4QF8t3PBpdj0pzM3mjVD7HTs2_zrD9a0 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 73683f3ff4a74617b8b864c2b9f25d9e Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestServerBasicOps-861523481 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestServerBasicOps-861523481 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 73683f3ff4a74617b8b864c2b9f25d9e Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestServerBasicOps-861523481 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestServerBasicOps-861523481-project Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 64d43f2acdf948058b064ef103ef21a7 Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestServerBasicOps-861523481-project Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '54bd398c-9a38-46d2-9e73-e0b8d38f7bfd'} Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:35.434772 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:44:35.439358 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:35.439358 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:35.439358 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:35.439358 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:35.439358 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:35.439358 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:35.439358 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:44:35.441826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Returning 404 to user: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:35.442942 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b46c3e6-85f1-4f68-98af-565423d0c4d5 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 404 len: 111 microversion: 2.1 time: 0.048876 Sep 18 01:44:35.444143 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3073/6116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:35 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:44:35.468235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:35.499742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:35.501359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:35.502676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5392a211-aee6-4e39-8e60-fa21d3cf44a7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1415 microversion: 2.54 time: 0.202006 Sep 18 01:44:35.514173 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3044/6117] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:35 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1415 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:36.009539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:36.010801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:36.029244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.030034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.030665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.031559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.032175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.032795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.460305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:36.461016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:36.472933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.473976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.474835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.476102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.476904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.477702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.500241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-04c63311-1e63-41fc-b42c-10d3549f50ce tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.493545 Sep 18 01:44:36.510806 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] HTTP exception thrown: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Request method failure captured: Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd HTTP/1.1 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJna-AsuTJ-u6aMPYz41FWyuCABqT9sCxFBO2wkg9yBi5uOUZiPuHpZFG3kO3cHcSHcmCeA9OIxBCTdxwsiHRk3-4Uek9P4MI1ELL0WXnFNYLtv_9993JdXokUnBpljZN_yLiqcT9-qc0u5g4QF8t3PBpdj0pzM3mjVD7HTs2_zrD9a0 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 73683f3ff4a74617b8b864c2b9f25d9e Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestServerBasicOps-861523481 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestServerBasicOps-861523481 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 73683f3ff4a74617b8b864c2b9f25d9e Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestServerBasicOps-861523481 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestServerBasicOps-861523481-project Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 64d43f2acdf948058b064ef103ef21a7 Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestServerBasicOps-861523481-project Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '54bd398c-9a38-46d2-9e73-e0b8d38f7bfd'} Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:44:36.512891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.516899 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.517645 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3074/6118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:36 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:36.527016 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Returning 404 to user: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:36.528141 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fe9b369-0899-41c1-8e21-fc7e9d16ec30 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "DELETE /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 404 len: 111 microversion: 2.1 time: 0.073229 Sep 18 01:44:36.529199 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3045/6119] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:44:36 2022] DELETE /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:44:36.543227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:36.544137 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] [instance: 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:36.554746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:36.555518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.556086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.556775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:36.556913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.557866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.558702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.559396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.575287 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] HTTP exception thrown: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.577639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Request method failure captured: Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd HTTP/1.1 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJna-AsuTJ-u6aMPYz41FWyuCABqT9sCxFBO2wkg9yBi5uOUZiPuHpZFG3kO3cHcSHcmCeA9OIxBCTdxwsiHRk3-4Uek9P4MI1ELL0WXnFNYLtv_9993JdXokUnBpljZN_yLiqcT9-qc0u5g4QF8t3PBpdj0pzM3mjVD7HTs2_zrD9a0 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 73683f3ff4a74617b8b864c2b9f25d9e Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestServerBasicOps-861523481 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73683f3ff4a74617b8b864c2b9f25d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestServerBasicOps-861523481 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 73683f3ff4a74617b8b864c2b9f25d9e Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestServerBasicOps-861523481 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestServerBasicOps-861523481-project Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 64d43f2acdf948058b064ef103ef21a7 Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestServerBasicOps-861523481-project Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '54bd398c-9a38-46d2-9e73-e0b8d38f7bfd'} Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:36.577885 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.582162 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:36.582162 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:36.582162 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:36.582162 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:36.582162 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:36.582162 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. Sep 18 01:44:36.582162 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:36.582599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.582599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.582599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.583730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Returning 404 to user: Instance 54bd398c-9a38-46d2-9e73-e0b8d38f7bfd could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:36.585011 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20bd25d3-49a4-4c45-b1c0-e67a975a1dcb tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd" status: 404 len: 111 microversion: 2.1 time: 0.047036 Sep 18 01:44:36.586105 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3046/6120] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:36 2022] GET /compute/v2.1/servers/54bd398c-9a38-46d2-9e73-e0b8d38f7bfd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:44:36.595117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.595700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.802618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:36.831981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:36.834555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:36.844928 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a74735e-7598-423e-9ad4-b0a6c69234e1 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1400 microversion: 2.54 time: 0.309954 Sep 18 01:44:36.875697 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3075/6121] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:36 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1400 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:36.894799 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65e2093e-d9d7-4025-b70f-fd2b5ae304b7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '.version_select at 0x7f70063b2af0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:36.947339 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65e2093e-d9d7-4025-b70f-fd2b5ae304b7 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1640942763" status: 204 len: 0 microversion: 2.54 time: 0.056205 Sep 18 01:44:36.953354 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3047/6122] 10.222.0.25 () {60 vars in 1319 bytes} [Sun Sep 18 01:44:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1640942763 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:44:36.962889 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:36.963607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:36.972640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.973429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.974187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:36.975134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:36.975794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:36.976573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:37.007885 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:44:37.158204 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3aea6caa-e65d-4c3f-8523-1d4c11c433a0 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "DELETE /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 204 len: 0 microversion: 2.54 time: 0.200127 Sep 18 01:44:37.159095 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3076/6123] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 18 01:44:36 2022] DELETE /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:44:37.169102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:37.169768 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:37.182590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:37.183723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:37.184180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:37.184960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:37.185613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:37.186051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:37.324485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:37.345724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:37.349608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:37.358923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4a4c9734-5514-46d6-adfa-0e84099cbe3c tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1406 microversion: 2.54 time: 0.193842 Sep 18 01:44:37.379128 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3048/6124] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:37 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:37.408044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a640903-3151-4021-b605-9e11b18f5cf3 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] Calling method '.version_select at 0x7f7006fc5ca0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:37.459870 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a640903-3151-4021-b605-9e11b18f5cf3 tempest-TestServerBasicOps-861523481 tempest-TestServerBasicOps-861523481-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1377582447" status: 202 len: 0 microversion: 2.1 time: 0.055964 Sep 18 01:44:37.466477 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3077/6125] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Sep 18 01:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1377582447 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:44:37.543174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:37.543863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:37.558126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:37.558795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:37.559329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:37.560389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:37.560939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:37.569376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:37.819658 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3e5aa6cd-d2b7-4865-83e6-45f39e972dd8 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.280488 Sep 18 01:44:37.822488 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3049/6126] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:37 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:38.386260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:38.387031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:38.398781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:38.399397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:38.399964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:38.400887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:38.401363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:38.401867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:38.473028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:38.483658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:38.485478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:38.486799 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2703e0e9-576d-45c0-b05b-4998af34b8f5 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1406 microversion: 2.54 time: 0.104631 Sep 18 01:44:38.495472 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3078/6127] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:38 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1406 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:38.862470 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:38.863698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:38.886318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:38.887159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:38.887853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:38.888661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:38.889864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:38.890613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:39.105976 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf061127-817e-4a41-ac69-d030a6385b57 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.246700 Sep 18 01:44:39.107096 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3050/6128] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:38 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:39.518526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:39.518526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:39.520654 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:39.536328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:39.538101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:39.538642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:39.542668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:39.544431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:39.545674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:39.653541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:39.671064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:39.673513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:39.676901 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b087f94b-869d-4024-8173-46eade42206e tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1406 microversion: 2.54 time: 0.162461 Sep 18 01:44:39.677830 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3079/6129] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:39 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:40.134422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:40.138176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:40.158886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:40.161842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:40.162873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:40.164346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:40.165468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:40.166426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:40.354233 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1a88522-e66e-4b25-bd72-c82c91728447 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.227612 Sep 18 01:44:40.355113 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3051/6130] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:40 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:40.713434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:40.714688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:40.719438 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:40.722963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:40.723568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:40.724107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:40.724963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:40.726304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:40.726304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:40.819794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:40.833592 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:40.835420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:40.836857 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0bac3c82-3990-4c92-bade-78b790a988a4 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1406 microversion: 2.54 time: 0.127570 Sep 18 01:44:40.837973 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3080/6131] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:40 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:44:41.378736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:41.379370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:41.386562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:41.387053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:41.387511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:41.388192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:41.388644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:41.389064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:41.549701 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ce7d98f-f6ed-46e2-8df1-710879049c3d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.175227 Sep 18 01:44:41.551466 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3052/6132] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:41 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:41.594667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-768153496", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "abc3f317-195e-4b55-b05a-509d64ae2bf2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-298279531", "security_groups": [{"name": "tempest-secgroup-smoke-1735894738"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:41.834495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] validate_networks() for [('abc3f317-195e-4b55-b05a-509d64ae2bf2', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:44:41.864262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:41.865292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:41.872326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:41.873230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:41.874043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:41.875638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:41.876399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:41.877066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:41.952841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:41.954667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:41.957011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:41.957920 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lazy-loading 'fault' on Instance uuid 281d3516-6295-49c6-b1b4-9ff8a6212aa7 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:44:42.079738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:42.095096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:42.097507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49235f403f5e42ec9e2d0ccc5685f37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f74a75e5e304fd186afaf45fb7426d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:42.099646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6221b957-e4cb-4e2f-8268-d3fdb43843bc tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 200 len: 1411 microversion: 2.54 time: 0.238801 Sep 18 01:44:42.127476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3053/6133] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:41 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 1411 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:44:42.283090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-befd576c-c64f-4e92-a933-578b73b5702d req-72aa227f-0c65-48dd-8fee-836188606dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f404d1c5-ab5d-43b2-9e53-4f3d498b2059", "name": "network-vif-plugged", "status": "completed", "tag": "7d3f91de-9f5b-455b-9c6c-c4f64524d5b9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:42.320904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-befd576c-c64f-4e92-a933-578b73b5702d req-72aa227f-0c65-48dd-8fee-836188606dd5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:42.321418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-befd576c-c64f-4e92-a933-578b73b5702d req-72aa227f-0c65-48dd-8fee-836188606dd5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:42.321887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-befd576c-c64f-4e92-a933-578b73b5702d req-72aa227f-0c65-48dd-8fee-836188606dd5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:42.337280 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-befd576c-c64f-4e92-a933-578b73b5702d req-72aa227f-0c65-48dd-8fee-836188606dd5 service nova] Creating event network-vif-plugged:7d3f91de-9f5b-455b-9c6c-c4f64524d5b9 for instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 on n-h2-master-1 Sep 18 01:44:42.342341 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-befd576c-c64f-4e92-a933-578b73b5702d req-72aa227f-0c65-48dd-8fee-836188606dd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062919 Sep 18 01:44:42.343271 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3054/6134] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:42.576480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:42.577918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:42.590896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:42.593215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:42.593881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:42.596397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:42.597106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:42.602332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:42.647854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:44:42.648274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:44:42.649093 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:44:42.649879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:44:42.650465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:44:42.672718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:42.673217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:42.673683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:42.674610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:42.675943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:42.676540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:42.704725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:44:42.712777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:44:42.731023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:44:42.733950 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:44:42.792450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-10a0ac42-0440-4785-b553-3788df28a5ad tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.201459 Sep 18 01:44:42.800800 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3081/6135] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:44:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:44:42.806492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-69230ac1-8985-4c1f-8eaf-69f279c2fabf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:42.807123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-69230ac1-8985-4c1f-8eaf-69f279c2fabf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:42.844608 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e1eaa1f8-3f15-46b4-9fa9-6e116f02c320 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1463 microversion: 2.1 time: 0.274903 Sep 18 01:44:42.845191 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3055/6136] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:42 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1463 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:42.895035 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-69230ac1-8985-4c1f-8eaf-69f279c2fabf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:42.905918 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-69230ac1-8985-4c1f-8eaf-69f279c2fabf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1265 microversion: 2.1 time: 0.103603 Sep 18 01:44:42.906516 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3082/6137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:42 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:44:43.141803 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:43.146903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] [instance: 281d3516-6295-49c6-b1b4-9ff8a6212aa7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:43.165659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:43.166483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:43.167112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:43.168037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:43.169537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:43.170192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:43.195195 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] HTTP exception thrown: Instance 281d3516-6295-49c6-b1b4-9ff8a6212aa7 could not be found. Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Request method failure captured: Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 HTTP/1.1 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnfgLcnc2lrdXH519_pSfk1WXVSJrBy5gg_W-h5cyUO6ZNw2Yx2ua9kTLxjzL5XVNjiIRGlD8GLppsPvLVBladgbRzUvYR9yLA3uidkD_LgbwwPlUVvR-K03L3nSEyo9LrVxUfYbmpQcC5B1Oj4JlMvvJGdX5UMOEdPOdVDWFQaVmHA Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Openstack-Nova-Api-Version: 2.54 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5f74a75e5e304fd186afaf45fb7426d2 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerShowV254Test-1743173272 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f74a75e5e304fd186afaf45fb7426d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f74a75e5e304fd186afaf45fb7426d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f74a75e5e304fd186afaf45fb7426d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f74a75e5e304fd186afaf45fb7426d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerShowV254Test-1743173272 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5f74a75e5e304fd186afaf45fb7426d2 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerShowV254Test-1743173272 Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerShowV254Test-1743173272-project Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 49235f403f5e42ec9e2d0ccc5685f37a Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerShowV254Test-1743173272-project Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 281d3516-6295-49c6-b1b4-9ff8a6212aa7 could not be found. Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '281d3516-6295-49c6-b1b4-9ff8a6212aa7'} Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281d3516-6295-49c6-b1b4-9ff8a6212aa7 could not be found. Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281d3516-6295-49c6-b1b4-9ff8a6212aa7 could not be found. Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:43.198411 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:43.202734 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:43.202734 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:43.202734 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:43.202734 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:43.202734 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:43.202734 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281d3516-6295-49c6-b1b4-9ff8a6212aa7 could not be found. Sep 18 01:44:43.202734 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:43.205747 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] Returning 404 to user: Instance 281d3516-6295-49c6-b1b4-9ff8a6212aa7 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:43.207607 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f18bc46-7a27-4a76-b086-d53ef5aa6ba8 tempest-ServerShowV254Test-1743173272 tempest-ServerShowV254Test-1743173272-project] 10.222.0.25 "GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7" status: 404 len: 111 microversion: 2.54 time: 0.080154 Sep 18 01:44:43.208886 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3056/6138] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 18 01:44:43 2022] GET /compute/v2.1/servers/281d3516-6295-49c6-b1b4-9ff8a6212aa7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:44:43.890112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:43.891031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:43.905465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:43.908593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:43.909546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:43.912496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:43.918335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:43.922252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:43.941659 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:43.953520 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:43.964020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:43.964519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:43.964960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:43.970754 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:43.977897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:43.978531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:43.979600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:44.148995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:44.164250 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-220dc93b-2874-4339-8a4c-3674a297d6d8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1317 microversion: 2.1 time: 0.234798 Sep 18 01:44:44.165289 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3057/6139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:43 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:44.716315 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0eb8acf6-f552-43a7-84be-ad825030ece3 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1647 microversion: 2.1 time: 0.850875 Sep 18 01:44:44.717259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3083/6140] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:43 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1647 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:44.740678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:44.742248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:44.749461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:44.750280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:44.750914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:44.751964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:44.752950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:44.754263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.087457 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-31b47667-54b8-41e1-ac42-9701a36aee0a tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1647 microversion: 2.1 time: 0.351479 Sep 18 01:44:45.088133 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3058/6141] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:44 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1647 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:45.109810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:45.110437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:45.117648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.118382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.119058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.120492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.121406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.122615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.200464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:45.201501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:45.209054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.209580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.210332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.211383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.215495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.216552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.339114 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:45.354945 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d450015d-1f82-4eb8-89d1-22b1fd4dc2e0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1323 microversion: 2.1 time: 0.164469 Sep 18 01:44:45.368846 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3059/6142] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:45 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:45.395635 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-718c8db0-6395-4fe3-b233-4c8c4f7fc647 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1647 microversion: 2.1 time: 0.289280 Sep 18 01:44:45.396276 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3084/6143] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:45 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1647 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:45.420840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:45.421432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:45.438514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.439025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.439474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.440208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.440703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.441140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.502436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:44:45.647041 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ab72c150-aace-43a7-8251-1d2116c93847 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 204 len: 0 microversion: 2.1 time: 0.231302 Sep 18 01:44:45.648199 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3060/6144] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:44:45 2022] DELETE /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:44:45.656682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:45.657313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:45.665634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.668659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.669197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.670073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:45.670756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:45.671196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:45.888424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-933bf6d4-07ce-4e84-ad82-03122ee3240f tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1653 microversion: 2.1 time: 0.235474 Sep 18 01:44:45.891370 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3085/6145] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:45 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1653 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:46.388147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:46.389695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:46.398582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:46.398582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:46.399507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:46.403138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:46.403138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:46.403138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:46.593869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:46.600809 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:46.604064 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-764dd882-d65b-4ce4-9c46-a08b177d6b5d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1391 microversion: 2.1 time: 0.220088 Sep 18 01:44:46.604579 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3061/6146] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:46 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:46.923151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:46.927165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:46.938493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:46.939886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:46.940720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:46.941702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:46.942328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:46.943189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:47.172669 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b1696ed7-4410-4290-be27-990497fce938 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1653 microversion: 2.1 time: 0.257775 Sep 18 01:44:47.173986 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3086/6147] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:46 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1653 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:47.413047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-283fe2bd-49b2-4a0f-a94d-051dee07b757 tempest-ComputeTenantNetworksTest-1106249601 tempest-ComputeTenantNetworksTest-1106249601-project] Calling method '.version_select at 0x7f7005ecdc10>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:47.620752 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-283fe2bd-49b2-4a0f-a94d-051dee07b757 tempest-ComputeTenantNetworksTest-1106249601 tempest-ComputeTenantNetworksTest-1106249601-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.351250 Sep 18 01:44:47.628574 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3062/6148] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:44:47 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:47.628769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:47.633969 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-443c0d4b-3a5a-484f-ba01-9066b3e89d2c tempest-ComputeTenantNetworksTest-1106249601 tempest-ComputeTenantNetworksTest-1106249601-project] Calling method '.version_select at 0x7f700a6b3280>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:47.639599 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:47.646412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:47.646902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:47.647603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:47.648307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:47.648762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:47.649189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:47.767586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-443c0d4b-3a5a-484f-ba01-9066b3e89d2c tempest-ComputeTenantNetworksTest-1106249601 tempest-ComputeTenantNetworksTest-1106249601-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/9499fbc3-d7b0-419e-919a-6424cec01557" status: 200 len: 140 microversion: 2.1 time: 0.137721 Sep 18 01:44:47.769026 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3063/6149] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:44:47 2022] GET /compute/v2.1/os-tenant-networks/9499fbc3-d7b0-419e-919a-6424cec01557 => generated 140 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:47.914080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:47.923426 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dac60c65-d33a-42b1-8a19-cc378e314a83 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1391 microversion: 2.1 time: 0.299568 Sep 18 01:44:47.925628 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3087/6150] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:47 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1391 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:44:48.198394 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:48.199322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:48.206735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:48.207233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:48.207678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:48.208455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:48.208915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:48.209337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:48.216909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a2962735-eda8-42c6-9d15-73e81cd5468b req-4e8f3b7c-5757-4603-9032-e1f9324946fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031a6ae1-6149-4bad-ac44-c69d843943de", "tag": "11ca64fc-6f90-4f32-8375-64281de10731"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:48.229394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a2962735-eda8-42c6-9d15-73e81cd5468b req-4e8f3b7c-5757-4603-9032-e1f9324946fc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:48.229999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a2962735-eda8-42c6-9d15-73e81cd5468b req-4e8f3b7c-5757-4603-9032-e1f9324946fc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:48.230488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a2962735-eda8-42c6-9d15-73e81cd5468b req-4e8f3b7c-5757-4603-9032-e1f9324946fc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:48.246019 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a2962735-eda8-42c6-9d15-73e81cd5468b req-4e8f3b7c-5757-4603-9032-e1f9324946fc service nova] Creating event network-changed:11ca64fc-6f90-4f32-8375-64281de10731 for instance 031a6ae1-6149-4bad-ac44-c69d843943de on n-h1-master-1 Sep 18 01:44:48.253349 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a2962735-eda8-42c6-9d15-73e81cd5468b req-4e8f3b7c-5757-4603-9032-e1f9324946fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039906 Sep 18 01:44:48.254829 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3088/6151] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:48.474055 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f971c727-89de-491f-8119-43aa7d5b93d1 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 200 len: 1653 microversion: 2.1 time: 0.279794 Sep 18 01:44:48.475564 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3064/6152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:48 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 1653 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:48.951956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:48.953494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:48.962309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:48.965314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:48.967080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:48.968636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:48.970342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:48.972158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:49.202877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:49.213593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4bfed42-fbc9-46e3-abb2-73f10f206dda tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1391 microversion: 2.1 time: 0.267777 Sep 18 01:44:49.214700 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3089/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:48 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:49.504136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:49.505392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f404d1c5-ab5d-43b2-9e53-4f3d498b2059] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:49.513518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:49.516749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:49.517416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:49.518424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:49.519206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:49.520130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:49.542049 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] HTTP exception thrown: Instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 could not be found. Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Request method failure captured: Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 HTTP/1.1 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnfwao0RxPaMvb2_S3sAvOgtRNRroBr8h8myM7CWzqDxWKKCWS6QY7mqiqy_opMIZ3zvkL8EgRsBI0E0VsnCoFzL1K19cCImPIIVgJs94ibtm07LkvsAIKP7A9SvDMc5gv3x4AHpokKW7VME6XXKr_g_y3ohTlYsierfhkmANj8fars Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c50aa5467486451582c9105d0a098aec Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestServerMultinode-353159407 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c50aa5467486451582c9105d0a098aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c50aa5467486451582c9105d0a098aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c50aa5467486451582c9105d0a098aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c50aa5467486451582c9105d0a098aec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestServerMultinode-353159407 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c50aa5467486451582c9105d0a098aec Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestServerMultinode-353159407 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestServerMultinode-353159407-project-admin Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cdfffd38e02c4661b0f4fc9344bdef23 Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestServerMultinode-353159407-project-admin Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: exception: Instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 could not be found. Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'f404d1c5-ab5d-43b2-9e53-4f3d498b2059'} Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 could not be found. Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 could not be found. Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:49.543728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 could not be found. Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Returning 404 to user: Instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e372485c-abe6-4f17-8b6b-59cae351c881 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059" status: 404 len: 111 microversion: 2.1 time: 0.046949 Sep 18 01:44:49.548674 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3065/6154] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:49 2022] GET /compute/v2.1/servers/f404d1c5-ab5d-43b2-9e53-4f3d498b2059 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:44:49.560009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:49.560779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:49.572862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:49.573623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:49.574309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:49.575247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:49.575940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:49.576571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:49.613929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:44:49.707848 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb698827-fffe-4c80-8668-09c7f55a25b7 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 204 len: 0 microversion: 2.1 time: 0.155868 Sep 18 01:44:49.712259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3090/6155] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:44:49 2022] DELETE /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:44:49.720110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:49.721033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:49.732539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:49.733362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:49.733930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:49.734665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:49.735139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:49.735574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:49.917869 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b699843d-0e38-42f0-a470-31315d2b01e5 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1655 microversion: 2.1 time: 0.202302 Sep 18 01:44:49.924471 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3066/6156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:49 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1655 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:49.943381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-014f8178-91b6-4c2e-b35b-36769b0a1cd9 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Action: 'create', calling method: .version_select at 0x7f70053f2b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-856495292", "metadata": {"Type": "work"}}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:50.247689 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:50.249249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:50.289054 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-014f8178-91b6-4c2e-b35b-36769b0a1cd9 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.552672 Sep 18 01:44:50.290083 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3091/6157] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 18 01:44:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 555 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 18 01:44:50.294899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-9320275d-04da-469c-9cdd-09c5b4614d09 req-2a08ea6a-0725-4f7d-a7f0-0d471feb05c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f404d1c5-ab5d-43b2-9e53-4f3d498b2059", "name": "network-vif-deleted", "tag": "7d3f91de-9f5b-455b-9c6c-c4f64524d5b9"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:50.299712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:50.302838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:50.303523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:50.306327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:50.307568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:50.308027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:50.332896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9320275d-04da-469c-9cdd-09c5b4614d09 req-2a08ea6a-0725-4f7d-a7f0-0d471feb05c2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:50.333375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9320275d-04da-469c-9cdd-09c5b4614d09 req-2a08ea6a-0725-4f7d-a7f0-0d471feb05c2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:50.333824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9320275d-04da-469c-9cdd-09c5b4614d09 req-2a08ea6a-0725-4f7d-a7f0-0d471feb05c2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:50.367688 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-9320275d-04da-469c-9cdd-09c5b4614d09 req-2a08ea6a-0725-4f7d-a7f0-0d471feb05c2 service nova] Creating event network-vif-deleted:7d3f91de-9f5b-455b-9c6c-c4f64524d5b9 for instance f404d1c5-ab5d-43b2-9e53-4f3d498b2059 on n-h2-master-1 Sep 18 01:44:50.388450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-9320275d-04da-469c-9cdd-09c5b4614d09 req-2a08ea6a-0725-4f7d-a7f0-0d471feb05c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087554 Sep 18 01:44:50.389620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3092/6158] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:50.395673 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4d536cd-28e3-4711-9f07-97db7800a06b tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f7004fc3160>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:50.468526 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4d536cd-28e3-4711-9f07-97db7800a06b tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 200 len: 352 microversion: 2.1 time: 0.077469 Sep 18 01:44:50.482108 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3093/6159] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:44:50 2022] GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:50.598242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:50.615757 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-67a9eeb9-90f9-4201-8ccd-0d12ed5f03a8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1391 microversion: 2.1 time: 0.373916 Sep 18 01:44:50.617307 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3067/6160] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:50 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1391 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:50.949140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:50.949909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:50.957353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:50.957952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:50.958462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:50.959236 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:50.959796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:50.960280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:51.110939 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ea4c8d4c-b308-4eca-8c03-d33db199095d tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1655 microversion: 2.1 time: 0.172651 Sep 18 01:44:51.123551 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3094/6161] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:50 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1655 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:51.482379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a20d621-c240-46d4-94a3-d536e39bd821 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f7006512e50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:51.536165 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a20d621-c240-46d4-94a3-d536e39bd821 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 200 len: 353 microversion: 2.1 time: 0.057545 Sep 18 01:44:51.536757 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3068/6162] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:44:51 2022] GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:51.549501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a32e4a47-d7b2-4cee-a0ea-c471d13e8487 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f7004fc34c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:51.606711 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a32e4a47-d7b2-4cee-a0ea-c471d13e8487 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 200 len: 353 microversion: 2.1 time: 0.061147 Sep 18 01:44:51.607450 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3095/6163] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:44:51 2022] GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:51.624479 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e53615d9-1f73-4665-b367-38d619e2b969 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f7005f673a0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:51.641375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:51.649457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:51.654403 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:51.669458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:51.670208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:51.670818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:51.671715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:51.672568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:51.673156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:51.731209 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e53615d9-1f73-4665-b367-38d619e2b969 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 202 len: 0 microversion: 2.1 time: 0.111040 Sep 18 01:44:51.732210 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3069/6164] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 18 01:44:51 2022] DELETE /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:44:51.748027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a31847ea-d64c-4a88-891d-950d2efa2bd4 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f7005eade50>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:51.833973 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a31847ea-d64c-4a88-891d-950d2efa2bd4 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 200 len: 352 microversion: 2.1 time: 0.092561 Sep 18 01:44:51.834543 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3070/6165] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:44:51 2022] GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:51.979526 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:51.990253 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-493c0c0a-16ca-438c-ab54-670a65b0f733 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1391 microversion: 2.1 time: 0.352449 Sep 18 01:44:51.991800 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3096/6166] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:51 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:52.135189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:52.135797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:52.145589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:52.146068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:52.146506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:52.147471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:52.156975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:52.158485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:52.442356 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d38ada1-c13e-46bc-8283-41f5e1d7cd15 tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 200 len: 1655 microversion: 2.1 time: 0.310842 Sep 18 01:44:52.442947 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3071/6167] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:52 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 1655 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:52.600322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-fae3b432-e94a-4e0b-86e7-576a383988b3 req-c4c326a2-1658-489e-9ef2-8e70ed3c7869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f706c376-5085-4369-aa9c-c849746cfd8e", "name": "network-vif-deleted", "tag": "7f3fafa6-3624-4968-a695-e736882d5d80"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:52.610934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fae3b432-e94a-4e0b-86e7-576a383988b3 req-c4c326a2-1658-489e-9ef2-8e70ed3c7869 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:52.612506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fae3b432-e94a-4e0b-86e7-576a383988b3 req-c4c326a2-1658-489e-9ef2-8e70ed3c7869 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:52.613008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fae3b432-e94a-4e0b-86e7-576a383988b3 req-c4c326a2-1658-489e-9ef2-8e70ed3c7869 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:52.629705 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-fae3b432-e94a-4e0b-86e7-576a383988b3 req-c4c326a2-1658-489e-9ef2-8e70ed3c7869 service nova] Creating event network-vif-deleted:7f3fafa6-3624-4968-a695-e736882d5d80 for instance f706c376-5085-4369-aa9c-c849746cfd8e on n-h1-master-1 Sep 18 01:44:52.636859 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-fae3b432-e94a-4e0b-86e7-576a383988b3 req-c4c326a2-1658-489e-9ef2-8e70ed3c7869 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040833 Sep 18 01:44:52.640485 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3097/6168] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:52.848048 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a969842-e7ef-402f-ab59-c7810edbdcce tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f7005273d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:52.922572 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a969842-e7ef-402f-ab59-c7810edbdcce tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 200 len: 352 microversion: 2.1 time: 0.078269 Sep 18 01:44:52.923164 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3072/6169] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:44:52 2022] GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:53.010357 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:53.011617 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:44:53.019583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:53.020303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:53.035788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:53.036290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:53.036741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:53.037453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:53.037938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:53.038364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:53.243271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:53.256441 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-901c90e4-a75a-41d7-86b9-aabb2e977f01 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1391 microversion: 2.1 time: 0.246927 Sep 18 01:44:53.257539 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3098/6170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:53 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:53.472853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:53.473624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] [instance: f706c376-5085-4369-aa9c-c849746cfd8e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:53.485950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:53.488360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:53.489050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:53.490119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:53.490662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:53.491522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:53.519404 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] HTTP exception thrown: Instance f706c376-5085-4369-aa9c-c849746cfd8e could not be found. Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Request method failure captured: Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e HTTP/1.1 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnfwao0RxPaMvb2_S3sAvOgtRNRroBr8h8myM7CWzqDxWKKCWS6QY7mqiqy_opMIZ3zvkL8EgRsBI0E0VsnCoFzL1K19cCImPIIVgJs94ibtm07LkvsAIKP7A9SvDMc5gv3x4AHpokKW7VME6XXKr_g_y3ohTlYsierfhkmANj8fars Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: c50aa5467486451582c9105d0a098aec Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestServerMultinode-353159407 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c50aa5467486451582c9105d0a098aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c50aa5467486451582c9105d0a098aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c50aa5467486451582c9105d0a098aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c50aa5467486451582c9105d0a098aec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestServerMultinode-353159407 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: c50aa5467486451582c9105d0a098aec Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestServerMultinode-353159407 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestServerMultinode-353159407-project-admin Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cdfffd38e02c4661b0f4fc9344bdef23 Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestServerMultinode-353159407-project-admin Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: exception: Instance f706c376-5085-4369-aa9c-c849746cfd8e could not be found. Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'f706c376-5085-4369-aa9c-c849746cfd8e'} Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f706c376-5085-4369-aa9c-c849746cfd8e could not be found. Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f706c376-5085-4369-aa9c-c849746cfd8e could not be found. Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:53.522978 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f706c376-5085-4369-aa9c-c849746cfd8e could not be found. Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] Returning 404 to user: Instance f706c376-5085-4369-aa9c-c849746cfd8e could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:53.528181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a2491b70-7f22-446c-838d-3e960b4b223e tempest-TestServerMultinode-353159407 tempest-TestServerMultinode-353159407-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e" status: 404 len: 111 microversion: 2.1 time: 0.062299 Sep 18 01:44:53.529465 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3073/6171] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:53 2022] GET /compute/v2.1/servers/f706c376-5085-4369-aa9c-c849746cfd8e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:44:53.814713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-fc6be9b5-4efd-4ecd-a9ef-6b0a2d309c2e req-d9e4838e-656c-4860-8e3f-63ee1eb1d7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031a6ae1-6149-4bad-ac44-c69d843943de", "name": "network-vif-plugged", "status": "completed", "tag": "11ca64fc-6f90-4f32-8375-64281de10731"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:44:53.843633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fc6be9b5-4efd-4ecd-a9ef-6b0a2d309c2e req-d9e4838e-656c-4860-8e3f-63ee1eb1d7d8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:53.844469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fc6be9b5-4efd-4ecd-a9ef-6b0a2d309c2e req-d9e4838e-656c-4860-8e3f-63ee1eb1d7d8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:53.846903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fc6be9b5-4efd-4ecd-a9ef-6b0a2d309c2e req-d9e4838e-656c-4860-8e3f-63ee1eb1d7d8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:53.881677 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-fc6be9b5-4efd-4ecd-a9ef-6b0a2d309c2e req-d9e4838e-656c-4860-8e3f-63ee1eb1d7d8 service nova] Creating event network-vif-plugged:11ca64fc-6f90-4f32-8375-64281de10731 for instance 031a6ae1-6149-4bad-ac44-c69d843943de on n-h1-master-1 Sep 18 01:44:53.890145 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-fc6be9b5-4efd-4ecd-a9ef-6b0a2d309c2e req-d9e4838e-656c-4860-8e3f-63ee1eb1d7d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079250 Sep 18 01:44:53.891859 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3099/6172] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:53.938131 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12b4dc8f-9650-41b0-9e38-4e3f50c09e04 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f700670cb80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:54.014289 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12b4dc8f-9650-41b0-9e38-4e3f50c09e04 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 200 len: 352 microversion: 2.1 time: 0.080624 Sep 18 01:44:54.017814 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3074/6173] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:44:53 2022] GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:44:54.285439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:54.286212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:54.300052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:54.302155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:54.302603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:54.303353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:54.303817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:54.304245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:54.610543 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:54.623173 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5edbc213-9c3e-4a31-bbb3-1cd55a6ffa1b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1391 microversion: 2.1 time: 0.343147 Sep 18 01:44:54.623780 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3100/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:54 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1391 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:55.029788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe30130c-0b65-440e-ac5a-b46d495e4df2 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Calling method '.version_select at 0x7f7005e83c10>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:55.085935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-fe30130c-0b65-440e-ac5a-b46d495e4df2 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] HTTP exception thrown: Volume 69c0bf5c-e04b-45b5-8ecc-fb621767174e could not be found. Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe30130c-0b65-440e-ac5a-b46d495e4df2 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Request method failure captured: Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e HTTP/1.1 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJngRX1l674uMOkT3YUcQfA56BFq2Zr7hWGoyCcbVRcS3L43WTMJPfWnV4DbFUPQYmyk_mi3Ztx_zPU0SFxUpe4NwgbClfgdM4qFA8nhLFM-hbmsHRfw363PqSIryNKjYPMbjxDr0DWJQgr541N5uc5WNN4ZE2yR_FYN79WiK5E8rDz8 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 50c2abac418b4e898752401d8a1ac503 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-VolumesGetTestJSON-1454567045 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50c2abac418b4e898752401d8a1ac503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/50c2abac418b4e898752401d8a1ac503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_50c2abac418b4e898752401d8a1ac503"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50c2abac418b4e898752401d8a1ac503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-VolumesGetTestJSON-1454567045 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 50c2abac418b4e898752401d8a1ac503 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-VolumesGetTestJSON-1454567045 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-VolumesGetTestJSON-1454567045-project Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 46b0819374cb4df7be2fece72cb0fff2 Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-VolumesGetTestJSON-1454567045-project Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: method: Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: exception: Volume 69c0bf5c-e04b-45b5-8ecc-fb621767174e could not be found. Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '69c0bf5c-e04b-45b5-8ecc-fb621767174e'} Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69c0bf5c-e04b-45b5-8ecc-fb621767174e could not be found. (HTTP 404) (Request-ID: req-405e70db-61d4-4918-9f1b-808f272307b5) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:44:55.088321 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69c0bf5c-e04b-45b5-8ecc-fb621767174e could not be found. Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69c0bf5c-e04b-45b5-8ecc-fb621767174e could not be found. Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69c0bf5c-e04b-45b5-8ecc-fb621767174e could not be found. Sep 18 01:44:55.093425 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:44:55.097696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe30130c-0b65-440e-ac5a-b46d495e4df2 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] Returning 404 to user: Volume 69c0bf5c-e04b-45b5-8ecc-fb621767174e could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:44:55.098742 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe30130c-0b65-440e-ac5a-b46d495e4df2 tempest-VolumesGetTestJSON-1454567045 tempest-VolumesGetTestJSON-1454567045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e" status: 404 len: 109 microversion: 2.1 time: 0.074023 Sep 18 01:44:55.099829 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3075/6175] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 18 01:44:55 2022] GET /compute/v2.1/os-volumes/69c0bf5c-e04b-45b5-8ecc-fb621767174e => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:44:55.649855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:55.651178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:55.664087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:55.666461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:55.667110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:55.668044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:55.669796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:55.670638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:56.044965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:56.057175 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d39ef9e-7f6f-4c09-83fe-e6f24d1480bb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1563 microversion: 2.1 time: 0.411011 Sep 18 01:44:56.074639 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3101/6176] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:55 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1563 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:44:56.083859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:44:56.084483 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:44:56.098324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:56.099072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:56.099689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:56.100585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:44:56.102572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:44:56.103209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:44:56.626155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:44:56.637004 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e144b212-f83c-4640-9c60-2c02fb38a2ec tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1563 microversion: 2.1 time: 0.558441 Sep 18 01:44:56.637822 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3076/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:44:56 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1563 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:00.914287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:00.915069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:00.917825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ee215b19-0cba-4df1-8b1d-f21ccf743032 req-4817f77c-6c14-466a-8334-20e76c4971a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031a6ae1-6149-4bad-ac44-c69d843943de", "tag": "11ca64fc-6f90-4f32-8375-64281de10731"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:00.929304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:00.929764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:00.930214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:00.934344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ee215b19-0cba-4df1-8b1d-f21ccf743032 req-4817f77c-6c14-466a-8334-20e76c4971a1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:00.935139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ee215b19-0cba-4df1-8b1d-f21ccf743032 req-4817f77c-6c14-466a-8334-20e76c4971a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:00.936178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ee215b19-0cba-4df1-8b1d-f21ccf743032 req-4817f77c-6c14-466a-8334-20e76c4971a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:00.943416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:00.949719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:00.952164 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ee215b19-0cba-4df1-8b1d-f21ccf743032 req-4817f77c-6c14-466a-8334-20e76c4971a1 service nova] Creating event network-changed:11ca64fc-6f90-4f32-8375-64281de10731 for instance 031a6ae1-6149-4bad-ac44-c69d843943de on n-h1-master-1 Sep 18 01:45:00.953647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:00.974965 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ee215b19-0cba-4df1-8b1d-f21ccf743032 req-4817f77c-6c14-466a-8334-20e76c4971a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059279 Sep 18 01:45:00.982390 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3077/6178] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:45:01.441843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:01.454440 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c6f49aeb-00a4-431b-bfd5-3db710b50b6f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1563 microversion: 2.1 time: 0.551056 Sep 18 01:45:01.455072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3102/6179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:00 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1563 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:20.133327 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:45:20.134678 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=36 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:45:20.364986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:20.367648 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:20.374101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:20.374808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:20.375254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:20.375968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:20.376431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:20.376861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:20.448823 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fd2c4057-79b1-4098-a3c3-bc72391683b0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action" status: 200 len: 24563 microversion: 2.1 time: 0.317469 Sep 18 01:45:20.456079 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3078/6180] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:45:20 2022] POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action => generated 24563 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:45:26.866481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:26.873671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:26.884653 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=13 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:45:26.885771 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:45:26.890512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:26.891030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:26.892179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:26.893604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:26.894083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:26.894523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:27.137208 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:27.150458 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce887880-9928-4c1f-a63d-f8872a100dd0 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1682 microversion: 2.1 time: 0.288451 Sep 18 01:45:27.151496 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3103/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:26 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:45:27.279004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:27.281921 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:27.290728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:27.291335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:27.291854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:27.292662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:27.293200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:27.293945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:27.374408 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-45def123-cc07-4e80-b767-5ddf1103b31b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action" status: 200 len: 32638 microversion: 2.1 time: 0.100094 Sep 18 01:45:27.375509 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3079/6182] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:45:27 2022] POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action => generated 32638 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:45:27.806178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:27.806797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:27.814266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:27.814842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:27.815294 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:27.816002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:27.816466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:27.816898 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:27.965522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9032faf5-d441-4db2-b8b1-a7e076165285 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1833 microversion: 2.1 time: 0.352020 Sep 18 01:45:27.966235 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3104/6183] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:27 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1833 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:45:27.996158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:27.998791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:28.006393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:28.006877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:28.007316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:28.008014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:28.008469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:28.008899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:28.161180 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lazy-loading 'flavor' on Instance uuid 031a6ae1-6149-4bad-ac44-c69d843943de {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:45:28.176894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Going to try to live migrate instance to another host {{(pid=122373) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 18 01:45:29.932646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e422e4d2-25e8-47b5-9ec2-19a774283106 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action" status: 202 len: 0 microversion: 2.1 time: 1.940396 Sep 18 01:45:29.934055 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3080/6184] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:45:27 2022] POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action => generated 0 bytes in 1943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:45:29.947006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:29.947720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:29.956155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:29.957035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:29.957681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:29.958575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:29.959198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:29.959823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:30.269508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:30.281917 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65806bc7-158f-4203-a699-3c028d6e4eb8 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.341870 Sep 18 01:45:30.283734 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3105/6185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:29 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:31.309601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:31.310484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:31.323644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:31.325149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:31.340005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:31.340943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:31.341435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:31.341997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:31.562208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:31.571120 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6315cb86-c2d9-4ce8-a362-42e64196f595 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.267145 Sep 18 01:45:31.571801 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3081/6186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:31 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:45:31.762797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-76dd012d-462f-4c2b-b3a7-3f4a42eced52 req-7ef3f1dc-dbf3-4b07-8869-cc072a2b2a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031a6ae1-6149-4bad-ac44-c69d843943de", "name": "network-vif-unplugged", "status": "completed", "tag": "11ca64fc-6f90-4f32-8375-64281de10731"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:31.783356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-76dd012d-462f-4c2b-b3a7-3f4a42eced52 req-7ef3f1dc-dbf3-4b07-8869-cc072a2b2a0b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:31.784023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-76dd012d-462f-4c2b-b3a7-3f4a42eced52 req-7ef3f1dc-dbf3-4b07-8869-cc072a2b2a0b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:31.784524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-76dd012d-462f-4c2b-b3a7-3f4a42eced52 req-7ef3f1dc-dbf3-4b07-8869-cc072a2b2a0b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:31.808652 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-76dd012d-462f-4c2b-b3a7-3f4a42eced52 req-7ef3f1dc-dbf3-4b07-8869-cc072a2b2a0b service nova] Creating event network-vif-unplugged:11ca64fc-6f90-4f32-8375-64281de10731 for instance 031a6ae1-6149-4bad-ac44-c69d843943de on n-h1-master-1 Sep 18 01:45:31.816912 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-76dd012d-462f-4c2b-b3a7-3f4a42eced52 req-7ef3f1dc-dbf3-4b07-8869-cc072a2b2a0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061588 Sep 18 01:45:31.817521 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3106/6187] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:45:32.594979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:32.595596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:32.618081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:32.618857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:32.619996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:32.621412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:32.622103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:32.622767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:32.817368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:32.829072 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aa62251d-e2d7-4f5f-9c73-147986d675d4 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.238063 Sep 18 01:45:32.830356 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3082/6188] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:32 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:33.862684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:33.863582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:33.872869 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-07433c63-7a97-4470-a8f3-0d1d2962b2aa req-7fed6420-3d93-4e1d-944a-ef30dd2615c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031a6ae1-6149-4bad-ac44-c69d843943de", "tag": "11ca64fc-6f90-4f32-8375-64281de10731"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:33.887539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:33.888042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:33.888477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:33.889222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-07433c63-7a97-4470-a8f3-0d1d2962b2aa req-7fed6420-3d93-4e1d-944a-ef30dd2615c7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:33.889678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:33.890144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:33.890460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-07433c63-7a97-4470-a8f3-0d1d2962b2aa req-7fed6420-3d93-4e1d-944a-ef30dd2615c7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:33.890579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:33.891569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-07433c63-7a97-4470-a8f3-0d1d2962b2aa req-7fed6420-3d93-4e1d-944a-ef30dd2615c7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:33.905985 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-07433c63-7a97-4470-a8f3-0d1d2962b2aa req-7fed6420-3d93-4e1d-944a-ef30dd2615c7 service nova] Creating event network-changed:11ca64fc-6f90-4f32-8375-64281de10731 for instance 031a6ae1-6149-4bad-ac44-c69d843943de on n-h1-master-1 Sep 18 01:45:33.912826 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-07433c63-7a97-4470-a8f3-0d1d2962b2aa req-7fed6420-3d93-4e1d-944a-ef30dd2615c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045140 Sep 18 01:45:33.914475 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3083/6189] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:45:34.091243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:34.104323 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-81513991-4280-4b64-ba7a-84575f63240d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.251199 Sep 18 01:45:34.105600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3107/6190] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:33 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:35.137703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:35.139312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:35.148951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:35.149631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:35.150234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:35.151317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:35.151974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:35.152640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:35.440408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:35.456535 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-300cadc3-af5d-451f-940b-04790376de6b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.325233 Sep 18 01:45:35.458727 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3084/6191] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:35 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:45:36.498783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:36.500113 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:36.507835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:36.508874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:36.509238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:36.509998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:36.510463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:36.510895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:36.713104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:36.743349 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e3d5a7cf-4485-4633-b8e9-5657a1ed1ecf tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.252277 Sep 18 01:45:36.756789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3108/6192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:36 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:37.781497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:37.783531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:37.791927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:37.792712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:37.793345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:37.794256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:37.795030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:37.795836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:38.068433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:38.080735 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94ec2e1a-5868-40d8-aa3e-52ea16518075 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.304356 Sep 18 01:45:38.081491 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3085/6193] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:37 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:39.105906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:39.106793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:39.115191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:39.115764 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:39.116214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:39.117036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:39.117526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:39.117976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:39.347563 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:39.358802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a4d366f-5c49-4c6b-8b41-fc0a466e1141 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1692 microversion: 2.1 time: 0.258258 Sep 18 01:45:39.363081 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3109/6194] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:39 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1692 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:40.385015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:40.386286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:40.393740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:40.408029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:40.410679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:40.413346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:40.414859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:40.416845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:40.647848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:40.656292 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fc11de7-b29a-4bde-9bc0-3cabc5fe553c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1682 microversion: 2.1 time: 0.274916 Sep 18 01:45:40.657023 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3086/6195] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:40 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:40.679445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:40.680494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:40.689220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:40.689901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:40.690445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:40.691256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:40.691947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:40.693347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:40.954855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-72bb43fa-89d4-461d-b686-80daf11c2156 tempest-TestNetworkAdvancedServerOps-1804788609 tempest-TestNetworkAdvancedServerOps-1804788609-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1833 microversion: 2.1 time: 0.279330 Sep 18 01:45:40.955464 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3110/6196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:40 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1833 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:40.981046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:40.981738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:40.989687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:40.989985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:40.990631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:40.991730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:40.992354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:40.992945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:41.263902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:41.288306 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12583752-ed1e-4a76-bad5-eb178e277711 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1682 microversion: 2.1 time: 0.311022 Sep 18 01:45:41.289578 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3087/6197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:40 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1682 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:41.423842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:41.426173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:41.432494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:41.433017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:41.433692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:41.434405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:41.434864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:41.435291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:41.526463 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa85f367-0dd3-4b69-8387-1ec81d7876a5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action" status: 200 len: 38490 microversion: 2.1 time: 0.108305 Sep 18 01:45:41.527224 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3111/6198] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:45:41 2022] POST /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de/action => generated 38490 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:45:45.206299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:45.206815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:45.224400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-50365984-a813-472f-985f-c14f21150215 req-28418b6e-8492-4c95-93e8-ce1dd7671420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031a6ae1-6149-4bad-ac44-c69d843943de", "tag": "11ca64fc-6f90-4f32-8375-64281de10731"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:45.231394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:45.232282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:45.232886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:45.238922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:45.239624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:45.240279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:45.246163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-50365984-a813-472f-985f-c14f21150215 req-28418b6e-8492-4c95-93e8-ce1dd7671420 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:45.252290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-50365984-a813-472f-985f-c14f21150215 req-28418b6e-8492-4c95-93e8-ce1dd7671420 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:45.252951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-50365984-a813-472f-985f-c14f21150215 req-28418b6e-8492-4c95-93e8-ce1dd7671420 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:45.279883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-50365984-a813-472f-985f-c14f21150215 req-28418b6e-8492-4c95-93e8-ce1dd7671420 service nova] Creating event network-changed:11ca64fc-6f90-4f32-8375-64281de10731 for instance 031a6ae1-6149-4bad-ac44-c69d843943de on n-h2-master-1 Sep 18 01:45:45.293791 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-50365984-a813-472f-985f-c14f21150215 req-28418b6e-8492-4c95-93e8-ce1dd7671420 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074770 Sep 18 01:45:45.295936 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3112/6199] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:45:45.299448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:45:45.438566 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-01b7b165-2aa2-4c19-b321-b95a3acd368f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 204 len: 0 microversion: 2.1 time: 0.236733 Sep 18 01:45:45.439599 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3088/6200] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:45:45 2022] DELETE /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:45:45.448923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:45.449803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:45.466862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:45.469533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:45.473256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:45.474429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:45.476377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:45.478563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:45.766162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:45.794891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2036a324-3d88-4064-83d2-ffe8709debb3 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1688 microversion: 2.1 time: 0.345819 Sep 18 01:45:45.796432 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3113/6201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:45 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1688 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:46.829790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:46.830508 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:46.847459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:46.848662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:46.849271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:46.850288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:46.851682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:46.852286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:47.294853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:45:47.307934 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4f67d592-25ee-41ae-9e72-231a232cc3b1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 200 len: 1569 microversion: 2.1 time: 0.480733 Sep 18 01:45:47.308758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3089/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:46 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 1569 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:45:47.612696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-88f853dc-104f-4fd0-80bf-7014948ec1ed req-9667a0c3-8e46-41b1-99ef-ea92c16264b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031a6ae1-6149-4bad-ac44-c69d843943de", "name": "network-vif-deleted", "tag": "11ca64fc-6f90-4f32-8375-64281de10731"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:47.624689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-88f853dc-104f-4fd0-80bf-7014948ec1ed req-9667a0c3-8e46-41b1-99ef-ea92c16264b8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:47.625449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-88f853dc-104f-4fd0-80bf-7014948ec1ed req-9667a0c3-8e46-41b1-99ef-ea92c16264b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:47.626064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-88f853dc-104f-4fd0-80bf-7014948ec1ed req-9667a0c3-8e46-41b1-99ef-ea92c16264b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:47.643663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-88f853dc-104f-4fd0-80bf-7014948ec1ed req-9667a0c3-8e46-41b1-99ef-ea92c16264b8 service nova] Creating event network-vif-deleted:11ca64fc-6f90-4f32-8375-64281de10731 for instance 031a6ae1-6149-4bad-ac44-c69d843943de on n-h2-master-1 Sep 18 01:45:47.650171 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-88f853dc-104f-4fd0-80bf-7014948ec1ed req-9667a0c3-8e46-41b1-99ef-ea92c16264b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042441 Sep 18 01:45:47.651476 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3114/6203] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:45:48.339474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:48.341651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 031a6ae1-6149-4bad-ac44-c69d843943de] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:45:48.358693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:48.362020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:48.362682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:48.373872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:45:48.375676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:45:48.376419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:45:48.400729 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] HTTP exception thrown: Instance 031a6ae1-6149-4bad-ac44-c69d843943de could not be found. Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Request method failure captured: Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de HTTP/1.1 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnbyk5s0dRRAabvkMBwA_LP2vJUd_Q5hjvjpPddO70XgVKwdaPyUXiB9cCjfcYFRppjLgCrsUwFQKRWZZf_FtW7ok49SJDalWxps012yn7ohGXMzX4A07Ecf2_5KAzVkxyB1I14F4f2c_IEKdWF_O6ffKflIC9mNPHg5YUoKxuxhkRc Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/534af518a54843d9b0288bc79448de27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_534af518a54843d9b0288bc79448de27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 50ef9fd3ac384cfe907975caddd403a2 Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 031a6ae1-6149-4bad-ac44-c69d843943de could not be found. Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '031a6ae1-6149-4bad-ac44-c69d843943de'} Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031a6ae1-6149-4bad-ac44-c69d843943de could not be found. Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031a6ae1-6149-4bad-ac44-c69d843943de could not be found. Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:45:48.403046 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031a6ae1-6149-4bad-ac44-c69d843943de could not be found. Sep 18 01:45:48.408505 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:45:48.424026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Returning 404 to user: Instance 031a6ae1-6149-4bad-ac44-c69d843943de could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:45:48.425372 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8df18457-d6c9-4049-9c50-4044e6cf0ba5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de" status: 404 len: 111 microversion: 2.1 time: 0.090983 Sep 18 01:45:48.426584 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3090/6204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:45:48 2022] GET /compute/v2.1/servers/031a6ae1-6149-4bad-ac44-c69d843943de => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:45:54.308808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e0f25eb-251a-46db-836c-9af212ce5fcc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '.version_select at 0x7f70065b5af0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:45:54.355325 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e0f25eb-251a-46db-836c-9af212ce5fcc tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-298279531" status: 202 len: 0 microversion: 2.1 time: 0.051868 Sep 18 01:45:54.356172 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3115/6205] 10.222.0.25 () {58 vars in 1281 bytes} [Sun Sep 18 01:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-298279531 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:45:54.394139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4ce6a70e-fee4-4440-8c71-81fa795b6ceb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: .version_select at 0x7f7005281af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-896016642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsTS8aR3S3BEVlOUr7BXPNHiy8d/vIGSNBoS2t0URVhpNS6eHfp/IG2a4yo1OXQ5FlI4pMTNoRR/Ffy3xKWX806rT73It2vaxUKXQ4JKJSdMEocD6MQ75skgpM3bUUCpw=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:45:54.401792 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:45:54.415683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4ce6a70e-fee4-4440-8c71-81fa795b6ceb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:45:54.424193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4ce6a70e-fee4-4440-8c71-81fa795b6ceb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:45:54.458629 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4ce6a70e-fee4-4440-8c71-81fa795b6ceb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.069026 Sep 18 01:45:54.459546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3091/6206] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:45:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:46:04.548393 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=58 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:04.549263 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:04.566229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-658582478", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "a1614c46-19e4-41c6-a075-ea4d68833f67"}], "key_name": "tempest-TestNetworkAdvancedServerOps-896016642", "security_groups": [{"name": "tempest-secgroup-smoke-948795053"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:46:04.791855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] validate_networks() for [('a1614c46-19e4-41c6-a075-ea4d68833f67', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:46:06.135879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:46:06.136984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:46:06.137651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:46:06.138221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:46:06.138818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:46:06.150977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:06.151980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:06.153483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:06.160375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:06.161068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:06.161752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:06.204288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:46:06.215161 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Getting quotas for user 50ef9fd3ac384cfe907975caddd403a2 and project 534af518a54843d9b0288bc79448de27. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:46:06.241573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:46:06.244771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:46:06.341120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5fe95cfd-85a0-4c02-a5ae-f0520e96c53f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.794405 Sep 18 01:46:06.343971 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3116/6207] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:46:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:46:06.364143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72c076a6-5339-4ce4-8f8e-56770f2aa0c5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:06.365521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72c076a6-5339-4ce4-8f8e-56770f2aa0c5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:06.369851 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:06.371481 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:06.372492 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:06.480551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72c076a6-5339-4ce4-8f8e-56770f2aa0c5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:06.493644 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72c076a6-5339-4ce4-8f8e-56770f2aa0c5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1265 microversion: 2.1 time: 0.130392 Sep 18 01:46:06.518565 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3092/6208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:06 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:07.520711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:07.521657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:07.539999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:07.543447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:07.547543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:07.548322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:07.553157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:07.556326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:07.776328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:07.789952 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52bef860-38b7-4f71-b76e-ed51f8ee5f36 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1269 microversion: 2.1 time: 0.274402 Sep 18 01:46:07.790577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3117/6209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:07 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1269 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:08.818529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:08.819266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:08.836821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:08.837328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:08.838910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:08.840753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:08.841975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:08.842425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:08.981428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:08.992680 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6b98a8dc-4830-46e6-889f-df1b99f22e49 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1323 microversion: 2.1 time: 0.179737 Sep 18 01:46:09.008633 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3093/6210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:08 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:10.022416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:10.023702 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:10.036720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:10.039827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:10.040612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:10.042406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:10.044662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:10.048570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:10.310881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:10.319434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0f1998d8-cca0-4a28-9049-428a3787c491 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1390 microversion: 2.1 time: 0.301968 Sep 18 01:46:10.320037 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3118/6211] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:10 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1390 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:10.934212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c70bacbe-d93c-41f6-82e9-90fb77daaba1 req-8811236c-31aa-4756-8ab3-8cac40cb0c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98985424-fc84-41fe-a3ff-104631895ee7", "tag": "f5f70582-78ac-4edc-b642-62466922762e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:46:10.946048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c70bacbe-d93c-41f6-82e9-90fb77daaba1 req-8811236c-31aa-4756-8ab3-8cac40cb0c1a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:10.946646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c70bacbe-d93c-41f6-82e9-90fb77daaba1 req-8811236c-31aa-4756-8ab3-8cac40cb0c1a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:10.947147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c70bacbe-d93c-41f6-82e9-90fb77daaba1 req-8811236c-31aa-4756-8ab3-8cac40cb0c1a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:10.960868 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c70bacbe-d93c-41f6-82e9-90fb77daaba1 req-8811236c-31aa-4756-8ab3-8cac40cb0c1a service nova] Creating event network-changed:f5f70582-78ac-4edc-b642-62466922762e for instance 98985424-fc84-41fe-a3ff-104631895ee7 on n-h1-master-1 Sep 18 01:46:10.966525 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c70bacbe-d93c-41f6-82e9-90fb77daaba1 req-8811236c-31aa-4756-8ab3-8cac40cb0c1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036663 Sep 18 01:46:10.967323 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3094/6212] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:46:11.357971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:11.363378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:11.388465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:11.389767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:11.390480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:11.391507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:11.391972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:11.392396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:11.663762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:11.676829 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d44225f-698e-4eb5-ac3c-6cf8f23383d1 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1390 microversion: 2.1 time: 0.331555 Sep 18 01:46:11.676829 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3119/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:11 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1390 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:12.705475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:12.706854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:12.720757 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:12.724872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:12.726049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:12.727566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:12.729352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:12.730085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:13.099123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:13.114073 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6201c2b7-1d85-462d-9ca8-416b7abbc637 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1390 microversion: 2.1 time: 0.410113 Sep 18 01:46:13.115288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3095/6214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:12 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1390 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:14.139309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:14.140174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:14.147832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:14.148654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:14.149280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:14.150185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:14.150816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:14.151555 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:14.318775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:14.327753 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42dfbeee-ccde-4b4a-bbe2-c697662857f5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1390 microversion: 2.1 time: 0.193486 Sep 18 01:46:14.328578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3120/6215] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:14 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1390 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:15.354121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:15.360144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:15.366945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:15.367749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:15.368569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:15.369589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:15.370035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:15.370626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:15.553176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:15.562685 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4222cd6-b67d-4f57-91e4-19f29bb8e05d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1390 microversion: 2.1 time: 0.213182 Sep 18 01:46:15.563380 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3096/6216] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:15 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:46:15.968053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bc2f1d61-0567-4705-a5de-d84e9e9e421d req-486b653f-4664-4b32-9dd4-524734f6f8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98985424-fc84-41fe-a3ff-104631895ee7", "name": "network-vif-plugged", "status": "completed", "tag": "f5f70582-78ac-4edc-b642-62466922762e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:46:15.986809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bc2f1d61-0567-4705-a5de-d84e9e9e421d req-486b653f-4664-4b32-9dd4-524734f6f8d8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:15.987541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bc2f1d61-0567-4705-a5de-d84e9e9e421d req-486b653f-4664-4b32-9dd4-524734f6f8d8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:15.988724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bc2f1d61-0567-4705-a5de-d84e9e9e421d req-486b653f-4664-4b32-9dd4-524734f6f8d8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:16.003261 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bc2f1d61-0567-4705-a5de-d84e9e9e421d req-486b653f-4664-4b32-9dd4-524734f6f8d8 service nova] Creating event network-vif-plugged:f5f70582-78ac-4edc-b642-62466922762e for instance 98985424-fc84-41fe-a3ff-104631895ee7 on n-h1-master-1 Sep 18 01:46:16.008583 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bc2f1d61-0567-4705-a5de-d84e9e9e421d req-486b653f-4664-4b32-9dd4-524734f6f8d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048537 Sep 18 01:46:16.009889 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3121/6217] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:46:16.586308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:16.587555 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:16.590208 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:16.595965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:16.596494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:16.596930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:16.597667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:16.598132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:16.598553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:16.750169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:16.759507 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7400283b-f7c0-49e6-af0e-322b80107eab tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1390 microversion: 2.1 time: 0.177041 Sep 18 01:46:16.761249 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3097/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:16 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:17.781802 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:17.782997 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:17.788581 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:17.789346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:17.797283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:17.797792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:17.798338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:17.798901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:17.799355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:17.799777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:17.956553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:17.970430 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-32e46780-1175-4019-b323-a0b048613857 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1562 microversion: 2.1 time: 0.189663 Sep 18 01:46:17.981849 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3122/6219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:17 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1562 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:18.007347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:18.008076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:18.015763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:18.016280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:18.016689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:18.017384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:18.017922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:18.018597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:18.172541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:18.180632 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-387e2e05-ccc1-4b6a-95e0-102e07475c16 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1562 microversion: 2.1 time: 0.177886 Sep 18 01:46:18.181830 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3098/6220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:18 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:20.184037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:20.184822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:20.185684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-56e6fe54-1e43-4fab-b993-93251291668d req-2b810bc8-cf8b-4b2c-ae33-753beaf06711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98985424-fc84-41fe-a3ff-104631895ee7", "tag": "f5f70582-78ac-4edc-b642-62466922762e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:46:20.199620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-56e6fe54-1e43-4fab-b993-93251291668d req-2b810bc8-cf8b-4b2c-ae33-753beaf06711 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:20.200436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:20.200940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:20.201076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-56e6fe54-1e43-4fab-b993-93251291668d req-2b810bc8-cf8b-4b2c-ae33-753beaf06711 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:20.201387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:20.202032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-56e6fe54-1e43-4fab-b993-93251291668d req-2b810bc8-cf8b-4b2c-ae33-753beaf06711 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:20.205574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:20.206070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:20.206519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:20.218568 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-56e6fe54-1e43-4fab-b993-93251291668d req-2b810bc8-cf8b-4b2c-ae33-753beaf06711 service nova] Creating event network-changed:f5f70582-78ac-4edc-b642-62466922762e for instance 98985424-fc84-41fe-a3ff-104631895ee7 on n-h1-master-1 Sep 18 01:46:20.226304 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-56e6fe54-1e43-4fab-b993-93251291668d req-2b810bc8-cf8b-4b2c-ae33-753beaf06711 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043758 Sep 18 01:46:20.232477 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3099/6221] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:46:20.496628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:20.514735 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e3fe14a1-3298-4024-8f5f-665a8fb13964 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1562 microversion: 2.1 time: 0.334324 Sep 18 01:46:20.515694 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3123/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:20 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1562 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:42.935231 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=18 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:42.936213 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=34 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:42.940665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:46:42.943136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:42.950471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:42.951101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:42.951554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:42.952260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:42.952723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:42.953162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:43.026716 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-058af4ce-abe7-4689-8da9-41787d5bb7fe tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7/action" status: 200 len: 24561 microversion: 2.1 time: 0.093553 Sep 18 01:46:43.034601 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3100/6223] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:46:42 2022] POST /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7/action => generated 24561 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:46:54.045390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:46:54.048231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:54.050774 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:54.051442 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=40 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:54.058324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:54.058811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:54.059759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:54.060473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:54.060923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:54.061348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:54.148086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:46:54.148516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:46:54.149065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:46:54.149544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:46:54.150021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:46:54.214547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:54.220750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:54.221235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:54.221697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:54.222501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:54.222831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:54.223271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:54.251163 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9fad26a-7a2d-439b-900e-f9b3b3bf26ba tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7/action" status: 202 len: 1137 microversion: 2.1 time: 0.209588 Sep 18 01:46:54.252086 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3124/6224] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:46:54 2022] POST /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7/action => generated 1137 bytes in 211 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 18 01:46:54.273666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:54.274365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:54.277086 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:54.278029 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:46:54.286556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:54.286556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:54.286556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:54.286556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:54.286556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:54.286556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:54.444002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:54.460200 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7222b2c4-642e-4a0e-8083-be2e1f86245f tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.190999 Sep 18 01:46:54.461124 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3101/6225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:54 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:46:55.485818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:55.486445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:55.493582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:55.494076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:55.494519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:55.495217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:55.495676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:55.496126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:55.647697 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:55.656064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74d41b04-919c-408c-a5ac-adfcd237dc97 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.174231 Sep 18 01:46:55.656647 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3125/6226] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:55 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:56.680210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:56.681486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:56.700888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:56.701836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:56.702817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:56.703729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:56.704410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:56.705031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:56.866616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:56.877628 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a325e511-bf70-411e-b366-d374d19e20eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.201795 Sep 18 01:46:56.881949 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3102/6227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:56 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:57.904202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:57.904793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:57.911846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:57.912330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:57.912766 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:57.913589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:57.914257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:57.914688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:58.063784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:58.074264 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0e7e6319-39f4-4c49-8d9b-051073cb8b3c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.173879 Sep 18 01:46:58.085541 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3126/6228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:57 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:46:59.098172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:46:59.098878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:46:59.106030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:59.106543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:59.107058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:59.107878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:46:59.108425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:46:59.108926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:46:59.265829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:46:59.281579 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-613aa4b4-f487-4374-b621-0a7dd109479e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.187231 Sep 18 01:46:59.282216 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3103/6229] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:46:59 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:00.306357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:00.306922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:00.313521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:00.314040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:00.314478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:00.315182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:00.315641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:00.316065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:00.464783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:00.476742 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-73a69eee-bfc5-48b1-b11a-5fc43298a023 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.174810 Sep 18 01:47:00.477829 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3127/6230] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:00 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:01.502703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:01.504171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:01.513381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:01.514299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:01.515198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:01.516238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:01.517111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:01.517997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:01.688934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:01.697996 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b86d1cfa-53e3-4fd9-9c35-53d47ee2b871 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.201208 Sep 18 01:47:01.698642 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3104/6231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:01 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:02.722050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:02.723561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:02.733078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:02.733781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:02.734304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:02.735030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:02.735508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:02.735924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:02.918101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:02.927512 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a6af3868-8601-48fc-8cc3-82e6aaed04b5 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.209493 Sep 18 01:47:02.928105 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3128/6232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:02 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:03.952822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:03.953752 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:03.961460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:03.961985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:03.962429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:03.963225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:03.964013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:03.964445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:04.117480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:04.130599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0ae7e51-3c20-4280-a40c-dc65b96e7e5a tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.182272 Sep 18 01:47:04.131182 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3105/6233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:03 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:05.155539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:05.159533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:05.169822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:05.170607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:05.171089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:05.176529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:05.177268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:05.177907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:05.342381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:05.351922 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bfb4d6bc-2d4e-437b-b93e-44fab67bbc06 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.200808 Sep 18 01:47:05.355952 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3129/6234] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:05 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:06.376954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:06.377765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:06.396732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:06.397238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:06.397758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:06.398671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:06.399137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:06.399750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:06.550896 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:06.561237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-062a83f1-c879-4c68-a520-09908a728e6e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.188492 Sep 18 01:47:06.562384 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3106/6235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:06 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:07.585996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:07.586938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:07.595836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:07.596456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:07.597304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:07.598445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:07.599462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:07.600106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:07.768765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:07.779991 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e0916943-41ca-445f-a00f-8edbccbbc45c tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.197839 Sep 18 01:47:07.780629 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3130/6236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:07 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:08.804356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:08.805909 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:08.813951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:08.814700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:08.817284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:08.818135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:08.818855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:08.819279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:08.968536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:08.977118 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b23d68d1-f914-4c13-9018-422376b9c73b tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.176639 Sep 18 01:47:08.977866 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3107/6237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:08 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:10.004396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:10.005243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:10.013239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:10.013837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:10.014558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:10.015649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:10.016193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:10.016863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:10.164611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:10.175384 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0670a704-b965-4611-b5bc-4511d395c4fd tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.174826 Sep 18 01:47:10.176301 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3131/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:09 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:11.201934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:11.203176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:11.211180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:11.211959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:11.212588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:11.213486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:11.214368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:11.215829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:11.367482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:11.381641 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a1c00fcd-429e-4fcc-abc6-f47ef9b3c877 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1690 microversion: 2.1 time: 0.183927 Sep 18 01:47:11.383337 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3108/6239] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:11 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:12.407394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:12.408003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:12.415126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:12.415611 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:12.416038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:12.416820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:12.417272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:12.417726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:12.572963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:12.582054 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ae80893-e051-4c2f-bc60-7cb8fbfff285 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1696 microversion: 2.1 time: 0.178506 Sep 18 01:47:12.582647 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3132/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:12 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:13.608794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:13.609588 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:13.616276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:13.616887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:13.617432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:13.618257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:13.618821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:13.619362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:13.761944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:13.770800 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33b56826-0246-414b-84f7-4ffe5fc26012 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1696 microversion: 2.1 time: 0.166479 Sep 18 01:47:13.771385 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3109/6241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:13 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:14.424188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7eba7247-d4f8-48dd-8ba9-30b1780faa92 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Action: 'create', calling method: .version_select at 0x7f7004fc3b80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1727660839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxWeC/ttfUpTPsoqa3OkiTjQQYN2B2erxIBOOQnQH0gI6IqMbYEmIUn0X0FC49tadsLcTStYsJxxYxZZCiooiS55db1DWdvY/ReMmFzi7dRH7aAxwHoDZp0TVgLOCNxCQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:14.446748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7eba7247-d4f8-48dd-8ba9-30b1780faa92 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Getting quotas for project 2c34abb4fe344d49b6ad1b54dbdb4050. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:47:14.453834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-7eba7247-d4f8-48dd-8ba9-30b1780faa92 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Getting quotas for user f242cecefb004ae0bdf5899810cf100f and project 2c34abb4fe344d49b6ad1b54dbdb4050. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:47:14.485214 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7eba7247-d4f8-48dd-8ba9-30b1780faa92 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065467 Sep 18 01:47:14.486316 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3133/6242] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:47:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:47:14.802189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:14.806972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:14.817656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:14.818541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:14.819229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:14.820279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:14.821072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:14.821711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:15.020961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:15.030769 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-edf0725f-999b-4730-a71d-32e13f3896eb tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1681 microversion: 2.1 time: 0.237815 Sep 18 01:47:15.031520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3110/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:14 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:15.704201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-2130144295", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cb870242-9a59-4cae-b2b1-6ce65dfbccd6", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1727660839", "security_groups": [{"name": "tempest-secgroup-smoke-345677972"}], "networks": [{"uuid": "eea0258d-95d2-4fe4-b4b0-592acec61848"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:15.829118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] validate_networks() for [('eea0258d-95d2-4fe4-b4b0-592acec61848', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:47:16.233157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:47:16.233942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:47:16.234495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:47:16.235080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:47:16.235490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:47:16.244650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:16.245410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:16.245913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:16.246747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:16.247102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:16.247484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:16.266310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Getting quotas for project 2c34abb4fe344d49b6ad1b54dbdb4050. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:47:16.272466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Getting quotas for user f242cecefb004ae0bdf5899810cf100f and project 2c34abb4fe344d49b6ad1b54dbdb4050. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:47:16.344138 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:47:16.346891 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb870242-9a59-4cae-b2b1-6ce65dfbccd6',volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:47:16.458686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-fd461970-33e6-4ca9-85fe-c7487ba84386 req-582dc313-3b35-4e1c-aaf7-f43c013ca5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98985424-fc84-41fe-a3ff-104631895ee7", "name": "network-vif-plugged", "status": "completed", "tag": "f5f70582-78ac-4edc-b642-62466922762e"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:16.469146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fd461970-33e6-4ca9-85fe-c7487ba84386 req-582dc313-3b35-4e1c-aaf7-f43c013ca5b7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:16.469841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fd461970-33e6-4ca9-85fe-c7487ba84386 req-582dc313-3b35-4e1c-aaf7-f43c013ca5b7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:16.470509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fd461970-33e6-4ca9-85fe-c7487ba84386 req-582dc313-3b35-4e1c-aaf7-f43c013ca5b7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:16.484181 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-fd461970-33e6-4ca9-85fe-c7487ba84386 req-582dc313-3b35-4e1c-aaf7-f43c013ca5b7 service nova] Creating event network-vif-plugged:f5f70582-78ac-4edc-b642-62466922762e for instance 98985424-fc84-41fe-a3ff-104631895ee7 on n-h1-master-1 Sep 18 01:47:16.490416 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-fd461970-33e6-4ca9-85fe-c7487ba84386 req-582dc313-3b35-4e1c-aaf7-f43c013ca5b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208773 Sep 18 01:47:16.491596 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3111/6244] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:47:16.520094 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-135069d5-45ea-4610-b88d-b34ae8da501a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.819746 Sep 18 01:47:16.521173 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3134/6245] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:47:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:47:16.534195 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fff86ab9-d22d-4a01-9329-de35daf8f4e8 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:16.535304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fff86ab9-d22d-4a01-9329-de35daf8f4e8 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:16.597800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fff86ab9-d22d-4a01-9329-de35daf8f4e8 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:16.609708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fff86ab9-d22d-4a01-9329-de35daf8f4e8 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1099 microversion: 2.1 time: 0.080402 Sep 18 01:47:16.621801 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3112/6246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:16 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1099 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:47:17.635118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:17.635744 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:17.643466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:17.644193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:17.645050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:17.645909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:17.646618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:17.647451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:17.767764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:17.779237 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-466917fa-0967-4eff-bf8e-40f3a33be688 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1205 microversion: 2.1 time: 0.148914 Sep 18 01:47:17.779841 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3135/6247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:17 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1205 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:18.807783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:18.810164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:18.842877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:18.843940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:18.844864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:18.845869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:18.847569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:18.848175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:19.091418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:19.100432 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4ffbf62-2c90-4fc1-9827-9f6220181125 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1282 microversion: 2.1 time: 0.299545 Sep 18 01:47:19.113322 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3113/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:18 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1282 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:20.059957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0c08b84e-40d5-429d-9b98-ae27bfe07096 req-08642b18-8852-400b-bac9-0b1e5b8a4b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815dc72a-ccde-4003-8d45-40da67e7ce35", "tag": "2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:20.078432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0c08b84e-40d5-429d-9b98-ae27bfe07096 req-08642b18-8852-400b-bac9-0b1e5b8a4b1a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:20.078902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0c08b84e-40d5-429d-9b98-ae27bfe07096 req-08642b18-8852-400b-bac9-0b1e5b8a4b1a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:20.079339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0c08b84e-40d5-429d-9b98-ae27bfe07096 req-08642b18-8852-400b-bac9-0b1e5b8a4b1a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:20.116393 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0c08b84e-40d5-429d-9b98-ae27bfe07096 req-08642b18-8852-400b-bac9-0b1e5b8a4b1a service nova] Creating event network-changed:2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c for instance 815dc72a-ccde-4003-8d45-40da67e7ce35 on n-h2-master-1 Sep 18 01:47:20.127368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:20.128612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:20.133299 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0c08b84e-40d5-429d-9b98-ae27bfe07096 req-08642b18-8852-400b-bac9-0b1e5b8a4b1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219578 Sep 18 01:47:20.133961 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3136/6249] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:47:20.146628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:20.147239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:20.147792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:20.149919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:20.150568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:20.151084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:20.407256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:20.416741 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb54a057-e702-4187-8169-a99f50c0eb4d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1282 microversion: 2.1 time: 0.295159 Sep 18 01:47:20.427895 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3114/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:20 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1282 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:21.442073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:21.443573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:21.450554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:21.451141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:21.451695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:21.452504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:21.453033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:21.453532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:21.601003 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:21.609932 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-68435370-8a15-4c80-a77f-cf608c5c4de4 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1282 microversion: 2.1 time: 0.173237 Sep 18 01:47:21.610838 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3137/6251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:21 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:22.633047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:22.633817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:22.643305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:22.644206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:22.645084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:22.646354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:22.647105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:22.647549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:22.817279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:22.831992 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6703cece-9031-44de-9e12-81dc24cf9b45 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1282 microversion: 2.1 time: 0.203195 Sep 18 01:47:22.832624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3115/6252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:22 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:23.854904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:23.855552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:23.862533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:23.863013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:23.863445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:23.864134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:23.864591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:23.865008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:24.009173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:24.017449 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08fad7a5-910f-4962-b441-4725e5869824 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.166593 Sep 18 01:47:24.018340 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3138/6253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:23 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:25.041715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:25.042934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:25.045744 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=33 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:25.051155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:25.051648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:25.052084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:25.052782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:25.053241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:25.053769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:25.056564 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=81 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:25.202424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:25.210796 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e94b4aaa-125f-4663-a147-1d85c3a3fd6c tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.172916 Sep 18 01:47:25.211390 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3116/6254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:25 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:47:26.234674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:26.235198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:26.238185 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:26.244029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:26.244741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:26.245922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:26.246653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:26.247103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:26.247527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:26.251376 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:26.265896 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:26.284975 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:26.395706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:26.403864 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-143e9175-dbbe-413d-9067-416f90b727bf tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.173110 Sep 18 01:47:26.404439 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3139/6255] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:26 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:27.428248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:27.429631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:27.432626 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:27.438892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:27.439519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:27.439954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:27.440846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:27.441483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:27.442098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:27.597949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:27.606589 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1446788f-365b-4554-8927-810c2ebd696d tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.182721 Sep 18 01:47:27.607162 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3117/6256] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:27 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:28.629537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:28.630179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:28.638179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:28.638667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:28.639097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:28.639794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:28.640246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:28.640668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:28.780889 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:28.788846 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aab5b2a5-22bd-4f8b-8099-dddee9b0e546 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.163268 Sep 18 01:47:28.789444 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3140/6257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:28 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:29.812956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:29.813515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:29.820527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:29.821011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:29.821452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:29.822183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:29.822643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:29.823069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:29.958431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:29.967005 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-db3d8844-5078-4ef4-9208-e38ad08e275a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.158604 Sep 18 01:47:29.967580 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3118/6258] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:29 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:30.991188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:30.991842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:30.999657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:31.000142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:31.000617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:31.001324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:31.001812 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:31.002241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:31.164821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:31.172716 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e14f5a94-47a9-4c4b-9c86-2b47ae2e7809 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.185958 Sep 18 01:47:31.173296 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3141/6259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:30 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:32.195766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:32.196405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:32.203628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:32.204114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:32.204552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:32.205252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:32.205740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:32.206172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:32.354755 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:32.363462 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-089029c4-e8f5-4a2b-b517-becac05dfc1e tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.172055 Sep 18 01:47:32.366476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3119/6260] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:32 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:32.682967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-737f59a1-a71a-4bc2-b16a-3f9ce503845e req-ab53696b-1dfc-4e1f-b4eb-4de4478cfebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815dc72a-ccde-4003-8d45-40da67e7ce35", "name": "network-vif-plugged", "status": "completed", "tag": "2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:32.702046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-737f59a1-a71a-4bc2-b16a-3f9ce503845e req-ab53696b-1dfc-4e1f-b4eb-4de4478cfebf service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:32.702527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-737f59a1-a71a-4bc2-b16a-3f9ce503845e req-ab53696b-1dfc-4e1f-b4eb-4de4478cfebf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:32.702961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-737f59a1-a71a-4bc2-b16a-3f9ce503845e req-ab53696b-1dfc-4e1f-b4eb-4de4478cfebf service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:32.717520 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-737f59a1-a71a-4bc2-b16a-3f9ce503845e req-ab53696b-1dfc-4e1f-b4eb-4de4478cfebf service nova] Creating event network-vif-plugged:2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c for instance 815dc72a-ccde-4003-8d45-40da67e7ce35 on n-h2-master-1 Sep 18 01:47:32.723980 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-737f59a1-a71a-4bc2-b16a-3f9ce503845e req-ab53696b-1dfc-4e1f-b4eb-4de4478cfebf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045585 Sep 18 01:47:32.724667 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3142/6261] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:47:33.387209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:33.387835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:33.397218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:33.398065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:33.398950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:33.399911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:33.400576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:33.401208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:33.576718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:33.593783 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-544652d2-dd96-4a79-9136-18926c140ab9 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1270 microversion: 2.1 time: 0.211118 Sep 18 01:47:33.594198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3120/6262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:33 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:34.619441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:34.620269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:34.626840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:34.627405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:34.627850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:34.628548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:34.629013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:34.629443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:34.766171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:34.774736 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e723a726-2769-4064-8b46-2f8e789f58af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1460 microversion: 2.1 time: 0.160461 Sep 18 01:47:34.775319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3143/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:34 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:34.798118 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:34.798725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:34.805268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:34.805816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:34.806253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:34.806948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:34.807400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:34.807821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:34.947744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:34.956174 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c89878e1-6d3c-4a0b-87d0-0883856cf619 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1460 microversion: 2.1 time: 0.162723 Sep 18 01:47:34.956966 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3121/6264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:34 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1460 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:36.830192 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a04785da-c473-4234-99e1-2a0ec9ecda08 req-61df3f0d-9268-4f22-8df2-0770bb9fc72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815dc72a-ccde-4003-8d45-40da67e7ce35", "tag": "2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:36.852819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a04785da-c473-4234-99e1-2a0ec9ecda08 req-61df3f0d-9268-4f22-8df2-0770bb9fc72e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:36.853769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a04785da-c473-4234-99e1-2a0ec9ecda08 req-61df3f0d-9268-4f22-8df2-0770bb9fc72e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:36.858119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a04785da-c473-4234-99e1-2a0ec9ecda08 req-61df3f0d-9268-4f22-8df2-0770bb9fc72e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:36.899085 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a04785da-c473-4234-99e1-2a0ec9ecda08 req-61df3f0d-9268-4f22-8df2-0770bb9fc72e service nova] Creating event network-changed:2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c for instance 815dc72a-ccde-4003-8d45-40da67e7ce35 on n-h2-master-1 Sep 18 01:47:36.906169 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a04785da-c473-4234-99e1-2a0ec9ecda08 req-61df3f0d-9268-4f22-8df2-0770bb9fc72e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079458 Sep 18 01:47:36.907346 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3144/6265] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:47:38.976539 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-56cb18cc-c45f-4bb2-bda0-fe08ef6a440a req-80e8e624-bea7-4081-8517-7e2b90e8d3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815dc72a-ccde-4003-8d45-40da67e7ce35", "tag": "2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c"}, {"name": "network-changed", "server_uuid": "815dc72a-ccde-4003-8d45-40da67e7ce35", "tag": "2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:38.987464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-56cb18cc-c45f-4bb2-bda0-fe08ef6a440a req-80e8e624-bea7-4081-8517-7e2b90e8d3b1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:38.988220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-56cb18cc-c45f-4bb2-bda0-fe08ef6a440a req-80e8e624-bea7-4081-8517-7e2b90e8d3b1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:38.988642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-56cb18cc-c45f-4bb2-bda0-fe08ef6a440a req-80e8e624-bea7-4081-8517-7e2b90e8d3b1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:39.000653 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-56cb18cc-c45f-4bb2-bda0-fe08ef6a440a req-80e8e624-bea7-4081-8517-7e2b90e8d3b1 service nova] Creating event network-changed:2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c for instance 815dc72a-ccde-4003-8d45-40da67e7ce35 on n-h2-master-1 Sep 18 01:47:39.001403 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-56cb18cc-c45f-4bb2-bda0-fe08ef6a440a req-80e8e624-bea7-4081-8517-7e2b90e8d3b1 service nova] Creating event network-changed:2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c for instance 815dc72a-ccde-4003-8d45-40da67e7ce35 on n-h2-master-1 Sep 18 01:47:39.006705 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-56cb18cc-c45f-4bb2-bda0-fe08ef6a440a req-80e8e624-bea7-4081-8517-7e2b90e8d3b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034193 Sep 18 01:47:39.007315 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3122/6266] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:47:39.241013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:39.244892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:39.253650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:39.254494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:39.255220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:39.256139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:39.256807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:39.257443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:39.338687 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-401f5bf1-8b3c-47f3-a5ea-59904fcb4746 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "POST /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7/action" status: 200 len: 24569 microversion: 2.1 time: 0.102862 Sep 18 01:47:39.339684 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3145/6267] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:47:39 2022] POST /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7/action => generated 24569 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:47:51.271527 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=13 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:51.272272 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=31 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:51.277411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-32202d4c-ca13-4cd1-9f09-c3de18b36997 req-bcaee798-7b3c-452a-ae96-cf755769f372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98985424-fc84-41fe-a3ff-104631895ee7", "tag": "f5f70582-78ac-4edc-b642-62466922762e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:51.278765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:51.279923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:51.288288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-32202d4c-ca13-4cd1-9f09-c3de18b36997 req-bcaee798-7b3c-452a-ae96-cf755769f372 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:51.288776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-32202d4c-ca13-4cd1-9f09-c3de18b36997 req-bcaee798-7b3c-452a-ae96-cf755769f372 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:51.289206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-32202d4c-ca13-4cd1-9f09-c3de18b36997 req-bcaee798-7b3c-452a-ae96-cf755769f372 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:51.290185 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=13 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:51.292853 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=37 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:47:51.297920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:51.299287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:51.300151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:51.301987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:51.302816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:51.303610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:51.306331 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-32202d4c-ca13-4cd1-9f09-c3de18b36997 req-bcaee798-7b3c-452a-ae96-cf755769f372 service nova] Creating event network-changed:f5f70582-78ac-4edc-b642-62466922762e for instance 98985424-fc84-41fe-a3ff-104631895ee7 on n-h1-master-1 Sep 18 01:47:51.312022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-32202d4c-ca13-4cd1-9f09-c3de18b36997 req-bcaee798-7b3c-452a-ae96-cf755769f372 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042617 Sep 18 01:47:51.313014 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3146/6268] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:47:51.341478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:47:51.508930 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91389724-b3c5-4cbf-95f5-a826aa7eb846 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 204 len: 0 microversion: 2.1 time: 0.241894 Sep 18 01:47:51.511752 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3123/6269] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:47:51 2022] DELETE /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:47:51.522923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:51.524180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:51.532149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:51.533062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:51.533655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:51.535198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:51.535893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:51.536554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:51.705598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:51.713566 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5cf28c1c-61e3-4993-bc9e-deb5708285a6 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1687 microversion: 2.1 time: 0.196785 Sep 18 01:47:51.714724 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3147/6270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:51 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:47:52.740166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:52.741589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:52.748574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:52.749133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:52.749832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:52.751367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:52.751828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:52.752253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:52.920116 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:52.930845 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52c14b86-df8a-488d-afa1-cdee2764041e tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1687 microversion: 2.1 time: 0.194936 Sep 18 01:47:52.932241 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3124/6271] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:52 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:53.817364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b708f9eb-d7ac-4bbf-9fdb-45f0435e0179 req-4df04e22-8bdc-49f3-ae2b-b2f006bb983b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98985424-fc84-41fe-a3ff-104631895ee7", "name": "network-vif-deleted", "tag": "f5f70582-78ac-4edc-b642-62466922762e"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:47:53.828697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b708f9eb-d7ac-4bbf-9fdb-45f0435e0179 req-4df04e22-8bdc-49f3-ae2b-b2f006bb983b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:53.829334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b708f9eb-d7ac-4bbf-9fdb-45f0435e0179 req-4df04e22-8bdc-49f3-ae2b-b2f006bb983b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:53.829797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b708f9eb-d7ac-4bbf-9fdb-45f0435e0179 req-4df04e22-8bdc-49f3-ae2b-b2f006bb983b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:53.842280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b708f9eb-d7ac-4bbf-9fdb-45f0435e0179 req-4df04e22-8bdc-49f3-ae2b-b2f006bb983b service nova] Creating event network-vif-deleted:f5f70582-78ac-4edc-b642-62466922762e for instance 98985424-fc84-41fe-a3ff-104631895ee7 on n-h1-master-1 Sep 18 01:47:53.847781 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b708f9eb-d7ac-4bbf-9fdb-45f0435e0179 req-4df04e22-8bdc-49f3-ae2b-b2f006bb983b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225470 Sep 18 01:47:53.848388 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3148/6272] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:47:53.956007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:53.956637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:53.964825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:53.965328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:53.965816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:53.966540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:53.967003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:53.967620 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:54.003292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:54.003787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:54.004234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:54.004694 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lazy-loading 'fault' on Instance uuid 98985424-fc84-41fe-a3ff-104631895ee7 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:47:54.060918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ef9fd3ac384cfe907975caddd403a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534af518a54843d9b0288bc79448de27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:47:54.069912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5be7a2e1-1af4-4937-85d9-bfeefedebc6d tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 200 len: 1355 microversion: 2.1 time: 0.117270 Sep 18 01:47:54.074031 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3125/6273] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:53 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 1355 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:47:55.097098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:47:55.098698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] [instance: 98985424-fc84-41fe-a3ff-104631895ee7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:47:55.110010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:55.110516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:55.110959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:55.111899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:47:55.112370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:47:55.112827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:47:55.128916 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] HTTP exception thrown: Instance 98985424-fc84-41fe-a3ff-104631895ee7 could not be found. Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Request method failure captured: Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 HTTP/1.1 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnbyk5s0dRRAabvkMBwA_LP2vJUd_Q5hjvjpPddO70XgVKwdaPyUXiB9cCjfcYFRppjLgCrsUwFQKRWZZf_FtW7ok49SJDalWxps012yn7ohGXMzX4A07Ecf2_5KAzVkxyB1I14F4f2c_IEKdWF_O6ffKflIC9mNPHg5YUoKxuxhkRc Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/534af518a54843d9b0288bc79448de27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_534af518a54843d9b0288bc79448de27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/534af518a54843d9b0288bc79448de27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 534af518a54843d9b0288bc79448de27 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1479945112 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 50ef9fd3ac384cfe907975caddd403a2 Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1479945112-project Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 98985424-fc84-41fe-a3ff-104631895ee7 could not be found. Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '98985424-fc84-41fe-a3ff-104631895ee7'} Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98985424-fc84-41fe-a3ff-104631895ee7 could not be found. Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98985424-fc84-41fe-a3ff-104631895ee7 could not be found. Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:47:55.131030 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98985424-fc84-41fe-a3ff-104631895ee7 could not be found. Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:47:55.137988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Returning 404 to user: Instance 98985424-fc84-41fe-a3ff-104631895ee7 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:47:55.140077 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e408a1dd-4d5f-47c6-806e-7be67c73d4a9 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7" status: 404 len: 111 microversion: 2.1 time: 0.047091 Sep 18 01:47:55.140717 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3149/6274] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:47:55 2022] GET /compute/v2.1/servers/98985424-fc84-41fe-a3ff-104631895ee7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:48:00.159817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ef1df7c-09a2-48f1-898f-fb2a9a33c401 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] Calling method '.version_select at 0x7f7006216d30>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:00.190577 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ef1df7c-09a2-48f1-898f-fb2a9a33c401 tempest-TestNetworkAdvancedServerOps-1479945112 tempest-TestNetworkAdvancedServerOps-1479945112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-896016642" status: 202 len: 0 microversion: 2.1 time: 0.039293 Sep 18 01:48:00.192264 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3126/6275] 10.222.0.25 () {58 vars in 1281 bytes} [Sun Sep 18 01:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-896016642 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:48:06.190216 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:06.191118 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:06.316142 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64122b3f-7362-49d6-869a-9f574b3aa395 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-163304927", "availability_zone": "foo_zone"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:06.319729 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.aggregate [None req-64122b3f-7362-49d6-869a-9f574b3aa395 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Generated uuid 2c008151-1562-47f4-8683-8f45cdd0a0f2 for aggregate {{(pid=122374) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 18 01:48:06.354679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64122b3f-7362-49d6-869a-9f574b3aa395 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.170219 Sep 18 01:48:06.355559 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3150/6276] 10.222.0.25 () {60 vars in 1164 bytes} [Sun Sep 18 01:48:06 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.364925 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:06.369204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb9152b9-860f-4cb3-beee-1b3083c686dd tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:06.403383 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb9152b9-860f-4cb3-beee-1b3083c686dd tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.040185 Sep 18 01:48:06.404003 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3127/6277] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:48:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.415615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:06.419336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:06.419829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:06.420499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:06.421255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:06.421753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:06.422187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:06.446846 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e77bf17-a9d8-43b4-920a-140c4c4a8f80 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034933 Sep 18 01:48:06.447473 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3151/6278] 10.222.0.25 () {58 vars in 1176 bytes} [Sun Sep 18 01:48:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.459475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e23a1288-f0ef-4e59-a23a-9537090c2c53 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:06.467508 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e23a1288-f0ef-4e59-a23a-9537090c2c53 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.011712 Sep 18 01:48:06.468069 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3128/6279] 10.222.0.25 () {58 vars in 1143 bytes} [Sun Sep 18 01:48:06 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.479785 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5079a064-2765-474a-88ba-b32966bb685c tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:06.490220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5079a064-2765-474a-88ba-b32966bb685c tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:06.490712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5079a064-2765-474a-88ba-b32966bb685c tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:06.491155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5079a064-2765-474a-88ba-b32966bb685c tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:06.794812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5079a064-2765-474a-88ba-b32966bb685c tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.318759 Sep 18 01:48:06.795434 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3152/6280] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:48:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.806998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-319f5845-251c-4a21-a6c9-8c81fba8b92b tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:06.815935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-319f5845-251c-4a21-a6c9-8c81fba8b92b tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.012543 Sep 18 01:48:06.816452 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3129/6281] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:48:06 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.828863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-46063f1d-0044-4d5d-9dc9-c6a8fc112da9 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1752051527", "availability_zone": "foo_zone"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:06.878133 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-46063f1d-0044-4d5d-9dc9-c6a8fc112da9 tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.051216 Sep 18 01:48:06.879122 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3153/6282] 10.222.0.25 () {60 vars in 1173 bytes} [Sun Sep 18 01:48:06 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.894073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c73ea2d-3c15-45c5-9ccf-53c1152bc6ea tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:06.923617 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c73ea2d-3c15-45c5-9ccf-53c1152bc6ea tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.033329 Sep 18 01:48:06.924516 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3130/6283] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:48:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.936766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec4347de-faea-478f-b1b6-d00c4e569e8c tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:06.945531 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ec4347de-faea-478f-b1b6-d00c4e569e8c tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013147 Sep 18 01:48:06.946231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3154/6284] 10.222.0.25 () {58 vars in 1152 bytes} [Sun Sep 18 01:48:06 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:06.959877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d931b35-c71c-46db-8889-23e77d4629ca tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:06.971222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d931b35-c71c-46db-8889-23e77d4629ca tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:06.971707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d931b35-c71c-46db-8889-23e77d4629ca tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:06.972149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d931b35-c71c-46db-8889-23e77d4629ca tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:07.199865 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d931b35-c71c-46db-8889-23e77d4629ca tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.241486 Sep 18 01:48:07.201275 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3131/6285] 10.222.0.25 () {60 vars in 1194 bytes} [Sun Sep 18 01:48:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:48:07.217271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5df94c44-ec26-4687-8888-b3ba093382bf tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:07.259907 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5df94c44-ec26-4687-8888-b3ba093382bf tempest-TestAggregatesBasicOps-1364267297 tempest-TestAggregatesBasicOps-1364267297-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.047916 Sep 18 01:48:07.260631 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3155/6286] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 18 01:48:07 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 18 01:48:15.141495 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:15.153478 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-24e56a80-f035-436b-83ef-f585c02e0d86 req-c8e310ef-89f4-465c-a59c-41615272e9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815dc72a-ccde-4003-8d45-40da67e7ce35", "tag": "2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:15.159258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:15.167490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:15.167987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:15.173819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:15.176168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-24e56a80-f035-436b-83ef-f585c02e0d86 req-c8e310ef-89f4-465c-a59c-41615272e9e2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:15.188804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:15.192830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:15.193336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:15.194312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-24e56a80-f035-436b-83ef-f585c02e0d86 req-c8e310ef-89f4-465c-a59c-41615272e9e2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:15.194750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-24e56a80-f035-436b-83ef-f585c02e0d86 req-c8e310ef-89f4-465c-a59c-41615272e9e2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:15.218473 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-24e56a80-f035-436b-83ef-f585c02e0d86 req-c8e310ef-89f4-465c-a59c-41615272e9e2 service nova] Creating event network-changed:2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c for instance 815dc72a-ccde-4003-8d45-40da67e7ce35 on n-h2-master-1 Sep 18 01:48:15.231961 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-24e56a80-f035-436b-83ef-f585c02e0d86 req-c8e310ef-89f4-465c-a59c-41615272e9e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088481 Sep 18 01:48:15.236820 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3156/6287] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:15.250511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:48:15.361024 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98db193c-d197-4c08-bc7e-1297de6c7b98 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "DELETE /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 204 len: 0 microversion: 2.1 time: 0.224072 Sep 18 01:48:15.362268 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3132/6288] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:48:15 2022] DELETE /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:48:15.374199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:15.375023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:15.384697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:15.386001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:15.386527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:15.387513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:15.388248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:15.388916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:15.601989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:15.613503 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f651c262-8450-4eaa-a640-a3ab32be8b14 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1585 microversion: 2.1 time: 0.245688 Sep 18 01:48:15.625291 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3157/6289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:15 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1585 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:16.640559 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:16.642774 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:16.651740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:16.652393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:16.652393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:16.653180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:16.654033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:16.654465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:16.891240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:16.904611 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98234de6-08a5-439d-99d1-c0349ba02f33 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1585 microversion: 2.1 time: 0.268098 Sep 18 01:48:16.905641 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3133/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:16 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1585 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:17.852109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4e1d9a6b-1920-49de-b425-6188d2c63078 req-df6424e6-21ea-4d3a-90fb-6e8c77ddb838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815dc72a-ccde-4003-8d45-40da67e7ce35", "name": "network-vif-deleted", "tag": "2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:17.858098 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:17.864285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4e1d9a6b-1920-49de-b425-6188d2c63078 req-df6424e6-21ea-4d3a-90fb-6e8c77ddb838 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:17.868037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4e1d9a6b-1920-49de-b425-6188d2c63078 req-df6424e6-21ea-4d3a-90fb-6e8c77ddb838 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:17.868037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4e1d9a6b-1920-49de-b425-6188d2c63078 req-df6424e6-21ea-4d3a-90fb-6e8c77ddb838 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:17.879496 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4e1d9a6b-1920-49de-b425-6188d2c63078 req-df6424e6-21ea-4d3a-90fb-6e8c77ddb838 service nova] Creating event network-vif-deleted:2f75b0ab-0d78-4cd0-82fe-2d7c1747fd9c for instance 815dc72a-ccde-4003-8d45-40da67e7ce35 on n-h2-master-1 Sep 18 01:48:17.885296 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4e1d9a6b-1920-49de-b425-6188d2c63078 req-df6424e6-21ea-4d3a-90fb-6e8c77ddb838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Sep 18 01:48:17.886065 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3158/6291] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:17.942533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:17.943408 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:17.951096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:17.952067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:17.952235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:17.953001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:17.953711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:17.954142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:18.060865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:18.070635 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a43ff856-f4e5-40e7-b86a-2a5732544356 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1230 microversion: 2.1 time: 0.131925 Sep 18 01:48:18.071769 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3134/6292] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:17 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1230 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:19.096527 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:19.097481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:19.105224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:19.106042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:19.106676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:19.107934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:19.108588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:19.109586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:19.179540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:19.188010 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c9f38b1-ac81-4aa4-b06a-9c0d0a947591 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1230 microversion: 2.1 time: 0.096689 Sep 18 01:48:19.188890 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3159/6293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:19 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:20.214200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:20.215514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:20.223273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:20.224040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:20.224636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:20.225541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:20.226242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:20.226841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:20.319463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:20.328779 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72a31e87-17b9-4455-9957-ee6f68a03b11 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1230 microversion: 2.1 time: 0.120025 Sep 18 01:48:20.329617 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3135/6294] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:20 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1230 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:21.351988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:21.352624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:21.359681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:21.360473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:21.361098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:21.362012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:21.362642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:21.363475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:21.462141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:21.470108 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dead7a76-74a6-4c2c-bd4e-df7e9c84038a tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1230 microversion: 2.1 time: 0.121961 Sep 18 01:48:21.471286 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3160/6295] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:21 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:22.495752 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:22.496891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:22.499795 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:22.512369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:22.516888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:22.518759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:22.520010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:22.521952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:22.522803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:22.586119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:22.586889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:22.587504 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:22.588177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lazy-loading 'fault' on Instance uuid 815dc72a-ccde-4003-8d45-40da67e7ce35 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:48:22.636054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f242cecefb004ae0bdf5899810cf100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c34abb4fe344d49b6ad1b54dbdb4050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:22.645237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4007e694-9288-49f3-be91-749755c7beed tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 200 len: 1235 microversion: 2.1 time: 0.154145 Sep 18 01:48:22.646344 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3136/6296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:22 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 1235 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:23.669427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:23.670169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] [instance: 815dc72a-ccde-4003-8d45-40da67e7ce35] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:23.679806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:23.682945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:23.683488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:23.684488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:23.685156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:23.685849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:23.700778 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] HTTP exception thrown: Instance 815dc72a-ccde-4003-8d45-40da67e7ce35 could not be found. Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Request method failure captured: Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 HTTP/1.1 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJngcYG5FtwDcOMG1ptklSSc5xYIvn3X4RIPpVyCUWtBjXaP-Hb4LI1WK7Gas7TDvxd65cO_WVrIlvpuoM6WVLdvD2_A8PwgdZTIJlxPQYfMRQax7-zky8R17gapRhmedgjSg9MfZU7FeRJilfBoe6vZxqks2Mtfbslc-ATjPzoCoVxg Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 2c34abb4fe344d49b6ad1b54dbdb4050 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBackupRestore-430157287 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c34abb4fe344d49b6ad1b54dbdb4050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c34abb4fe344d49b6ad1b54dbdb4050"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c34abb4fe344d49b6ad1b54dbdb4050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c34abb4fe344d49b6ad1b54dbdb4050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBackupRestore-430157287 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 2c34abb4fe344d49b6ad1b54dbdb4050 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBackupRestore-430157287 Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBackupRestore-430157287-project Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: f242cecefb004ae0bdf5899810cf100f Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBackupRestore-430157287-project Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 815dc72a-ccde-4003-8d45-40da67e7ce35 could not be found. Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '815dc72a-ccde-4003-8d45-40da67e7ce35'} Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815dc72a-ccde-4003-8d45-40da67e7ce35 could not be found. Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815dc72a-ccde-4003-8d45-40da67e7ce35 could not be found. Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:48:23.703369 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:48:23.708272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:48:23.708272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:48:23.708272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:48:23.708272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:48:23.708272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:48:23.708272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815dc72a-ccde-4003-8d45-40da67e7ce35 could not be found. Sep 18 01:48:23.708272 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:48:23.710859 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Returning 404 to user: Instance 815dc72a-ccde-4003-8d45-40da67e7ce35 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:48:23.711973 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-abd98b4a-f332-4580-9fe9-971273109a16 tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35" status: 404 len: 111 microversion: 2.1 time: 0.047080 Sep 18 01:48:23.712796 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3161/6297] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:23 2022] GET /compute/v2.1/servers/815dc72a-ccde-4003-8d45-40da67e7ce35 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:48:23.933792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b2103e25-02d4-4856-b5be-f3ede36938af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] Calling method '.version_select at 0x7f700a60e4c0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:23.972429 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b2103e25-02d4-4856-b5be-f3ede36938af tempest-TestVolumeBackupRestore-430157287 tempest-TestVolumeBackupRestore-430157287-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1727660839" status: 202 len: 0 microversion: 2.1 time: 0.043086 Sep 18 01:48:23.976996 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3137/6298] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 18 01:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1727660839 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:48:49.928523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-713783570", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ff1a8390-fb1e-46f0-b68d-e1f0f7e53bf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:49.938814 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:49.939649 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=30 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:49.996428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:48:50.489261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:48:50.489725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:48:50.490322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:48:50.490597 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:48:50.491173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:48:50.500848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:50.501472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:50.501945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:50.502675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:50.503130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:50.503553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:50.521544 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:48:50.526822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:48:50.584911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:48:50.587083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff1a8390-fb1e-46f0-b68d-e1f0f7e53bf0',volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:48:50.722425 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-69c74435-d1f6-461c-91ee-080fe51c4624 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797988 Sep 18 01:48:50.723304 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3162/6299] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:48:50.735185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-acf9f5d3-b781-4852-882c-28e1bacab741 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:50.735878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-acf9f5d3-b781-4852-882c-28e1bacab741 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:50.738307 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:50.739358 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:48:50.808381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-acf9f5d3-b781-4852-882c-28e1bacab741 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:50.815191 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-acf9f5d3-b781-4852-882c-28e1bacab741 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1056 microversion: 2.1 time: 0.084197 Sep 18 01:48:50.815769 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3138/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:50 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1056 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:48:51.838572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:51.839813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:51.849628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:51.850195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:51.850638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:51.851347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:51.851800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:51.852256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:51.929931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:51.938755 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a5355f0-8713-47a7-85fb-de116a8efc1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1154 microversion: 2.1 time: 0.104265 Sep 18 01:48:51.939451 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3163/6301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:51 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1154 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:52.965637 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:52.966604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:52.976755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:52.977825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:52.978650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:52.979641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:52.980302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:52.980967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:53.188399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:53.200493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-319481a1-a92d-4e13-99f3-d959f6dc3938 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1214 microversion: 2.1 time: 0.239495 Sep 18 01:48:53.202108 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3139/6302] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:52 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:48:53.840871 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3007647b-cf03-4c23-b2ff-471bbcb2e98b req-0e5cdcfc-6f8a-4256-b091-8d5ede03b691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8283515-3621-446d-9fcb-74959f597368", "tag": "9a199e0f-f2e4-4368-9397-cc82c667fa6d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:48:53.857587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3007647b-cf03-4c23-b2ff-471bbcb2e98b req-0e5cdcfc-6f8a-4256-b091-8d5ede03b691 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:53.858607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3007647b-cf03-4c23-b2ff-471bbcb2e98b req-0e5cdcfc-6f8a-4256-b091-8d5ede03b691 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:53.859431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3007647b-cf03-4c23-b2ff-471bbcb2e98b req-0e5cdcfc-6f8a-4256-b091-8d5ede03b691 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:53.875169 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3007647b-cf03-4c23-b2ff-471bbcb2e98b req-0e5cdcfc-6f8a-4256-b091-8d5ede03b691 service nova] Creating event network-changed:9a199e0f-f2e4-4368-9397-cc82c667fa6d for instance d8283515-3621-446d-9fcb-74959f597368 on n-h2-master-1 Sep 18 01:48:53.883503 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3007647b-cf03-4c23-b2ff-471bbcb2e98b req-0e5cdcfc-6f8a-4256-b091-8d5ede03b691 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047832 Sep 18 01:48:53.885789 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3164/6303] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:48:54.224639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:54.226022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:54.233530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:54.234046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:54.234478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:54.235182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:54.235659 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:54.236452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:54.384859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:54.393245 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a18c47c2-1513-4c1f-9bad-a5ffcdce3f05 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1214 microversion: 2.1 time: 0.172642 Sep 18 01:48:54.394148 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3140/6304] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:54 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:55.418206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:55.418902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:55.425044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:55.425518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:55.425978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:55.426664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:55.427112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:55.427530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:55.563722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:55.572892 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db6e46e1-9f61-419b-bdf5-4fa320ded6ba tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1214 microversion: 2.1 time: 0.160146 Sep 18 01:48:55.573493 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3165/6305] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:55 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:56.596558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:56.597241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:56.605222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:56.605739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:56.606185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:56.606887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:56.607348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:56.607775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:56.737426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:56.745711 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-03b27a76-3861-4785-8a13-0c98d85047c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1214 microversion: 2.1 time: 0.153117 Sep 18 01:48:56.746288 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3141/6306] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:56 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:57.769311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:57.770085 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:57.781113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:57.781632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:57.782072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:57.782801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:57.783254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:57.783673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:57.930774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:57.939334 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-342d65ec-5316-4c06-8a03-7f3233e18144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.174044 Sep 18 01:48:57.940079 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3166/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:57 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:48:58.965480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:48:58.966392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:48:58.973168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:58.973677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:58.974107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:58.974844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:48:58.975302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:48:58.975736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:48:59.108618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:48:59.116387 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c566ae5d-c324-4ff5-b270-17fc9a9a132c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.155353 Sep 18 01:48:59.116956 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3142/6308] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:48:58 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:00.138243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:00.138797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:00.146054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:00.146546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:00.146986 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:00.147690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:00.148148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:00.149080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:00.280674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:00.288507 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11fa74f5-7a01-4a5f-8ea9-c60924b25dcc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.154250 Sep 18 01:49:00.289078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3167/6309] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:00 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:01.312600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:01.313209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:01.315942 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:01.321805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:01.322290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:01.322723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:01.323413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:01.323864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:01.324284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:01.455010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:01.462788 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e26056f5-d417-4aa6-829f-26456641f311 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.154332 Sep 18 01:49:01.463534 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3143/6310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:01 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:02.485490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:02.486148 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:02.488164 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:02.489143 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:02.495460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:02.495946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:02.496384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:02.497076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:02.497530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:02.497976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:02.626613 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:02.635132 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d7855f52-a6c6-4a39-83c5-cf82fcf8af99 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.153836 Sep 18 01:49:02.635709 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3168/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:02 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:03.658727 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:03.659630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:03.666738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:03.667216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:03.667646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:03.668362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:03.668810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:03.669229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:03.799707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:03.807896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a3e1552-da3e-4210-8051-8dbacb19644e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.154202 Sep 18 01:49:03.808466 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3144/6312] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:03 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:04.831274 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:04.831877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:04.839464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:04.840017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:04.840459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:04.841151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:04.841625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:04.842049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:04.972800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:04.980815 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b25af677-2812-4d7c-bdcf-15158007326d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.153336 Sep 18 01:49:04.981532 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3169/6313] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:04 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:06.003623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:06.004277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:06.011337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:06.011826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:06.012267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:06.012965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:06.013425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:06.013883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:06.150276 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:06.158593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-49d69dee-50d0-4701-a6c0-7f8328650b82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.158829 Sep 18 01:49:06.159165 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3145/6314] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:05 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:07.161237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-70c03452-2db7-4819-991c-ab6aa1b1b799 req-27903eb1-22db-4ef8-aae1-3e94f1c52038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8283515-3621-446d-9fcb-74959f597368", "name": "network-vif-plugged", "status": "completed", "tag": "9a199e0f-f2e4-4368-9397-cc82c667fa6d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:49:07.173698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-70c03452-2db7-4819-991c-ab6aa1b1b799 req-27903eb1-22db-4ef8-aae1-3e94f1c52038 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:07.174583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-70c03452-2db7-4819-991c-ab6aa1b1b799 req-27903eb1-22db-4ef8-aae1-3e94f1c52038 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:07.179858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-70c03452-2db7-4819-991c-ab6aa1b1b799 req-27903eb1-22db-4ef8-aae1-3e94f1c52038 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:07.182462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:07.183700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:07.190277 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-70c03452-2db7-4819-991c-ab6aa1b1b799 req-27903eb1-22db-4ef8-aae1-3e94f1c52038 service nova] Creating event network-vif-plugged:9a199e0f-f2e4-4368-9397-cc82c667fa6d for instance d8283515-3621-446d-9fcb-74959f597368 on n-h2-master-1 Sep 18 01:49:07.191303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:07.191885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:07.192397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:07.193178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:07.194545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:07.195012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:07.195674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-70c03452-2db7-4819-991c-ab6aa1b1b799 req-27903eb1-22db-4ef8-aae1-3e94f1c52038 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038199 Sep 18 01:49:07.196698 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3170/6315] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:49:07.335881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:07.344173 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3d254065-2f28-48d7-b853-8685d3899bd1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.165970 Sep 18 01:49:07.344772 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3146/6316] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:07 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:08.368523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:08.369230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:08.375961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:08.376450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:08.376881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:08.377623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:08.378085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:08.378514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:08.531603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:08.540148 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f499301e-2eaf-4a7e-8e5b-ac77b114b0f4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1202 microversion: 2.1 time: 0.176831 Sep 18 01:49:08.540828 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3171/6317] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:08 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:09.563414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:09.563995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:09.570816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:09.571298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:09.571766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:09.572484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:09.572932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:09.573353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:09.703200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:09.710985 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b87c07a3-1532-46f9-aabb-a93337e585f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1390 microversion: 2.1 time: 0.151613 Sep 18 01:49:09.711568 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3147/6318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:09 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:09.733434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:09.734091 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:09.740783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:09.741261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:09.741736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:09.742424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:09.742875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:09.743298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:09.869405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:09.877662 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6c47a39d-d918-4df5-876d-70511d8cca9c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1390 microversion: 2.1 time: 0.148068 Sep 18 01:49:09.878438 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3172/6319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:09 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1390 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:09.900649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:09.901272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:09.907933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:09.908419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:09.908973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:09.909695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:09.910178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:09.910607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:10.045667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:10.053413 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d84749a1-269f-44af-bca7-59be764c2828 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1390 microversion: 2.1 time: 0.156900 Sep 18 01:49:10.054023 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3148/6320] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:09 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:10.076489 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:10.076917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:10.082864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:10.083345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:10.083781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:10.084467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:10.084921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:10.085350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:10.110233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:49:10.184436 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7ff92e04-2cc5-4ba8-a3aa-6a1efbf3c7e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 204 len: 0 microversion: 2.1 time: 0.112160 Sep 18 01:49:10.185024 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3173/6321] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:49:10 2022] DELETE /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:49:10.193789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:10.194407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:10.201643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:10.202141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:10.202579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:10.203286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:10.203771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:10.204191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:10.338372 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:10.346535 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9905a9d9-0b74-4ced-b95c-b15ca6be4d18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1396 microversion: 2.1 time: 0.156638 Sep 18 01:49:10.347159 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3149/6322] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:10 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:49:11.370632 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:11.371370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:11.378340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:11.378830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:11.379267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:11.379974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:11.380428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:11.380847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:11.523493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:11.532964 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e80b805-4a8a-4de9-ac8b-ca0a2c061c7c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1396 microversion: 2.1 time: 0.166596 Sep 18 01:49:11.533680 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3174/6323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:11 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:12.423343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0173fbc1-01b8-45fd-a2b9-f0850ffe71cf req-8082a71d-e84e-4bd8-b68a-165dbce6a91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8283515-3621-446d-9fcb-74959f597368", "name": "network-vif-deleted", "tag": "9a199e0f-f2e4-4368-9397-cc82c667fa6d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:49:12.438244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0173fbc1-01b8-45fd-a2b9-f0850ffe71cf req-8082a71d-e84e-4bd8-b68a-165dbce6a91e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:12.438754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0173fbc1-01b8-45fd-a2b9-f0850ffe71cf req-8082a71d-e84e-4bd8-b68a-165dbce6a91e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:12.439379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0173fbc1-01b8-45fd-a2b9-f0850ffe71cf req-8082a71d-e84e-4bd8-b68a-165dbce6a91e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:12.460293 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0173fbc1-01b8-45fd-a2b9-f0850ffe71cf req-8082a71d-e84e-4bd8-b68a-165dbce6a91e service nova] Creating event network-vif-deleted:9a199e0f-f2e4-4368-9397-cc82c667fa6d for instance d8283515-3621-446d-9fcb-74959f597368 on n-h2-master-1 Sep 18 01:49:12.477542 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0173fbc1-01b8-45fd-a2b9-f0850ffe71cf req-8082a71d-e84e-4bd8-b68a-165dbce6a91e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058040 Sep 18 01:49:12.478190 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3150/6324] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:49:12.556155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:12.557036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:12.564517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:12.565006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:12.565436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:12.566442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:12.566915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:12.567336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:12.649662 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:12.658341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0f9059cb-25a1-42ed-8ab9-67db153f7627 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1187 microversion: 2.1 time: 0.105892 Sep 18 01:49:12.659197 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3175/6325] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:12 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:13.681908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:13.682536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:13.689024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:13.689337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:13.689815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:13.690515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:13.690977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:13.691407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:13.755581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:13.764415 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ab858600-57dd-4226-bb8b-49db2e6e9ff0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1187 microversion: 2.1 time: 0.087782 Sep 18 01:49:13.764997 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3151/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:13 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:14.788213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:14.788854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:14.796350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:14.796836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:14.797274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:14.797993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:14.798452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:14.798877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:14.864171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:14.874328 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f465a9fe-15b5-4b14-afb4-ed23a805d1c9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1187 microversion: 2.1 time: 0.089921 Sep 18 01:49:14.876460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3176/6327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:14 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:15.898914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:15.899627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:15.908070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:15.908652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:15.909156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:15.909950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:15.910472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:15.910961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:15.980156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:15.991235 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d6d6ed68-473b-4a27-906c-4dd3e99c76e3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1187 microversion: 2.1 time: 0.096255 Sep 18 01:49:15.991830 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3152/6328] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:15 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:17.015074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:17.015681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:17.023861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:17.024106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:17.024543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:17.025235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:17.025728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:17.026496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:17.059386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:17.059866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:17.060295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:17.060737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lazy-loading 'fault' on Instance uuid d8283515-3621-446d-9fcb-74959f597368 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:49:17.103362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:17.111312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bd054025-a4fa-4bab-8c3b-110cbb82d006 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 200 len: 1146 microversion: 2.1 time: 0.100586 Sep 18 01:49:17.111903 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3177/6329] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:17 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 1146 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:18.135115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:18.135696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: d8283515-3621-446d-9fcb-74959f597368] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:18.142727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:18.143464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:18.143909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:18.144610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:18.145066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:18.145492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:18.159555 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance d8283515-3621-446d-9fcb-74959f597368 could not be found. Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 HTTP/1.1 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: exception: Instance d8283515-3621-446d-9fcb-74959f597368 could not be found. Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd8283515-3621-446d-9fcb-74959f597368'} Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8283515-3621-446d-9fcb-74959f597368 could not be found. Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8283515-3621-446d-9fcb-74959f597368 could not be found. Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:49:18.161191 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8283515-3621-446d-9fcb-74959f597368 could not be found. Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance d8283515-3621-446d-9fcb-74959f597368 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0807e9a-c137-42bb-9785-f657efd7d362 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368" status: 404 len: 111 microversion: 2.1 time: 0.031690 Sep 18 01:49:18.167161 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3153/6330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:18 2022] GET /compute/v2.1/servers/d8283515-3621-446d-9fcb-74959f597368 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:49:23.122219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-270229705", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9fdee294-3cba-4411-9adf-372156ac66c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:49:23.132993 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:23.186024 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:49:23.548073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:49:23.548429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:49:23.548899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:49:23.549372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:49:23.549805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:49:23.561733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:23.562237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:23.562674 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:23.563393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:23.563870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:23.564286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:23.570994 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:23.583610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:49:23.589291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:49:23.646731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:49:23.648752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9fdee294-3cba-4411-9adf-372156ac66c2',volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:49:23.774965 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ebe4726-d420-41f8-89c9-7ffcfba62534 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657142 Sep 18 01:49:23.775618 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3178/6331] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:49:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:49:23.787626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-946cc31d-9697-4a7d-8de5-1dc0a768748e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:23.788261 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-946cc31d-9697-4a7d-8de5-1dc0a768748e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:23.792059 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=35 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:23.844816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-946cc31d-9697-4a7d-8de5-1dc0a768748e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:23.856093 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-946cc31d-9697-4a7d-8de5-1dc0a768748e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1056 microversion: 2.1 time: 0.071759 Sep 18 01:49:23.856725 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3154/6332] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:23 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1056 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:24.879541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:24.880152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:24.886955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:24.887444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:24.887874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:24.888574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:24.889024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:24.889443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:24.956037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:24.964280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-739b8df3-b13e-49a1-bd87-c92e7292606a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1162 microversion: 2.1 time: 0.089486 Sep 18 01:49:24.965132 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3179/6333] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:24 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1162 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:49:25.988696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:25.989344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:25.996616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:25.998495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:25.999420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:26.000143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:26.000604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:26.001210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:26.005824 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=83 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:26.151639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:26.161572 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a64022c4-965b-4727-a311-acdf601a9862 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1214 microversion: 2.1 time: 0.177034 Sep 18 01:49:26.162274 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3155/6334] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:25 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:26.695798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d0e443f3-ad15-4351-a8df-f010de082003 req-eda18a80-0bed-4870-a41a-a67a4aaec6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e069a8-0be8-4259-a5ca-979bb5e17b15", "tag": "e703ca54-e2ca-41ab-87f6-abe40b158001"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:49:26.708554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d0e443f3-ad15-4351-a8df-f010de082003 req-eda18a80-0bed-4870-a41a-a67a4aaec6ac service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:26.709325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d0e443f3-ad15-4351-a8df-f010de082003 req-eda18a80-0bed-4870-a41a-a67a4aaec6ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:26.709798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d0e443f3-ad15-4351-a8df-f010de082003 req-eda18a80-0bed-4870-a41a-a67a4aaec6ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:26.721501 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d0e443f3-ad15-4351-a8df-f010de082003 req-eda18a80-0bed-4870-a41a-a67a4aaec6ac service nova] Creating event network-changed:e703ca54-e2ca-41ab-87f6-abe40b158001 for instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 on n-h2-master-1 Sep 18 01:49:26.735387 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d0e443f3-ad15-4351-a8df-f010de082003 req-eda18a80-0bed-4870-a41a-a67a4aaec6ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055515 Sep 18 01:49:26.739885 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3180/6335] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:49:27.185937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:27.186563 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:27.193970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:27.194464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:27.194915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:27.195627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:27.196088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:27.196520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:27.337348 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:27.346686 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-63d905c1-83c8-4ca8-be77-6ebeef1e6af4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1214 microversion: 2.1 time: 0.165342 Sep 18 01:49:27.347533 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3156/6336] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:27 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:28.371805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:28.372623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:28.380399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:28.380972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:28.381409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:28.382137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:28.382620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:28.383044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:28.520801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:28.529456 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-10f28b7b-4d67-4905-944b-1290ad0bbbe5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1214 microversion: 2.1 time: 0.162544 Sep 18 01:49:28.530085 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3181/6337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:28 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:29.552340 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:29.552952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:29.560632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:29.561116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:29.561572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:29.562259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:29.562709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:29.563138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:29.693643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:29.701597 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c7b55a9b-bc98-4b87-8158-d6d6ec36c382 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1214 microversion: 2.1 time: 0.153146 Sep 18 01:49:29.702196 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3157/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:29 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:30.724710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:30.725329 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:30.732196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:30.732672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:30.733101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:30.733800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:30.734252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:30.734672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:30.865861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:30.874342 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-96f95fea-0351-4ebc-8c2d-bdc7314a3901 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.153728 Sep 18 01:49:30.875122 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3182/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:30 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:31.898306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:31.898940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:31.906507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:31.906990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:31.907435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:31.908138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:31.908600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:31.909116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:32.039591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:32.047366 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fb65f01-286b-447e-ab4b-86a84d91d579 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.153008 Sep 18 01:49:32.047944 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3158/6340] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:31 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:33.072780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:33.073397 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:33.080403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:33.080885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:33.081323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:33.082070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:33.082529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:33.082955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:33.210655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:33.218414 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74606b68-6522-4075-bf3d-85ee89c728d4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.149676 Sep 18 01:49:33.218998 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3183/6341] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:33 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:34.242162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:34.242816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:34.246062 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:34.251475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:34.251954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:34.252383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:34.253103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:34.253576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:34.253994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:34.387287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:34.395217 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a26934b6-a8f8-42b6-ace8-d30522333a79 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.157528 Sep 18 01:49:34.395790 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3159/6342] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:34 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:35.418078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:35.418612 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:35.420574 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:35.421443 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:49:35.428245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:35.428728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:35.429164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:35.429883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:35.430340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:35.430765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:35.559753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:35.567568 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-da26abf8-897f-4c31-b217-4e221558c080 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.153515 Sep 18 01:49:35.568145 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3184/6343] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:35 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:36.591430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:36.592055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:36.598981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:36.599465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:36.599907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:36.600605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:36.601072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:36.601499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:36.734596 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:36.743980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77496de5-5b76-4b8a-9121-d4b25aa50a8f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.156438 Sep 18 01:49:36.744567 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3160/6344] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:36 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:37.767698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:37.768583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:37.775545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:37.776034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:37.776514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:37.777222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:37.777775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:37.778171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:37.917180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:37.925700 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-56fed20b-3d9a-4b29-9a2d-e2999a4c5d50 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.161954 Sep 18 01:49:37.926298 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3185/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:37 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:38.948136 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:38.948778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:38.955740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:38.956227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:38.956667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:38.957360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:38.957844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:38.958275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:39.085384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:39.093093 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-da331197-83ce-4868-b378-f6b449659447 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.148881 Sep 18 01:49:39.093678 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3161/6346] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:38 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:39.301980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8101c615-7f22-4fa7-a473-958e2710ff07 req-1d0f44a5-f427-4202-a77f-1e794eb1bfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e069a8-0be8-4259-a5ca-979bb5e17b15", "name": "network-vif-plugged", "status": "completed", "tag": "e703ca54-e2ca-41ab-87f6-abe40b158001"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:49:39.312627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8101c615-7f22-4fa7-a473-958e2710ff07 req-1d0f44a5-f427-4202-a77f-1e794eb1bfb9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:39.313065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8101c615-7f22-4fa7-a473-958e2710ff07 req-1d0f44a5-f427-4202-a77f-1e794eb1bfb9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:39.313490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8101c615-7f22-4fa7-a473-958e2710ff07 req-1d0f44a5-f427-4202-a77f-1e794eb1bfb9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:39.327615 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8101c615-7f22-4fa7-a473-958e2710ff07 req-1d0f44a5-f427-4202-a77f-1e794eb1bfb9 service nova] Creating event network-vif-plugged:e703ca54-e2ca-41ab-87f6-abe40b158001 for instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 on n-h2-master-1 Sep 18 01:49:39.332608 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8101c615-7f22-4fa7-a473-958e2710ff07 req-1d0f44a5-f427-4202-a77f-1e794eb1bfb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034356 Sep 18 01:49:39.333403 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3186/6347] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:49:40.125744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:40.126262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:40.132566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:40.133055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:40.133492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:40.134222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:40.134679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:40.135107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:40.287173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:40.296479 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90931d3f-c490-45b4-ae62-68e5bd31c82c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1202 microversion: 2.1 time: 0.184080 Sep 18 01:49:40.297174 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3162/6348] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:40 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1202 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:41.321330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:41.322237 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:41.328450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.328938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.329374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.330107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.330565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.330994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.459422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:41.467229 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d3264e5-62b2-4e58-a4b6-90f1fcd0871d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1390 microversion: 2.1 time: 0.151041 Sep 18 01:49:41.467817 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3187/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:41 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:41.489843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:41.490461 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:41.499925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.499925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.499925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.499925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.500255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.500579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.643916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:41.652359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b32f210-f267-4420-9a0d-acc4aa80c017 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1390 microversion: 2.1 time: 0.166411 Sep 18 01:49:41.653011 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3163/6350] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:41 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:41.675404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:41.675936 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:41.684883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.685361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.685833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.686530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.687048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.687471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.823403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:41.831749 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a54e1d1-3f7b-46c7-ae83-649f8f1ff5e6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1390 microversion: 2.1 time: 0.160330 Sep 18 01:49:41.832336 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3188/6351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:41 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:41.853948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:41.854455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:41.861136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.861670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.862119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.862827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.863283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.863710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.893657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:49:41.981144 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-71ba8051-01aa-4dbb-b119-00718892d817 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 204 len: 0 microversion: 2.1 time: 0.130651 Sep 18 01:49:41.982083 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3164/6352] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:49:41 2022] DELETE /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:49:41.990802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:41.991634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:41.998032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:41.998521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:41.998961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:41.999665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:42.000120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:42.000543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:42.133476 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:42.142022 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd1d239e-92c2-4eed-a45b-dde10e02e973 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1396 microversion: 2.1 time: 0.155213 Sep 18 01:49:42.142612 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3189/6353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:41 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1396 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:43.168066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:43.168767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:43.177208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:43.177744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:43.178184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:43.178887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:43.179335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:43.179766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:43.325786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:43.333811 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d3ef5ac7-ff44-4bcf-be6a-e1efc4c581f6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1396 microversion: 2.1 time: 0.170623 Sep 18 01:49:43.334399 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3165/6354] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:43 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1396 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:44.238963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-849b3f21-67bc-4b26-8afc-ff8ae4a158d4 req-819eeef5-af41-411e-b459-63d602d869eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e069a8-0be8-4259-a5ca-979bb5e17b15", "name": "network-vif-deleted", "tag": "e703ca54-e2ca-41ab-87f6-abe40b158001"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:49:44.253306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-849b3f21-67bc-4b26-8afc-ff8ae4a158d4 req-819eeef5-af41-411e-b459-63d602d869eb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:44.253831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-849b3f21-67bc-4b26-8afc-ff8ae4a158d4 req-819eeef5-af41-411e-b459-63d602d869eb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:44.254361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-849b3f21-67bc-4b26-8afc-ff8ae4a158d4 req-819eeef5-af41-411e-b459-63d602d869eb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:44.268708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-849b3f21-67bc-4b26-8afc-ff8ae4a158d4 req-819eeef5-af41-411e-b459-63d602d869eb service nova] Creating event network-vif-deleted:e703ca54-e2ca-41ab-87f6-abe40b158001 for instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 on n-h2-master-1 Sep 18 01:49:44.274570 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-849b3f21-67bc-4b26-8afc-ff8ae4a158d4 req-819eeef5-af41-411e-b459-63d602d869eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039496 Sep 18 01:49:44.275193 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3190/6355] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:49:44.359108 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:44.359737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:44.366586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:44.367082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:44.367524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:44.368453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:44.368916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:44.369441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:44.438780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:44.446646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2fbdcd5-b1c0-48ce-b80b-05beba7cb586 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1187 microversion: 2.1 time: 0.093211 Sep 18 01:49:44.447233 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3166/6356] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:44 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:45.471458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:45.472066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:45.478314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:45.478794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:45.479227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:45.479915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:45.480383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:45.480790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:45.545417 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:45.553440 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc1a0bba-59f0-409a-b160-365d99c59ce7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1187 microversion: 2.1 time: 0.087566 Sep 18 01:49:45.554054 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3191/6357] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:45 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:46.577058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:46.577833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:46.584654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:46.585145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:46.585600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:46.586309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:46.586767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:46.587188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:46.660306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:46.671768 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3ee1123d-5832-4f95-809d-36d4facaeede tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1187 microversion: 2.1 time: 0.099220 Sep 18 01:49:46.672444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3167/6358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:46 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:47.694938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:47.695552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:47.702508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:47.702989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:47.703420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:47.704107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:47.704557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:47.704983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:47.767507 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:47.775848 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19763f8f-7e73-450d-a475-13c2a70d889d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1187 microversion: 2.1 time: 0.085294 Sep 18 01:49:47.776962 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3192/6359] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:47 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:48.798828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:48.799463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:48.806646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:48.807138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:48.808179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:48.808893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:48.809543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:48.809982 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:48.843112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:48.843707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:48.844150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:48.844607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lazy-loading 'fault' on Instance uuid 21e069a8-0be8-4259-a5ca-979bb5e17b15 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:49:48.888013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:49:48.895526 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0da4fcf8-0ac5-4e77-a8bc-4631e4970dcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 200 len: 1146 microversion: 2.1 time: 0.100663 Sep 18 01:49:48.896105 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3168/6360] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:48 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 1146 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:49:49.918369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:49:49.918989 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 21e069a8-0be8-4259-a5ca-979bb5e17b15] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:49:49.925850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:49.926340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:49.926781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:49.927480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:49:49.927966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:49:49.928401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:49:49.942226 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 could not be found. Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 HTTP/1.1 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 could not be found. Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '21e069a8-0be8-4259-a5ca-979bb5e17b15'} Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 could not be found. Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 could not be found. Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:49:49.943851 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 could not be found. Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance 21e069a8-0be8-4259-a5ca-979bb5e17b15 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ce6e46fe-cb95-46e5-90f1-89de8f2349e7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15" status: 404 len: 111 microversion: 2.1 time: 0.030824 Sep 18 01:49:49.947840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3193/6361] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:49:49 2022] GET /compute/v2.1/servers/21e069a8-0be8-4259-a5ca-979bb5e17b15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:50:10.892834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1255260266", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "59525bac-9cdb-4c83-9655-33eae2328012", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:50:10.904288 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:10.904941 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:10.985718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:50:11.358317 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:50:11.358733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:50:11.359203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:50:11.359607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:50:11.360013 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:50:11.368900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:11.369380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:11.369841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:11.370558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:11.371009 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:11.371433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:11.388412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:50:11.394004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:50:11.406829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:50:11.408848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='59525bac-9cdb-4c83-9655-33eae2328012',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:50:11.495192 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-02491a22-b834-4b61-a91c-d4788c5e391b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606522 Sep 18 01:50:11.495860 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3169/6362] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:50:11.506769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-874f2572-3ed1-40e3-b644-67630a23e8dd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:11.507383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-874f2572-3ed1-40e3-b644-67630a23e8dd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:11.510380 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:11.511023 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=75 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:11.564607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-874f2572-3ed1-40e3-b644-67630a23e8dd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:11.571373 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-874f2572-3ed1-40e3-b644-67630a23e8dd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1057 microversion: 2.1 time: 0.068433 Sep 18 01:50:11.571939 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3194/6363] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:11 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1057 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:12.597375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:12.599033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:12.609214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:12.610228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:12.611036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:12.612017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:12.612725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:12.613466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:12.692301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:12.700943 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eec73ace-3f05-4c1e-a9ae-603227b13b0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1127 microversion: 2.1 time: 0.109225 Sep 18 01:50:12.717957 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3170/6364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:12 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1127 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:13.726395 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:13.727010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:13.735693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:13.736178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:13.736786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:13.737479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:13.737946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:13.738541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:13.888862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:13.898339 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6e9dadff-7c77-4fc1-8539-88b2304a08f7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.176171 Sep 18 01:50:13.899445 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3195/6365] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:13 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:50:14.084449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4db20b2b-742a-4290-8b63-b35542b27ad8 req-72994e64-0584-4526-b3b7-b2c9a8659c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7", "tag": "f504d5c0-6404-4c2b-819a-e3ba47a6de9c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:50:14.103204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4db20b2b-742a-4290-8b63-b35542b27ad8 req-72994e64-0584-4526-b3b7-b2c9a8659c21 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:14.103795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4db20b2b-742a-4290-8b63-b35542b27ad8 req-72994e64-0584-4526-b3b7-b2c9a8659c21 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:14.108751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4db20b2b-742a-4290-8b63-b35542b27ad8 req-72994e64-0584-4526-b3b7-b2c9a8659c21 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:14.126508 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4db20b2b-742a-4290-8b63-b35542b27ad8 req-72994e64-0584-4526-b3b7-b2c9a8659c21 service nova] Creating event network-changed:f504d5c0-6404-4c2b-819a-e3ba47a6de9c for instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 on n-h1-master-1 Sep 18 01:50:14.133295 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4db20b2b-742a-4290-8b63-b35542b27ad8 req-72994e64-0584-4526-b3b7-b2c9a8659c21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053987 Sep 18 01:50:14.134257 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3171/6366] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:50:14.920615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:14.921316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:14.929475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:14.929920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:14.930411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:14.931117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:14.931571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:14.931994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:15.068409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:15.077470 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b6f017c-346b-4986-838f-0837254db4a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.160957 Sep 18 01:50:15.078399 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3196/6367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:14 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:16.102253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:16.102946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:16.109942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:16.110425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:16.110859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:16.111548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:16.112000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:16.112419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:16.264309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:16.272851 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c89c03d2-541c-4137-a08f-ec1ef3298c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.176016 Sep 18 01:50:16.273908 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3172/6368] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:16 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:50:17.297685 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:17.298309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:17.310712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:17.310872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:17.311293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:17.312113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:17.312580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:17.313007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:17.483727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:17.506868 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-779ed1e3-51a4-410e-a877-a3db0b9ad683 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.213276 Sep 18 01:50:17.507803 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3197/6369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:17 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:18.543378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:18.544068 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:18.550567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:18.551053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:18.551492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:18.552195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:18.552677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:18.553108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:18.699058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:18.713086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f11cdf78-1a75-4220-a4e9-1035cb9733ec tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.174198 Sep 18 01:50:18.716223 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3173/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:18 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:19.741655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:19.742350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:19.750402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:19.751110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:19.751585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:19.752260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:19.752776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:19.753388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:19.890624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:19.899283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-de192754-0a01-4832-b1f6-4419ebef59bd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.161769 Sep 18 01:50:19.899866 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3198/6371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:19 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:50:20.922416 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:20.923025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:20.930030 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:20.930509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:20.930945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:20.931626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:20.932124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:20.932707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:21.065045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:21.073272 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ea8e36a-c14d-4df1-b089-6cf9e8da0a07 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.154191 Sep 18 01:50:21.073889 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3174/6372] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:20 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:22.096332 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:22.096935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:22.099637 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:22.104873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:22.105358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:22.105829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:22.106521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:22.106972 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:22.107396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:22.238154 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:22.246322 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7bc60ff3-9e54-4e5d-b831-81e6122fb3a8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.153960 Sep 18 01:50:22.246903 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3199/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:22 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:23.269695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:23.270309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:23.272271 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:23.272946 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:23.280422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:23.280905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:23.281340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:23.282067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:23.282524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:23.282949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:23.412452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:23.420206 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a818a917-0755-4abb-a3f5-fef9279a614e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.154720 Sep 18 01:50:23.420780 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3175/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:23 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:24.443184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:24.443789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:24.451136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:24.451642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:24.452072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:24.452729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:24.453175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:24.453618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:24.595431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:24.603265 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d865ff67-b685-476e-8bbc-873fb86f8610 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.164044 Sep 18 01:50:24.603916 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3200/6375] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:24 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:25.627039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:25.627655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:25.634655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:25.635208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:25.635650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:25.636341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:25.636798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:25.637221 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:25.769790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:25.778164 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc5f7373-a0de-4bc2-b882-4dd7a9d9d838 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.155141 Sep 18 01:50:25.778738 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3176/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:25 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:26.802366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:26.803010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:26.809507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:26.810024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:26.810489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:26.811249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:26.811704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:26.812135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:27.104868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:27.113412 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-66dd1cf1-b12c-40f2-b666-17ff46b7e36c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1169 microversion: 2.1 time: 0.315820 Sep 18 01:50:27.114049 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3201/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:26 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1169 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:28.137895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:28.138504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:28.145689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:28.146181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:28.146626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:28.147322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:28.147785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:28.148217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:28.622680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:28.630781 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8cac25a1-65a3-4b7a-adc3-e6df43f4f6de tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.496944 Sep 18 01:50:28.631361 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3177/6378] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:28 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:29.654406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:29.655013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:29.661860 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:29.662338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:29.662767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:29.663450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:29.663934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:29.664334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:29.792015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:29.799774 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-39c9204c-62b1-47aa-a383-7af66eadf00c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.149823 Sep 18 01:50:29.800346 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3202/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:29 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:30.822358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:30.822974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:30.829917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:30.830395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:30.830830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:30.831510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:30.831961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:30.832381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:30.963074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:30.970824 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8038f117-afc2-42eb-b31f-5efe88f50d77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.152419 Sep 18 01:50:30.971403 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3178/6380] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:30 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:31.994286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:31.994896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:32.002212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:32.002684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:32.003112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:32.003791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:32.004237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:32.004653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:32.129964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:32.138093 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b6c2f5b5-255a-4b5d-9e82-eb27a5f5e058 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.147888 Sep 18 01:50:32.138671 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3203/6381] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:31 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:33.161735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:33.162371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:33.169900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:33.170296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:33.170736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:33.171433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:33.171891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:33.172316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:33.363012 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:33.371168 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aece0491-c42c-4257-a343-139f0ff41d85 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.213459 Sep 18 01:50:33.371740 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3179/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:33 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:34.394881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:34.395496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:34.403077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:34.403559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:34.403991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:34.404679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:34.405134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:34.405577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:34.543695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:34.551468 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-583cd52b-b09a-4335-a3bf-728a41de2c5c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.160699 Sep 18 01:50:34.552040 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3204/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:34 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:50:35.573709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:35.574245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:35.581053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:35.581538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:35.582000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:35.582692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:35.583151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:35.583572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:35.722200 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:35.730561 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b5b7c44-8beb-4ddd-bea7-73808689722e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.160950 Sep 18 01:50:35.731348 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3180/6384] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:35 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:36.753077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:36.753724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:36.759723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:36.761675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:36.762138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:36.762843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:36.763308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:36.763739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:36.893913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:36.901623 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b670e8b-45c1-467c-8720-2d5a7ecd2a0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.153379 Sep 18 01:50:36.902199 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3205/6385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:36 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:37.257232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4e77cd51-eeb2-42d4-8415-c0f04834c6cc req-7ec3479c-c676-4ac1-b1a1-9f8f1a1af175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7", "name": "network-vif-plugged", "status": "completed", "tag": "f504d5c0-6404-4c2b-819a-e3ba47a6de9c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:50:37.269272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4e77cd51-eeb2-42d4-8415-c0f04834c6cc req-7ec3479c-c676-4ac1-b1a1-9f8f1a1af175 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:37.269789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4e77cd51-eeb2-42d4-8415-c0f04834c6cc req-7ec3479c-c676-4ac1-b1a1-9f8f1a1af175 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:37.270219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4e77cd51-eeb2-42d4-8415-c0f04834c6cc req-7ec3479c-c676-4ac1-b1a1-9f8f1a1af175 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:37.282385 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4e77cd51-eeb2-42d4-8415-c0f04834c6cc req-7ec3479c-c676-4ac1-b1a1-9f8f1a1af175 service nova] Creating event network-vif-plugged:f504d5c0-6404-4c2b-819a-e3ba47a6de9c for instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 on n-h1-master-1 Sep 18 01:50:37.287493 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4e77cd51-eeb2-42d4-8415-c0f04834c6cc req-7ec3479c-c676-4ac1-b1a1-9f8f1a1af175 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034153 Sep 18 01:50:37.288109 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3181/6386] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:50:37.924792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:37.925416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:37.933271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:37.933779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:37.934220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:37.934924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:37.935386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:37.935810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:38.069793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:38.078287 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5fbb1eb6-134e-46ac-b1df-5f44f9b8ef13 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1203 microversion: 2.1 time: 0.157368 Sep 18 01:50:38.078869 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3206/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:37 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:39.103306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:39.104047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:39.110382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.110856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.111286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.111961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.112437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.112855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.243719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:39.252033 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-445824d7-b985-49fa-9448-d19830cec336 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1390 microversion: 2.1 time: 0.153853 Sep 18 01:50:39.252609 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3182/6388] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:39 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:39.274626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:39.275249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:39.282008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.282494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.282934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.283626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.284086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.284517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.413855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:39.422041 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c00e6eca-a6cd-4427-9e20-ee0cb4573e62 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1390 microversion: 2.1 time: 0.151210 Sep 18 01:50:39.422629 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3207/6389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:39 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:39.444846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:39.445380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:39.452245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.452727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.453156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.453918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.454366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.454786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.593214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:39.601034 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bb15adc3-431f-4eb4-be27-f3512f733cb0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1390 microversion: 2.1 time: 0.160220 Sep 18 01:50:39.601622 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3183/6390] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:39 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:39.681671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:39.682286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:39.688787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.689270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.689739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.690423 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.690878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.691301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.716827 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:50:39.792863 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b776d644-888c-4533-9b24-f83a5305a4e9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 204 len: 0 microversion: 2.1 time: 0.114665 Sep 18 01:50:39.793539 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3208/6391] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:50:39 2022] DELETE /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:50:39.801739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:39.802350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:39.808297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.808771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.809200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.809933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:39.810389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:39.810810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:39.938890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:39.946782 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-254be5cd-64e0-4c3b-bd38-f82474e1f962 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1396 microversion: 2.1 time: 0.149140 Sep 18 01:50:39.947353 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3184/6392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:39 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1396 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:40.971470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:40.972195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:40.978128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:40.978616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:40.979050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:40.979740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:40.980195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:40.980622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:41.108450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:41.112006 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:41.117067 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-702e8927-0952-45ec-8155-4ec0ac36402a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1396 microversion: 2.1 time: 0.150784 Sep 18 01:50:41.117652 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3209/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:40 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1396 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:41.907584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f4d1b0f1-a51c-4eac-a765-2c387862cec1 req-ac1804ee-73e6-4067-850a-b566216f5c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7", "name": "network-vif-deleted", "tag": "f504d5c0-6404-4c2b-819a-e3ba47a6de9c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:50:41.913694 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:41.920916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f4d1b0f1-a51c-4eac-a765-2c387862cec1 req-ac1804ee-73e6-4067-850a-b566216f5c35 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:41.921640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f4d1b0f1-a51c-4eac-a765-2c387862cec1 req-ac1804ee-73e6-4067-850a-b566216f5c35 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:41.922077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f4d1b0f1-a51c-4eac-a765-2c387862cec1 req-ac1804ee-73e6-4067-850a-b566216f5c35 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:41.925141 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=85 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:41.941354 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f4d1b0f1-a51c-4eac-a765-2c387862cec1 req-ac1804ee-73e6-4067-850a-b566216f5c35 service nova] Creating event network-vif-deleted:f504d5c0-6404-4c2b-819a-e3ba47a6de9c for instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 on n-h1-master-1 Sep 18 01:50:41.946421 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f4d1b0f1-a51c-4eac-a765-2c387862cec1 req-ac1804ee-73e6-4067-850a-b566216f5c35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042583 Sep 18 01:50:41.947033 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3185/6394] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:50:42.140928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:42.141496 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:42.145058 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:50:42.152117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:42.152682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:42.153196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:42.153945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:42.154426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:42.154848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:42.224012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:42.231910 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-84221ad4-e607-4cd3-ab3f-546acabeebe6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1188 microversion: 2.1 time: 0.095002 Sep 18 01:50:42.232484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3210/6395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:42 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:43.257266 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:43.257986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:43.264420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:43.264910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:43.265351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:43.266079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:43.266538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:43.266959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:43.330309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:43.338217 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de8d4c28-c1f1-440c-bae9-cfa11606c7fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1188 microversion: 2.1 time: 0.086390 Sep 18 01:50:43.339308 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3186/6396] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:43 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:44.361727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:44.362344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:44.369505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:44.370176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:44.371277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:44.371841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:44.372291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:44.372712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:44.436682 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:44.444848 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-81bffc34-3599-41fd-87d3-6c85414185ce tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1188 microversion: 2.1 time: 0.087111 Sep 18 01:50:44.445439 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3211/6397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:44 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:45.467653 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:45.468224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:45.475297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:45.475786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:45.476227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:45.476929 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:45.477387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:45.477842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:45.539813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:45.547700 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fd493f9a-8d62-48e8-a028-94e2068777ca tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1188 microversion: 2.1 time: 0.084218 Sep 18 01:50:45.548271 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3187/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:45 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:46.571663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:46.572276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:46.580339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:46.580830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:46.581266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:46.582175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:46.582663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:46.583067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:46.617885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:46.618370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:46.618805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:46.619256 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lazy-loading 'fault' on Instance uuid f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:50:46.667271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:50:46.674500 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0bddfd83-616c-424a-a789-80dd113e6df3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 200 len: 1147 microversion: 2.1 time: 0.107178 Sep 18 01:50:46.675082 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3212/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:46 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 1147 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:50:47.697857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:47.698602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:47.705346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:47.705821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:47.706283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:47.706969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:47.707429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:47.707856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:47.722298 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 HTTP/1.1 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: exception: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7'} Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:50:47.723993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f2476eb-2047-4c6b-b3f4-c20558d3a3be tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 404 len: 111 microversion: 2.1 time: 0.031680 Sep 18 01:50:47.727402 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3188/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:47 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:50:48.825280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:48.825883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:48.833103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:48.833734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:48.834225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:48.834932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:48.835550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:48.836087 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:48.850605 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 HTTP/1.1 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: exception: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7'} Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:50:48.852279 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c09fde5-a853-4c7c-948d-abc474b57cd6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 404 len: 111 microversion: 2.1 time: 0.032849 Sep 18 01:50:48.856596 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3213/6401] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:50:48 2022] DELETE /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:50:48.862893 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:50:48.863507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:50:48.871331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:48.871823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:48.872258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:48.872962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:50:48.873527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:50:48.874064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:50:48.894036 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 HTTP/1.1 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: exception: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7'} Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:50:48.895592 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-35ff28dc-f84e-4b06-af42-7213a988330a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7" status: 404 len: 111 microversion: 2.1 time: 0.037969 Sep 18 01:50:48.899513 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3189/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:50:48 2022] GET /compute/v2.1/servers/f8a11c2b-c0fa-45d3-9f71-e00936bfb0d7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:51:08.548828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-858432698", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e83288dc-9b24-4d68-b824-eb564f703c7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:51:08.559533 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=9 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:08.560185 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=22 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:08.614627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:51:08.980392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:51:08.980818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:51:08.981295 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:51:08.981742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:51:08.982159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:51:08.991104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:08.991593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:08.992036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:08.992794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:08.993257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:08.993720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:09.011108 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:51:09.016516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:51:09.074746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:51:09.076817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e83288dc-9b24-4d68-b824-eb564f703c7c',volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:51:09.204532 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-62940d19-ac8e-4a0b-9cd9-c4517b77b90f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659792 Sep 18 01:51:09.205392 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3214/6403] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:51:09.216935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b076213-aa39-4e13-ab3e-8d1ca6205ead tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:09.217698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b076213-aa39-4e13-ab3e-8d1ca6205ead tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:09.221435 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=9 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:09.222299 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=17 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:09.274366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b076213-aa39-4e13-ab3e-8d1ca6205ead tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:09.282020 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b076213-aa39-4e13-ab3e-8d1ca6205ead tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1070 microversion: 2.1 time: 0.069453 Sep 18 01:51:09.282608 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3190/6404] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:09 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1070 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:10.305649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:10.306752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:10.312995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:10.313483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:10.314114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:10.314990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:10.315452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:10.315883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:10.382378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:10.391090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee9d8c53-95c7-4386-b0c6-9865b5366492 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1176 microversion: 2.1 time: 0.090331 Sep 18 01:51:10.391698 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3215/6405] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:10 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1176 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:11.416166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:11.416764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:11.425646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:11.426137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:11.426598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:11.427299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:11.427917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:11.428355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:11.577424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:11.585955 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77da7179-ce8c-46b6-a125-5779e6b02da9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1228 microversion: 2.1 time: 0.173801 Sep 18 01:51:11.586837 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3191/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:11 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1228 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:11.707930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e12c54b0-8bd4-421c-aa01-2c7eef53f736 req-5b3eb06a-4d86-4515-8107-5937e31cffd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c1c008-dfa1-4d79-8e76-c3aef5a24b06", "tag": "ad1ce179-a466-460e-bf11-e89d5327e3c0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:51:11.740992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e12c54b0-8bd4-421c-aa01-2c7eef53f736 req-5b3eb06a-4d86-4515-8107-5937e31cffd9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:11.741465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e12c54b0-8bd4-421c-aa01-2c7eef53f736 req-5b3eb06a-4d86-4515-8107-5937e31cffd9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:11.741916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e12c54b0-8bd4-421c-aa01-2c7eef53f736 req-5b3eb06a-4d86-4515-8107-5937e31cffd9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:11.769281 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e12c54b0-8bd4-421c-aa01-2c7eef53f736 req-5b3eb06a-4d86-4515-8107-5937e31cffd9 service nova] Creating event network-changed:ad1ce179-a466-460e-bf11-e89d5327e3c0 for instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 on n-h2-master-1 Sep 18 01:51:11.774776 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e12c54b0-8bd4-421c-aa01-2c7eef53f736 req-5b3eb06a-4d86-4515-8107-5937e31cffd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071943 Sep 18 01:51:11.776941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3216/6407] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:51:12.613833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:12.615187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:12.624422 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:51:12.624903 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 01:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 (ip 10.222.0.25) !!! Sep 18 01:51:12.630522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:12.631433 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:12.632106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:12.633053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:12.633774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:12.634655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:12.800834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:12.809924 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc84ad86-1753-424e-b7ba-259c77ac2f47 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1228 microversion: 2.1 time: 0.199881 Sep 18 01:51:12.810625 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3192/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:12 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1228 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:13.833448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:13.834080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:13.841679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:13.842165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:13.842703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:13.843287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:13.843740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:13.844162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:13.985120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:13.993283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e08d546-be16-4728-9c6c-8df6f78985ef tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1228 microversion: 2.1 time: 0.164204 Sep 18 01:51:13.993977 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3217/6409] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:13 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1228 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:15.016498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:15.017398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:15.024720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:15.025206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:15.025663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:15.026360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:15.026813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:15.027236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:15.170586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:15.178586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-93f64a23-0e28-4774-b15b-de7297279744 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1228 microversion: 2.1 time: 0.166088 Sep 18 01:51:15.179290 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3193/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:15 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1228 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:16.202591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:16.203240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:16.210058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:16.210818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:16.211308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:16.212141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:16.212682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:16.213117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:16.340860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:16.348862 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-190ec9e8-0087-4a13-a395-7e665393b5df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.150883 Sep 18 01:51:16.349445 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3218/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:16 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:17.371566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:17.372172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:17.378737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:17.379223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:17.379657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:17.380346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:17.380801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:17.381224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:17.516056 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:17.524199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f6083a3-34ce-43d9-a15b-f3cf5bacaa4e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.156674 Sep 18 01:51:17.524768 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3194/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:17 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:18.547173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:18.547811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:18.554629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:18.555112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:18.555550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:18.556238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:18.556691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:18.557117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:18.691928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:18.700153 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b3c9d249-9ff5-4364-b423-bc1739319ba6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.156873 Sep 18 01:51:18.700723 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3219/6413] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:18 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:19.723722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:19.724350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:19.727124 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:19.733130 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:19.733633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:19.734148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:19.734844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:19.735294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:19.735718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:19.869513 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:19.877410 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d2b6a6d-bf7e-4b04-9abf-e649962f85c6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.158135 Sep 18 01:51:19.878226 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3195/6414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:19 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:20.900756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:20.901374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:20.903420 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:20.904165 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:20.911263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:20.911749 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:20.912218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:20.912916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:20.913374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:20.913849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:21.060755 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:21.073946 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-24538e7e-77f3-45f7-9671-1d21e9086d0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.177078 Sep 18 01:51:21.074787 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3220/6415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:20 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:22.103845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:22.104604 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:22.111552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:22.112032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:22.112475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:22.113162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:22.113634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:22.114054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:22.251467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:22.259705 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e8c22fbf-e00d-40d8-b775-a6d86713b1cd tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.159708 Sep 18 01:51:22.260291 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3196/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:22 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:23.283610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:23.284225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:23.290992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:23.291470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:23.291905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:23.292773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:23.293229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:23.293688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:23.423573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:23.431334 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82eb6a04-a74e-4dec-9fbf-ec641c6f4e82 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.151669 Sep 18 01:51:23.431913 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3221/6417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:23 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:23.717771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0d3e0588-b6e9-40de-9863-46d2fc2efe09 req-9999e873-cafa-47fb-902e-27c8ec68bfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c1c008-dfa1-4d79-8e76-c3aef5a24b06", "name": "network-vif-plugged", "status": "completed", "tag": "ad1ce179-a466-460e-bf11-e89d5327e3c0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:51:23.730532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0d3e0588-b6e9-40de-9863-46d2fc2efe09 req-9999e873-cafa-47fb-902e-27c8ec68bfc0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:23.731022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0d3e0588-b6e9-40de-9863-46d2fc2efe09 req-9999e873-cafa-47fb-902e-27c8ec68bfc0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:23.731459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0d3e0588-b6e9-40de-9863-46d2fc2efe09 req-9999e873-cafa-47fb-902e-27c8ec68bfc0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:23.743055 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0d3e0588-b6e9-40de-9863-46d2fc2efe09 req-9999e873-cafa-47fb-902e-27c8ec68bfc0 service nova] Creating event network-vif-plugged:ad1ce179-a466-460e-bf11-e89d5327e3c0 for instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 on n-h2-master-1 Sep 18 01:51:23.749061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0d3e0588-b6e9-40de-9863-46d2fc2efe09 req-9999e873-cafa-47fb-902e-27c8ec68bfc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Sep 18 01:51:23.749857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3197/6418] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:51:24.453712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:24.454328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:24.461464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:24.462118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:24.462437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:24.463398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:24.464379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:24.464785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:24.607522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:24.615623 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb245538-dfe0-48d5-80cf-0a6315909346 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1216 microversion: 2.1 time: 0.165791 Sep 18 01:51:24.616203 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3222/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:24 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:25.639057 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:25.639749 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:25.647263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:25.647741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:25.648175 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:25.648862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:25.649311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:25.649762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:25.787098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:25.795824 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c2f9ccb-eaa3-4b7c-9744-1943495beee8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1404 microversion: 2.1 time: 0.161022 Sep 18 01:51:25.796409 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3198/6420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:25 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:25.819131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:25.819725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:25.826532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:25.827008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:25.827465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:25.828144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:25.828600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:25.829016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:25.964367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:25.972179 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f733036-d7c1-4ef1-934c-a1904c042f0b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1404 microversion: 2.1 time: 0.157038 Sep 18 01:51:25.972765 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3223/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:25 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:25.995007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-451261284"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:51:25.997315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:26.003228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:26.003705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:26.004138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:26.004822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:26.005279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:26.005742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:26.098626 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Attempting to quiesce instance before volume snapshot. Sep 18 01:51:26.181695 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 18 01:51:26.250840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Creating snapshot from volume e83288dc-9b24-4d68-b824-eb564f703c7c. {{(pid=122373) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 18 01:51:27.135103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6c7c832f-a856-4fbf-a9b4-7e6e44c34f7f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06/action" status: 202 len: 0 microversion: 2.1 time: 1.143900 Sep 18 01:51:27.136035 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3199/6422] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:51:25 2022] POST /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06/action => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 01:51:28.305735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-143371637", "imageRef": "d78970f5-d4d0-454a-9ea9-3793a76a4c41", "flavorRef": "452", "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:51:28.364211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:51:28.746308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:51:28.746722 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:51:28.747213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:51:28.747616 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:51:28.748021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:51:28.756920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:28.757391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:28.757850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:28.758647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:28.759100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:28.759521 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:28.780376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:51:28.785434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:51:28.798081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:51:28.800606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5b78b0d7-9209-46aa-97f5-8a3963b16eb4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:51:28.877802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dc15bcf8-afff-468b-b173-e2b132d2f6b4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575930 Sep 18 01:51:28.878489 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3224/6423] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:51:28.891369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8af97560-ed0e-4660-a631-c539847c06bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:28.892374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8af97560-ed0e-4660-a631-c539847c06bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:28.949651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8af97560-ed0e-4660-a631-c539847c06bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:28.956668 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8af97560-ed0e-4660-a631-c539847c06bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1229 microversion: 2.1 time: 0.070645 Sep 18 01:51:28.957220 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3200/6424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:28 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1229 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:29.981227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:29.981874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:29.987960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:29.988442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:29.988875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:29.989587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:29.990042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:29.990467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:30.063546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:30.072858 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dad24dd4-7abf-4501-b6eb-c3311f232181 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1289 microversion: 2.1 time: 0.095988 Sep 18 01:51:30.073594 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3225/6425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:29 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:31.098076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:31.099103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:31.110430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:31.110943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:31.111407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:31.112131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:31.112808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:31.113462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:31.342809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:31.360232 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11a8931c-e1bf-47a6-b9ea-5bbb4065b1c0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.265308 Sep 18 01:51:31.361121 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3201/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:31 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:31.845969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-5971c676-e978-4878-af09-272123bf6d68 req-1e89bc2c-0ad4-4798-b6a2-6f6633d097c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98910f5d-b1ad-4c56-98e1-4762c5a64047", "tag": "dfb44b0f-686f-47f6-8d87-199ec2187b2f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:51:31.864827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5971c676-e978-4878-af09-272123bf6d68 req-1e89bc2c-0ad4-4798-b6a2-6f6633d097c6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:31.866644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5971c676-e978-4878-af09-272123bf6d68 req-1e89bc2c-0ad4-4798-b6a2-6f6633d097c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:31.867275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-5971c676-e978-4878-af09-272123bf6d68 req-1e89bc2c-0ad4-4798-b6a2-6f6633d097c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:31.885762 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-5971c676-e978-4878-af09-272123bf6d68 req-1e89bc2c-0ad4-4798-b6a2-6f6633d097c6 service nova] Creating event network-changed:dfb44b0f-686f-47f6-8d87-199ec2187b2f for instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 on n-h1-master-1 Sep 18 01:51:31.894372 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-5971c676-e978-4878-af09-272123bf6d68 req-1e89bc2c-0ad4-4798-b6a2-6f6633d097c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053739 Sep 18 01:51:31.895714 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3226/6427] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:51:32.384265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:32.384897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:32.392835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:32.393328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:32.393798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:32.394503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:32.395138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:32.395573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:32.549423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:32.558707 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-432e2a7d-a64a-4cd5-82f6-39ae67baabb5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.178127 Sep 18 01:51:32.571505 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3202/6428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:32 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:33.584101 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:33.585461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:33.596831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:33.597409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:33.597788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:33.598495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:33.598945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:33.599367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:33.793110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:33.801091 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b405e7b-8099-41df-8c53-29d9a5d8501a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.222236 Sep 18 01:51:33.801693 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3227/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:33 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:34.826398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:34.827327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:34.835903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:34.836514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:34.836965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:34.839033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:34.839033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:34.839439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:35.086964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:35.101118 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-97148ed1-40c3-4b89-bee7-3634f7014a95 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.280148 Sep 18 01:51:35.101881 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3203/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:34 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:51:36.131842 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:36.132384 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:36.140589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:36.141128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:36.141981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:36.142646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:36.143142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:36.143822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:36.342049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:36.352028 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3710f32d-f612-425d-a454-2f90ed374cf6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.222749 Sep 18 01:51:36.352028 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3228/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:36 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:37.388568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:37.389627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:37.398258 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:37.398778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:37.399262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:37.400732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:37.402024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:37.402468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:37.553923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:37.562021 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-255a219d-d2ad-466f-b564-f302ebaf7c0a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.179139 Sep 18 01:51:37.573630 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3204/6432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:37 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:51:38.586012 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:38.586643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:38.590160 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:38.596272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:38.596759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:38.597199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:38.597915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:38.598370 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:38.598790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:38.602860 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=75 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:38.736641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:38.744389 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1aeb5021-8af5-45db-af76-fd59009b8762 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.162273 Sep 18 01:51:38.745023 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3229/6433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:38 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:39.767808 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:39.768626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:39.774956 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:39.775623 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=35 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:39.777400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:39.778005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:39.778499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:39.779242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:39.779698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:39.780142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:39.784017 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:39.926686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:39.935012 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-763999f3-69e9-462e-98a8-9d6617936fcb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.171878 Sep 18 01:51:39.935591 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3205/6434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:39 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:40.958456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:40.959051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:40.960958 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:40.961620 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:51:40.969585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:40.970075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:40.970513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:40.971249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:40.971700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:40.972118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:41.115577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:41.127048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bdc31207-0546-4014-b5ce-6a4f44485b77 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.172668 Sep 18 01:51:41.127578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3230/6435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:40 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:51:42.151638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:42.152273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:42.159444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:42.159941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:42.160394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:42.161103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:42.161595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:42.162034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:42.311309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:42.319017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6fa4a60c-ccc7-47a0-8542-508baa50e740 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.172003 Sep 18 01:51:42.319598 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3206/6436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:42 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:43.344490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:43.345211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:43.352866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:43.353527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:43.354000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:43.354706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:43.355318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:43.355879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:43.501322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:43.511182 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cfe26ab9-f942-44cf-a061-2fc19820022b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1341 microversion: 2.1 time: 0.171315 Sep 18 01:51:43.511828 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3231/6437] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:43 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:51:44.535245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:44.535877 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:44.543153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:44.543709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:44.544196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:44.545236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:44.545974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:44.546470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:44.702832 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:44.711118 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee3f2d74-943a-427a-8031-75ddc316a13e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1387 microversion: 2.1 time: 0.180261 Sep 18 01:51:44.711716 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3207/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:44 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1387 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:45.735225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:45.735836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:45.742679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:45.743162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:45.743592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:45.744276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:45.744724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:45.745270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:45.878448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:45.887100 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e4afe14-9810-43c0-97ba-39bb1ab3a69a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.155927 Sep 18 01:51:45.887688 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3232/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:45 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:46.912400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:46.912978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:46.920311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:46.920806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:46.921248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:46.921996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:46.922495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:46.922950 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:47.063303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:47.071740 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9e0a40d9-7d8e-422c-b318-35459081de66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.163449 Sep 18 01:51:47.071740 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3208/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:46 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:48.099487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:48.100078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:48.107693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:48.108187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:48.108630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:48.109338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:48.109828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:48.110281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:48.255284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:48.263448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-888ed879-ad4c-4d78-b0ca-046e30145348 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.167919 Sep 18 01:51:48.264035 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3233/6441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:48 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:49.289089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:49.289911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:49.298998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:49.299705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:49.300296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:49.301226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:49.301968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:49.302730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:49.439665 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:49.447705 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-766b80bf-3d65-4721-abc2-c65ccf0487b5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.163885 Sep 18 01:51:49.448808 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3209/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:49 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:50.476313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:50.477067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:50.485944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:50.486516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:50.487036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:50.487780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:50.488323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:50.488694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:50.645639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:50.655370 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-03e80795-a698-4e7f-9bca-ed7ea3ce1623 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.183538 Sep 18 01:51:50.656091 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3234/6443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:50 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:51.680778 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:51.681617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:51.689886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:51.690450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:51.690921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:51.691843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:51.692465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:51.692938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:51.843663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:51.855321 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0fe5a4e9-e0c5-4f03-a1fb-a1c9f6a541eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.178214 Sep 18 01:51:51.856177 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3210/6444] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:51 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:52.881367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:52.882004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:52.889348 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:52.889857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:52.890309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:52.890993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:52.891444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:52.892129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:53.024912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:53.033426 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5b6abbf6-b4a9-461e-8f91-b4ad3a33782d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.155908 Sep 18 01:51:53.034030 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3235/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:52 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:54.057940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:54.059518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:54.068852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:54.069663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:54.070649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:54.071508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:54.072083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:54.072598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:54.227436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:54.238634 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ef8302a-9310-44ca-969d-c43bab964e18 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.185789 Sep 18 01:51:54.239377 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3211/6446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:54 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:55.266328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:55.267318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:55.274966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:55.275452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:55.275887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:55.276590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:55.277041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:55.277465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:55.421133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:55.429541 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e224e950-05fb-456a-acff-222001cc88aa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.168202 Sep 18 01:51:55.430179 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3236/6447] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:55 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:51:55.603080 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-642db9f0-d330-42c1-92d6-56949de89d17 req-fe01add9-7074-404d-be36-2bb385400191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98910f5d-b1ad-4c56-98e1-4762c5a64047", "name": "network-vif-plugged", "status": "completed", "tag": "dfb44b0f-686f-47f6-8d87-199ec2187b2f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:51:55.616290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-642db9f0-d330-42c1-92d6-56949de89d17 req-fe01add9-7074-404d-be36-2bb385400191 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:55.616802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-642db9f0-d330-42c1-92d6-56949de89d17 req-fe01add9-7074-404d-be36-2bb385400191 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:55.617262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-642db9f0-d330-42c1-92d6-56949de89d17 req-fe01add9-7074-404d-be36-2bb385400191 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:55.631845 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-642db9f0-d330-42c1-92d6-56949de89d17 req-fe01add9-7074-404d-be36-2bb385400191 service nova] Creating event network-vif-plugged:dfb44b0f-686f-47f6-8d87-199ec2187b2f for instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 on n-h1-master-1 Sep 18 01:51:55.638200 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-642db9f0-d330-42c1-92d6-56949de89d17 req-fe01add9-7074-404d-be36-2bb385400191 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040518 Sep 18 01:51:55.638923 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3212/6448] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:51:56.455847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:56.456474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:56.465240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:56.466015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:56.466449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:56.467438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:56.467991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:56.468570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:56.619845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:56.629081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-58e470ce-ebfb-492b-9875-e0a11f4ee617 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1375 microversion: 2.1 time: 0.179445 Sep 18 01:51:56.630266 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3237/6449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:56 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:57.660618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:57.661865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:57.672426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:57.673199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:57.673909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:57.675168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:57.675705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:57.676424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:57.832873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:57.842113 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e029e565-f9f0-4769-a931-5a08d4321434 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1562 microversion: 2.1 time: 0.186965 Sep 18 01:51:57.842646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3213/6450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:57 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:57.866214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:57.873466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:57.889452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:57.889978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:57.890416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:57.891284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:57.892123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:57.892730 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:58.033618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:58.042123 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dadc1c65-acb6-4c5d-869c-a3a0286489b9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1562 microversion: 2.1 time: 0.180197 Sep 18 01:51:58.042715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3238/6451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:57 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:58.125673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:58.126207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:58.132282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:58.132782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:58.133232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:58.133962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:58.134431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:58.134870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:58.161769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:51:58.242984 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb17321f-8e6c-401e-bb21-8df5539e9994 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 204 len: 0 microversion: 2.1 time: 0.122618 Sep 18 01:51:58.243624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3214/6452] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:51:58 2022] DELETE /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:51:58.252278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:58.252898 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:58.258810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:58.259284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:58.259715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:58.260395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:58.260854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:58.261269 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:58.391843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:58.399643 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6623af6b-4363-42ce-aa1d-37a9a8caa7c7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1568 microversion: 2.1 time: 0.151469 Sep 18 01:51:58.400217 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3239/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:58 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:51:59.423824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:51:59.424528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:51:59.431585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:59.432052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:59.432497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:59.433224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:51:59.433714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:51:59.434159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:51:59.573115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:51:59.581637 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c043df58-ceff-44ab-9570-990fa450d6f9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1568 microversion: 2.1 time: 0.162153 Sep 18 01:51:59.582242 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3215/6454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:51:59 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:00.341423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bd77bfa9-0e95-4c0c-a8ce-32afa770218b req-1b41b666-16ea-405e-aea6-c6864d76c1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98910f5d-b1ad-4c56-98e1-4762c5a64047", "name": "network-vif-deleted", "tag": "dfb44b0f-686f-47f6-8d87-199ec2187b2f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:52:00.375161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bd77bfa9-0e95-4c0c-a8ce-32afa770218b req-1b41b666-16ea-405e-aea6-c6864d76c1bb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:00.375799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bd77bfa9-0e95-4c0c-a8ce-32afa770218b req-1b41b666-16ea-405e-aea6-c6864d76c1bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:00.376473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bd77bfa9-0e95-4c0c-a8ce-32afa770218b req-1b41b666-16ea-405e-aea6-c6864d76c1bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:00.391196 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bd77bfa9-0e95-4c0c-a8ce-32afa770218b req-1b41b666-16ea-405e-aea6-c6864d76c1bb service nova] Creating event network-vif-deleted:dfb44b0f-686f-47f6-8d87-199ec2187b2f for instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 on n-h1-master-1 Sep 18 01:52:00.397794 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bd77bfa9-0e95-4c0c-a8ce-32afa770218b req-1b41b666-16ea-405e-aea6-c6864d76c1bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064479 Sep 18 01:52:00.398752 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3240/6455] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:52:00.606543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:00.607191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:00.619318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:00.620012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:00.620012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:00.620745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:00.621972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:00.622777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:00.693775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:00.702646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-51c1a944-57d1-4121-87a7-752072611afb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1360 microversion: 2.1 time: 0.100570 Sep 18 01:52:00.703245 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3216/6456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:00 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1360 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:01.727786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:01.728620 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:01.737761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:01.738245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:01.738679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:01.739378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:01.739829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:01.740246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:01.805353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:01.826078 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7f007153-923d-4ff8-926f-d9d3ae918e9b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1360 microversion: 2.1 time: 0.102804 Sep 18 01:52:01.830958 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3241/6457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:01 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1360 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:02.848497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:02.849521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:02.857332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:02.857919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:02.858376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:02.859085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:02.859546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:02.859988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:02.928332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:02.937313 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb9c1584-565a-4821-8fba-8d8fe4cd3b5b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1360 microversion: 2.1 time: 0.092698 Sep 18 01:52:02.937923 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3217/6458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:02 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:03.963780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:03.964400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:03.972352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:03.972838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:03.973274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:03.973999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:03.974458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:03.974883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:04.045036 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:04.053128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d6c39640-c3e5-42d7-b87a-c1d1185d30a7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1360 microversion: 2.1 time: 0.093870 Sep 18 01:52:04.053845 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3242/6459] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:03 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:05.079209 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:05.079983 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:05.087954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:05.088656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:05.089141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:05.090474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:05.090961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:05.091398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:05.131231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:05.131843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:05.132708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:05.132905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lazy-loading 'fault' on Instance uuid 98910f5d-b1ad-4c56-98e1-4762c5a64047 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:52:05.180998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:05.188469 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c2a3d99-151b-4e73-a7b7-9bc6f165d2e4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 200 len: 1319 microversion: 2.1 time: 0.115677 Sep 18 01:52:05.189082 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3218/6460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:05 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:06.216124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:06.217046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:06.225882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:06.226516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:06.227025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:06.227869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:06.228404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:06.228966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:06.246456 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 HTTP/1.1 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '98910f5d-b1ad-4c56-98e1-4762c5a64047'} Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:06.248965 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:06.254104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:06.254104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:06.254104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:06.254104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:52:06.254104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:52:06.254104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:06.254104 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:06.255664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:52:06.261812 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-66ffe055-4fb6-473a-bdee-d6a83784adc5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 404 len: 111 microversion: 2.1 time: 0.046102 Sep 18 01:52:06.263935 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3243/6461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:06 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:52:10.574453 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:10.574998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:10.577951 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:10.583216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:10.583714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:10.584166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:10.584879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:10.585354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:10.585824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:10.589716 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:10.614173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:52:10.689212 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6c5d11ac-71dc-411c-bf7e-d37f8f2cdcc0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 204 len: 0 microversion: 2.1 time: 0.118356 Sep 18 01:52:10.690118 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3219/6462] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:52:10 2022] DELETE /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:52:10.698392 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:10.699570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:10.702498 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=30 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:10.707842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:10.708361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:10.708799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:10.709493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:10.709979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:10.710404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:10.713341 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=82 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:10.849247 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:10.857288 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e69fd0aa-d236-4b4b-ab93-7263a4d89144 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1410 microversion: 2.1 time: 0.162919 Sep 18 01:52:10.857914 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3244/6463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:10 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:11.881423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:11.882377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:11.890540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:11.891049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:11.891767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:11.892484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:11.892981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:11.893417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:12.041262 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:12.051726 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4f7d7edb-7dff-4911-902e-31ddc536b711 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1410 microversion: 2.1 time: 0.174422 Sep 18 01:52:12.052724 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3220/6464] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:11 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1410 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:12.933884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-43400262-6008-426d-8070-d6320e5f0f04 req-6c58553e-13db-4c32-8005-6d393aa98497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c1c008-dfa1-4d79-8e76-c3aef5a24b06", "name": "network-vif-deleted", "tag": "ad1ce179-a466-460e-bf11-e89d5327e3c0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:52:12.946436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-43400262-6008-426d-8070-d6320e5f0f04 req-6c58553e-13db-4c32-8005-6d393aa98497 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:12.946436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-43400262-6008-426d-8070-d6320e5f0f04 req-6c58553e-13db-4c32-8005-6d393aa98497 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:12.946436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-43400262-6008-426d-8070-d6320e5f0f04 req-6c58553e-13db-4c32-8005-6d393aa98497 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:12.961274 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-43400262-6008-426d-8070-d6320e5f0f04 req-6c58553e-13db-4c32-8005-6d393aa98497 service nova] Creating event network-vif-deleted:ad1ce179-a466-460e-bf11-e89d5327e3c0 for instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 on n-h2-master-1 Sep 18 01:52:12.967437 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-43400262-6008-426d-8070-d6320e5f0f04 req-6c58553e-13db-4c32-8005-6d393aa98497 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037276 Sep 18 01:52:12.968293 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3245/6465] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:52:13.078294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:13.079599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:13.087531 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:13.088381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:13.089714 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:13.090810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:13.091650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:13.092297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:13.167959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:13.177522 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d604083-4591-43ff-93f2-80e1c2e2ccdb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1201 microversion: 2.1 time: 0.105047 Sep 18 01:52:13.182379 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3221/6466] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:13 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:14.202198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:14.202852 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:14.209354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:14.209887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:14.210329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:14.211081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:14.211542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:14.212050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:14.277630 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:14.285593 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e93a1cf7-f7f0-42a9-b613-e5e7a299f18b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1201 microversion: 2.1 time: 0.089001 Sep 18 01:52:14.286173 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3246/6467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:14 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:15.308977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:15.309624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:15.316680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:15.317177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:15.317662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:15.318375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:15.318844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:15.319280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:15.383418 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:15.392566 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc958aff-3460-419e-b4a0-7b1da9c48f9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1201 microversion: 2.1 time: 0.087446 Sep 18 01:52:15.393165 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3222/6468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:15 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:16.416415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:16.417022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:16.423789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:16.424267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:16.424703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:16.425386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:16.425871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:16.426283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:16.487289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:16.495024 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db44a240-82bc-4775-bc04-ce0b2223e9da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1201 microversion: 2.1 time: 0.082628 Sep 18 01:52:16.496085 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3247/6469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:16 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1201 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:17.518475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:17.519993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:17.527349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:17.527871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:17.528319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:17.529033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:17.529523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:17.530134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:17.565113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:17.565640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:17.566089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:17.566573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lazy-loading 'fault' on Instance uuid a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:52:17.614081 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:17.623024 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-41598b45-ea21-4514-958d-9a8c3d9a1deb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 200 len: 1206 microversion: 2.1 time: 0.108737 Sep 18 01:52:17.623601 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3223/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:17 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 1206 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:18.646253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:18.647015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:18.654051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:18.654542 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:18.654981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:18.655678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:18.656138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:18.656567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:18.671128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 HTTP/1.1 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a3c1c008-dfa1-4d79-8e76-c3aef5a24b06'} Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:18.672787 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:52:18.676826 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac75958d-6b40-4423-9e7a-2db14c2624b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 404 len: 111 microversion: 2.1 time: 0.031952 Sep 18 01:52:18.678003 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3248/6471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:18 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:52:20.820595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:20.821096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:20.828626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:20.829119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:20.829574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:20.830282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:20.830744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:20.831177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:20.845260 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 HTTP/1.1 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '98910f5d-b1ad-4c56-98e1-4762c5a64047'} Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:52:20.846954 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:52:20.850958 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30a7fadf-5c1e-4fd0-a3e0-2bede2951989 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 404 len: 111 microversion: 2.1 time: 0.031642 Sep 18 01:52:20.852185 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3224/6472] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:52:20 2022] DELETE /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:52:20.857253 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:20.857983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 98910f5d-b1ad-4c56-98e1-4762c5a64047] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:20.864951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:20.865517 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:20.866085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:20.866846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:20.867380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:20.867881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:20.882550 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 HTTP/1.1 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '98910f5d-b1ad-4c56-98e1-4762c5a64047'} Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:20.884129 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance 98910f5d-b1ad-4c56-98e1-4762c5a64047 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c98b7ea9-185d-4c29-8e06-86786f7ea8a1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047" status: 404 len: 111 microversion: 2.1 time: 0.032319 Sep 18 01:52:20.888162 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3249/6473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:20 2022] GET /compute/v2.1/servers/98910f5d-b1ad-4c56-98e1-4762c5a64047 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:52:21.248825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:21.249331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:21.255325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:21.255819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:21.256262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:21.256954 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:21.257418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:21.257877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:21.272484 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 HTTP/1.1 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: exception: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'a3c1c008-dfa1-4d79-8e76-c3aef5a24b06'} Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:52:21.274056 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2e0e65cd-2777-4b8f-b581-37c81f08e130 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 404 len: 111 microversion: 2.1 time: 0.031086 Sep 18 01:52:21.278106 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3225/6474] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:52:21 2022] DELETE /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:52:21.284341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:21.284959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: a3c1c008-dfa1-4d79-8e76-c3aef5a24b06] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:21.290974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:21.291450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:21.291886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:21.292571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:21.293024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:21.293449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:21.306779 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 HTTP/1.1 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: exception: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'a3c1c008-dfa1-4d79-8e76-c3aef5a24b06'} Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:52:21.308723 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be5b4713-561e-4065-bf03-1cf13bf3ec3a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06" status: 404 len: 111 microversion: 2.1 time: 0.029746 Sep 18 01:52:21.312709 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3250/6475] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:21 2022] GET /compute/v2.1/servers/a3c1c008-dfa1-4d79-8e76-c3aef5a24b06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:52:21.382198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0999e50d-229c-4063-9c10-36eb05ca90ea tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: .version_select at 0x7f70050ef820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-7166308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1fSeKgL9nM2R/AVDBbMdoNNJcSVifDeuskUJmo6JP1bp0av0kpJhRQISKpski51Zu5yklSgL/lBd/s2KlU5yVnJWLHk+I/PsRs5MY71aUhc8UTRLlUqiene7TCqJ8w6w=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:52:21.399131 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0999e50d-229c-4063-9c10-36eb05ca90ea tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:52:21.404199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0999e50d-229c-4063-9c10-36eb05ca90ea tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:52:21.431906 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0999e50d-229c-4063-9c10-36eb05ca90ea tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053559 Sep 18 01:52:21.433006 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3226/6476] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 01:52:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:52:37.660202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-675869383", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7166308", "security_groups": [{"name": "tempest-secgroup-smoke-1379763383"}], "block_device_mapping_v2": [{"uuid": "72630f39-33be-447a-9f0d-8d53a0e617bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:52:37.671625 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=13 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:37.672423 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=25 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:37.783081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:52:38.184782 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:52:38.185207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:52:38.185788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:52:38.186201 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:52:38.186640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:52:38.197833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:38.198313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:38.198744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:38.199461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:38.200424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:38.200844 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:38.218022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:52:38.223890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:52:38.288324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:52:38.290465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72630f39-33be-447a-9f0d-8d53a0e617bc',volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:52:38.421454 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ec385072-0cf3-4a88-b974-d1040baa4df9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765228 Sep 18 01:52:38.422155 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3251/6477] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:52:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:52:38.431579 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:38.432351 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:38.432997 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:38.437488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-06cfcd60-0a76-41ec-a4a1-ffabd31240d6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:38.438169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-06cfcd60-0a76-41ec-a4a1-ffabd31240d6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:38.500353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-06cfcd60-0a76-41ec-a4a1-ffabd31240d6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:38.508352 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-06cfcd60-0a76-41ec-a4a1-ffabd31240d6 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1091 microversion: 2.1 time: 0.078844 Sep 18 01:52:38.509690 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3227/6478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:38 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1091 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:39.534549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:39.535233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:39.542676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:39.543178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:39.543645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:39.544512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:39.544982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:39.545417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:39.610481 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:39.620569 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c959802b-7c73-41d7-a051-7eac8d026afe tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1207 microversion: 2.1 time: 0.091375 Sep 18 01:52:39.621998 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3252/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:39 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1207 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:40.645026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:40.645902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:40.653163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:40.653835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:40.654391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:40.655362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:40.656054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:40.656617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:40.802682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:40.811209 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2173443a-fa01-47ea-8c95-c0dc79583018 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1275 microversion: 2.1 time: 0.170547 Sep 18 01:52:40.811794 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3228/6480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:40 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:40.933377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4a1acc58-5950-4456-87b0-c181828c4b17 req-b3d2d858-f168-4ef2-91cf-759d0d13b506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6ac00b-eee5-4daa-a376-f55963fdee5d", "tag": "fd2a6bd8-2d95-4132-836b-dc01fc158366"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:52:40.944859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4a1acc58-5950-4456-87b0-c181828c4b17 req-b3d2d858-f168-4ef2-91cf-759d0d13b506 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:40.945599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4a1acc58-5950-4456-87b0-c181828c4b17 req-b3d2d858-f168-4ef2-91cf-759d0d13b506 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:40.946205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4a1acc58-5950-4456-87b0-c181828c4b17 req-b3d2d858-f168-4ef2-91cf-759d0d13b506 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:40.959503 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4a1acc58-5950-4456-87b0-c181828c4b17 req-b3d2d858-f168-4ef2-91cf-759d0d13b506 service nova] Creating event network-changed:fd2a6bd8-2d95-4132-836b-dc01fc158366 for instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d on n-h1-master-1 Sep 18 01:52:40.964477 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4a1acc58-5950-4456-87b0-c181828c4b17 req-b3d2d858-f168-4ef2-91cf-759d0d13b506 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034994 Sep 18 01:52:40.965085 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3253/6481] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:52:41.836615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:41.838828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:41.849450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:41.850282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:41.850749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:41.851699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:41.852375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:41.852990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:42.014723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:42.023584 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4c6fe4e-43d1-4616-b798-4cac12813db1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1275 microversion: 2.1 time: 0.192710 Sep 18 01:52:42.024416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3229/6482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:41 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:43.049044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:43.049663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:43.056117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:43.056606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:43.057044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:43.057773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:43.058231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:43.058654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:43.190202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:43.198144 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52ca119e-d20d-4336-a26e-52f2e5908344 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1275 microversion: 2.1 time: 0.154207 Sep 18 01:52:43.198645 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3254/6483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:43 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:44.222770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:44.223504 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:44.230526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:44.231026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:44.231478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:44.232190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:44.233887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:44.234359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:44.377371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:44.386321 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-29b6fcdd-6f02-49e9-b4f1-408763e09460 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1275 microversion: 2.1 time: 0.168322 Sep 18 01:52:44.386913 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3230/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:44 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:45.411305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:45.411926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:45.419082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:45.419566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:45.420033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:45.420722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:45.421179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:45.421631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:45.554847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:45.563573 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae89356f-d1fb-4384-9ec7-db9280d5a755 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.156321 Sep 18 01:52:45.564198 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3255/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:45 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:46.588293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:46.588920 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:46.596097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:46.596588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:46.597035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:46.597779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:46.598250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:46.598691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:46.730375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:46.738083 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6dac7b24-e43d-491c-b230-f8e25108f11f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.153881 Sep 18 01:52:46.738656 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3231/6486] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:46 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:47.761268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:47.761908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:47.769449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:47.769960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:47.770409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:47.771095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:47.771540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:47.771957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:47.902533 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:47.910798 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d9e4a4b4-94b7-4746-8f32-a56bc73fe803 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.153573 Sep 18 01:52:47.911371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3256/6487] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:47 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:48.933940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:48.934591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:48.937317 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:48.943071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:48.943595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:48.944039 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:48.944736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:48.945206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:48.945709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:49.076998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:49.084683 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ad3ac46a-5d5d-4be0-9a83-f7b9a0378a63 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.154593 Sep 18 01:52:49.085265 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3232/6488] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:48 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:50.108158 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:50.108772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:50.110823 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:50.111479 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:52:50.118680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:50.119163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:50.119596 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:50.120289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:50.120738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:50.121160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:50.250763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:50.258513 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa7b2f49-af37-44d4-87b2-cda76ec8eed0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.154802 Sep 18 01:52:50.259082 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3257/6489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:50 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:51.281507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:51.282165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:51.288965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:51.289457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:51.289940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:51.290640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:51.291103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:51.291535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:51.421475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:51.429199 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d371262-c086-4c8c-b625-af0ee2e85687 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.151571 Sep 18 01:52:51.429851 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3233/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:51 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:52.452408 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:52.453055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:52.460545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:52.461160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:52.461621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:52.462314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:52.462786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:52.463196 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:52.602378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:52.610663 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-65ee3ed7-ac5f-4af9-8032-e4d6adc1acad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.162225 Sep 18 01:52:52.611253 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3258/6491] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:52 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:53.633983 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:53.634583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:53.642991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:53.643489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:53.643934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:53.644626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:53.645088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:53.645519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:53.782565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:53.790412 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3c7a216-8a68-407f-927d-0baa657aa1eb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.160385 Sep 18 01:52:53.790935 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3234/6492] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:53 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:53.929536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c5d593b9-3791-4c98-9de9-89c1665593ba req-37fc9c41-1cb1-4744-8ebb-dbde7b5635a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6ac00b-eee5-4daa-a376-f55963fdee5d", "name": "network-vif-plugged", "status": "completed", "tag": "fd2a6bd8-2d95-4132-836b-dc01fc158366"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:52:53.942062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5d593b9-3791-4c98-9de9-89c1665593ba req-37fc9c41-1cb1-4744-8ebb-dbde7b5635a6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:53.942537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5d593b9-3791-4c98-9de9-89c1665593ba req-37fc9c41-1cb1-4744-8ebb-dbde7b5635a6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:53.942967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5d593b9-3791-4c98-9de9-89c1665593ba req-37fc9c41-1cb1-4744-8ebb-dbde7b5635a6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:53.954252 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c5d593b9-3791-4c98-9de9-89c1665593ba req-37fc9c41-1cb1-4744-8ebb-dbde7b5635a6 service nova] Creating event network-vif-plugged:fd2a6bd8-2d95-4132-836b-dc01fc158366 for instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d on n-h1-master-1 Sep 18 01:52:53.959258 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c5d593b9-3791-4c98-9de9-89c1665593ba req-37fc9c41-1cb1-4744-8ebb-dbde7b5635a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108613 Sep 18 01:52:53.959840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3259/6493] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:52:54.814765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:54.815304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:54.822553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:54.823060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:54.823515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:54.824816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:54.825307 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:54.825780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:54.960173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:54.967819 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2531042f-32d0-477f-a5b7-5fdfe7711706 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1263 microversion: 2.1 time: 0.157094 Sep 18 01:52:54.968398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3235/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:54 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:55.991959 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:55.992661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:55.998876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:55.999308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:55.999746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:56.000429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:56.000885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:56.001312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:56.137273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:56.145328 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af7a66d9-f9ad-4877-84e5-a3d8adb29253 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1451 microversion: 2.1 time: 0.158463 Sep 18 01:52:56.145938 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3260/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:55 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:52:56.168100 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:52:56.168773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:52:56.175549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:56.176040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:56.176483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:56.177174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:56.177688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:56.178121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:56.306625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:52:56.314366 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-939e25be-866a-4abf-a383-2a20d1492810 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1451 microversion: 2.1 time: 0.150161 Sep 18 01:52:56.314941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3236/6496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:52:56 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:52:58.271553 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-49b12f7e-1e2c-4b56-94cf-b8c5a88799b3 req-900875ea-ea52-45a6-a801-17db6985a48a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6ac00b-eee5-4daa-a376-f55963fdee5d", "tag": "fd2a6bd8-2d95-4132-836b-dc01fc158366"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:52:58.282185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-49b12f7e-1e2c-4b56-94cf-b8c5a88799b3 req-900875ea-ea52-45a6-a801-17db6985a48a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:52:58.282779 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-49b12f7e-1e2c-4b56-94cf-b8c5a88799b3 req-900875ea-ea52-45a6-a801-17db6985a48a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:52:58.285648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-49b12f7e-1e2c-4b56-94cf-b8c5a88799b3 req-900875ea-ea52-45a6-a801-17db6985a48a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:52:58.300068 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-49b12f7e-1e2c-4b56-94cf-b8c5a88799b3 req-900875ea-ea52-45a6-a801-17db6985a48a service nova] Creating event network-changed:fd2a6bd8-2d95-4132-836b-dc01fc158366 for instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d on n-h1-master-1 Sep 18 01:52:58.305447 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-49b12f7e-1e2c-4b56-94cf-b8c5a88799b3 req-900875ea-ea52-45a6-a801-17db6985a48a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103454 Sep 18 01:52:58.306173 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3261/6497] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:54:53.586880 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 01:54:53.587729 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=22 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:54:53.588473 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=54 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:54:53.589839 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:54:53.589974 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 01:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d (ip 10.222.0.25) !!! Sep 18 01:54:53.650693 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:54:53.651236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:54:53.657165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:53.657698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:53.658144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:53.658846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:53.659313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:53.659743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:53.686489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:54:53.766418 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ae92416-f389-41f1-8187-53f65d87224a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 204 len: 0 microversion: 2.1 time: 0.181305 Sep 18 01:54:53.767122 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3237/6498] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:54:53 2022] DELETE /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:54:53.776006 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 18 01:54:53.778101 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 18 01:54:53.778707 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:54:53.779442 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=50 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:54:53.780797 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 01:54:53.780966 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d (ip 10.222.0.25) !!! Sep 18 01:54:53.783040 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:54:53.783151 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d (ip 10.222.0.25) !!! Sep 18 01:54:53.800760 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:54:53.801466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:54:53.809160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:53.809666 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:53.810106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:53.810798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:53.811252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:53.811675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:53.952512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:54:53.960823 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4488a36-27ed-425b-8398-5e9940289c43 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1576 microversion: 2.1 time: 0.188144 Sep 18 01:54:53.961399 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3262/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:54:53 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:54:54.985798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:54:54.986510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:54:54.996476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:54.996975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:54.997425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:54.998148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:54.998617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:54.999050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:55.005600 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36464. Sep 18 01:54:55.133816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:54:55.142083 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-72fccd96-e33d-4400-bcf8-27f4d702fa67 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1576 microversion: 2.1 time: 0.160679 Sep 18 01:54:55.142703 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3238/6500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:54:54 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:54:56.165369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:54:56.166053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:54:56.178485 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36468. Sep 18 01:54:56.184299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:56.184788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:56.185221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:56.185941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:56.186392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:56.186808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:56.192450 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36470. Sep 18 01:54:56.254942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:54:56.263955 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e778d530-c672-4ac2-bbc3-43a8c5029165 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1508 microversion: 2.1 time: 0.102443 Sep 18 01:54:56.264551 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3263/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:54:56 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1508 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:54:56.457256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-52b5dff9-6be1-4e26-a8d0-dfd0d3808b7b req-0b075b82-4e6e-4076-9900-7931d2fbdfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6ac00b-eee5-4daa-a376-f55963fdee5d", "name": "network-vif-deleted", "tag": "fd2a6bd8-2d95-4132-836b-dc01fc158366"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:54:56.471928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-52b5dff9-6be1-4e26-a8d0-dfd0d3808b7b req-0b075b82-4e6e-4076-9900-7931d2fbdfee service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:56.472438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-52b5dff9-6be1-4e26-a8d0-dfd0d3808b7b req-0b075b82-4e6e-4076-9900-7931d2fbdfee service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:56.472873 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-52b5dff9-6be1-4e26-a8d0-dfd0d3808b7b req-0b075b82-4e6e-4076-9900-7931d2fbdfee service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:56.485721 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-52b5dff9-6be1-4e26-a8d0-dfd0d3808b7b req-0b075b82-4e6e-4076-9900-7931d2fbdfee service nova] Creating event network-vif-deleted:fd2a6bd8-2d95-4132-836b-dc01fc158366 for instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d on n-h1-master-1 Sep 18 01:54:56.491157 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-52b5dff9-6be1-4e26-a8d0-dfd0d3808b7b req-0b075b82-4e6e-4076-9900-7931d2fbdfee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131582 Sep 18 01:54:56.491769 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3239/6502] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:54:57.288066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:54:57.288858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:54:57.296441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:57.297382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:57.297903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:57.299075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:57.299681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:57.300186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:57.368594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:54:57.377611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9f81e525-72e3-4a8d-8311-5899a5a123fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1222 microversion: 2.1 time: 0.093931 Sep 18 01:54:57.378137 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3264/6503] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:54:57 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:54:58.401822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:54:58.402543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:54:58.408766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:58.409280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:58.409771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:58.410488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:58.410964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:58.411407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:58.475427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:54:58.483623 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0f66628-18a8-4637-a756-c2d811ee358c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1222 microversion: 2.1 time: 0.086970 Sep 18 01:54:58.484973 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3240/6504] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:54:58 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:54:59.507288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:54:59.507908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:54:59.514836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:59.515586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:59.516032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:59.516733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:54:59.517186 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:54:59.517648 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:54:59.846284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:54:59.854376 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b220036-a316-48b1-85e2-62fa14e767cb tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1222 microversion: 2.1 time: 0.351475 Sep 18 01:54:59.854955 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3265/6505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:54:59 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1222 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:00.877737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:00.878363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:00.885388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:00.885916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:00.886375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:00.887124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:00.887626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:00.888065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:00.923603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:00.924104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:00.924558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:00.925019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lazy-loading 'fault' on Instance uuid 0e6ac00b-eee5-4daa-a376-f55963fdee5d {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:55:00.973682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:00.981629 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c99c93c-d700-4531-a7f0-55064734e300 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 200 len: 1227 microversion: 2.1 time: 0.107827 Sep 18 01:55:00.982209 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3241/6506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:00 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 1227 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:02.004856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:02.005482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:02.012390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:02.012873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:02.013310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:02.014026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:02.014479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:02.014902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:02.028885 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d HTTP/1.1 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0e6ac00b-eee5-4daa-a376-f55963fdee5d'} Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:55:02.030559 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e029236b-5629-4d59-8add-49e1c8aeaae4 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 404 len: 111 microversion: 2.1 time: 0.031462 Sep 18 01:55:02.034557 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3266/6507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:01 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:55:02.080958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1203260592", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7166308", "security_groups": [{"name": "tempest-secgroup-smoke-1379763383"}], "block_device_mapping_v2": [{"uuid": "72630f39-33be-447a-9f0d-8d53a0e617bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:55:02.195139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:55:02.621194 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:55:02.621602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:55:02.622096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:55:02.622517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:55:02.622975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:55:02.631846 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:02.632341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:02.632791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:02.633529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:02.634098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:02.634563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:02.651285 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:55:02.656487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:55:02.715884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:55:02.718049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72630f39-33be-447a-9f0d-8d53a0e617bc',volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:55:02.847077 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [730c7e74-21c9-4893-a0e7-8445aa48eb7d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 01:55:03.854509 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [730c7e74-21c9-4893-a0e7-8445aa48eb7d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36504. Sep 18 01:55:03.858392 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ffc7d2a-ae28-4928-a9e6-7ded78ab410f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.781560 Sep 18 01:55:03.859247 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3242/6508] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:55:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:55:03.870706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11d4b74c-a12a-4edd-a95a-dc717d8baaaf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:03.871598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11d4b74c-a12a-4edd-a95a-dc717d8baaaf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:03.931817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11d4b74c-a12a-4edd-a95a-dc717d8baaaf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:03.938717 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11d4b74c-a12a-4edd-a95a-dc717d8baaaf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1092 microversion: 2.1 time: 0.071920 Sep 18 01:55:03.939273 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3267/6509] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:03 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:04.962692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:04.963338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:04.970020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:04.970530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:04.970973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:04.971682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:04.972147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:04.972574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:05.043472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:05.057353 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1b1d9c5-a6ca-43fc-af10-bd8e9f583e41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1190 microversion: 2.1 time: 0.100188 Sep 18 01:55:05.061587 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3243/6510] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:04 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:06.087699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:06.088688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:06.096515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:06.097020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:06.097462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:06.098496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:06.099670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:06.100110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:06.255912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:06.264467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-737afebc-b692-44f3-8118-d4417078132e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1276 microversion: 2.1 time: 0.181556 Sep 18 01:55:06.265312 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3268/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:06 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:06.642222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-87d231ed-a402-4a07-a3b3-6c28df0ea222 req-ce1fb3f6-a078-46ce-99c3-9e94e36a47a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f698b502-45a6-44ab-a5fc-035c94a27b22", "tag": "93633cb5-4e34-4186-938e-dc8d54c5f08c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:55:06.660155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-87d231ed-a402-4a07-a3b3-6c28df0ea222 req-ce1fb3f6-a078-46ce-99c3-9e94e36a47a1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:06.662081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-87d231ed-a402-4a07-a3b3-6c28df0ea222 req-ce1fb3f6-a078-46ce-99c3-9e94e36a47a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:06.662915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-87d231ed-a402-4a07-a3b3-6c28df0ea222 req-ce1fb3f6-a078-46ce-99c3-9e94e36a47a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:06.686659 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-87d231ed-a402-4a07-a3b3-6c28df0ea222 req-ce1fb3f6-a078-46ce-99c3-9e94e36a47a1 service nova] Creating event network-changed:93633cb5-4e34-4186-938e-dc8d54c5f08c for instance f698b502-45a6-44ab-a5fc-035c94a27b22 on n-h2-master-1 Sep 18 01:55:06.692070 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-87d231ed-a402-4a07-a3b3-6c28df0ea222 req-ce1fb3f6-a078-46ce-99c3-9e94e36a47a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059774 Sep 18 01:55:06.692670 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3244/6512] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:55:07.288410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:07.289608 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:07.296934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:07.297627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:07.298251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:07.298945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:07.299548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:07.300120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:07.463847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:07.473770 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b2fbdc9-895c-4ebe-a03d-48c051a0864a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1276 microversion: 2.1 time: 0.189141 Sep 18 01:55:07.474379 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3269/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:07 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:08.498350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:08.499074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:08.505788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:08.506284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:08.506727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:08.507424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:08.507890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:08.508321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:08.639564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:08.647601 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-127b068f-49e6-473c-abd1-3f1b042ce159 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1276 microversion: 2.1 time: 0.154456 Sep 18 01:55:08.648169 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3245/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:08 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:09.672289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:09.673055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:09.680357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:09.680842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:09.681281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:09.682010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:09.682466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:09.682891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:09.826126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:09.834602 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c14db50-6b8b-42bf-b5a9-d7091722f85d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1276 microversion: 2.1 time: 0.166951 Sep 18 01:55:09.835194 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3270/6515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:09 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:10.858553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:10.859182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:10.867240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:10.867745 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:10.868200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:10.868909 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:10.870082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:10.870984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:11.009287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:11.017896 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0bcbcad6-c0d9-4c04-adf5-82e2f6b8c8a0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.163166 Sep 18 01:55:11.018691 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3246/6516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:10 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:12.042092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:12.042713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:12.049962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:12.050447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:12.050888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:12.051576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:12.052031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:12.052454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:12.198184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:12.208757 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf70c4ea-0ef4-41e8-9972-9755075436df tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.169914 Sep 18 01:55:12.209347 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3271/6517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:12 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:13.232615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:13.233350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:13.236298 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:55:13.236977 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:55:13.243809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:13.244318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:13.244769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:13.245493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:13.245994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:13.246434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:13.402319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:13.411986 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05a74b34-42c6-49c0-ab29-a92ad49616b3 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.182944 Sep 18 01:55:13.413063 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3247/6518] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:13 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:14.436095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:14.436712 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:14.440475 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:55:14.447912 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:14.448406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:14.448852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:14.449585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:14.450038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:14.450465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:14.597238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:14.605202 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26f4c025-f57e-42df-8848-de048d381aa9 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.173136 Sep 18 01:55:14.605830 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3272/6519] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:14 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:55:15.630189 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:15.630782 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:15.637565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:15.638308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:15.639049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:15.640462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:15.641247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:15.642017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:15.802773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:15.811767 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-73f54ba1-347b-463f-b5b5-6c58f2e79511 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.185276 Sep 18 01:55:15.812757 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3248/6520] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:15 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:16.838272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:16.838893 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:16.845982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:16.846472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:16.847006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:16.848009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:16.849199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:16.849786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:16.985911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:16.994686 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36013726-560b-432d-8253-fe6d39d51a41 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.159943 Sep 18 01:55:16.995271 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3273/6521] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:16 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:18.017098 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:18.017758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:18.024705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:18.025207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:18.025705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:18.026421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:18.026896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:18.027338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:18.172001 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:18.180129 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60d1da91-a89a-4b6b-bcd1-ee38e73cb20d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.167203 Sep 18 01:55:18.180742 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3249/6522] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:18 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:19.203487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:19.204131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:19.211734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:19.212215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:19.212651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:19.213354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:19.213839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:19.214266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:19.350748 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:19.358994 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b9fedb2-e6de-4df2-88e9-bdc751127ef7 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.159406 Sep 18 01:55:19.359574 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3274/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:19 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:20.382894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:20.383545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:20.390636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:20.391125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:20.391567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:20.392264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:20.392731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:20.393165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:20.532892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:20.541347 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-66dbc66f-0198-4d17-85ee-507105204608 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.162547 Sep 18 01:55:20.541959 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3250/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:20 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:55:20.721890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f698b502-45a6-44ab-a5fc-035c94a27b22", "name": "network-vif-plugged", "status": "completed", "tag": "93633cb5-4e34-4186-938e-dc8d54c5f08c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:55:20.732747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:20.733238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:20.733711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:20.746786 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] Creating event network-vif-plugged:93633cb5-4e34-4186-938e-dc8d54c5f08c for instance f698b502-45a6-44ab-a5fc-035c94a27b22 on n-h2-master-1 Sep 18 01:55:20.750299 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] [26138284-084d-46ea-b427-82b5249009d4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 01:55:21.565326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:21.566002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:21.573518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:21.574046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:21.574495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:21.575203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:21.575671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:21.576110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:21.704448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:21.712234 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3c92f256-448e-46f7-9efb-785c017f9e8a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.150818 Sep 18 01:55:21.712799 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3251/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:21 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:55:21.757369 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] [26138284-084d-46ea-b427-82b5249009d4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36562. Sep 18 01:55:21.761352 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f1a34b91-8f9b-4d67-aef6-85dea8d1e90d req-70886ca1-2d9b-48d6-b6bc-32b5a0dba9b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043634 Sep 18 01:55:21.762010 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3275/6526] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:55:22.735582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:22.736239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:22.744427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:22.745006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:22.745541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:22.746393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:22.746945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:22.747456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:22.889486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:22.901102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4050b925-5a90-4565-972b-b8fa4bbb9be8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1264 microversion: 2.1 time: 0.169075 Sep 18 01:55:22.902302 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3252/6527] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:22 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:23.940078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:23.940780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:23.942747 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=31 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:55:23.948297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:23.948786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:23.949225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:23.949949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:23.950407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:23.950832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:23.953575 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=71 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:55:24.089858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:24.097792 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a01e884b-d244-4b2a-93d4-b6605aea2082 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1451 microversion: 2.1 time: 0.162941 Sep 18 01:55:24.099174 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3276/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:23 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:24.120585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:55:24.121216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:55:24.124108 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:55:24.129354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:24.129886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:24.130337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:24.131232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:24.131709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:24.134880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:24.139517 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:55:24.277811 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:55:24.285613 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-adf9b18a-17cc-4748-a4b4-50a53257191b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1451 microversion: 2.1 time: 0.168902 Sep 18 01:55:24.286204 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3253/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:55:24 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:55:25.954863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-794e9fe7-47eb-4bb5-a1f4-b02d43929f9c req-3105d457-e65d-4b47-a0bd-8f664386f160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f698b502-45a6-44ab-a5fc-035c94a27b22", "tag": "93633cb5-4e34-4186-938e-dc8d54c5f08c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:55:25.966603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-794e9fe7-47eb-4bb5-a1f4-b02d43929f9c req-3105d457-e65d-4b47-a0bd-8f664386f160 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:55:25.967145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-794e9fe7-47eb-4bb5-a1f4-b02d43929f9c req-3105d457-e65d-4b47-a0bd-8f664386f160 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:55:25.967585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-794e9fe7-47eb-4bb5-a1f4-b02d43929f9c req-3105d457-e65d-4b47-a0bd-8f664386f160 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:55:25.980203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-794e9fe7-47eb-4bb5-a1f4-b02d43929f9c req-3105d457-e65d-4b47-a0bd-8f664386f160 service nova] Creating event network-changed:93633cb5-4e34-4186-938e-dc8d54c5f08c for instance f698b502-45a6-44ab-a5fc-035c94a27b22 on n-h2-master-1 Sep 18 01:55:25.983958 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-794e9fe7-47eb-4bb5-a1f4-b02d43929f9c req-3105d457-e65d-4b47-a0bd-8f664386f160 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033508 Sep 18 01:55:25.984877 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3277/6530] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:57:08.780361 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 01:57:08.780911 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:57:08.781825 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=5 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:57:08.787414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-873043667", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7166308", "security_groups": [{"name": "tempest-secgroup-smoke-1379763383"}], "block_device_mapping_v2": [{"uuid": "3f8586d0-9423-4623-869d-61638cdd9a6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a45778f0-3e75-4bd7-9418-cb78590429f1"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:57:09.032593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] validate_networks() for [('a45778f0-3e75-4bd7-9418-cb78590429f1', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:57:09.407241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:57:09.407690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:57:09.408179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:57:09.408600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:57:09.409031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:57:09.418478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:09.418974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:09.419428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:09.420171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:09.420641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:09.421078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:09.438295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:57:09.443625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Getting quotas for user d0ca8b49fa66486fa2426498dd730b49 and project 94357c55e41b460db9ff8415b4eaaaff. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:57:09.502023 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:57:09.504173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f8586d0-9423-4623-869d-61638cdd9a6d',volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:57:09.629889 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68f53b66-3488-43f4-80d9-f43f95a79598 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.851645 Sep 18 01:57:09.630546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3254/6531] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:57:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:57:09.641821 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 18 01:57:09.643639 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 18 01:57:09.644299 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:57:09.645717 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=7 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:57:09.652738 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-933339d6-32b4-43d4-bd36-73c44a2d725f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:09.653418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-933339d6-32b4-43d4-bd36-73c44a2d725f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:09.762772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-933339d6-32b4-43d4-bd36-73c44a2d725f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:09.771266 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-933339d6-32b4-43d4-bd36-73c44a2d725f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1091 microversion: 2.1 time: 0.133342 Sep 18 01:57:09.771836 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3278/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:09 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1091 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:10.796176 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:10.797071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:10.806046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:10.806046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:10.806452 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:10.807007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:10.807521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:10.807967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:10.815245 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36678. Sep 18 01:57:10.875750 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:10.886046 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1092261b-e9b9-43c4-b193-ad57820d217a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1197 microversion: 2.1 time: 0.095322 Sep 18 01:57:10.886640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3255/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:10 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:11.912631 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:11.913246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:11.931678 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:11.932173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:11.932609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:11.933313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:11.933882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:11.934313 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:11.934947 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36686. Sep 18 01:57:11.938695 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36684. Sep 18 01:57:12.089074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:12.099047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-267eff3b-16be-43f9-9e83-a9deb24ee9fa tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1275 microversion: 2.1 time: 0.192640 Sep 18 01:57:12.113622 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3279/6534] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:11 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:12.302316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-10717744-b917-4d44-a2da-3ade5bec36c2 req-f51c60dd-582f-460a-a9bc-c151cc841697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb", "tag": "42146022-08bd-41d2-9a42-565b296f5285"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:57:12.316451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-10717744-b917-4d44-a2da-3ade5bec36c2 req-f51c60dd-582f-460a-a9bc-c151cc841697 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:12.318158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-10717744-b917-4d44-a2da-3ade5bec36c2 req-f51c60dd-582f-460a-a9bc-c151cc841697 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:12.318862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-10717744-b917-4d44-a2da-3ade5bec36c2 req-f51c60dd-582f-460a-a9bc-c151cc841697 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:12.336016 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-10717744-b917-4d44-a2da-3ade5bec36c2 req-f51c60dd-582f-460a-a9bc-c151cc841697 service nova] Creating event network-changed:42146022-08bd-41d2-9a42-565b296f5285 for instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb on n-h1-master-1 Sep 18 01:57:12.342550 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-10717744-b917-4d44-a2da-3ade5bec36c2 req-f51c60dd-582f-460a-a9bc-c151cc841697 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044936 Sep 18 01:57:12.343954 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3256/6535] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:57:13.124656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:13.126017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:13.133285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:13.134077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:13.134733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:13.135665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:13.136544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:13.137161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:13.284039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:13.293453 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26e2f6c4-0830-4045-a16f-e6334fc665ed tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1275 microversion: 2.1 time: 0.173966 Sep 18 01:57:13.294100 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3280/6536] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:13 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:14.317785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:14.318467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:14.325521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:14.326067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:14.326517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:14.327224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:14.327695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:14.328135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:14.462359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:14.470354 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7a91ee76-3f13-427f-8ddc-903de89c77fc tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1275 microversion: 2.1 time: 0.157656 Sep 18 01:57:14.471140 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3257/6537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:14 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:15.494411 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:15.495022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:15.501993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:15.502472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:15.502905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:15.503598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:15.504050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:15.505072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:15.644578 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:15.652818 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f0ea10c7-fbd3-40ec-89e4-efd2ca1de385 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1275 microversion: 2.1 time: 0.162177 Sep 18 01:57:15.653308 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3281/6538] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:15 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:16.675541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:16.676161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:16.682955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:16.683448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:16.683894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:16.684598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:16.685067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:16.685501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:16.815121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:16.823281 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c654eab-fee4-4fb7-9014-ebb8c5b4ee33 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.151859 Sep 18 01:57:16.823855 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3258/6539] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:16 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:17.846537 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:17.847153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:17.854116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:17.854599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:17.855066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:17.855760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:17.856215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:17.856667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:17.990462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:17.998176 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f67df491-0678-4783-8f17-5e0f1694999d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.155601 Sep 18 01:57:17.998748 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3282/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:17 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:19.020662 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:19.021902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:19.028660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:19.029182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:19.029645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:19.030759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:19.031239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:19.031673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:19.162427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:19.170258 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d4d4d47c-b443-486a-a3da-3afccef27a9e tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.153517 Sep 18 01:57:19.170825 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3259/6541] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:19 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:20.194355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:20.194977 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:20.197749 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:57:20.203185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:20.203675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:20.204113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:20.204815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:20.205304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:20.205759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:20.340448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:20.348656 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d6ef9ac-90bc-4cf7-9d44-d37754fc48f5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.158859 Sep 18 01:57:20.349804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3283/6542] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:20 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:21.372304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:21.372956 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:21.374950 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:57:21.375619 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:57:21.384365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:21.384860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:21.385371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:21.386345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:21.387042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:21.387498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:21.542236 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:21.550161 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6fda4138-63f5-41a5-b01e-3b91a249dcd8 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.181786 Sep 18 01:57:21.550756 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3260/6543] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:21 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:22.574218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:22.574834 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:22.581778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:22.582267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:22.582709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:22.584067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:22.584538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:22.584966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:22.718303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:22.725982 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-987101d0-a9b5-472f-b970-8fd330a0b888 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.155773 Sep 18 01:57:22.726560 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3284/6544] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:22 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:23.748792 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:23.749424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:23.758847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:23.759805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:23.760395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:23.761123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:23.761626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:23.762079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:23.904814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:23.912662 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-921143fe-17f0-4515-bd42-41cb7550c52b tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.167933 Sep 18 01:57:23.913258 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3261/6545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:23 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:24.936220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:24.936840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:24.944299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:24.944787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:24.945242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:24.945948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:24.946407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:24.946832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:25.075991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:25.084445 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3b42e92-571d-4b12-ad1e-6ef91ac0ca6f tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.152136 Sep 18 01:57:25.085022 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3285/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:24 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:25.456017 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1f607d32-c1f7-49a1-9b0f-889d9bce0900 req-7f1cc6bc-2118-480f-a06d-02d32ddc285b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb", "name": "network-vif-plugged", "status": "completed", "tag": "42146022-08bd-41d2-9a42-565b296f5285"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:57:25.467537 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1f607d32-c1f7-49a1-9b0f-889d9bce0900 req-7f1cc6bc-2118-480f-a06d-02d32ddc285b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:25.468131 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1f607d32-c1f7-49a1-9b0f-889d9bce0900 req-7f1cc6bc-2118-480f-a06d-02d32ddc285b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:25.468578 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1f607d32-c1f7-49a1-9b0f-889d9bce0900 req-7f1cc6bc-2118-480f-a06d-02d32ddc285b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:25.479650 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1f607d32-c1f7-49a1-9b0f-889d9bce0900 req-7f1cc6bc-2118-480f-a06d-02d32ddc285b service nova] Creating event network-vif-plugged:42146022-08bd-41d2-9a42-565b296f5285 for instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb on n-h1-master-1 Sep 18 01:57:25.484688 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1f607d32-c1f7-49a1-9b0f-889d9bce0900 req-7f1cc6bc-2118-480f-a06d-02d32ddc285b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 Sep 18 01:57:25.485476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3262/6547] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:57:26.106691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:26.107316 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:26.114173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:26.115168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:26.115612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:26.116311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:26.116776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:26.117210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:26.270276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:26.278406 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4066b540-4854-4e59-855a-11c9bb87ec59 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1263 microversion: 2.1 time: 0.175739 Sep 18 01:57:26.278992 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3286/6548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:26 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:27.303115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:27.304259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:27.310640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:27.311144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:27.311597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:27.312300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:27.312771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:27.313207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:27.442122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:27.449912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ba7329c2-8576-42d0-8c72-c2ac1dd9701c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1450 microversion: 2.1 time: 0.152122 Sep 18 01:57:27.450486 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3263/6549] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:27 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:27.472418 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:57:27.473032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:57:27.480452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:27.480936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:27.481404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:27.482156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:27.482630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:27.483055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:27.613763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:57:27.621746 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-72f06b61-709b-4f44-b478-895bd9eb871c tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1450 microversion: 2.1 time: 0.153293 Sep 18 01:57:27.622326 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3287/6550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:57:27 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:57:29.552135 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-f3e3fb77-c34c-4ac5-832b-bba2790dcd42 req-22b4f2ac-bb98-4e11-a476-2c8843a42666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb", "tag": "42146022-08bd-41d2-9a42-565b296f5285"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:57:29.562787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f3e3fb77-c34c-4ac5-832b-bba2790dcd42 req-22b4f2ac-bb98-4e11-a476-2c8843a42666 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:57:29.563273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f3e3fb77-c34c-4ac5-832b-bba2790dcd42 req-22b4f2ac-bb98-4e11-a476-2c8843a42666 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:57:29.563715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-f3e3fb77-c34c-4ac5-832b-bba2790dcd42 req-22b4f2ac-bb98-4e11-a476-2c8843a42666 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:57:29.577345 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-f3e3fb77-c34c-4ac5-832b-bba2790dcd42 req-22b4f2ac-bb98-4e11-a476-2c8843a42666 service nova] Creating event network-changed:42146022-08bd-41d2-9a42-565b296f5285 for instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb on n-h1-master-1 Sep 18 01:57:29.583158 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-f3e3fb77-c34c-4ac5-832b-bba2790dcd42 req-22b4f2ac-bb98-4e11-a476-2c8843a42666 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034656 Sep 18 01:57:29.583788 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3264/6551] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:58:57.894604 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=22 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:58:57.895633 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=54 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:58:57.896341 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:58:57.896527 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:58:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb (ip 10.222.0.25) !!! Sep 18 01:58:57.897715 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:58:57.897823 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:58:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb (ip 10.222.0.25) !!! Sep 18 01:58:57.898691 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:58:57.898997 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 01:58:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb (ip 10.222.0.25) !!! Sep 18 01:58:57.905266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:58:57.905805 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:58:57.915845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:58:57.916352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:58:57.916804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:58:57.917527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:58:57.918029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:58:57.918464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:58:57.952705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:58:58.004218 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:58:58.005358 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=50 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:58:58.006540 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 01:58:58.006656 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 01:58:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 18 01:58:58.054082 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cc68abbb-0ffd-4fa8-8b8c-760af6832764 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 204 len: 0 microversion: 2.1 time: 0.161214 Sep 18 01:58:58.054806 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3288/6552] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:58:57 2022] DELETE /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:58:58.063784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:58:58.064504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:58:58.071714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:58:58.072224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:58:58.072671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:58:58.073386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:58:58.073877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:58:58.074309 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:58:58.121401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0f3f0bf4-9764-45e1-a748-b76531bfe68b req-5f558b29-739b-407f-ad31-96ec3a701155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb", "tag": "42146022-08bd-41d2-9a42-565b296f5285"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:58:58.131994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f3f0bf4-9764-45e1-a748-b76531bfe68b req-5f558b29-739b-407f-ad31-96ec3a701155 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:58:58.132479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f3f0bf4-9764-45e1-a748-b76531bfe68b req-5f558b29-739b-407f-ad31-96ec3a701155 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:58:58.132917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f3f0bf4-9764-45e1-a748-b76531bfe68b req-5f558b29-739b-407f-ad31-96ec3a701155 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:58:58.145247 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0f3f0bf4-9764-45e1-a748-b76531bfe68b req-5f558b29-739b-407f-ad31-96ec3a701155 service nova] Creating event network-changed:42146022-08bd-41d2-9a42-565b296f5285 for instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb on n-h1-master-1 Sep 18 01:58:58.150778 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0f3f0bf4-9764-45e1-a748-b76531bfe68b req-5f558b29-739b-407f-ad31-96ec3a701155 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152103 Sep 18 01:58:58.151381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3265/6553] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:58:58.358103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:58:58.366021 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c74432bb-bf19-419a-87ff-b3ddf7f88693 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1574 microversion: 2.1 time: 0.307006 Sep 18 01:58:58.366609 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3289/6554] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:58:58 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1574 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:58:59.393761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:58:59.393761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:58:59.399037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:58:59.399539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:58:59.399988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:58:59.400699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:58:59.401172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:58:59.401638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:58:59.623621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:58:59.632359 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4d8d06f-247e-4683-ba69-ce499a935b51 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1574 microversion: 2.1 time: 0.246700 Sep 18 01:58:59.633037 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3266/6555] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:58:59 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1574 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:00.584774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-518268ce-9597-44c7-9527-fa19feca5f48 req-bb07d24d-c921-406d-b988-71567ae099e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb", "name": "network-vif-deleted", "tag": "42146022-08bd-41d2-9a42-565b296f5285"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:00.594807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-518268ce-9597-44c7-9527-fa19feca5f48 req-bb07d24d-c921-406d-b988-71567ae099e3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:00.595317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-518268ce-9597-44c7-9527-fa19feca5f48 req-bb07d24d-c921-406d-b988-71567ae099e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:00.595753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-518268ce-9597-44c7-9527-fa19feca5f48 req-bb07d24d-c921-406d-b988-71567ae099e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:00.608206 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-518268ce-9597-44c7-9527-fa19feca5f48 req-bb07d24d-c921-406d-b988-71567ae099e3 service nova] Creating event network-vif-deleted:42146022-08bd-41d2-9a42-565b296f5285 for instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb on n-h1-master-1 Sep 18 01:59:00.613857 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-518268ce-9597-44c7-9527-fa19feca5f48 req-bb07d24d-c921-406d-b988-71567ae099e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085052 Sep 18 01:59:00.614405 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3290/6556] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:00.663806 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:00.664439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:00.675885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:00.676720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:00.677472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:00.678284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:00.678763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:00.679210 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:00.745343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:00.754441 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12f2d4e5-0d32-4f16-9919-ccb608d0863d tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1222 microversion: 2.1 time: 0.094661 Sep 18 01:59:00.755252 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3267/6557] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:00 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:01.778326 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:01.778931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:01.786852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:01.787339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:01.787781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:01.788481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:01.788940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:01.789375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:01.855594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:01.864132 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d102ee04-f209-4a68-bfbf-f067b23204a2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1222 microversion: 2.1 time: 0.090062 Sep 18 01:59:01.864949 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3291/6558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:01 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:02.888044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:02.889166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:02.896574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:02.897360 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:02.897839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:02.898572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:02.899046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:02.899486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:02.965925 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:02.974521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-95fb712b-9142-47d3-bb6b-6483c1f2c563 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1222 microversion: 2.1 time: 0.090617 Sep 18 01:59:02.975110 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3268/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:02 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:03.998915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:03.999431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:04.006364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:04.006857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:04.007297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:04.013115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:04.013988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:04.014447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:04.086462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:04.094450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80caa726-c069-4cf6-8d94-0e961ea01775 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 200 len: 1222 microversion: 2.1 time: 0.100261 Sep 18 01:59:04.095032 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3292/6560] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:03 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:05.117605 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:05.118212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:05.125536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:05.125997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:05.126441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:05.127136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:05.127601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:05.128031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:05.142837 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb could not be found. Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb HTTP/1.1 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: exception: Instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb could not be found. Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb'} Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb could not be found. Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb could not be found. Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:05.144489 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb could not be found. Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36272cb6-d2b2-4648-a68f-19d9af7b0ea1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb" status: 404 len: 111 microversion: 2.1 time: 0.032279 Sep 18 01:59:05.149076 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3269/6561] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:05 2022] GET /compute/v2.1/servers/c3ca7091-cf5b-4b7b-a702-36e2ce54a0cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:59:11.370571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:11.371111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:11.376760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-49d28194-22d8-4716-ada0-27c0ff0654a5 req-715e4adb-1c75-4668-8580-d3d290461b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f698b502-45a6-44ab-a5fc-035c94a27b22", "tag": "93633cb5-4e34-4186-938e-dc8d54c5f08c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:11.378992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:11.379469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:11.379906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:11.380603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:11.381057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:11.381471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:11.390086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49d28194-22d8-4716-ada0-27c0ff0654a5 req-715e4adb-1c75-4668-8580-d3d290461b3d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:11.390657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49d28194-22d8-4716-ada0-27c0ff0654a5 req-715e4adb-1c75-4668-8580-d3d290461b3d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:11.391321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49d28194-22d8-4716-ada0-27c0ff0654a5 req-715e4adb-1c75-4668-8580-d3d290461b3d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:11.405519 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-49d28194-22d8-4716-ada0-27c0ff0654a5 req-715e4adb-1c75-4668-8580-d3d290461b3d service nova] Creating event network-changed:93633cb5-4e34-4186-938e-dc8d54c5f08c for instance f698b502-45a6-44ab-a5fc-035c94a27b22 on n-h2-master-1 Sep 18 01:59:11.410966 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-49d28194-22d8-4716-ada0-27c0ff0654a5 req-715e4adb-1c75-4668-8580-d3d290461b3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041487 Sep 18 01:59:11.411701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:59:11.415198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3270/6562] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:11.503009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9819ea51-c5ec-4f41-a304-4d95ef8b8e84 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 204 len: 0 microversion: 2.1 time: 0.136001 Sep 18 01:59:11.503936 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3293/6563] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:59:11 2022] DELETE /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:59:11.514140 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:11.514860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:11.524587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:11.525098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:11.525545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:11.526843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:11.527342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:11.527776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:11.671779 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:11.680103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54e63924-c730-4d64-b942-1f67ca1c5510 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1575 microversion: 2.1 time: 0.171276 Sep 18 01:59:11.680902 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3271/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:11 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:12.708992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:12.710002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:12.717501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:12.718180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:12.718780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:12.719966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:12.720530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:12.721013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:12.874251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:12.884196 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eb3fe301-f62f-40c3-9f7f-0fc58acbe5e5 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1575 microversion: 2.1 time: 0.180350 Sep 18 01:59:12.884800 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3294/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:12 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:59:13.829132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-52b795f7-7eff-4084-b217-68665606f063 req-1dc773cf-4ab9-4846-a1c7-66a7d4785a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f698b502-45a6-44ab-a5fc-035c94a27b22", "name": "network-vif-deleted", "tag": "93633cb5-4e34-4186-938e-dc8d54c5f08c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:13.840501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-52b795f7-7eff-4084-b217-68665606f063 req-1dc773cf-4ab9-4846-a1c7-66a7d4785a1f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:13.841027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-52b795f7-7eff-4084-b217-68665606f063 req-1dc773cf-4ab9-4846-a1c7-66a7d4785a1f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:13.841545 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-52b795f7-7eff-4084-b217-68665606f063 req-1dc773cf-4ab9-4846-a1c7-66a7d4785a1f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:13.856848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-52b795f7-7eff-4084-b217-68665606f063 req-1dc773cf-4ab9-4846-a1c7-66a7d4785a1f service nova] Creating event network-vif-deleted:93633cb5-4e34-4186-938e-dc8d54c5f08c for instance f698b502-45a6-44ab-a5fc-035c94a27b22 on n-h2-master-1 Sep 18 01:59:13.862413 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-52b795f7-7eff-4084-b217-68665606f063 req-1dc773cf-4ab9-4846-a1c7-66a7d4785a1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Sep 18 01:59:13.863017 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3272/6566] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:13.911803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:13.912434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:13.919763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:13.920256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:13.920702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:13.921408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:13.921897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:13.922328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:13.988929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:13.998135 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2fa73177-18ce-4c49-858e-c8a29012c217 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1223 microversion: 2.1 time: 0.089666 Sep 18 01:59:13.998746 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3295/6567] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:13 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:15.022882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:15.023524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:15.032933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:15.033435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:15.033917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:15.034628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:15.035102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:15.035542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:15.101474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:15.110459 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-af10f787-7eec-4708-8408-8c0235b13b66 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1223 microversion: 2.1 time: 0.092708 Sep 18 01:59:15.111049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3273/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:15 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:16.132987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:16.133541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:16.141264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:16.141804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:16.142242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:16.142938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:16.143391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:16.143815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:16.206232 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:16.214735 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3a6276d3-34d2-4b9a-beb5-830dda53b2da tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1223 microversion: 2.1 time: 0.085785 Sep 18 01:59:16.215327 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3296/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:16 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:17.239182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:17.239834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:17.246823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:17.247320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:17.247769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:17.248473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:17.248935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:17.249366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:17.311601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:17.319564 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2669ee99-f331-4d95-942b-ec5b4db23cf0 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1223 microversion: 2.1 time: 0.084328 Sep 18 01:59:17.320142 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3274/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:17 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:18.342653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:18.343277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:18.352719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:18.353434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:18.353906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:18.354610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:18.355063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:18.355487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:18.390486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:18.390974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:18.391416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:18.391869 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lazy-loading 'fault' on Instance uuid f698b502-45a6-44ab-a5fc-035c94a27b22 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:59:18.432561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ca8b49fa66486fa2426498dd730b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94357c55e41b460db9ff8415b4eaaaff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:18.441265 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-735be4b9-5b86-4cdd-be3d-5ea4521db7bf tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 200 len: 1228 microversion: 2.1 time: 0.102555 Sep 18 01:59:18.442182 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3297/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:18 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 1228 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:19.465003 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:19.465683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: f698b502-45a6-44ab-a5fc-035c94a27b22] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:19.473275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:19.473814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:19.474271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:19.474992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:19.475466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:19.475911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:19.491749 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance f698b502-45a6-44ab-a5fc-035c94a27b22 could not be found. Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 HTTP/1.1 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: exception: Instance f698b502-45a6-44ab-a5fc-035c94a27b22 could not be found. Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'f698b502-45a6-44ab-a5fc-035c94a27b22'} Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f698b502-45a6-44ab-a5fc-035c94a27b22 could not be found. Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f698b502-45a6-44ab-a5fc-035c94a27b22 could not be found. Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:19.493435 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f698b502-45a6-44ab-a5fc-035c94a27b22 could not be found. Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance f698b502-45a6-44ab-a5fc-035c94a27b22 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15f575b4-0577-4fc5-b005-f137568107f2 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22" status: 404 len: 111 microversion: 2.1 time: 0.033845 Sep 18 01:59:19.497857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3275/6572] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:19 2022] GET /compute/v2.1/servers/f698b502-45a6-44ab-a5fc-035c94a27b22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:59:20.272182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:20.272725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:20.279741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:20.280238 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:20.280697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:20.281387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:20.281887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:20.282322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:20.299230 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d HTTP/1.1 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0e6ac00b-eee5-4daa-a376-f55963fdee5d'} Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:59:20.300920 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1dc439a4-ed4d-4cea-9703-c232d638ec1a tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 404 len: 111 microversion: 2.1 time: 0.034301 Sep 18 01:59:20.304929 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3298/6573] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:59:20 2022] DELETE /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:59:20.311822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:20.312457 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] [instance: 0e6ac00b-eee5-4daa-a376-f55963fdee5d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:20.318475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:20.318974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:20.319424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:20.320124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:20.320594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:20.321035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:20.337873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] HTTP exception thrown: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Request method failure captured: Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d HTTP/1.1 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnj62OPKNL1K6e12NiYlKUON88hYtCD5cZTblU8lQW9DtHGheK_UKCnjgBpRJAmBmwnfjOoR6jxvpL68uZf1YWJsGVmqhS-rCvDdeKON0xz0IF37_xB_8LniQFSG0d2CDIm4FIvEsvJE2FFBpCoqqAjxkGk6Y7RoDVFThT7InfI2ELA Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94357c55e41b460db9ff8415b4eaaaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 94357c55e41b460db9ff8415b4eaaaff Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713029768 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: d0ca8b49fa66486fa2426498dd730b49 Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestVolumeBootPattern-1713029768-project Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '0e6ac00b-eee5-4daa-a376-f55963fdee5d'} Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:20.339401 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Returning 404 to user: Instance 0e6ac00b-eee5-4daa-a376-f55963fdee5d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f4290690-7739-4a67-8d7d-86182fb336c1 tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d" status: 404 len: 111 microversion: 2.1 time: 0.033501 Sep 18 01:59:20.343248 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3276/6574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:20 2022] GET /compute/v2.1/servers/0e6ac00b-eee5-4daa-a376-f55963fdee5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:59:23.767419 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2a505398-c0e8-4139-8d98-7e2f6e6d5fad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] Calling method '.version_select at 0x7f70050f3d30>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:23.811668 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2a505398-c0e8-4139-8d98-7e2f6e6d5fad tempest-TestVolumeBootPattern-1713029768 tempest-TestVolumeBootPattern-1713029768-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-7166308" status: 202 len: 0 microversion: 2.1 time: 0.048690 Sep 18 01:59:23.812260 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3299/6575] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Sep 18 01:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-7166308 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:59:42.025254 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=24 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:59:42.026026 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=48 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:59:42.133344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1595547957", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:42.186302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] validate_networks() for None {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:59:42.380444 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:59:42.380882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:59:42.381367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:59:42.381834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:59:42.382265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:59:42.394362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:42.394863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:42.395320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:42.396066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:42.396541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:42.396983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:42.416535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Getting quotas for project d590ae189e9141efbcb652ce9038f753. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:59:42.421816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Getting quotas for user 1509c1d52ea742a4a3d172cf3cb78b04 and project d590ae189e9141efbcb652ce9038f753. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:59:42.434507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:59:42.437360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:59:42.483015 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6f3a84e7-dd10-40a2-998b-765b69a125d0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.462806 Sep 18 01:59:42.483686 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3277/6576] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:59:42.494760 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:59:42.495641 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:59:42.500569 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-561fa96f-2bd1-4fab-ad67-9e3641d9540c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:42.501189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-561fa96f-2bd1-4fab-ad67-9e3641d9540c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:42.564854 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-561fa96f-2bd1-4fab-ad67-9e3641d9540c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:42.575612 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-561fa96f-2bd1-4fab-ad67-9e3641d9540c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1222 microversion: 2.1 time: 0.082612 Sep 18 01:59:42.584210 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3300/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:42 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:43.602393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:43.603878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:43.611129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:43.611651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:43.612305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:43.614156 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:43.614839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:43.615339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:43.723155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:43.731898 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cdffcbcf-6120-418f-8f7d-6412cf71854a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1282 microversion: 2.1 time: 0.133612 Sep 18 01:59:43.732745 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3278/6578] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:43 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:44.756479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:44.757188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:44.764705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:44.765216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:44.765680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:44.766377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:44.766858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:44.767282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:44.959046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:44.966825 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d88fc2e-9ecc-4479-9f95-a863899bc13f tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.214418 Sep 18 01:59:44.967927 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3301/6579] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:44 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:45.306498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a5a7476b-e162-4b78-9701-f4b4c25ba13e req-f9d31b2d-526f-47ca-b6f6-c6399a9ac89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d6ac6b-e733-44b0-97e1-a93d6da69d8f", "tag": "a0920e27-7213-44d6-803a-1e24ec7708f1"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:45.318472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a5a7476b-e162-4b78-9701-f4b4c25ba13e req-f9d31b2d-526f-47ca-b6f6-c6399a9ac89c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:45.318960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a5a7476b-e162-4b78-9701-f4b4c25ba13e req-f9d31b2d-526f-47ca-b6f6-c6399a9ac89c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:45.319399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a5a7476b-e162-4b78-9701-f4b4c25ba13e req-f9d31b2d-526f-47ca-b6f6-c6399a9ac89c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:45.331652 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a5a7476b-e162-4b78-9701-f4b4c25ba13e req-f9d31b2d-526f-47ca-b6f6-c6399a9ac89c service nova] Creating event network-changed:a0920e27-7213-44d6-803a-1e24ec7708f1 for instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f on n-h2-master-1 Sep 18 01:59:45.337166 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a5a7476b-e162-4b78-9701-f4b4c25ba13e req-f9d31b2d-526f-47ca-b6f6-c6399a9ac89c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035661 Sep 18 01:59:45.337835 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3279/6580] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:45.990363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:45.990982 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:45.997998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:45.999110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:45.999558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:46.000266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:46.000735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:46.001171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:46.135868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:46.144886 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e482d480-c9f1-4217-9132-b7372742b328 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.158476 Sep 18 01:59:46.145474 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3302/6581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:45 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:47.169788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:47.171066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:47.177298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:47.177897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:47.178358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:47.179068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:47.179621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:47.180000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:47.311970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:47.319818 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a279d09a-406d-48b0-b1d9-cfce74065bf7 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.155175 Sep 18 01:59:47.320426 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3280/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:47 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:48.343060 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:48.343699 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:48.350519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:48.351003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:48.351438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:48.352129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:48.352579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:48.353000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:48.486706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:48.494472 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9afae61-577e-4ac4-a2cd-1301fb51e27d tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.155917 Sep 18 01:59:48.495051 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3303/6583] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:48 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:49.517972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:49.518597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:49.525496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:49.526055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:49.526473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:49.527168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:49.527628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:49.528058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:49.655897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:49.663541 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d87867d8-2eb5-41e4-b67f-dd38b111070b tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.149554 Sep 18 01:59:49.664112 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3281/6584] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:49 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:50.692008 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:50.692651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:50.699895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:50.700381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:50.700821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:50.702103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:50.702581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:50.703008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:50.839809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:50.847857 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27d2811d-e65d-4a94-8439-b22621538356 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.159764 Sep 18 01:59:50.848435 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3304/6585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:50 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:51.869680 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:51.870484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:51.877601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:51.878132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:51.878580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:51.879311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:51.879790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:51.880231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:52.022424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:52.042574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c1514883-c0ef-42d8-b99b-6d3ad00c5459 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.176743 Sep 18 01:59:52.043412 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3282/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:51 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:52.125031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-868b60db-5be5-4b18-9e2b-e19a8837b964 req-4ee39740-5ed2-47f8-b4c1-1a35f97b501f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d6ac6b-e733-44b0-97e1-a93d6da69d8f", "name": "network-vif-plugged", "status": "completed", "tag": "a0920e27-7213-44d6-803a-1e24ec7708f1"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:52.134651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-868b60db-5be5-4b18-9e2b-e19a8837b964 req-4ee39740-5ed2-47f8-b4c1-1a35f97b501f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:52.135134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-868b60db-5be5-4b18-9e2b-e19a8837b964 req-4ee39740-5ed2-47f8-b4c1-1a35f97b501f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:52.135572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-868b60db-5be5-4b18-9e2b-e19a8837b964 req-4ee39740-5ed2-47f8-b4c1-1a35f97b501f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:52.147409 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-868b60db-5be5-4b18-9e2b-e19a8837b964 req-4ee39740-5ed2-47f8-b4c1-1a35f97b501f service nova] Creating event network-vif-plugged:a0920e27-7213-44d6-803a-1e24ec7708f1 for instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f on n-h2-master-1 Sep 18 01:59:52.152502 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-868b60db-5be5-4b18-9e2b-e19a8837b964 req-4ee39740-5ed2-47f8-b4c1-1a35f97b501f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085019 Sep 18 01:59:52.153105 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3305/6587] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:53.066374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:53.067014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:53.069097 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:59:53.069875 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:59:53.076928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:53.077437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:53.077923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:53.078653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:53.079133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:53.079578 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:53.227248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:53.235723 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3287623e-9973-445b-a51c-f43c89e580f0 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1322 microversion: 2.1 time: 0.173257 Sep 18 01:59:53.236322 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3283/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:53 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:54.259145 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:54.259969 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:54.261854 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:59:54.268371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:54.268859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:54.269301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:54.270028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:54.270499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:54.270933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:54.402586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:54.410348 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ad8161d-46c4-4867-9049-64d02ecb1af8 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1471 microversion: 2.1 time: 0.155757 Sep 18 01:59:54.410937 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3306/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:54 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:54.482426 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b880b3e0-8ab4-489d-9448-4a9ff50ab912 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Calling method '.version_select at 0x7f700513c5e0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:54.547846 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b880b3e0-8ab4-489d-9448-4a9ff50ab912 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a38038f12ac641c7916677f614ba4a15" status: 200 len: 371 microversion: 2.1 time: 0.116344 Sep 18 01:59:54.548425 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3284/6590] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:59:54 2022] GET /compute/v2.1/os-quota-sets/a38038f12ac641c7916677f614ba4a15 => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:54.564918 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f1aa6a6-5a1a-4635-9b68-4ebba0fc85b8 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2007654191", "id": 216444714, "os-flavor-access:is_public": "True"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:54.582813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f1aa6a6-5a1a-4635-9b68-4ebba0fc85b8 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021715 Sep 18 01:59:54.583399 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3307/6591] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:59:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:54.596295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "216444714"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:54.598726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:54.605194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:54.605722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:54.606455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:54.607163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:54.607658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:54.608605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:54.815573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '344ab4aeaec64436a3f71c3059f855a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38038f12ac641c7916677f614ba4a15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:54.821911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2007654191 {{(pid=122373) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:59:54.829209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:54.829772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:54.830226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:54.830972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:54.831446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:54.831889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:54.853995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Getting quotas for project d590ae189e9141efbcb652ce9038f753. Resources: {'ram', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:59:54.859654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Getting quotas for user 1509c1d52ea742a4a3d172cf3cb78b04 and project d590ae189e9141efbcb652ce9038f753. Resources: {'ram', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:59:54.875624 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] ram quota exceeded for a38038f12ac641c7916677f614ba4a15, tried to resize instance. Sep 18 01:59:54.876173 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Request method failure captured: Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f/action HTTP/1.1 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 38 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnuNbcoXMvpZMAfImgetPqNK7EZlRMYraofsigwGhPiqr6uZ2H_XwM7bI2fGK__Zb5QCQQz-rWvRGRh_gNvVpvBv1NUMZ25U9YBOyC82OPnPsgiZNzXT39ElpJ9CY-Elk-kIE7aquiHp-tYnKPTHU1Fc2EbavrGvR-dtdk8YEgRSqfU Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: a38038f12ac641c7916677f614ba4a15 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1889592035 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,admin,member Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,admin,member Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a38038f12ac641c7916677f614ba4a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a38038f12ac641c7916677f614ba4a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a38038f12ac641c7916677f614ba4a15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a38038f12ac641c7916677f614ba4a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1889592035 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: a38038f12ac641c7916677f614ba4a15 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1889592035 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersAdminNegativeTestJSON-1889592035-project-admin Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 344ab4aeaec64436a3f71c3059f855a6 Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1889592035-project-admin Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: {"resize": {"flavorRef": "216444714"}} Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b2d6ac6b-e733-44b0-97e1-a93d6da69d8f', 'body': {'resize': {'flavorRef': '216444714'}}} Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:59:54.878322 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb460d6b-8c05-40ad-ae5c-406fb5b24a6d tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f/action" status: 403 len: 118 microversion: 2.1 time: 0.287876 Sep 18 01:59:54.882491 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3285/6592] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:59:54 2022] POST /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f/action => generated 118 bytes in 289 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:59:54.889073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bdd0c868-f6a2-414e-9f4a-839da3102e61 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:54.905802 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bdd0c868-f6a2-414e-9f4a-839da3102e61 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/216444714" status: 202 len: 0 microversion: 2.1 time: 0.020660 Sep 18 01:59:54.906395 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3308/6593] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:59:54 2022] DELETE /compute/v2.1/flavors/216444714 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:59:54.914443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d5f6258-5115-4d40-a08c-9bb240fdd6e4 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:54.934708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d5f6258-5115-4d40-a08c-9bb240fdd6e4 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023910 Sep 18 01:59:54.935275 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3286/6594] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:59:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:59:54.955731 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9d0b5d1e-4890-47bf-a65c-96e78d6960dc tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Calling method '.version_select at 0x7f70062479d0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:55.024763 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9d0b5d1e-4890-47bf-a65c-96e78d6960dc tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a38038f12ac641c7916677f614ba4a15" status: 200 len: 371 microversion: 2.1 time: 0.072634 Sep 18 01:59:55.025269 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3309/6595] 10.222.0.25 () {58 vars in 1242 bytes} [Sun Sep 18 01:59:54 2022] GET /compute/v2.1/os-quota-sets/a38038f12ac641c7916677f614ba4a15 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:55.037221 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0015fcf2-5caa-44d0-acda-1f90bfb23079 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-454882727", "id": 414859629, "os-flavor-access:is_public": "True"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:55.056014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0015fcf2-5caa-44d0-acda-1f90bfb23079 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022627 Sep 18 01:59:55.056601 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3287/6596] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 01:59:55 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:55.069423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "414859629"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:55.071706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:55.077705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.078187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.078623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.079310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.079759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.080184 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.238648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '344ab4aeaec64436a3f71c3059f855a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38038f12ac641c7916677f614ba4a15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:55.245094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-454882727 {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 01:59:55.252334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.252824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.253265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.254033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.254626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.254961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.280758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Getting quotas for project d590ae189e9141efbcb652ce9038f753. Resources: {'ram', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:59:55.285781 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Getting quotas for user 1509c1d52ea742a4a3d172cf3cb78b04 and project d590ae189e9141efbcb652ce9038f753. Resources: {'ram', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:59:55.298178 n-d-master-1 devstack@n-api.service[122374]: INFO nova.compute.api [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] cores quota exceeded for a38038f12ac641c7916677f614ba4a15, tried to resize instance. Sep 18 01:59:55.298722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Request method failure captured: Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f/action HTTP/1.1 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 38 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnuNbcoXMvpZMAfImgetPqNK7EZlRMYraofsigwGhPiqr6uZ2H_XwM7bI2fGK__Zb5QCQQz-rWvRGRh_gNvVpvBv1NUMZ25U9YBOyC82OPnPsgiZNzXT39ElpJ9CY-Elk-kIE7aquiHp-tYnKPTHU1Fc2EbavrGvR-dtdk8YEgRSqfU Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: a38038f12ac641c7916677f614ba4a15 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1889592035 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,admin,member Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,admin,member Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a38038f12ac641c7916677f614ba4a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a38038f12ac641c7916677f614ba4a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a38038f12ac641c7916677f614ba4a15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a38038f12ac641c7916677f614ba4a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1889592035 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: a38038f12ac641c7916677f614ba4a15 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1889592035 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersAdminNegativeTestJSON-1889592035-project-admin Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 344ab4aeaec64436a3f71c3059f855a6 Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1889592035-project-admin Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: {"resize": {"flavorRef": "414859629"}} Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'b2d6ac6b-e733-44b0-97e1-a93d6da69d8f', 'body': {'resize': {'flavorRef': '414859629'}}} Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:59:55.300783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a186645a-1e1a-4c1c-b8f6-7a8dcfc86b47 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f/action" status: 403 len: 113 microversion: 2.1 time: 0.236903 Sep 18 01:59:55.305217 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3310/6597] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 01:59:55 2022] POST /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f/action => generated 113 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:59:55.312007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-58351133-c9f2-4628-8ed7-642a021250d7 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:55.329337 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-58351133-c9f2-4628-8ed7-642a021250d7 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/414859629" status: 202 len: 0 microversion: 2.1 time: 0.021675 Sep 18 01:59:55.329964 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3288/6598] 10.222.0.25 () {58 vars in 1158 bytes} [Sun Sep 18 01:59:55 2022] DELETE /compute/v2.1/flavors/414859629 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:59:55.338050 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c0062dfa-821e-4efa-b392-2ab37709bf16 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:55.362309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c0062dfa-821e-4efa-b392-2ab37709bf16 tempest-ServersAdminNegativeTestJSON-1889592035 tempest-ServersAdminNegativeTestJSON-1889592035-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024730 Sep 18 01:59:55.362309 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3311/6599] 10.222.0.25 () {58 vars in 1146 bytes} [Sun Sep 18 01:59:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:55.381241 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:55.381788 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:55.388499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.389667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.390115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.390817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.391280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.391712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.417854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:59:55.497930 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75a3f735-5a59-40f4-a7f3-3dbc7f546f2a tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 204 len: 0 microversion: 2.1 time: 0.120300 Sep 18 01:59:55.499461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3289/6600] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 01:59:55 2022] DELETE /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:59:55.507348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:55.508104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:55.515491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.516700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.518314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.519865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:55.520489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:55.520937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:55.655703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:55.663902 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5d0adced-a301-44f2-ad11-8e7d76d2c12c tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1477 microversion: 2.1 time: 0.160322 Sep 18 01:59:55.664692 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3312/6601] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:55 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:56.688883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:56.689728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:56.699869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:56.700398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:56.700857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:56.702203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:56.702690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:56.703118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:56.880682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:56.889979 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9edd82b-d6db-4b20-bf36-91f6a45591b3 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1477 microversion: 2.1 time: 0.204908 Sep 18 01:59:56.890640 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3290/6602] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:56 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1477 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:57.465828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-155e8009-6f3b-4010-bc5b-a37e57ff7219 req-f2263367-a9e9-4cb2-ba2c-a555f36524b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d6ac6b-e733-44b0-97e1-a93d6da69d8f", "name": "network-vif-deleted", "tag": "a0920e27-7213-44d6-803a-1e24ec7708f1"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:59:57.479038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-155e8009-6f3b-4010-bc5b-a37e57ff7219 req-f2263367-a9e9-4cb2-ba2c-a555f36524b1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:57.479433 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-155e8009-6f3b-4010-bc5b-a37e57ff7219 req-f2263367-a9e9-4cb2-ba2c-a555f36524b1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:57.480068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-155e8009-6f3b-4010-bc5b-a37e57ff7219 req-f2263367-a9e9-4cb2-ba2c-a555f36524b1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:57.510200 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-155e8009-6f3b-4010-bc5b-a37e57ff7219 req-f2263367-a9e9-4cb2-ba2c-a555f36524b1 service nova] Creating event network-vif-deleted:a0920e27-7213-44d6-803a-1e24ec7708f1 for instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f on n-h2-master-1 Sep 18 01:59:57.516880 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-155e8009-6f3b-4010-bc5b-a37e57ff7219 req-f2263367-a9e9-4cb2-ba2c-a555f36524b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055516 Sep 18 01:59:57.517504 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3313/6603] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 01:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:59:57.913014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:57.913726 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:57.922226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:57.923133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:57.923957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:57.924881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:57.925366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:57.925919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:57.960730 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:57.961239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:57.961724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:57.962192 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lazy-loading 'fault' on Instance uuid b2d6ac6b-e733-44b0-97e1-a93d6da69d8f {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:59:58.007167 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1509c1d52ea742a4a3d172cf3cb78b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590ae189e9141efbcb652ce9038f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:59:58.016097 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a149b560-f9f3-4dfc-96cb-8b1795ed2714 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 200 len: 1312 microversion: 2.1 time: 0.106711 Sep 18 01:59:58.016787 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3291/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:57 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:59:59.039416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:59:59.040116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] [instance: b2d6ac6b-e733-44b0-97e1-a93d6da69d8f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:59:59.047866 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:59.048351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:59.048789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:59.049485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:59:59.050127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:59:59.051846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:59:59.065037 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] HTTP exception thrown: Instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f could not be found. Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Request method failure captured: Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f HTTP/1.1 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnuNto2M9_YjdF2uslyAbrc0jDYK6y1MQ7HrfyDUUGB3WvC6Q8NgQbSMdBMsWxvZ5WLdtOQN542Wr-1y_Z5WxVW2KkgpM4vUxgJ7962OZSyX6eKHnp1elbfKyEAQ2kPc-3MfQCypC8PaCMeuWG3bvG87j0OctTI-JAR1qanWrJ1_-ek Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d590ae189e9141efbcb652ce9038f753 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1456069903 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d590ae189e9141efbcb652ce9038f753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d590ae189e9141efbcb652ce9038f753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d590ae189e9141efbcb652ce9038f753"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d590ae189e9141efbcb652ce9038f753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1456069903 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d590ae189e9141efbcb652ce9038f753 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1456069903 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersAdminNegativeTestJSON-1456069903-project Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 1509c1d52ea742a4a3d172cf3cb78b04 Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1456069903-project Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: exception: Instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f could not be found. Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'b2d6ac6b-e733-44b0-97e1-a93d6da69d8f'} Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f could not be found. Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f could not be found. Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:59.066681 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f could not be found. Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] Returning 404 to user: Instance b2d6ac6b-e733-44b0-97e1-a93d6da69d8f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be3479a9-7632-4d94-8729-2d0eddd28e55 tempest-ServersAdminNegativeTestJSON-1456069903 tempest-ServersAdminNegativeTestJSON-1456069903-project] 10.222.0.25 "GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f" status: 404 len: 111 microversion: 2.1 time: 0.033028 Sep 18 01:59:59.071186 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3314/6605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 01:59:59 2022] GET /compute/v2.1/servers/b2d6ac6b-e733-44b0-97e1-a93d6da69d8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:00:05.292731 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:05.293531 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:05.407860 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1171894830", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "be3f1b59-cde4-4674-8109-6a95727b8b78"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:05.466487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] validate_networks() for [('be3f1b59-cde4-4674-8109-6a95727b8b78', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:00:05.889731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:00:05.889731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:00:05.890451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:00:05.890880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:00:05.891307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:00:05.903901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:05.904406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:05.904973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:05.906372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:05.906849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:05.907316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:05.930296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Getting quotas for project 867a2f7d362542f699a8043633e6f991. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:00:05.936010 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Getting quotas for user 9a356f3c9a354a288428d50cc266c3fe and project 867a2f7d362542f699a8043633e6f991. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:00:05.958738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:00:05.961367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:00:06.018368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3b0634ce-f6f6-4165-b3f3-5c0f5fe5c789 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731743 Sep 18 02:00:06.019535 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3292/6606] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 02:00:06.037571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3c53ea7-1281-461f-af39-8530653194f4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:06.038307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3c53ea7-1281-461f-af39-8530653194f4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:06.049744 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:06.051260 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:06.122498 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3c53ea7-1281-461f-af39-8530653194f4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:06.131061 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3c53ea7-1281-461f-af39-8530653194f4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1215 microversion: 2.1 time: 0.104239 Sep 18 02:00:06.131740 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3315/6607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:06 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:07.158630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:07.159274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:07.168456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:07.168967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:07.169587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:07.170366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:07.170902 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:07.172165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:07.250411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:07.259946 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fecaa1b5-5446-490b-9027-6e22906b15de tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1275 microversion: 2.1 time: 0.107327 Sep 18 02:00:07.261056 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3293/6608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:07 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:08.284666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:08.285523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:08.301062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:08.301746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:08.302287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:08.303107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:08.303810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:08.304476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:08.463268 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:08.471850 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7c46d0f1-119a-49c4-b13f-4f6485134468 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1315 microversion: 2.1 time: 0.191624 Sep 18 02:00:08.472442 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3316/6609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:08 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:08.846081 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5cc802fb-a17c-4931-9568-5350b098db83 req-5f2a3715-0ff6-4432-bee1-aec25b09f6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3809d1-9d03-4449-80f1-77b3f56dba9a", "tag": "d07ad9bf-74b3-4d8a-8930-a28ff8205509"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:08.860606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5cc802fb-a17c-4931-9568-5350b098db83 req-5f2a3715-0ff6-4432-bee1-aec25b09f6ca service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:08.861169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5cc802fb-a17c-4931-9568-5350b098db83 req-5f2a3715-0ff6-4432-bee1-aec25b09f6ca service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:08.861647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5cc802fb-a17c-4931-9568-5350b098db83 req-5f2a3715-0ff6-4432-bee1-aec25b09f6ca service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:08.875635 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5cc802fb-a17c-4931-9568-5350b098db83 req-5f2a3715-0ff6-4432-bee1-aec25b09f6ca service nova] Creating event network-changed:d07ad9bf-74b3-4d8a-8930-a28ff8205509 for instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a on n-h2-master-1 Sep 18 02:00:08.881254 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5cc802fb-a17c-4931-9568-5350b098db83 req-5f2a3715-0ff6-4432-bee1-aec25b09f6ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041472 Sep 18 02:00:08.881918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3294/6610] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:00:09.495810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:09.496425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:09.504005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:09.504489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:09.505036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:09.505624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:09.506081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:09.506507 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:09.650005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:09.661929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a79f22e2-7915-4e06-81b1-0e665e680e05 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1315 microversion: 2.1 time: 0.169544 Sep 18 02:00:09.662930 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3317/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:09 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:10.686535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:10.687301 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:10.694715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:10.695225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:10.695682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:10.696420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:10.696927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:10.697370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:10.839000 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:10.847722 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6594d072-530d-4aa5-beec-77ca733abebd tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1315 microversion: 2.1 time: 0.166147 Sep 18 02:00:10.848320 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3295/6612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:10 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:11.870211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:11.870868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:11.880701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:11.881195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:11.881790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:11.882509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:11.882961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:11.883383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:12.017462 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:12.025910 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2c92e231-1802-41b7-b7e5-cbe6cb3c2d31 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1315 microversion: 2.1 time: 0.159516 Sep 18 02:00:12.026502 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3318/6613] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:11 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:13.048463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:13.049093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:13.052472 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:13.058027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:13.058559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:13.059010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:13.059726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:13.060197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:13.060634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:13.064064 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:13.201532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:13.209252 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2464154d-a75d-4a2c-a002-61b9ce06b86a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1315 microversion: 2.1 time: 0.164761 Sep 18 02:00:13.209847 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3296/6614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:13 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:14.103716 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ee8f588e-fd3c-4768-a590-43019dcecfa0 req-24e793b6-2860-4b0f-a60b-7ec4020b3913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3809d1-9d03-4449-80f1-77b3f56dba9a", "name": "network-vif-plugged", "status": "completed", "tag": "d07ad9bf-74b3-4d8a-8930-a28ff8205509"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:14.110884 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:14.114959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee8f588e-fd3c-4768-a590-43019dcecfa0 req-24e793b6-2860-4b0f-a60b-7ec4020b3913 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:14.115534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee8f588e-fd3c-4768-a590-43019dcecfa0 req-24e793b6-2860-4b0f-a60b-7ec4020b3913 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:14.115975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ee8f588e-fd3c-4768-a590-43019dcecfa0 req-24e793b6-2860-4b0f-a60b-7ec4020b3913 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:14.124314 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=74 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:14.137965 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ee8f588e-fd3c-4768-a590-43019dcecfa0 req-24e793b6-2860-4b0f-a60b-7ec4020b3913 service nova] Creating event network-vif-plugged:d07ad9bf-74b3-4d8a-8930-a28ff8205509 for instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a on n-h2-master-1 Sep 18 02:00:14.147915 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ee8f588e-fd3c-4768-a590-43019dcecfa0 req-24e793b6-2860-4b0f-a60b-7ec4020b3913 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047856 Sep 18 02:00:14.148827 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3319/6615] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:00:14.232546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:14.233226 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:14.240626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:14.241135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:14.241684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:14.242404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:14.242872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:14.243306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:14.380223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:14.388397 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c7c9cd4-cc5e-4100-9fdb-c75d0ca31098 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1315 microversion: 2.1 time: 0.159446 Sep 18 02:00:14.388997 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3297/6616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:14 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:15.412984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:15.413717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:15.420173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:15.420705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:15.421233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:15.421965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:15.422418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:15.422839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:15.556277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:15.564085 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6342b272-3711-4a41-881d-6a2355c9a169 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1503 microversion: 2.1 time: 0.156231 Sep 18 02:00:15.564670 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3320/6617] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:15 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:15.587151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:15.589439 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:15.596205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:15.596698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:15.597147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:15.597890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:15.598355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:15.598788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:15.628181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:15.634210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Old instance type m1.heat2, new instance type m1.heat {{(pid=122373) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:00:15.641058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:00:15.641486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:00:15.642094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:00:15.642517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:00:15.643546 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:00:15.708294 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-914490d1-f207-4569-90cc-8d25c4bc3a91 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "POST /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a/action" status: 202 len: 0 microversion: 2.1 time: 0.124899 Sep 18 02:00:15.708848 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3298/6618] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:00:15 2022] POST /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:00:15.716879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:15.717499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:15.724145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:15.724669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:15.725108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:15.725850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:15.726314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:15.726744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:15.863264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:15.872309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d94d4d61-e508-4ecb-a0b0-e401a7e13120 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1512 microversion: 2.1 time: 0.159218 Sep 18 02:00:15.872901 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3321/6619] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:15 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:16.897201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:16.897972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:16.899996 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:16.900745 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:16.908656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:16.909162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:16.909632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:16.910392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:16.910941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:16.911475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:17.051651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:17.059412 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75f9bb5b-8835-4ca5-b87e-0a5c8e40b36f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1512 microversion: 2.1 time: 0.167085 Sep 18 02:00:17.059980 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3299/6620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:16 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:18.083456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:18.084011 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:18.085986 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:18.092042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:18.092520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:18.092962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:18.093690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:18.094149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:18.094573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:18.237217 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:18.245263 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a2e2abfb-a843-47aa-baf6-e7dfbf370793 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.166303 Sep 18 02:00:18.245872 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3322/6621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:18 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:19.270671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:19.271658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:19.278852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:19.279617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:19.280065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:19.280860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:19.281327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:19.281786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:19.410343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:19.417998 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c34aaf1-8a15-4d90-87d1-b509d0c29717 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.151868 Sep 18 02:00:19.418569 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3300/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:19 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:20.440924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:20.441573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:20.448510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:20.448995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:20.449437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:20.450167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:20.450624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:20.451051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:20.586095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:20.595882 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2be6733e-24e3-4b25-b0d4-a6a20acf455a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.158779 Sep 18 02:00:20.596561 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3323/6623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:20 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:21.619597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:21.620223 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:21.627064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:21.627554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:21.628000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:21.628694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:21.629158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:21.629615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:21.760488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:21.769712 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2daf17e9-76b9-40ff-a056-c333967457e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.153871 Sep 18 02:00:21.770295 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3301/6624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:21 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:22.793540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:22.794199 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:22.801407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:22.801926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:22.802368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:22.803052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:22.803505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:22.803929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:22.932461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:22.940269 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab2f1f94-af0b-4262-bf4b-3023abfef427 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.150771 Sep 18 02:00:22.940845 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3324/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:22 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:23.963914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:23.964535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:23.972061 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:23.972548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:23.972993 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:23.973735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:23.974200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:23.974630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:24.107464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:24.115210 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-272b5253-5b6b-48a2-bafc-9aedd8e123b8 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.155164 Sep 18 02:00:24.115782 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3302/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:23 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:00:25.138286 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:25.138912 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:25.146485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:25.146978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:25.147425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:25.148153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:25.148618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:25.149049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:25.285098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:25.293007 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27b7d7a5-e862-4dab-a65e-a49df1092e70 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.159048 Sep 18 02:00:25.293609 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3325/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:25 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:26.315952 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:26.316585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:26.323419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:26.323920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:26.324374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:26.325088 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:26.325581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:26.326326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:26.465044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:26.472873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0e1a953b-63a5-4817-b57c-5a205ecf49a7 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.160871 Sep 18 02:00:26.474132 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3303/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:26 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:27.496354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:27.496966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:27.504401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:27.504526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:27.504883 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:27.505634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:27.506119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:27.506645 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:27.636749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:27.644764 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e8262907-5fd8-4138-bdcd-0017b173e59e tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.152369 Sep 18 02:00:27.645881 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3326/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:27 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:28.669679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:28.670308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:28.677973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:28.678483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:28.679048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:28.679804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:28.680283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:28.680725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:28.811264 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:28.819030 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ddcf7a7-0d7c-4ee6-b433-66fe6dc252c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.153481 Sep 18 02:00:28.819611 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3304/6630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:28 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:29.846162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:29.846777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:29.853756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:29.854235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:29.854670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:29.855355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:29.855805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:29.856232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:29.991894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:29.999589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-520dac93-01d7-4f0c-9e42-90bc9e4000c5 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.158800 Sep 18 02:00:30.000169 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3327/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:29 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:31.024478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:31.025123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:31.031983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:31.032484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:31.032938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:31.033671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:31.034148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:31.034590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:31.164256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:31.172076 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3133461a-5f14-40e1-888a-2feed029fcda tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.152096 Sep 18 02:00:31.172665 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3305/6632] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:31 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:32.195588 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:32.196115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:32.203107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:32.203593 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:32.204089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:32.204787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:32.205247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:32.205707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:32.347120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:32.355746 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b34a35e-ec53-4640-9d8e-a92cd27da58b tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.164001 Sep 18 02:00:32.356853 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3328/6633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:32 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:00:33.378670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:33.379333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:33.386200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:33.386688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:33.387129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:33.388404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:33.388629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:33.389060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:33.519088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:33.527018 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e20d7317-70f5-4dd9-ab20-cc2dabb4ecf2 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.152297 Sep 18 02:00:33.527605 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3306/6634] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:33 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:34.550490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:34.551108 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:34.558613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:34.559108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:34.559540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:34.560246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:34.560809 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:34.561124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:34.711555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:34.719519 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e99d481-2c17-4154-a6b1-ad8b5d8de264 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.172955 Sep 18 02:00:34.720104 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3329/6635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:34 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:35.743718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:35.744388 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:35.751193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:35.751682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:35.752128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:35.752822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:35.753291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:35.753753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:35.885742 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:35.893976 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d709f19-25f9-4001-ad67-24b678c78568 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.155090 Sep 18 02:00:35.894556 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3307/6636] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:35 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:36.919457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:36.920103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:36.928084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:36.928570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:36.929012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:36.929755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:36.930215 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:36.930647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:37.061423 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:37.069334 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59d434a4-fa99-4b70-94ef-cd0e1ef73cbc tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.154028 Sep 18 02:00:37.070159 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3330/6637] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:36 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:38.092695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:38.093383 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:38.100978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:38.101571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:38.102028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:38.102741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:38.103223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:38.103641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:38.241835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:38.249540 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bea71a46-83a7-46c3-a5c7-eb4436a7dc24 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.160904 Sep 18 02:00:38.250195 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3308/6638] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:38 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:39.274680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:39.275291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:39.282872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:39.283352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:39.283787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:39.284479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:39.284938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:39.285360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:39.416983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:39.424998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5c69f0f4-5743-48a4-80aa-760f872cc19c tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.154713 Sep 18 02:00:39.425840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3331/6639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:39 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:40.448152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:40.448776 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:40.455735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:40.456230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:40.456671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:40.457911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:40.458377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:40.458806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:40.594652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:40.603020 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d6153e3-8918-4ff0-8412-62f98430f7ba tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.158776 Sep 18 02:00:40.603612 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3309/6640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:40 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:41.626017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:41.626667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:41.634108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:41.634588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:41.635024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:41.635712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:41.636165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:41.636587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:41.772370 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:41.780750 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab142583-d99d-4f43-93c7-dcbb2bec36e1 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.158649 Sep 18 02:00:41.781359 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3332/6641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:41 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:00:42.807849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:42.808497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:42.814969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:42.815459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:42.815906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:42.817245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:42.817737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:42.818172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:42.945720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:42.953401 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ec9b3284-cb8e-4009-b1b6-52bd54b42642 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.149609 Sep 18 02:00:42.954006 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3310/6642] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:42 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:43.976938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:43.977595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:43.984007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:43.984664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:43.985101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:43.985848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:43.986321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:43.986747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:44.128726 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:44.136862 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dd977810-587d-45b0-a309-5ce7c2a3697d tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1517 microversion: 2.1 time: 0.164648 Sep 18 02:00:44.137610 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3333/6643] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:43 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:45.162696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:45.163232 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:45.167708 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=34 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:45.171769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:45.172315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:45.172885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:45.173744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:45.174224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:45.174658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:45.179139 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:45.320464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:45.328306 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46bcdbd8-2fe0-49ed-aaf9-b93cf31d5e40 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1516 microversion: 2.1 time: 0.170106 Sep 18 02:00:45.328902 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3311/6644] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:45 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:00:45.614227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-67df1877-d701-4d53-9800-8ea1a1ec9c75 req-8605ec93-5587-4b32-ad41-7a4bf532d91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3809d1-9d03-4449-80f1-77b3f56dba9a", "name": "network-vif-unplugged", "status": "completed", "tag": "d07ad9bf-74b3-4d8a-8930-a28ff8205509"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:45.619994 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=30 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:45.626432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67df1877-d701-4d53-9800-8ea1a1ec9c75 req-8605ec93-5587-4b32-ad41-7a4bf532d91b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:45.627134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67df1877-d701-4d53-9800-8ea1a1ec9c75 req-8605ec93-5587-4b32-ad41-7a4bf532d91b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:45.627658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67df1877-d701-4d53-9800-8ea1a1ec9c75 req-8605ec93-5587-4b32-ad41-7a4bf532d91b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:45.631667 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=86 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:00:45.641237 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-67df1877-d701-4d53-9800-8ea1a1ec9c75 req-8605ec93-5587-4b32-ad41-7a4bf532d91b service nova] Creating event network-vif-unplugged:d07ad9bf-74b3-4d8a-8930-a28ff8205509 for instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a on n-h1-master-1 Sep 18 02:00:45.647341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-67df1877-d701-4d53-9800-8ea1a1ec9c75 req-8605ec93-5587-4b32-ad41-7a4bf532d91b service nova] Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:00:45.659114 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-67df1877-d701-4d53-9800-8ea1a1ec9c75 req-8605ec93-5587-4b32-ad41-7a4bf532d91b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049385 Sep 18 02:00:45.659751 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3334/6645] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:00:46.352364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:46.352986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:46.359868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:46.360432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:46.360878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:46.361631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:46.362101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:46.362534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:46.502142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:46.510382 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-38f5e05d-87fe-4b79-b654-ce09a7d5fbca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1516 microversion: 2.1 time: 0.162621 Sep 18 02:00:46.510958 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3312/6646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:46 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:47.536117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:47.536828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:47.543075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:47.543561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:47.544005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:47.544697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:47.545161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:47.545619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:47.681597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-937ba057-766b-4ec8-a88e-ce272e9db261 req-694dbea1-cba5-4897-b9fb-41dde54742a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3809d1-9d03-4449-80f1-77b3f56dba9a", "tag": "d07ad9bf-74b3-4d8a-8930-a28ff8205509"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:47.693728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-937ba057-766b-4ec8-a88e-ce272e9db261 req-694dbea1-cba5-4897-b9fb-41dde54742a1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:47.694216 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-937ba057-766b-4ec8-a88e-ce272e9db261 req-694dbea1-cba5-4897-b9fb-41dde54742a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:47.694648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-937ba057-766b-4ec8-a88e-ce272e9db261 req-694dbea1-cba5-4897-b9fb-41dde54742a1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:47.698782 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:47.706708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-937ba057-766b-4ec8-a88e-ce272e9db261 req-694dbea1-cba5-4897-b9fb-41dde54742a1 service nova] Creating event network-changed:d07ad9bf-74b3-4d8a-8930-a28ff8205509 for instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a on n-h1-master-1 Sep 18 02:00:47.707575 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a54e3e92-a7c5-4ab0-a063-9844b946cf2f tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1514 microversion: 2.1 time: 0.177088 Sep 18 02:00:47.708368 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3335/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:47 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:47.712694 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-937ba057-766b-4ec8-a88e-ce272e9db261 req-694dbea1-cba5-4897-b9fb-41dde54742a1 service nova] Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:00:47.724858 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-937ba057-766b-4ec8-a88e-ce272e9db261 req-694dbea1-cba5-4897-b9fb-41dde54742a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048774 Sep 18 02:00:47.725768 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3313/6648] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:00:48.736851 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:48.737402 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:48.746361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:48.747292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:48.747948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:48.748621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:48.749137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:48.749815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:48.911529 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:48.922251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-247737ba-d280-446d-ade8-d3dc2918e910 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1511 microversion: 2.1 time: 0.189547 Sep 18 02:00:48.937618 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3336/6649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:48 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:48.946118 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:48.946691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:48.953010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:48.953506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:48.953974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:48.954680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:48.955153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:48.955582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:48.983875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:00:49.035707 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Found an unconfirmed migration during delete, id: 16, status: finished Sep 18 02:00:50.484645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b3450ace-f566-49be-9633-fd1a3dc6a32f req-cbeae419-86a5-4682-bc02-70243a4f45be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3809d1-9d03-4449-80f1-77b3f56dba9a", "name": "network-vif-plugged", "status": "completed", "tag": "d07ad9bf-74b3-4d8a-8930-a28ff8205509"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:50.495701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b3450ace-f566-49be-9633-fd1a3dc6a32f req-cbeae419-86a5-4682-bc02-70243a4f45be service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:50.496376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b3450ace-f566-49be-9633-fd1a3dc6a32f req-cbeae419-86a5-4682-bc02-70243a4f45be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:50.497094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b3450ace-f566-49be-9633-fd1a3dc6a32f req-cbeae419-86a5-4682-bc02-70243a4f45be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:50.510617 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b3450ace-f566-49be-9633-fd1a3dc6a32f req-cbeae419-86a5-4682-bc02-70243a4f45be service nova] Creating event network-vif-plugged:d07ad9bf-74b3-4d8a-8930-a28ff8205509 for instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a on n-h1-master-1 Sep 18 02:00:50.516733 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b3450ace-f566-49be-9633-fd1a3dc6a32f req-cbeae419-86a5-4682-bc02-70243a4f45be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035936 Sep 18 02:00:50.518039 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3337/6650] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:00:50.628299 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6efc1939-8514-4bba-beaa-6d919c2cdf23 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 204 len: 0 microversion: 2.1 time: 1.686525 Sep 18 02:00:50.630233 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3314/6651] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:00:48 2022] DELETE /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 0 bytes in 1690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 02:00:50.639877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:50.640574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:50.647616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:50.648034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:50.648470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:50.649154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:50.649633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:50.650054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:50.779831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:50.787641 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-573b0b33-b78c-4f78-8f07-69a5e539baca tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1503 microversion: 2.1 time: 0.152347 Sep 18 02:00:50.788212 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3338/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:50 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:51.811158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:51.811878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:51.818953 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:51.819447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:51.819891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:51.820597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:51.821062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:51.821488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:51.976699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:51.984647 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f79c0c0d-43a1-4eee-b026-77f76401ef38 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1503 microversion: 2.1 time: 0.177825 Sep 18 02:00:51.985595 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3315/6653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:51 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:52.515614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ea6348d7-40a4-4005-a078-fbbefe299fcf req-7bcc0559-1448-46a1-8a1c-00990183176e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3809d1-9d03-4449-80f1-77b3f56dba9a", "name": "network-vif-deleted", "tag": "d07ad9bf-74b3-4d8a-8930-a28ff8205509"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:00:52.528878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ea6348d7-40a4-4005-a078-fbbefe299fcf req-7bcc0559-1448-46a1-8a1c-00990183176e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:52.536541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ea6348d7-40a4-4005-a078-fbbefe299fcf req-7bcc0559-1448-46a1-8a1c-00990183176e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:52.537056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ea6348d7-40a4-4005-a078-fbbefe299fcf req-7bcc0559-1448-46a1-8a1c-00990183176e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:52.550436 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ea6348d7-40a4-4005-a078-fbbefe299fcf req-7bcc0559-1448-46a1-8a1c-00990183176e service nova] Creating event network-vif-deleted:d07ad9bf-74b3-4d8a-8930-a28ff8205509 for instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a on n-h1-master-1 Sep 18 02:00:52.556483 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ea6348d7-40a4-4005-a078-fbbefe299fcf req-7bcc0559-1448-46a1-8a1c-00990183176e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044982 Sep 18 02:00:52.557152 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3339/6654] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:00:53.008309 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:53.008978 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:53.016831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:53.017327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:53.017828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:53.018763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:53.019260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:53.019692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:53.051976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:53.052470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:53.052914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:53.053370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lazy-loading 'fault' on Instance uuid 9c3809d1-9d03-4449-80f1-77b3f56dba9a {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:00:53.101304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a356f3c9a354a288428d50cc266c3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867a2f7d362542f699a8043633e6f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:00:53.109327 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-830c6ab1-4104-4e5d-9dae-77597b2b8d49 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 200 len: 1305 microversion: 2.1 time: 0.105726 Sep 18 02:00:53.109914 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3316/6655] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:53 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:00:54.135948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:54.136562 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:54.143052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:54.143537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:54.143969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:54.144660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:54.145108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:54.145531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:54.158801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] HTTP exception thrown: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Request method failure captured: Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a HTTP/1.1 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnulqhwzeckXkxSCf7d3DdtK-zoG0Pp8JULKMI0FOo_ppe2j6_MMeYq2gJKx8P0getsjx2EsHZZg74KS7z4jKU2IY5r1e8LCbyXY8C0VKRKKeND5UiP8NgJ6yntQqN5MyWk6XpPpWs1XwtSdHbECXButFsmMpcujj28g1EhR8MLHeds Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 867a2f7d362542f699a8043633e6f991 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/867a2f7d362542f699a8043633e6f991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/867a2f7d362542f699a8043633e6f991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_867a2f7d362542f699a8043633e6f991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/867a2f7d362542f699a8043633e6f991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 867a2f7d362542f699a8043633e6f991 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1579991495-project Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9a356f3c9a354a288428d50cc266c3fe Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1579991495-project Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '9c3809d1-9d03-4449-80f1-77b3f56dba9a'} Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:00:54.160437 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Returning 404 to user: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-272b06f5-41f2-44b0-9136-efb4708ac62a tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 404 len: 111 microversion: 2.1 time: 0.032605 Sep 18 02:00:54.165669 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3340/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:54 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:00:54.178766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:54.179306 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:54.186279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:54.186800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:54.187247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:54.187969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:54.188440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:54.188917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:54.202863 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] HTTP exception thrown: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Request method failure captured: Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a HTTP/1.1 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnulqhwzeckXkxSCf7d3DdtK-zoG0Pp8JULKMI0FOo_ppe2j6_MMeYq2gJKx8P0getsjx2EsHZZg74KS7z4jKU2IY5r1e8LCbyXY8C0VKRKKeND5UiP8NgJ6yntQqN5MyWk6XpPpWs1XwtSdHbECXButFsmMpcujj28g1EhR8MLHeds Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 867a2f7d362542f699a8043633e6f991 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/867a2f7d362542f699a8043633e6f991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/867a2f7d362542f699a8043633e6f991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_867a2f7d362542f699a8043633e6f991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/867a2f7d362542f699a8043633e6f991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 867a2f7d362542f699a8043633e6f991 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-DeleteServersTestJSON-1579991495-project Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 9a356f3c9a354a288428d50cc266c3fe Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-DeleteServersTestJSON-1579991495-project Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '9c3809d1-9d03-4449-80f1-77b3f56dba9a'} Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:00:54.204512 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Returning 404 to user: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91143432-8d0c-41d7-becb-144d3a4c5bcb tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 404 len: 111 microversion: 2.1 time: 0.031641 Sep 18 02:00:54.208698 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3317/6657] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:00:54 2022] DELETE /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:00:54.214743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:00:54.215352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] [instance: 9c3809d1-9d03-4449-80f1-77b3f56dba9a] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:00:54.221360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:54.221870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:54.222304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:54.222991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:00:54.223443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:00:54.224375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:00:54.238851 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] HTTP exception thrown: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Request method failure captured: Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a HTTP/1.1 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnulqhwzeckXkxSCf7d3DdtK-zoG0Pp8JULKMI0FOo_ppe2j6_MMeYq2gJKx8P0getsjx2EsHZZg74KS7z4jKU2IY5r1e8LCbyXY8C0VKRKKeND5UiP8NgJ6yntQqN5MyWk6XpPpWs1XwtSdHbECXButFsmMpcujj28g1EhR8MLHeds Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 867a2f7d362542f699a8043633e6f991 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/867a2f7d362542f699a8043633e6f991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/867a2f7d362542f699a8043633e6f991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_867a2f7d362542f699a8043633e6f991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/867a2f7d362542f699a8043633e6f991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 867a2f7d362542f699a8043633e6f991 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-DeleteServersTestJSON-1579991495 Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-DeleteServersTestJSON-1579991495-project Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 9a356f3c9a354a288428d50cc266c3fe Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-DeleteServersTestJSON-1579991495-project Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '9c3809d1-9d03-4449-80f1-77b3f56dba9a'} Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:00:54.240940 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] Returning 404 to user: Instance 9c3809d1-9d03-4449-80f1-77b3f56dba9a could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6936f226-7fc5-40b9-b352-59a8a7a992b4 tempest-DeleteServersTestJSON-1579991495 tempest-DeleteServersTestJSON-1579991495-project] 10.222.0.25 "GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a" status: 404 len: 111 microversion: 2.1 time: 0.031627 Sep 18 02:00:54.245302 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3341/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:00:54 2022] GET /compute/v2.1/servers/9c3809d1-9d03-4449-80f1-77b3f56dba9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:01:03.166880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-62164373", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "f208bd86-bbc8-46fe-8f93-ba233e217d56"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:03.222933 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] validate_networks() for [('f208bd86-bbc8-46fe-8f93-ba233e217d56', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:01:03.678126 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:01:03.678567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:01:03.679086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:01:03.679690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:01:03.680322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:01:03.690084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:03.690597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:03.691053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:03.691843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:03.692865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:03.693317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:03.714526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Getting quotas for project 41e4f6d463f8414591329deb362fd1f0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:01:03.720947 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Getting quotas for user faf71794af87483588ac3c7ca441afdd and project 41e4f6d463f8414591329deb362fd1f0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:01:03.737022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:01:03.740449 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:01:03.794380 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-87d91496-9ba4-461b-9fbb-ee0d06319325 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802444 Sep 18 02:01:03.795353 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3318/6659] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:01:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:01:03.807262 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82b5d4e1-abef-4db6-b292-1ab717ae4e65 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:03.808511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82b5d4e1-abef-4db6-b292-1ab717ae4e65 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:03.896634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-82b5d4e1-abef-4db6-b292-1ab717ae4e65 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:03.905257 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82b5d4e1-abef-4db6-b292-1ab717ae4e65 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1216 microversion: 2.1 time: 0.102256 Sep 18 02:01:03.907628 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3342/6660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:03 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:04.929789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:04.930356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:04.938063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:04.938563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:04.939005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:04.939711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:04.940173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:04.940601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:05.010162 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:05.033844 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c5e77162-2e5a-4918-8fea-a1d948e664b0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1268 microversion: 2.1 time: 0.107417 Sep 18 02:01:05.035174 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3319/6661] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:04 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1268 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:06.075005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:06.075627 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:06.078977 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=29 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:06.085660 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:06.086266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:06.086781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:06.087576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:06.088106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:06.088794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:06.314800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:06.326479 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-36731dde-0a0e-4438-b6c0-d046cecca1e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1316 microversion: 2.1 time: 0.256064 Sep 18 02:01:06.327077 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3343/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:06 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:06.668440 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4d1e8a90-c7b0-40d8-93cb-0742dd5c9354 req-1d9440fb-2a7b-4b9f-ac07-c3ddf6b5e38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72e9541-6c82-4f28-a1d9-c23f55b66081", "tag": "8ba66941-b949-42fb-8921-86a3cbf17d7c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:06.680719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4d1e8a90-c7b0-40d8-93cb-0742dd5c9354 req-1d9440fb-2a7b-4b9f-ac07-c3ddf6b5e38b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:06.681123 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4d1e8a90-c7b0-40d8-93cb-0742dd5c9354 req-1d9440fb-2a7b-4b9f-ac07-c3ddf6b5e38b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:06.681889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4d1e8a90-c7b0-40d8-93cb-0742dd5c9354 req-1d9440fb-2a7b-4b9f-ac07-c3ddf6b5e38b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:06.694031 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4d1e8a90-c7b0-40d8-93cb-0742dd5c9354 req-1d9440fb-2a7b-4b9f-ac07-c3ddf6b5e38b service nova] Creating event network-changed:8ba66941-b949-42fb-8921-86a3cbf17d7c for instance e72e9541-6c82-4f28-a1d9-c23f55b66081 on n-h2-master-1 Sep 18 02:01:06.699242 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4d1e8a90-c7b0-40d8-93cb-0742dd5c9354 req-1d9440fb-2a7b-4b9f-ac07-c3ddf6b5e38b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034880 Sep 18 02:01:06.700140 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3320/6663] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:01:07.349610 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:07.350242 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:07.357328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:07.357852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:07.358301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:07.358997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:07.359456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:07.359887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:07.497648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:07.506955 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b0b87da-f108-4e96-9889-e7318a2202e2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1316 microversion: 2.1 time: 0.161218 Sep 18 02:01:07.507578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3344/6664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:07 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:08.533183 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:08.533924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:08.541000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:08.541513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:08.541996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:08.542725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:08.543201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:08.543646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:08.684532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:08.692891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c5c09b7f-51a9-4a0f-bd78-28595369d563 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1316 microversion: 2.1 time: 0.165160 Sep 18 02:01:08.693537 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3321/6665] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:08 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:09.715733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:09.716351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:09.724062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:09.724553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:09.724989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:09.725747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:09.726202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:09.726615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:09.858338 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:09.866117 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2c0b939-b303-43a2-b08a-06d3ae998542 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1316 microversion: 2.1 time: 0.154325 Sep 18 02:01:09.866721 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3345/6666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:09 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:10.889914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:10.890543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:10.898026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:10.898527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:10.899002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:10.899720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:10.900183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:10.900619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:11.045515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:11.054087 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3bd7f842-639c-48eb-9209-ad431040c52d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1316 microversion: 2.1 time: 0.168359 Sep 18 02:01:11.054678 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3322/6667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:10 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:12.077178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:12.077848 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:12.084608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:12.085086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:12.085525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:12.086240 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:12.086726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:12.087152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:12.218649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:12.227378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fa8c42f-539e-4734-8c62-36fcbd680832 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1316 microversion: 2.1 time: 0.154314 Sep 18 02:01:12.227956 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3346/6668] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:12 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:12.519403 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-6630eae9-8c5a-4a04-a4f6-c4e9fbbd0bf8 req-9cf4ef57-abc8-499c-b859-aee111cd27d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72e9541-6c82-4f28-a1d9-c23f55b66081", "name": "network-vif-plugged", "status": "completed", "tag": "8ba66941-b949-42fb-8921-86a3cbf17d7c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:12.532118 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6630eae9-8c5a-4a04-a4f6-c4e9fbbd0bf8 req-9cf4ef57-abc8-499c-b859-aee111cd27d2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:12.532621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6630eae9-8c5a-4a04-a4f6-c4e9fbbd0bf8 req-9cf4ef57-abc8-499c-b859-aee111cd27d2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:12.533069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6630eae9-8c5a-4a04-a4f6-c4e9fbbd0bf8 req-9cf4ef57-abc8-499c-b859-aee111cd27d2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:12.544586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-6630eae9-8c5a-4a04-a4f6-c4e9fbbd0bf8 req-9cf4ef57-abc8-499c-b859-aee111cd27d2 service nova] Creating event network-vif-plugged:8ba66941-b949-42fb-8921-86a3cbf17d7c for instance e72e9541-6c82-4f28-a1d9-c23f55b66081 on n-h2-master-1 Sep 18 02:01:12.549856 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-6630eae9-8c5a-4a04-a4f6-c4e9fbbd0bf8 req-9cf4ef57-abc8-499c-b859-aee111cd27d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 Sep 18 02:01:12.550428 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3323/6669] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:01:13.251433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:13.252239 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:13.259704 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:13.260193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:13.260668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:13.261468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:13.262170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:13.262752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:13.397633 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:13.405914 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac62de63-3efe-4235-be7a-0b51dfc671ee tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1316 microversion: 2.1 time: 0.158242 Sep 18 02:01:13.406436 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3347/6670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:13 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:14.426512 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:14.427308 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:14.431609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:14.432327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:14.439424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.439924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.440380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:14.441081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.441571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.442021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:14.584809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:14.592624 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f6772c0d-3d73-4a38-ba70-d978cd870bc2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1507 microversion: 2.1 time: 0.167977 Sep 18 02:01:14.593203 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3324/6671] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:14 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:14.614739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:14.615359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:14.617283 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:14.624287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.624900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.625344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:14.626069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.626781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.627244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:14.755975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:14.764086 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f95e4086-07e9-4a33-b261-c84c5d0f6b18 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1507 microversion: 2.1 time: 0.153273 Sep 18 02:01:14.764669 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3348/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:14 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:14.786553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:14.788871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:14.794912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.795413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.795864 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:14.796574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.797048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.797491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:14.859553 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2c2d6514-ff8d-4e3f-a3ad-95c8eb1e2dd4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "PUT /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1079 microversion: 2.1 time: 0.076928 Sep 18 02:01:14.860359 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3325/6673] 10.222.0.25 () {60 vars in 1256 bytes} [Sun Sep 18 02:01:14 2022] PUT /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1079 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:14.880305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:14.880923 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:14.887092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.887472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.888274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:14.889095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:14.889705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:14.890208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:15.023390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:15.031358 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-512d38ff-5c5f-49b9-8276-daf4dab97586 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1505 microversion: 2.1 time: 0.155669 Sep 18 02:01:15.031939 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3349/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:14 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:15.053694 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:15.054257 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:15.060308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:15.060812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:15.061266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:15.061995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:15.062470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:15.062910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:15.189474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:15.197786 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f9d7369-67e8-4616-8640-44a13bcb305c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1505 microversion: 2.1 time: 0.148666 Sep 18 02:01:15.198365 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3326/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:15 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:15.220403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:15.223308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:15.229225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:15.229756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:15.230190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:15.230879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:15.231328 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:15.231753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:15.263888 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:15.269514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:01:15.276076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:01:15.276492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:01:15.276960 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:01:15.277364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:01:15.277803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:01:15.345544 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b174fc1f-d5df-4a36-9f3e-7c829831dec1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "POST /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081/action" status: 202 len: 0 microversion: 2.1 time: 0.129268 Sep 18 02:01:15.346226 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3350/6676] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:01:15 2022] POST /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:01:15.354864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:15.355619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:15.357528 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:15.364402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:15.364922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:15.365408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:15.366170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:15.366679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:15.367133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:15.370710 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:15.503069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:15.511069 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5310b138-d386-4632-bff5-841a54f3d6b4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1516 microversion: 2.1 time: 0.160002 Sep 18 02:01:15.511729 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3327/6677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:15 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:16.535109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:16.535835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:16.537889 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=40 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:16.544341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:16.544834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:16.545278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:16.546069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:16.546474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:16.546903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:16.687803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:16.696407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d2abba8-8bb5-4755-89e4-7d4e470a0609 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1516 microversion: 2.1 time: 0.166148 Sep 18 02:01:16.696993 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3351/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:16 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:17.719487 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:17.720120 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:17.727021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:17.727514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:17.727971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:17.728675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:17.729138 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:17.729593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:17.857815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:17.866407 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-52084aed-1eaf-4e6c-bc51-0e18d3579a76 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.151205 Sep 18 02:01:17.866985 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3328/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:17 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:18.890690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:18.891311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:18.899003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:18.899494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:18.899936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:18.900644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:18.901109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:18.901540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:19.037357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:19.045120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83a1b956-d9c1-4670-87d8-fd07d91937a7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.158687 Sep 18 02:01:19.045726 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3352/6680] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:18 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:20.068839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:20.069489 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:20.076266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:20.076753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:20.077225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:20.077946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:20.078411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:20.078842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:20.208730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:20.216513 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ca32989-6491-4006-8470-1e1406e4fd87 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.152167 Sep 18 02:01:20.217091 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3329/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:20 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:21.240723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:21.242141 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:21.248958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:21.249439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:21.249908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:21.250591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:21.251045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:21.251466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:21.385857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:21.393811 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aaf42392-7dae-44db-9fbf-b2f1c6c700da tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.157357 Sep 18 02:01:21.394386 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3353/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:21 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:22.416374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:22.417035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:22.423925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:22.424425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:22.424878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:22.425603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:22.426957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:22.429336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:22.557064 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:22.564987 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-14345ffa-82e2-4137-add1-20e244cfecfb tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.152526 Sep 18 02:01:22.565603 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3330/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:22 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:23.588858 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:23.589495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:23.597025 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:23.597523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:23.597991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:23.598679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:23.599134 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:23.599558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:23.731546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:23.739212 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a7296d1f-4cfe-4301-aec1-a2ad62ab33b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.154347 Sep 18 02:01:23.739782 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3354/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:23 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:24.763205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:24.763831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:24.771250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:24.771759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:24.772213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:24.772936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:24.773410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:24.773880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:24.911384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:24.919377 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5ca84547-de33-4dfd-8eee-3c23f46199b3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.160331 Sep 18 02:01:24.919977 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3331/6685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:24 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:25.943405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:25.944020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:25.950893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:25.951375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:25.951808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:25.952523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:25.952956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:25.953381 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:26.084021 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:26.091842 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e4920b2d-ada9-4c81-8cfc-07ef24fdaaa3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.152427 Sep 18 02:01:26.092424 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3355/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:25 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:27.116753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:27.117376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:27.126200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:27.126651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:27.127096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:27.127796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:27.128257 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:27.129359 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:27.261943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:27.270533 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1c83d299-ccb4-477d-baf4-227ac2849275 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.158436 Sep 18 02:01:27.271113 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3332/6687] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:27 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:28.294188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:28.294873 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:28.301682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:28.302133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:28.302576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:28.303308 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:28.303768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:28.304189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:28.435684 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:28.444242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-97c3ab23-b213-416b-9c29-fed07b773dc8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.154037 Sep 18 02:01:28.444832 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3356/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:28 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:29.467159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:29.467781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:29.475774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:29.476290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:29.476746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:29.477480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:29.478010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:29.478457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:29.611277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:29.619655 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eb60c9ea-6d75-473d-adc8-6aabf521965d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.156470 Sep 18 02:01:29.620232 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3333/6689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:29 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:30.642188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:30.642811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:30.649734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:30.650222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:30.650662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:30.651359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:30.651815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:30.652246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:30.783844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:30.791636 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9274906-54fe-4b71-91fc-ae1eb7fd9be5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.153757 Sep 18 02:01:30.792208 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3357/6690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:30 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:31.815562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:31.819855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:31.825845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:31.826344 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:31.826795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:31.827506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:31.827976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:31.828413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:31.973707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:31.981481 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5cae5a1d-2ff4-450c-942c-666b3fcdaf53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.170050 Sep 18 02:01:31.982090 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3334/6691] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:31 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:33.005892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:33.006503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:33.013667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:33.014148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:33.014583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:33.015273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:33.015722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:33.016146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:33.020808 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:33.155439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:33.164093 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fa67ed73-5e6c-4882-a41f-f30c2f89791e tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.162221 Sep 18 02:01:33.164665 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3358/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:33 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:34.187553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:34.188122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:34.195695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:34.196194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:34.196636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:34.197352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:34.197844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:34.198277 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:34.344362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:34.352438 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b8f98704-6316-4701-8ee2-055c5cb003a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.168857 Sep 18 02:01:34.353020 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3335/6693] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:34 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:35.376203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:35.376839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:35.383731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:35.384210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:35.384641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:35.385326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:35.385797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:35.386218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:35.522082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:35.529780 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e9938da6-57cc-466b-b14c-d87a7acef505 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.157452 Sep 18 02:01:35.530363 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3359/6694] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:35 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:36.553492 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:36.554121 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:36.561167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:36.561695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:36.562142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:36.562839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:36.563298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:36.563768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:36.698124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:36.705842 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ffb6b867-75bb-4007-bea8-344cf75dc1ad tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.156858 Sep 18 02:01:36.706921 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3336/6695] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:36 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:37.729420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:37.730163 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:37.736939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:37.737417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:37.737885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:37.738572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:37.739022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:37.739443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:37.869818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:37.877840 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c69cf52-3745-4d57-8f69-19443820a320 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.152287 Sep 18 02:01:37.879067 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3360/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:37 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:38.903319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:38.903938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:38.911342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:38.911832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:38.912278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:38.912978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:38.913440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:38.913907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:39.046072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:39.053925 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f401dcc0-287a-4e6e-91ac-e66b9f6d7349 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.154546 Sep 18 02:01:39.054498 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3337/6697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:38 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:40.076648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:40.077265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:40.084804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:40.085290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:40.085752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:40.086445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:40.086897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:40.087322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:40.215773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:40.223652 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-29646018-eca7-43ab-bdbd-e74e9f231bbc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.150950 Sep 18 02:01:40.224230 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3361/6698] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:40 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:41.248014 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:41.248569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:41.255151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:41.255630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:41.256079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:41.256772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:41.257255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:41.257695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:41.399165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:41.407235 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8852f47c-8a2e-4c87-bb59-2a0c6f4be68d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.163314 Sep 18 02:01:41.407820 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3338/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:41 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:42.431962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:42.432571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:42.438767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:42.439245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:42.439684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:42.440379 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:42.440830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:42.441255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:42.578514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:42.587026 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a4263855-4309-449c-9535-c8f1020be628 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.159154 Sep 18 02:01:42.587630 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3362/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:42 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:43.621296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:43.621957 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:43.629472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:43.629987 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:43.630429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:43.631129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:43.631590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:43.632023 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:43.766256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:43.774091 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98b19080-ff04-4fd7-9761-8a9a7ec498ec tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1521 microversion: 2.1 time: 0.156627 Sep 18 02:01:43.774668 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3339/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:43 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:44.797942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:44.798648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:44.805510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:44.806035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:44.806473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:44.807264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:44.808020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:44.808840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:44.957204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:44.965298 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bea30bd4-6055-4bd4-b40b-d8abbbf0b13b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1520 microversion: 2.1 time: 0.171443 Sep 18 02:01:44.966041 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3363/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:44 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:45.071207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a4da0290-a3b1-47fa-8b52-e7c89716022e req-014a2230-eb1e-4b75-ac43-b7554fdfbea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72e9541-6c82-4f28-a1d9-c23f55b66081", "name": "network-vif-unplugged", "status": "completed", "tag": "8ba66941-b949-42fb-8921-86a3cbf17d7c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:45.082829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a4da0290-a3b1-47fa-8b52-e7c89716022e req-014a2230-eb1e-4b75-ac43-b7554fdfbea4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:45.083689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a4da0290-a3b1-47fa-8b52-e7c89716022e req-014a2230-eb1e-4b75-ac43-b7554fdfbea4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:45.084461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a4da0290-a3b1-47fa-8b52-e7c89716022e req-014a2230-eb1e-4b75-ac43-b7554fdfbea4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:45.098364 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a4da0290-a3b1-47fa-8b52-e7c89716022e req-014a2230-eb1e-4b75-ac43-b7554fdfbea4 service nova] Creating event network-vif-unplugged:8ba66941-b949-42fb-8921-86a3cbf17d7c for instance e72e9541-6c82-4f28-a1d9-c23f55b66081 on n-h1-master-1 Sep 18 02:01:45.104279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-a4da0290-a3b1-47fa-8b52-e7c89716022e req-014a2230-eb1e-4b75-ac43-b7554fdfbea4 service nova] Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:01:45.118693 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a4da0290-a3b1-47fa-8b52-e7c89716022e req-014a2230-eb1e-4b75-ac43-b7554fdfbea4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051827 Sep 18 02:01:45.119494 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3340/6703] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:01:45.989793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:45.990416 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:45.998014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:45.998508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:45.998954 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:45.999654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:46.000116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:46.000547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:46.135382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:46.144114 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e15a4202-e165-4d04-a8f5-d63fbffeb62c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1518 microversion: 2.1 time: 0.159372 Sep 18 02:01:46.144681 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3364/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:45 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:47.149815 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-57a1acce-e2b8-44a2-9ba3-a9553ce75ad9 req-478b36d5-3718-4739-a9d8-9fbbcf3313ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72e9541-6c82-4f28-a1d9-c23f55b66081", "tag": "8ba66941-b949-42fb-8921-86a3cbf17d7c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:47.154612 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=28 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:47.160406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-57a1acce-e2b8-44a2-9ba3-a9553ce75ad9 req-478b36d5-3718-4739-a9d8-9fbbcf3313ce service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:47.160893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-57a1acce-e2b8-44a2-9ba3-a9553ce75ad9 req-478b36d5-3718-4739-a9d8-9fbbcf3313ce service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:47.161334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-57a1acce-e2b8-44a2-9ba3-a9553ce75ad9 req-478b36d5-3718-4739-a9d8-9fbbcf3313ce service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:47.165857 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=82 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:47.168122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:47.168746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:47.171457 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=28 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:47.173589 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-57a1acce-e2b8-44a2-9ba3-a9553ce75ad9 req-478b36d5-3718-4739-a9d8-9fbbcf3313ce service nova] Creating event network-changed:8ba66941-b949-42fb-8921-86a3cbf17d7c for instance e72e9541-6c82-4f28-a1d9-c23f55b66081 on n-h1-master-1 Sep 18 02:01:47.177320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:47.177838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:47.178285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:47.178984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:47.179445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:47.179547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-57a1acce-e2b8-44a2-9ba3-a9553ce75ad9 req-478b36d5-3718-4739-a9d8-9fbbcf3313ce service nova] Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:01:47.179874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:47.192077 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-57a1acce-e2b8-44a2-9ba3-a9553ce75ad9 req-478b36d5-3718-4739-a9d8-9fbbcf3313ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047313 Sep 18 02:01:47.192723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3341/6705] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:01:47.320927 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:47.328888 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-77723ee3-745e-4680-8c30-5462f732e3d2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1518 microversion: 2.1 time: 0.164677 Sep 18 02:01:47.329482 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3365/6706] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:47 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:01:48.353516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:48.354245 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:48.360377 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:48.360867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:48.361311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:48.362102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:48.362602 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:48.363040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:48.498828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:48.507385 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca7e0e21-4fa2-4aff-a183-0395bba6b1c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1515 microversion: 2.1 time: 0.158931 Sep 18 02:01:48.507971 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3342/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:48 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:48.530363 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:48.530906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:48.537856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:48.538343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:48.538781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:48.539473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:48.539929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:48.540355 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:48.598157 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-03b5c257-1ee0-42f0-a0bc-c1939bb502b9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "POST /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081/action" status: 204 len: 0 microversion: 2.1 time: 0.071433 Sep 18 02:01:48.598818 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3366/6708] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:01:48 2022] POST /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:01:48.607174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:48.607899 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:48.615250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:48.615744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:48.616199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:48.616917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:48.617394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:48.617848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:48.773344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:48.781175 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9603bc8e-0b03-4962-9716-9ecc695e1695 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1515 microversion: 2.1 time: 0.177948 Sep 18 02:01:48.781773 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3343/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:48 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:49.807211 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:49.807920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:49.814256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:49.814770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:49.815213 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:49.816454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:49.816916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:49.817346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:49.963001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:49.970890 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b06e77d8-7582-4751-8704-169ca01cdb20 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1515 microversion: 2.1 time: 0.169350 Sep 18 02:01:49.971460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3367/6710] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:49 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:50.814822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-cab220d7-62f6-4fe9-813e-a5b9f2cffc17 req-050719e3-4482-4390-b512-1fd5de0f8e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72e9541-6c82-4f28-a1d9-c23f55b66081", "name": "network-vif-plugged", "status": "completed", "tag": "8ba66941-b949-42fb-8921-86a3cbf17d7c"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:50.825910 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cab220d7-62f6-4fe9-813e-a5b9f2cffc17 req-050719e3-4482-4390-b512-1fd5de0f8e6d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:50.826448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cab220d7-62f6-4fe9-813e-a5b9f2cffc17 req-050719e3-4482-4390-b512-1fd5de0f8e6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:50.826856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-cab220d7-62f6-4fe9-813e-a5b9f2cffc17 req-050719e3-4482-4390-b512-1fd5de0f8e6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:50.839167 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-cab220d7-62f6-4fe9-813e-a5b9f2cffc17 req-050719e3-4482-4390-b512-1fd5de0f8e6d service nova] Creating event network-vif-plugged:8ba66941-b949-42fb-8921-86a3cbf17d7c for instance e72e9541-6c82-4f28-a1d9-c23f55b66081 on n-h1-master-1 Sep 18 02:01:50.844182 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-cab220d7-62f6-4fe9-813e-a5b9f2cffc17 req-050719e3-4482-4390-b512-1fd5de0f8e6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Sep 18 02:01:50.844813 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3344/6711] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:01:50.994378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:50.994975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:51.001915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:51.002397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:51.003508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:51.004197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:51.004653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:51.005080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:51.141919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:51.150622 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-72f69adc-9b4a-4ebf-a1e7-70107d29cc08 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1507 microversion: 2.1 time: 0.160297 Sep 18 02:01:51.151212 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3368/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:50 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:51.173390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:51.174240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:51.181133 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:51.181780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:51.182294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:51.183078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:51.183613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:51.184112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:51.322296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:51.330155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-62a5c453-0def-4b0a-9e2b-108492c0dd53 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1507 microversion: 2.1 time: 0.160981 Sep 18 02:01:51.330741 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3345/6713] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:51 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:51.355772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b425c06-d697-404b-8de4-8be1cc37f3bc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'create', calling method: .version_select at 0x7f7005f094c0>, body: {"keypair": {"name": "tempest-keypair-657236122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtn522tfydxioEWKxINsEEPSRc0hlXbLV35lb5QNLCqu4X/kUAxJpgFCWvVpBRdLq30H5eIkfT7rBuN6EBHBLwt+wzKZ/lpHIAAUJfix+UcLMW3/q+MDFutqnkL0Mwm4A=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:51.371835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-0b425c06-d697-404b-8de4-8be1cc37f3bc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Getting quotas for project 41e4f6d463f8414591329deb362fd1f0. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:01:51.376839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-0b425c06-d697-404b-8de4-8be1cc37f3bc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Getting quotas for user faf71794af87483588ac3c7ca441afdd and project 41e4f6d463f8414591329deb362fd1f0. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:01:51.401720 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b425c06-d697-404b-8de4-8be1cc37f3bc tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049747 Sep 18 02:01:51.402342 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3369/6714] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:01:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:01:52.965580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:52.966220 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:52.972935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:52.973430 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:52.973913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:52.974617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:52.975083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:52.975517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:53.106074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:53.114448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efe833ba-51b8-4805-8f16-f3f00f78aa51 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 200 len: 1507 microversion: 2.1 time: 0.153036 Sep 18 02:01:53.115027 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3346/6715] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:52 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:53.138473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:53.138991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:53.145705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:53.146194 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:53.146647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:53.147367 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:53.147823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:53.148254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:53.172512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:01:53.247649 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f4664de-ec8b-4679-b333-1da02194214d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 204 len: 0 microversion: 2.1 time: 0.113835 Sep 18 02:01:53.248698 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3370/6716] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:01:53 2022] DELETE /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:01:53.306700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1818349179", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "f208bd86-bbc8-46fe-8f93-ba233e217d56"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:53.359929 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] validate_networks() for [('f208bd86-bbc8-46fe-8f93-ba233e217d56', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:01:53.738452 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:01:53.738982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:01:53.739514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:01:53.739943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:01:53.740371 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:01:53.749253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:53.749791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:53.750244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:53.750988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:53.751458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:53.751898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:53.768971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Getting quotas for project 41e4f6d463f8414591329deb362fd1f0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:01:53.774405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Getting quotas for user faf71794af87483588ac3c7ca441afdd and project 41e4f6d463f8414591329deb362fd1f0. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:01:53.787248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:01:53.789610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:01:53.834522 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7e518a70-684f-44ef-bcef-55856180184a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531626 Sep 18 02:01:53.835099 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3347/6717] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:01:53.852698 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a044a386-4b64-48f9-8fc1-a22c658b213d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:53.853494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a044a386-4b64-48f9-8fc1-a22c658b213d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:53.911642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a044a386-4b64-48f9-8fc1-a22c658b213d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:53.918573 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a044a386-4b64-48f9-8fc1-a22c658b213d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1218 microversion: 2.1 time: 0.075886 Sep 18 02:01:53.925666 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3371/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:53 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:54.942156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:54.942880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:54.950209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:54.950812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:54.951335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:54.952124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:54.952685 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:54.953368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:55.021182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:55.032754 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5965b0e1-02d2-423c-bd31-310d6086d25c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1278 microversion: 2.1 time: 0.096174 Sep 18 02:01:55.033668 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3348/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:54 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:55.375513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e230a013-8a2a-4d07-b8bd-efe69264c3c0 req-841d7edd-e66e-4859-8374-387d78ac7608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72e9541-6c82-4f28-a1d9-c23f55b66081", "name": "network-vif-deleted", "tag": "8ba66941-b949-42fb-8921-86a3cbf17d7c"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:55.389299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e230a013-8a2a-4d07-b8bd-efe69264c3c0 req-841d7edd-e66e-4859-8374-387d78ac7608 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:55.389926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e230a013-8a2a-4d07-b8bd-efe69264c3c0 req-841d7edd-e66e-4859-8374-387d78ac7608 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:55.390386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e230a013-8a2a-4d07-b8bd-efe69264c3c0 req-841d7edd-e66e-4859-8374-387d78ac7608 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:55.401530 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e230a013-8a2a-4d07-b8bd-efe69264c3c0 req-841d7edd-e66e-4859-8374-387d78ac7608 service nova] Creating event network-vif-deleted:8ba66941-b949-42fb-8921-86a3cbf17d7c for instance e72e9541-6c82-4f28-a1d9-c23f55b66081 on n-h1-master-1 Sep 18 02:01:55.406402 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e230a013-8a2a-4d07-b8bd-efe69264c3c0 req-841d7edd-e66e-4859-8374-387d78ac7608 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034662 Sep 18 02:01:55.407426 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3372/6720] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:01:56.058550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:56.059204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:56.068059 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:56.068555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:56.069005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:56.069863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:56.070334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:56.070792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:56.214207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:56.222970 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7f4606b-90c0-44e9-9616-1ae2fb2fffe8 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1318 microversion: 2.1 time: 0.170394 Sep 18 02:01:56.223553 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3349/6721] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:56 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:57.247643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:57.248346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:57.255095 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:57.255579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:57.256017 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:57.256712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:57.257171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:57.257621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:57.392033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:57.400655 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-add5c80f-38b9-4758-b0fa-e561f9c40ca9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1318 microversion: 2.1 time: 0.158188 Sep 18 02:01:57.401230 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3373/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:57 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:57.421645 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c35e2152-e695-4df0-8439-68a29904cbb7 req-f522db1c-31c5-4bfd-a0fe-f7685a2aec7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbb8343-044b-48ab-bc2c-9e7303f8a34d", "tag": "c6fc2bf4-a264-4677-95c4-6b648ac17126"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:01:57.431870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c35e2152-e695-4df0-8439-68a29904cbb7 req-f522db1c-31c5-4bfd-a0fe-f7685a2aec7d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:57.432353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c35e2152-e695-4df0-8439-68a29904cbb7 req-f522db1c-31c5-4bfd-a0fe-f7685a2aec7d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:57.432787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c35e2152-e695-4df0-8439-68a29904cbb7 req-f522db1c-31c5-4bfd-a0fe-f7685a2aec7d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:57.443983 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c35e2152-e695-4df0-8439-68a29904cbb7 req-f522db1c-31c5-4bfd-a0fe-f7685a2aec7d service nova] Creating event network-changed:c6fc2bf4-a264-4677-95c4-6b648ac17126 for instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d on n-h2-master-1 Sep 18 02:01:57.448808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c35e2152-e695-4df0-8439-68a29904cbb7 req-f522db1c-31c5-4bfd-a0fe-f7685a2aec7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031025 Sep 18 02:01:57.449398 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3350/6723] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:01:58.423424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:58.424037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:58.431485 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:58.431966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:58.432421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:58.433107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:58.433568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:58.433992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:58.571344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:58.573839 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:01:58.583590 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6bbeca9-2760-4756-9d7d-dc5d21bc9772 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1318 microversion: 2.1 time: 0.163950 Sep 18 02:01:58.584384 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3374/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:58 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:01:59.609414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:01:59.610165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:01:59.616331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:59.616824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:59.617267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:59.617997 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:01:59.618462 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:01:59.618888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:01:59.748863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:01:59.757218 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b2d4398a-677d-4962-a19a-73c2d4076b2c tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1318 microversion: 2.1 time: 0.152875 Sep 18 02:01:59.757833 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3351/6725] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:01:59 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:00.780953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:00.781500 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:00.790558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:00.791051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:00.791510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:00.792191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:00.792650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:00.793069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:00.931645 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:00.939407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-281f06cb-d937-4d34-919f-4dc9a2fbd5ae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1318 microversion: 2.1 time: 0.162939 Sep 18 02:02:00.940590 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3375/6726] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:00 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:01.963155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:01.963800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:01.970728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:01.971746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:01.972197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:01.972904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:01.973376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:01.973838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:02.107056 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:02.115332 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-43589fc5-f4e7-47a9-89d7-441bc131c1ef tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1318 microversion: 2.1 time: 0.156104 Sep 18 02:02:02.115909 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3352/6727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:01 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:02.616337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-78a80256-a62d-4761-8314-4584a44b7964 req-6b8dc4f7-337a-4de5-acd3-ec067008b4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbb8343-044b-48ab-bc2c-9e7303f8a34d", "name": "network-vif-plugged", "status": "completed", "tag": "c6fc2bf4-a264-4677-95c4-6b648ac17126"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:02.628966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-78a80256-a62d-4761-8314-4584a44b7964 req-6b8dc4f7-337a-4de5-acd3-ec067008b4d0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:02.629462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-78a80256-a62d-4761-8314-4584a44b7964 req-6b8dc4f7-337a-4de5-acd3-ec067008b4d0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:02.629929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-78a80256-a62d-4761-8314-4584a44b7964 req-6b8dc4f7-337a-4de5-acd3-ec067008b4d0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:02.642410 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-78a80256-a62d-4761-8314-4584a44b7964 req-6b8dc4f7-337a-4de5-acd3-ec067008b4d0 service nova] Creating event network-vif-plugged:c6fc2bf4-a264-4677-95c4-6b648ac17126 for instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d on n-h2-master-1 Sep 18 02:02:02.648478 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-78a80256-a62d-4761-8314-4584a44b7964 req-6b8dc4f7-337a-4de5-acd3-ec067008b4d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036030 Sep 18 02:02:02.649508 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3376/6728] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:02:03.138289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:03.138907 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:03.145792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:03.146294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:03.146752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:03.147472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:03.147935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:03.148373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:03.291654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:03.301367 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a699ceb6-f7c6-4292-b066-528bf8980144 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1318 microversion: 2.1 time: 0.167170 Sep 18 02:02:03.301976 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3353/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:03 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:04.324990 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:04.325716 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:04.328511 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:04.334901 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.335417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.335904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.336607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.337065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.337491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.482393 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:04.490238 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-898039b3-6671-4108-8aa9-0ad2be2d7268 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1508 microversion: 2.1 time: 0.169607 Sep 18 02:02:04.490818 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3377/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:04 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:04.512771 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:04.513406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:04.515446 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:04.516253 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:04.523195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.523696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.524147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.524858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.525334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.525809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.656695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:04.664661 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f5029b20-a203-4327-8766-207b159ad8cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1508 microversion: 2.1 time: 0.155982 Sep 18 02:02:04.665237 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3354/6731] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:04 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:04.687229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:04.689494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:04.696016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.696495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.696928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.697641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.698094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.698514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.727221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:04.732733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:02:04.739773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:02:04.740194 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:02:04.740669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:02:04.741078 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:02:04.741486 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:02:04.807493 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3fff0cf5-8ad5-486f-a5c2-b983397ed177 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "POST /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d/action" status: 202 len: 0 microversion: 2.1 time: 0.124228 Sep 18 02:02:04.808145 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3378/6732] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:02:04 2022] POST /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:02:04.816231 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:04.816857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:04.822847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.823375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.823827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.824540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:04.825007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:04.825441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:04.997670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:05.005667 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f771734c-5732-4f58-bd6b-c90db0e7d5cf tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1515 microversion: 2.1 time: 0.193307 Sep 18 02:02:05.006236 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3355/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:04 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:06.029707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:06.030477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:06.038509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:06.039090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:06.039556 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:06.040284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:06.040743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:06.041174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:06.182549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:06.191162 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5eaeeea0-5b06-4567-ab69-78f4854e7d25 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1515 microversion: 2.1 time: 0.166781 Sep 18 02:02:06.191762 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3379/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:06 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:02:07.217974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:07.218590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:07.227854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:07.228351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:07.228885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:07.229521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:07.230019 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:07.230454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:07.363959 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:07.371991 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9ba80b49-e2b2-4fa5-929d-c69f9614124a tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.161587 Sep 18 02:02:07.372624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3356/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:07 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:08.395666 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:08.396287 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:08.403109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:08.403594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:08.404030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:08.404719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:08.405170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:08.405620 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:08.542224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:08.550556 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af81af4d-fb99-410e-878e-714d43565288 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.158826 Sep 18 02:02:08.551143 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3380/6736] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:08 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:09.573598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:09.574218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:09.580924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:09.581415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:09.582006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:09.582591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:09.583050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:09.583484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:09.711968 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:09.719727 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e63337e2-6fa2-4885-9420-ee3d0ad41ffa tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.150060 Sep 18 02:02:09.720298 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3357/6737] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:09 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:10.743615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:10.744235 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:10.751191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:10.751681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:10.752125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:10.752823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:10.753293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:10.753832 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:10.889976 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:10.898741 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-747d97a0-97c8-46da-bfd7-a8323a9d9eae tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.159002 Sep 18 02:02:10.899348 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3381/6738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:10 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:11.922455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:11.923113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:11.929644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:11.930141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:11.930586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:11.931290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:11.931753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:11.932188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:12.059550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:12.067283 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47821a7c-5cb5-4752-b7dd-7f27598f7778 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.148916 Sep 18 02:02:12.067847 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3358/6739] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:11 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:13.090793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:13.091447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:13.098378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:13.098859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:13.099298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:13.100022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:13.100481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:13.100903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:13.235396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:13.243947 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-554220f8-e124-4eb9-a04d-449ea82549d3 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.157056 Sep 18 02:02:13.244529 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3382/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:13 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:14.267934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:14.268517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:14.275436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:14.275926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:14.276368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:14.277069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:14.277530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:14.277989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:14.411650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:14.419477 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f830d14b-a84b-4f75-ba40-ecb52555ac3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.155517 Sep 18 02:02:14.420050 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3359/6741] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:14 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:15.443372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:15.443985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:15.451115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:15.451594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:15.452028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:15.452719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:15.453175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:15.453622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:15.586718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:15.594551 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8279386a-8936-4fad-b1a3-c703969b8f2b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.155794 Sep 18 02:02:15.595125 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3383/6742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:15 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:16.617919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:16.618545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:16.625640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:16.626140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:16.626594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:16.627912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:16.628390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:16.628831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:16.631471 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:16.765928 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:16.774363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-75dcb345-f6c0-4b13-baff-3c65849688a2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.160546 Sep 18 02:02:16.774941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3360/6743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:16 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:17.797377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:17.798019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:17.801305 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:17.807515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:17.808022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:17.808453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:17.809140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:17.809619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:17.810041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:17.959381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:17.973013 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6063e68c-ec49-452b-a9af-993e05748204 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.179298 Sep 18 02:02:17.973606 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3384/6744] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:17 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:18.998047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:18.998675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:19.002299 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:02:19.002441 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d (ip 10.222.0.25) !!! Sep 18 02:02:19.003361 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:19.011014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:19.011514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:19.011966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:19.012951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:19.013421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:19.013890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:19.150809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:19.158654 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2919a6f6-50c5-4ad0-9151-a0ce518457f4 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.164568 Sep 18 02:02:19.159233 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3361/6745] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:18 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:20.181975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:20.182579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:20.190588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:20.191080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:20.191513 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:20.192219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:20.192672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:20.193099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:20.328213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:20.335983 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8203f802-4981-43fa-abd8-9115bcb860d5 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.158092 Sep 18 02:02:20.336566 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3385/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:20 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:21.360910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:21.361574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:21.368624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:21.369127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:21.369607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:21.370315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:21.370779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:21.371227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:21.505598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:21.513753 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1da60803-5acc-41c9-9ce5-51a214a51386 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.156728 Sep 18 02:02:21.514333 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3362/6747] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:21 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:22.537331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:22.538057 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:22.545102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:22.545651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:22.546096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:22.546821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:22.547277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:22.547702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:22.698071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:22.705796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-05b0140d-4b43-48d9-acb7-32a711670add tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.172386 Sep 18 02:02:22.706371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3386/6748] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:22 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:23.728443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:23.729069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:23.736003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:23.736501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:23.736952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:23.737684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:23.738157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:23.738628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:23.872179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:23.880991 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ca3050c-40a9-478f-819c-02f82f5990de tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.156376 Sep 18 02:02:23.881894 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3363/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:23 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:24.904683 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:24.905307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:24.912729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:24.913208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:24.913671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:24.914361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:24.914811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:24.915229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:25.054015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:25.061769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8360317b-f261-4e53-81e5-9e0d82187d06 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.161318 Sep 18 02:02:25.062394 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3387/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:24 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:26.086943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:26.087573 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:26.094728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:26.095159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:26.095614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:26.096329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:26.096800 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:26.097242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:26.235093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:26.243812 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-af3c9c56-e76d-43c1-ab43-999f7046f703 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.160947 Sep 18 02:02:26.244424 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3364/6751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:26 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:27.268269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:27.268879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:27.275838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:27.276324 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:27.276769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:27.277468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:27.277958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:27.278387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:27.412872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:27.420590 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-102b1fc6-ce50-4bbe-ba84-c48901880af2 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.156509 Sep 18 02:02:27.421171 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3388/6752] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:27 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:28.445085 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:28.445739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:28.452686 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:28.453188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:28.453664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:28.454364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:28.455338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:28.455778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:28.592447 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:28.601115 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-73bff2b0-c405-4211-9320-c2bb85dc3267 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.160310 Sep 18 02:02:28.601720 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3365/6753] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:28 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:02:29.624398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:29.625013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:29.632589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:29.633079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:29.633524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:29.634263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:29.634724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:29.635158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:29.766243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:29.774748 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-00c568e3-87d2-46e7-84d6-e2d568f4c6f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.154358 Sep 18 02:02:29.775329 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3389/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:29 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:30.797954 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:30.798515 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:30.805269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:30.805796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:30.806248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:30.806971 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:30.807438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:30.807875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:30.943181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:30.950854 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3d4abe6-dbd4-422c-bb84-c1c0276c0659 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.157009 Sep 18 02:02:30.951430 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3366/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:30 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:31.974817 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:31.975438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:31.982488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:31.982973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:31.983408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:31.984107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:31.984557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:31.984985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:31.988485 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:32.141905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:32.151192 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4ab97d87-3a66-4ed2-a97d-4f86d1ebf577 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.180258 Sep 18 02:02:32.151823 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3390/6756] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:31 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:02:33.174676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:33.175224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:33.182183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:33.182681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:33.183148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:33.183854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:33.184317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:33.184750 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:33.326355 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:33.335352 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bdc4a003-3215-4acf-b097-6b89f385b8f9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1520 microversion: 2.1 time: 0.164637 Sep 18 02:02:33.335945 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3367/6757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:33 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:34.122504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b6cdbffd-0e83-4b16-be35-18b129014368 req-a99fe243-baa1-4ea7-9e4a-3ed7e03304e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbb8343-044b-48ab-bc2c-9e7303f8a34d", "name": "network-vif-unplugged", "status": "completed", "tag": "c6fc2bf4-a264-4677-95c4-6b648ac17126"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:34.134214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b6cdbffd-0e83-4b16-be35-18b129014368 req-a99fe243-baa1-4ea7-9e4a-3ed7e03304e3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:34.134691 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b6cdbffd-0e83-4b16-be35-18b129014368 req-a99fe243-baa1-4ea7-9e4a-3ed7e03304e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:34.135130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b6cdbffd-0e83-4b16-be35-18b129014368 req-a99fe243-baa1-4ea7-9e4a-3ed7e03304e3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:34.147747 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b6cdbffd-0e83-4b16-be35-18b129014368 req-a99fe243-baa1-4ea7-9e4a-3ed7e03304e3 service nova] Creating event network-vif-unplugged:c6fc2bf4-a264-4677-95c4-6b648ac17126 for instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d on n-h1-master-1 Sep 18 02:02:34.153096 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-b6cdbffd-0e83-4b16-be35-18b129014368 req-a99fe243-baa1-4ea7-9e4a-3ed7e03304e3 service nova] Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:02:34.164447 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b6cdbffd-0e83-4b16-be35-18b129014368 req-a99fe243-baa1-4ea7-9e4a-3ed7e03304e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045849 Sep 18 02:02:34.165078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3391/6758] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:02:34.358581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:34.359201 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:34.367045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:34.367471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:34.367919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:34.368628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:34.369096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:34.369529 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:34.774817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:34.783340 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-982cffbc-fa87-4f8f-8364-f1b8b286dbc9 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1519 microversion: 2.1 time: 0.428141 Sep 18 02:02:34.783923 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3368/6759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:34 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1519 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:35.808802 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:35.809503 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:35.816221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:35.816703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:35.817143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:35.817933 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:35.818391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:35.818845 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:35.949375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:35.957772 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-78469983-7596-4d2b-9c26-37a8b811d20b tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1517 microversion: 2.1 time: 0.154050 Sep 18 02:02:35.958352 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3392/6760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:35 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:36.198299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-32071685-9278-4e5a-bb36-dc496aa24f38 req-7ef26f65-726a-479d-92a8-2c1f8002b6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbb8343-044b-48ab-bc2c-9e7303f8a34d", "tag": "c6fc2bf4-a264-4677-95c4-6b648ac17126"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:36.209021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-32071685-9278-4e5a-bb36-dc496aa24f38 req-7ef26f65-726a-479d-92a8-2c1f8002b6f6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:36.209514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-32071685-9278-4e5a-bb36-dc496aa24f38 req-7ef26f65-726a-479d-92a8-2c1f8002b6f6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:36.210008 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-32071685-9278-4e5a-bb36-dc496aa24f38 req-7ef26f65-726a-479d-92a8-2c1f8002b6f6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:36.222275 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-32071685-9278-4e5a-bb36-dc496aa24f38 req-7ef26f65-726a-479d-92a8-2c1f8002b6f6 service nova] Creating event network-changed:c6fc2bf4-a264-4677-95c4-6b648ac17126 for instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d on n-h1-master-1 Sep 18 02:02:36.227581 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-32071685-9278-4e5a-bb36-dc496aa24f38 req-7ef26f65-726a-479d-92a8-2c1f8002b6f6 service nova] Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:02:36.238876 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-32071685-9278-4e5a-bb36-dc496aa24f38 req-7ef26f65-726a-479d-92a8-2c1f8002b6f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043737 Sep 18 02:02:36.238876 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3369/6761] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:02:36.981795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:36.982586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:36.992835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:36.993544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:36.994111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:36.995061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:36.996135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:36.996877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:37.149400 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:37.157211 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e01f4a3-8ddd-40d7-83e9-e38970b66c9f tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1514 microversion: 2.1 time: 0.179412 Sep 18 02:02:37.158378 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3393/6762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:36 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:37.181927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:37.182564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:37.188631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:37.189132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:37.189597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:37.190329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:37.190796 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:37.191234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:37.250200 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11ce5f2a-4cfd-440a-8e2d-52d897992e8d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "POST /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d/action" status: 204 len: 0 microversion: 2.1 time: 0.072151 Sep 18 02:02:37.250897 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3370/6763] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:02:37 2022] POST /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:02:37.261391 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:37.262156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:37.270418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:37.270934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:37.271735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:37.272768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:37.273320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:37.273801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:37.421304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:37.429092 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-55003fd6-f3a7-473d-87ef-f58284277bb6 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1514 microversion: 2.1 time: 0.173796 Sep 18 02:02:37.429876 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3394/6764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:37 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:38.453110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:38.454995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:38.462340 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:38.462992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:38.463581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:38.464297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:38.464763 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:38.465195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:38.607326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:38.615767 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05c0d1fe-f4f2-43a5-99b2-21b52c029f3d tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1514 microversion: 2.1 time: 0.167792 Sep 18 02:02:38.616600 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3371/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:38 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:38.934031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-9254442d-3e50-437e-8ec2-944c954de369 req-70556662-aea1-494e-9917-078960b7c35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbb8343-044b-48ab-bc2c-9e7303f8a34d", "name": "network-vif-plugged", "status": "completed", "tag": "c6fc2bf4-a264-4677-95c4-6b648ac17126"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:38.944936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9254442d-3e50-437e-8ec2-944c954de369 req-70556662-aea1-494e-9917-078960b7c35e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:38.945419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9254442d-3e50-437e-8ec2-944c954de369 req-70556662-aea1-494e-9917-078960b7c35e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:38.945895 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-9254442d-3e50-437e-8ec2-944c954de369 req-70556662-aea1-494e-9917-078960b7c35e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:38.960627 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-9254442d-3e50-437e-8ec2-944c954de369 req-70556662-aea1-494e-9917-078960b7c35e service nova] Creating event network-vif-plugged:c6fc2bf4-a264-4677-95c4-6b648ac17126 for instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d on n-h1-master-1 Sep 18 02:02:38.965762 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-9254442d-3e50-437e-8ec2-944c954de369 req-70556662-aea1-494e-9917-078960b7c35e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035374 Sep 18 02:02:38.966342 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3395/6766] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:02:39.639634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:39.640182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:39.647491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:39.647985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:39.648435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:39.649136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:39.649634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:39.650073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:39.779654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:39.788748 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2508a5af-2d0c-4098-b21f-1a21da097158 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1506 microversion: 2.1 time: 0.153337 Sep 18 02:02:39.789330 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3372/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:39 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:39.814840 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:39.815547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:39.822228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:39.822712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:39.823150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:39.823838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:39.824296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:39.824724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:39.953230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:39.960957 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-363a9727-1fe4-4e66-ad7d-3ff2d8d90b30 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1506 microversion: 2.1 time: 0.152086 Sep 18 02:02:39.961586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3396/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:39 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:39.983392 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:39.984022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:39.990673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:39.991167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:39.991618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:39.992321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:39.992791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:39.993230 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:40.127873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:40.137014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-120618d8-73b2-48d2-9c89-4a86473e01c7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1506 microversion: 2.1 time: 0.157559 Sep 18 02:02:40.137908 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3373/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:39 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:40.159772 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:40.160204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:40.166189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:40.166672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:40.167109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:40.167798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:40.168254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:40.168676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:40.194535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:02:40.269144 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e57e2219-2795-4522-ad93-3dace0bd40e7 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 204 len: 0 microversion: 2.1 time: 0.113419 Sep 18 02:02:40.269933 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3397/6770] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:02:40 2022] DELETE /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:02:40.285858 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:40.286368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:40.292394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:40.292886 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:40.293328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:40.294049 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:40.294514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:40.294964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:40.320272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:02:40.356199 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:40.369102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.compute.api [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Instance is already in deleting state, ignoring this request Sep 18 02:02:40.369962 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c2a8c2a0-025b-4401-8daf-6c043f3ad9f0 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 204 len: 0 microversion: 2.1 time: 0.088660 Sep 18 02:02:40.370522 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3374/6771] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:02:40 2022] DELETE /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 02:02:40.379176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:40.379881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:40.385819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:40.386302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:40.386770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:40.387728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:40.388181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:40.388604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:40.519808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:40.527697 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-228e42dd-cb2d-467f-ae23-15eff5b54087 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1512 microversion: 2.1 time: 0.152820 Sep 18 02:02:40.528279 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3398/6772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:40 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:41.552259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:41.552878 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:41.559625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:41.560111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:41.560559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:41.561250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:41.561752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:41.562183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:41.696231 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf71794af87483588ac3c7ca441afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4f6d463f8414591329deb362fd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:41.704044 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c2434db-d01a-4795-b426-608522685089 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 200 len: 1512 microversion: 2.1 time: 0.157282 Sep 18 02:02:41.704601 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3375/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:41 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:42.197374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a8d6bba8-22da-4668-91f4-51a6975dd1f1 req-993aa38b-9be2-4118-a5b0-e4d810383778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbb8343-044b-48ab-bc2c-9e7303f8a34d", "name": "network-vif-deleted", "tag": "c6fc2bf4-a264-4677-95c4-6b648ac17126"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:42.208322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8d6bba8-22da-4668-91f4-51a6975dd1f1 req-993aa38b-9be2-4118-a5b0-e4d810383778 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:42.208807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8d6bba8-22da-4668-91f4-51a6975dd1f1 req-993aa38b-9be2-4118-a5b0-e4d810383778 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:42.209242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8d6bba8-22da-4668-91f4-51a6975dd1f1 req-993aa38b-9be2-4118-a5b0-e4d810383778 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:42.223020 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a8d6bba8-22da-4668-91f4-51a6975dd1f1 req-993aa38b-9be2-4118-a5b0-e4d810383778 service nova] Creating event network-vif-deleted:c6fc2bf4-a264-4677-95c4-6b648ac17126 for instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d on n-h1-master-1 Sep 18 02:02:42.228344 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a8d6bba8-22da-4668-91f4-51a6975dd1f1 req-993aa38b-9be2-4118-a5b0-e4d810383778 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Sep 18 02:02:42.228961 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3399/6774] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:02:42.727055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:42.727618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: 6bbb8343-044b-48ab-bc2c-9e7303f8a34d] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:42.734590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:42.735084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:42.736066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:42.736769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:42.737235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:42.737709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:42.750917 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] HTTP exception thrown: Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d could not be found. Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Request method failure captured: Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d HTTP/1.1 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnve929QRFoRktNOOnMpNSIsAoNRfkO_W5NGhWerwmUyDCMIWbpML8LaYZKo_82CggSNWxqKp6P_nw--s_-SFcmMvhD-Avj9NS7-M-5G5O65QQb8GzOTLyhIxVZp6JjYhnq92VsDMVEBMpxMExV6AmxXp5gEVUDX6vjeAeXjPaIYcYI Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 41e4f6d463f8414591329deb362fd1f0 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 41e4f6d463f8414591329deb362fd1f0 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerDiskConfigTestJSON-1893426830-project Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: faf71794af87483588ac3c7ca441afdd Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerDiskConfigTestJSON-1893426830-project Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d could not be found. Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6bbb8343-044b-48ab-bc2c-9e7303f8a34d'} Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d could not be found. Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d could not be found. Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:02:42.753181 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d could not be found. Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Returning 404 to user: Instance 6bbb8343-044b-48ab-bc2c-9e7303f8a34d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6db630cb-c56e-42ab-a7ad-8e96d48e2d79 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d" status: 404 len: 111 microversion: 2.1 time: 0.031640 Sep 18 02:02:42.757758 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3376/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:42 2022] GET /compute/v2.1/servers/6bbb8343-044b-48ab-bc2c-9e7303f8a34d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:02:42.764364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e937d02c-8c7c-4cad-9c3f-661ac6cf29e1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '.version_select at 0x7f7006351040>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:42.787198 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e937d02c-8c7c-4cad-9c3f-661ac6cf29e1 tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657236122" status: 202 len: 0 microversion: 2.1 time: 0.027272 Sep 18 02:02:42.787800 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3400/6776] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 02:02:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657236122 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:02:43.697305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:43.697840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:43.703843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:43.704336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:43.704789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:43.705490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:43.705992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:43.706431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:43.720352 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] HTTP exception thrown: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Request method failure captured: Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 HTTP/1.1 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnve929QRFoRktNOOnMpNSIsAoNRfkO_W5NGhWerwmUyDCMIWbpML8LaYZKo_82CggSNWxqKp6P_nw--s_-SFcmMvhD-Avj9NS7-M-5G5O65QQb8GzOTLyhIxVZp6JjYhnq92VsDMVEBMpxMExV6AmxXp5gEVUDX6vjeAeXjPaIYcYI Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 41e4f6d463f8414591329deb362fd1f0 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 41e4f6d463f8414591329deb362fd1f0 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerDiskConfigTestJSON-1893426830-project Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: faf71794af87483588ac3c7ca441afdd Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerDiskConfigTestJSON-1893426830-project Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: exception: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'e72e9541-6c82-4f28-a1d9-c23f55b66081'} Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:02:43.721993 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Returning 404 to user: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef6a6b7a-434e-407a-b37a-051e7f45ebdd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 404 len: 111 microversion: 2.1 time: 0.030174 Sep 18 02:02:43.726289 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3377/6777] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:02:43 2022] DELETE /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:02:43.732833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:43.733583 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] [instance: e72e9541-6c82-4f28-a1d9-c23f55b66081] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:43.741279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:43.741804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:43.742243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:43.742939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:43.743395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:43.743823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:43.757144 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] HTTP exception thrown: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Request method failure captured: Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 HTTP/1.1 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnve929QRFoRktNOOnMpNSIsAoNRfkO_W5NGhWerwmUyDCMIWbpML8LaYZKo_82CggSNWxqKp6P_nw--s_-SFcmMvhD-Avj9NS7-M-5G5O65QQb8GzOTLyhIxVZp6JjYhnq92VsDMVEBMpxMExV6AmxXp5gEVUDX6vjeAeXjPaIYcYI Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 41e4f6d463f8414591329deb362fd1f0 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41e4f6d463f8414591329deb362fd1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 41e4f6d463f8414591329deb362fd1f0 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1893426830 Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerDiskConfigTestJSON-1893426830-project Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: faf71794af87483588ac3c7ca441afdd Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerDiskConfigTestJSON-1893426830-project Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: exception: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'e72e9541-6c82-4f28-a1d9-c23f55b66081'} Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:02:43.758828 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] Returning 404 to user: Instance e72e9541-6c82-4f28-a1d9-c23f55b66081 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4959e5d5-9b17-43c9-85ce-eb27571467cd tempest-ServerDiskConfigTestJSON-1893426830 tempest-ServerDiskConfigTestJSON-1893426830-project] 10.222.0.25 "GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081" status: 404 len: 111 microversion: 2.1 time: 0.032207 Sep 18 02:02:43.763874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3401/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:43 2022] GET /compute/v2.1/servers/e72e9541-6c82-4f28-a1d9-c23f55b66081 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:02:52.341927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d6ab688-b0c1-4d3a-bdfb-e55e491efc35 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'create', calling method: .version_select at 0x7f7006b0ab80>, body: {"keypair": {"name": "tempest-keypair-505809236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc1c1qE0lDOt6hAyUwk7pN32W1fHOSanBaAFIbv+flFdUg1ye4+EReamYf5kQ9p7HSuXV5qXQgHlOcIGJj6vqfGCPxjWcEgL1eo5vCQnYjPyNuTfGD7sW2synTQEyJjLg=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:52.347877 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=34 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:52.359380 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9d6ab688-b0c1-4d3a-bdfb-e55e491efc35 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for project 5635878f14df443cbcbbe618e9b0a496. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:02:52.365979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-9d6ab688-b0c1-4d3a-bdfb-e55e491efc35 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for user fa377acabe334070b636ba282f080029 and project 5635878f14df443cbcbbe618e9b0a496. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:02:52.395486 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d6ab688-b0c1-4d3a-bdfb-e55e491efc35 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.207765 Sep 18 02:02:52.396119 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3378/6779] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:02:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:02:54.034513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1541640134", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4d4763-3788-4522-9551-70a125575da8"}], "security_groups": [{"name": "tempest-securitygroup--165085111"}], "key_name": "tempest-keypair-505809236", "user_data": "}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:54.044026 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:54.044686 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:54.148285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] validate_networks() for [('9a4d4763-3788-4522-9551-70a125575da8', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:02:54.547937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:02:54.548425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:02:54.548901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:02:54.549305 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:02:54.549747 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:02:54.558594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:54.559077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:54.559515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:54.560245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:54.560697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:54.561119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:54.578301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:02:54.585433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for user fa377acabe334070b636ba282f080029 and project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:02:54.599556 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:02:54.601895 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:02:54.652250 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-283ae9bc-2088-4a81-be63-3a037394e2d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.622318 Sep 18 02:02:54.659319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3402/6780] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:02:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:02:54.662432 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:02:54.667303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-70450341-22bb-4be9-b930-f702d65cdc76 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:54.668128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-70450341-22bb-4be9-b930-f702d65cdc76 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:54.737036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-70450341-22bb-4be9-b930-f702d65cdc76 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:54.745252 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-70450341-22bb-4be9-b930-f702d65cdc76 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1238 microversion: 2.1 time: 0.084458 Sep 18 02:02:54.754219 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3379/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:54 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:55.770028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:55.770740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:55.778170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:55.778662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:55.779169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:55.780122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:55.780672 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:55.781176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:55.868099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:55.877870 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e7306fd-37c0-4a00-b2cf-6751a02bb2af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1290 microversion: 2.1 time: 0.112904 Sep 18 02:02:55.879277 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3403/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:55 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:56.902944 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:56.903713 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:56.911911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:56.912610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:56.913135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:56.914020 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:56.914922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:56.915409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:57.050052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:57.057932 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d9452a1f-b5f0-48f2-b840-115502bda815 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1363 microversion: 2.1 time: 0.159117 Sep 18 02:02:57.058504 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3380/6783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:56 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:57.490284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-6e9db15f-f9cc-4c3d-87b4-2d80a2f1ea2b req-94676d96-4125-4203-8c6c-b4abf7006132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8228a998-6811-481b-8674-097b7ca751ca", "tag": "3c06fa8a-f673-40e5-889b-cdcc85724d8f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:02:57.503392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e9db15f-f9cc-4c3d-87b4-2d80a2f1ea2b req-94676d96-4125-4203-8c6c-b4abf7006132 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:57.503886 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e9db15f-f9cc-4c3d-87b4-2d80a2f1ea2b req-94676d96-4125-4203-8c6c-b4abf7006132 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:57.504332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-6e9db15f-f9cc-4c3d-87b4-2d80a2f1ea2b req-94676d96-4125-4203-8c6c-b4abf7006132 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:57.518299 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-6e9db15f-f9cc-4c3d-87b4-2d80a2f1ea2b req-94676d96-4125-4203-8c6c-b4abf7006132 service nova] Creating event network-changed:3c06fa8a-f673-40e5-889b-cdcc85724d8f for instance 8228a998-6811-481b-8674-097b7ca751ca on n-h2-master-1 Sep 18 02:02:57.524395 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-6e9db15f-f9cc-4c3d-87b4-2d80a2f1ea2b req-94676d96-4125-4203-8c6c-b4abf7006132 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040926 Sep 18 02:02:57.525669 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3404/6784] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:02:58.082067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:58.082618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:58.090143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:58.090639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:58.091085 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:58.091784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:58.092248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:58.092680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:58.228650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:58.236480 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0af478fe-08c0-4f31-8b15-1b45cde4a6f7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1363 microversion: 2.1 time: 0.158554 Sep 18 02:02:58.237068 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3381/6785] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:58 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:02:59.261261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:02:59.261907 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:02:59.268893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:59.269387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:59.269884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:59.270571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:02:59.271159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:02:59.271646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:02:59.403570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:02:59.412004 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6ac5bf70-0304-4143-bb87-0e4fa14cfad0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1363 microversion: 2.1 time: 0.155989 Sep 18 02:02:59.412576 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3405/6786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:02:59 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:00.434535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:00.435164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:00.441998 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:00.442503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:00.442957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:00.443668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:00.444141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:00.444585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:00.579497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:00.587186 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dd93bbc0-147a-4333-b605-5196584734af tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1363 microversion: 2.1 time: 0.156587 Sep 18 02:03:00.587765 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3382/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:00 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:01.611065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:01.611686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:01.618667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:01.619155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:01.619589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:01.620291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:01.620748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:01.621170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:01.757521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:01.765766 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7b4da7fa-fddf-4007-b969-8fc0e4520e99 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1363 microversion: 2.1 time: 0.159145 Sep 18 02:03:01.766409 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3406/6788] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:01 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:02.788454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:02.789028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:02.795872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:02.796367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:02.796813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:02.797577 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:02.798065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:02.798485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:02.941507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:02.950270 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc48cba1-55c7-4f78-80be-3989186f63db tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1363 microversion: 2.1 time: 0.165685 Sep 18 02:03:02.950881 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3383/6789] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:02 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:03.002557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-34a87679-f59f-4fdd-8f31-5dc72e61d155 req-2113e75f-033c-4ab1-b840-02130bf766fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8228a998-6811-481b-8674-097b7ca751ca", "name": "network-vif-plugged", "status": "completed", "tag": "3c06fa8a-f673-40e5-889b-cdcc85724d8f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:03:03.013641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34a87679-f59f-4fdd-8f31-5dc72e61d155 req-2113e75f-033c-4ab1-b840-02130bf766fd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:03.014162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34a87679-f59f-4fdd-8f31-5dc72e61d155 req-2113e75f-033c-4ab1-b840-02130bf766fd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:03.014607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-34a87679-f59f-4fdd-8f31-5dc72e61d155 req-2113e75f-033c-4ab1-b840-02130bf766fd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:03.026312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-34a87679-f59f-4fdd-8f31-5dc72e61d155 req-2113e75f-033c-4ab1-b840-02130bf766fd service nova] Creating event network-vif-plugged:3c06fa8a-f673-40e5-889b-cdcc85724d8f for instance 8228a998-6811-481b-8674-097b7ca751ca on n-h2-master-1 Sep 18 02:03:03.031727 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-34a87679-f59f-4fdd-8f31-5dc72e61d155 req-2113e75f-033c-4ab1-b840-02130bf766fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 Sep 18 02:03:03.033274 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3407/6790] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:03:03.975647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:03.976275 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:03.983426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:03.983928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:03.984374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:03.985166 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:03.985646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:03.986091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:04.126813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:04.134703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-12555d4b-2194-48ad-8211-cd3310a39c9f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1363 microversion: 2.1 time: 0.163088 Sep 18 02:03:04.135303 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3384/6791] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:03 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:05.157832 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:03:05.158647 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:03:05.162909 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:05.163614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:05.170731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:05.171214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:05.171651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:05.172345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:05.172996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:05.173212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:05.303938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:05.311693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63425e82-78a0-4223-8893-3420e807e964 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1549 microversion: 2.1 time: 0.156295 Sep 18 02:03:05.312280 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3408/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:05 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:05.334367 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:05.334882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:05.336758 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:03:05.342905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:05.343400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:05.343867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:05.345157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:05.345650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:05.346084 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:05.422026 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d646bd1e-9d24-49f4-8221-f8d9a55aaadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091474 Sep 18 02:03:05.422637 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3385/6793] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 02:03:05 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:03:06.682250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3c5612e4-c930-4de1-9538-d39b03d2bf86 req-204268bb-5e28-46c5-9aae-4a363f4658ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8228a998-6811-481b-8674-097b7ca751ca", "tag": "3c06fa8a-f673-40e5-889b-cdcc85724d8f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:03:06.693303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3c5612e4-c930-4de1-9538-d39b03d2bf86 req-204268bb-5e28-46c5-9aae-4a363f4658ab service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:06.693826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3c5612e4-c930-4de1-9538-d39b03d2bf86 req-204268bb-5e28-46c5-9aae-4a363f4658ab service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:06.694263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3c5612e4-c930-4de1-9538-d39b03d2bf86 req-204268bb-5e28-46c5-9aae-4a363f4658ab service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:06.706309 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3c5612e4-c930-4de1-9538-d39b03d2bf86 req-204268bb-5e28-46c5-9aae-4a363f4658ab service nova] Creating event network-changed:3c06fa8a-f673-40e5-889b-cdcc85724d8f for instance 8228a998-6811-481b-8674-097b7ca751ca on n-h2-master-1 Sep 18 02:03:06.711234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3c5612e4-c930-4de1-9538-d39b03d2bf86 req-204268bb-5e28-46c5-9aae-4a363f4658ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033075 Sep 18 02:03:06.711840 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3409/6794] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:03:40.569582 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:03:40.570416 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=34 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:03:40.574823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:40.575454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:40.583295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:40.583794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:40.584245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:40.584957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:40.585428 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:40.585896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:40.723004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:40.730873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cc6f41ac-32d8-480d-ad6a-eaa930c24d19 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1667 microversion: 2.1 time: 0.163314 Sep 18 02:03:40.731450 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3386/6795] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:40 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:40.752739 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:03:40.753614 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=32 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:03:40.757760 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:40.758493 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:40.765998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:40.766492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:40.766929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:40.767624 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:40.768078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:40.768535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:40.904594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:40.913021 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-79d9bf96-4182-42b3-b835-18035f8425dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1667 microversion: 2.1 time: 0.162624 Sep 18 02:03:40.913626 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3410/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:40 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:40.936106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:40.936732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:40.942863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:40.943365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:40.943822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:40.944530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:40.945003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:40.945440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:41.082067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:41.089878 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c002028-d337-47d1-b4a6-2dce6d6030d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1667 microversion: 2.1 time: 0.158068 Sep 18 02:03:41.090464 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3387/6797] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:40 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:41.115606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:03:41.118497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:41.126910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:41.127544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:41.128808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:41.129802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:41.130312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:41.130799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:41.183207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:41.193312 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:03:41.205005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:03:41.205798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:03:41.206655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:03:41.207387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:03:41.208116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:03:41.284773 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0be4144f-ccae-453a-bac4-441d42f0c4e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca/action" status: 202 len: 0 microversion: 2.1 time: 0.175930 Sep 18 02:03:41.285410 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3411/6798] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:03:41 2022] POST /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:03:41.293854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:41.294586 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:41.301581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:41.302167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:41.302595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:41.303345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:41.303817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:41.304253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:41.441756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:41.449750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4b5c24dd-2807-489b-b8dd-92b6bbabbce0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1676 microversion: 2.1 time: 0.159848 Sep 18 02:03:41.450544 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3388/6799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:41 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:42.475013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:42.475626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:42.482803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:42.483296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:42.483848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:42.484447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:42.484929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:42.485352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:42.617779 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:42.626565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a7509e2-d0eb-4260-975e-586dc8e5de61 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1676 microversion: 2.1 time: 0.157259 Sep 18 02:03:42.627150 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3412/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:42 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:43.650770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:43.651396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:43.658334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:43.659412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:43.659809 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:43.660524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:43.661010 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:43.661440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:43.792064 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:43.800448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46ad6d77-b8ea-4079-9a08-13a57cf38011 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.153003 Sep 18 02:03:43.801026 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3389/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:43 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:44.824075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:44.824788 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:44.831811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:44.832305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:44.832746 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:44.833464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:44.833996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:44.834426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:44.966130 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:44.974160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-63723034-20b2-4029-9d43-b32e505ef921 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.154017 Sep 18 02:03:44.974740 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3413/6802] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:44 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:46.001414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:46.002109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:46.008613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:46.009111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:46.009576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:46.010295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:46.010765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:46.011238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:46.155738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:46.163909 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a5e57e2f-3cbc-4ae4-8230-867ae5a00a9a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.169265 Sep 18 02:03:46.164484 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3390/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:45 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:47.187826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:47.188451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:47.196112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:47.196592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:47.197024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:47.197732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:47.198182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:47.198602 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:47.335193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:47.342935 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-765596c6-7327-4444-bcc5-bbab4534fbf3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.159097 Sep 18 02:03:47.343494 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3414/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:47 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:48.366532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:48.367186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:48.374015 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:48.374509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:48.374955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:48.375655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:48.376128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:48.376564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:48.513207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:48.521396 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9120b78d-1734-487f-8502-79cdab444a51 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.159471 Sep 18 02:03:48.522005 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3391/6805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:48 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:49.543896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:49.544519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:49.551913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:49.552461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:49.552905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:49.553628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:49.554089 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:49.554520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:49.686440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:49.694206 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-540308a2-fba1-4fb6-aad1-c0f9b8c56aa7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.154245 Sep 18 02:03:49.694791 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3415/6806] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:49 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:50.717842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:50.718455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:50.726128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:50.726634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:50.727092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:50.727810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:50.728287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:50.728729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:50.857629 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:50.866025 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf2066e5-ad08-45e7-9cd1-0f1ae433a850 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.152263 Sep 18 02:03:50.866604 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3392/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:50 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:03:51.890661 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:51.891823 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:51.899337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:51.899824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:51.900260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:51.900964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:51.901448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:51.901908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:52.044372 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:52.052344 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16ed33f4-330c-4fb9-8987-9917c277f5f3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.166161 Sep 18 02:03:52.052933 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3416/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:51 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:53.076024 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:53.076654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:53.084235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:53.084731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:53.085178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:53.085921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:53.086391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:53.086831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:53.236346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:53.246131 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-83f1e339-c9df-4a46-9c12-0a8365fe5732 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.173937 Sep 18 02:03:53.246736 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3393/6809] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:53 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:54.269404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:54.270034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:54.277858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:54.278681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:54.279119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:54.279884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:54.280327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:54.280751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:54.418611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:54.426753 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-043f5b86-67c0-4e3e-b88d-6a6022ba18d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.161482 Sep 18 02:03:54.427378 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3417/6810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:54 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:55.450929 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:55.451473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:55.458331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:55.458838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:55.459294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:55.460013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:55.460489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:55.460940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:55.601061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:55.608985 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89e9a815-a029-414f-86fd-1c7a485d1252 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1681 microversion: 2.1 time: 0.162055 Sep 18 02:03:55.609584 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3394/6811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:55 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:56.156515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d1ed4942-a059-4bec-8bbb-db9cb81f421d req-a8dda411-f07b-44bb-af75-ba847f2c8c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8228a998-6811-481b-8674-097b7ca751ca", "name": "network-vif-unplugged", "status": "completed", "tag": "3c06fa8a-f673-40e5-889b-cdcc85724d8f"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:03:56.167701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d1ed4942-a059-4bec-8bbb-db9cb81f421d req-a8dda411-f07b-44bb-af75-ba847f2c8c0a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:56.168226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d1ed4942-a059-4bec-8bbb-db9cb81f421d req-a8dda411-f07b-44bb-af75-ba847f2c8c0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:56.168690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d1ed4942-a059-4bec-8bbb-db9cb81f421d req-a8dda411-f07b-44bb-af75-ba847f2c8c0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:56.181904 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d1ed4942-a059-4bec-8bbb-db9cb81f421d req-a8dda411-f07b-44bb-af75-ba847f2c8c0a service nova] Creating event network-vif-unplugged:3c06fa8a-f673-40e5-889b-cdcc85724d8f for instance 8228a998-6811-481b-8674-097b7ca751ca on n-h1-master-1 Sep 18 02:03:56.187515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-d1ed4942-a059-4bec-8bbb-db9cb81f421d req-a8dda411-f07b-44bb-af75-ba847f2c8c0a service nova] Instance 8228a998-6811-481b-8674-097b7ca751ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:03:56.198567 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d1ed4942-a059-4bec-8bbb-db9cb81f421d req-a8dda411-f07b-44bb-af75-ba847f2c8c0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045831 Sep 18 02:03:56.199383 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3418/6812] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:03:56.633145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:56.633809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:56.641080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:56.641618 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:56.642081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:56.643443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:56.643923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:56.644364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:56.780946 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:56.789109 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd87d8b2-b66f-4bce-ada6-d395a5c102ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1680 microversion: 2.1 time: 0.160022 Sep 18 02:03:56.789720 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3395/6813] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:56 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:57.814309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:57.815004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:57.821109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:57.821626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:57.822058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:57.822916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:57.823375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:57.823846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:58.004853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:58.012884 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2b3ba3e3-5841-4e73-a80e-07e531fa32a9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1678 microversion: 2.1 time: 0.203717 Sep 18 02:03:58.013462 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3419/6814] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:57 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:58.239084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-a7c03c13-d323-4890-bebb-815d80ea20c9 req-99c9e7e0-2460-4a9d-8839-a5ec1e6098b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8228a998-6811-481b-8674-097b7ca751ca", "tag": "3c06fa8a-f673-40e5-889b-cdcc85724d8f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:03:58.250029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a7c03c13-d323-4890-bebb-815d80ea20c9 req-99c9e7e0-2460-4a9d-8839-a5ec1e6098b2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:58.250520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a7c03c13-d323-4890-bebb-815d80ea20c9 req-99c9e7e0-2460-4a9d-8839-a5ec1e6098b2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:58.250961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-a7c03c13-d323-4890-bebb-815d80ea20c9 req-99c9e7e0-2460-4a9d-8839-a5ec1e6098b2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:58.263620 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-a7c03c13-d323-4890-bebb-815d80ea20c9 req-99c9e7e0-2460-4a9d-8839-a5ec1e6098b2 service nova] Creating event network-changed:3c06fa8a-f673-40e5-889b-cdcc85724d8f for instance 8228a998-6811-481b-8674-097b7ca751ca on n-h1-master-1 Sep 18 02:03:58.268894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-a7c03c13-d323-4890-bebb-815d80ea20c9 req-99c9e7e0-2460-4a9d-8839-a5ec1e6098b2 service nova] Instance 8228a998-6811-481b-8674-097b7ca751ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:03:58.280177 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-a7c03c13-d323-4890-bebb-815d80ea20c9 req-99c9e7e0-2460-4a9d-8839-a5ec1e6098b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045297 Sep 18 02:03:58.280781 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3396/6815] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:03:59.036307 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:59.036919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:59.043727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:59.044208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:59.044638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:59.045332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:59.045841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:59.046262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:59.193724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:59.202486 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fee9ac1e-4f21-47a9-abdb-af3f24b52c14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1675 microversion: 2.1 time: 0.169909 Sep 18 02:03:59.203078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3420/6816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:59 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:03:59.226699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:03:59.227327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:59.233748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:59.234244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:59.234689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:59.235388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:59.235857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:59.236283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:59.301999 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26874546-ac86-4583-b486-27e24d31f321 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca/action" status: 204 len: 0 microversion: 2.1 time: 0.080248 Sep 18 02:03:59.302757 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3397/6817] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:03:59 2022] POST /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:03:59.311932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:03:59.312547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:03:59.319909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:59.320601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:59.321151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:59.322133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:03:59.322851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:03:59.323318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:03:59.463752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:03:59.473211 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07e5b9ca-fc55-4b45-afda-8b39d3b7a8d8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1675 microversion: 2.1 time: 0.166136 Sep 18 02:03:59.473868 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3421/6818] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:03:59 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:00.502934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:00.504165 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:00.510568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:00.511070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:00.511521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:00.512499 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:00.512967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:00.513405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:00.700674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:00.708562 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26446a6a-e897-478b-96b5-b3541afd4024 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1675 microversion: 2.1 time: 0.214795 Sep 18 02:04:00.709142 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3398/6819] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:00 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:01.732321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:01.732860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:01.740301 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:01.740791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:01.741224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:01.741938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:01.742394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:01.742819 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:01.877375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:01.885892 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ff810b7-d2ae-4ad3-a7aa-dce5a80c76b1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1667 microversion: 2.1 time: 0.157515 Sep 18 02:04:01.886471 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3422/6820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:01 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:01.913912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:01.914566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:01.922765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:01.923214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:01.923801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:01.924637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:01.925124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:01.925574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:02.054592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:02.062343 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8df30337-ab9c-4ebd-ac76-a42f1511651a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1667 microversion: 2.1 time: 0.152346 Sep 18 02:04:02.062917 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3399/6821] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:01 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:02.085206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:02.085843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:02.092117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:02.092598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:02.093058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:02.093785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:02.094241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:02.094669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:02.224030 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:02.231678 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-77b266d0-c82f-46a9-8ad8-3d5657a8de20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1667 microversion: 2.1 time: 0.150285 Sep 18 02:04:02.232260 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3423/6822] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:02 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:02.254941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:02.255570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:02.261607 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:02.262348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:02.262795 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:02.263496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:02.263959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:02.264396 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:02.289966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:04:02.322780 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:02.368237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e14345c4-1adf-4f0e-9284-f9c96ad896fa tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 204 len: 0 microversion: 2.1 time: 0.117654 Sep 18 02:04:02.368834 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3400/6823] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:04:02 2022] DELETE /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:04:02.377775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:02.378387 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:02.384354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:02.384830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:02.385261 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:02.385967 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:02.386422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:02.386846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:02.519580 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:02.527300 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f9d0a7bb-8b24-4374-be55-8a48174aa806 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1673 microversion: 2.1 time: 0.153703 Sep 18 02:04:02.527871 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3424/6824] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:02 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:03.239069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-7f049575-e461-4a34-bdaa-727f534569b3 req-d70759b2-3721-4a96-bd9c-abc612829690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8228a998-6811-481b-8674-097b7ca751ca", "name": "network-vif-plugged", "status": "completed", "tag": "3c06fa8a-f673-40e5-889b-cdcc85724d8f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:04:03.251285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7f049575-e461-4a34-bdaa-727f534569b3 req-d70759b2-3721-4a96-bd9c-abc612829690 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:03.251780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7f049575-e461-4a34-bdaa-727f534569b3 req-d70759b2-3721-4a96-bd9c-abc612829690 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:03.252223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7f049575-e461-4a34-bdaa-727f534569b3 req-d70759b2-3721-4a96-bd9c-abc612829690 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:03.264037 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-7f049575-e461-4a34-bdaa-727f534569b3 req-d70759b2-3721-4a96-bd9c-abc612829690 service nova] Creating event network-vif-plugged:3c06fa8a-f673-40e5-889b-cdcc85724d8f for instance 8228a998-6811-481b-8674-097b7ca751ca on n-h1-master-1 Sep 18 02:04:03.269600 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-7f049575-e461-4a34-bdaa-727f534569b3 req-d70759b2-3721-4a96-bd9c-abc612829690 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033973 Sep 18 02:04:03.270235 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3401/6825] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:04:03.551839 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:03.552413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:03.559145 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:03.559626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:03.560067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:03.560760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:03.561223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:03.561664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:03.580415 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:03.693094 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:03.700798 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-228cd744-de8f-4aea-8a06-35e78bb9402e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1673 microversion: 2.1 time: 0.153666 Sep 18 02:04:03.701376 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3425/6826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:03 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:04.698196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b615b72e-9681-48b4-809b-aad0a1474a81 req-515fd855-aa2f-485c-aea3-50e218d904d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8228a998-6811-481b-8674-097b7ca751ca", "name": "network-vif-deleted", "tag": "3c06fa8a-f673-40e5-889b-cdcc85724d8f"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:04:04.709576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b615b72e-9681-48b4-809b-aad0a1474a81 req-515fd855-aa2f-485c-aea3-50e218d904d5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:04.710087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b615b72e-9681-48b4-809b-aad0a1474a81 req-515fd855-aa2f-485c-aea3-50e218d904d5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:04.710589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b615b72e-9681-48b4-809b-aad0a1474a81 req-515fd855-aa2f-485c-aea3-50e218d904d5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:04.722043 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b615b72e-9681-48b4-809b-aad0a1474a81 req-515fd855-aa2f-485c-aea3-50e218d904d5 service nova] Creating event network-vif-deleted:3c06fa8a-f673-40e5-889b-cdcc85724d8f for instance 8228a998-6811-481b-8674-097b7ca751ca on n-h1-master-1 Sep 18 02:04:04.723962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:04.724549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:04.726954 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b615b72e-9681-48b4-809b-aad0a1474a81 req-515fd855-aa2f-485c-aea3-50e218d904d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095354 Sep 18 02:04:04.728044 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3402/6827] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:04:04.732431 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:04.732917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:04.733352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:04.734076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:04.734525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:04.734949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:04.771814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:04.772306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:04.772905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:04.773177 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lazy-loading 'fault' on Instance uuid 8228a998-6811-481b-8674-097b7ca751ca {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:04:04.822595 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:04.830783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-882e7add-c063-42b7-bc9b-6ac1c2f83bfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 200 len: 1328 microversion: 2.1 time: 0.110696 Sep 18 02:04:04.832095 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3426/6828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:04 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:05.856765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:05.857398 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:05.863649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:05.864146 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:05.864596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:05.865298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:05.865917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:05.866357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:05.879833 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca HTTP/1.1 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8228a998-6811-481b-8674-097b7ca751ca'} Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:04:05.881488 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-134b80a6-6490-482d-9933-8e2da1305aef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 404 len: 111 microversion: 2.1 time: 0.031434 Sep 18 02:04:05.886043 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3403/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:05 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:04:05.896741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:05.897357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:05.904165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:05.904679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:05.905116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:05.905833 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:05.906292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:05.906718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:05.920934 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca HTTP/1.1 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8228a998-6811-481b-8674-097b7ca751ca'} Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:04:05.922614 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c9d1e4a1-173c-4f5e-bfa7-bd9c78000bef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 404 len: 111 microversion: 2.1 time: 0.031657 Sep 18 02:04:05.930926 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3427/6830] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:05 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:04:05.975159 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-437134747", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "9a4d4763-3788-4522-9551-70a125575da8"}], "security_groups": [{"name": "tempest-securitygroup--165085111"}], "key_name": "tempest-keypair-505809236", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:04:06.083027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] validate_networks() for [('9a4d4763-3788-4522-9551-70a125575da8', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:04:06.452767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:04:06.453207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:04:06.453725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:04:06.454152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:04:06.454580 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:04:06.464064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:06.464570 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:06.465026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:06.465810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:06.466291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:06.466735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:06.484802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:04:06.490599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for user fa377acabe334070b636ba282f080029 and project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:04:06.502781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:04:06.505763 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:04:06.552226 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc358f83-8ff5-4636-8a6c-4a61af7c0647 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.581580 Sep 18 02:04:06.552878 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3404/6831] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:04:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:04:06.564335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a7ec7424-8586-47f0-a06f-7a8f72a1ef86 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:06.565086 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a7ec7424-8586-47f0-a06f-7a8f72a1ef86 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:06.620279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a7ec7424-8586-47f0-a06f-7a8f72a1ef86 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:06.627184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a7ec7424-8586-47f0-a06f-7a8f72a1ef86 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1237 microversion: 2.1 time: 0.066928 Sep 18 02:04:06.627756 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3428/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:06 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:07.654133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:07.654823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:07.661890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:07.662393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:07.662841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:07.663558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:07.664018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:07.664636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:07.735701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:07.743860 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ace5c96-9088-402d-850c-7ee67fe94241 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1297 microversion: 2.1 time: 0.096519 Sep 18 02:04:07.744455 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3405/6833] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:07 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:08.768984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:08.769641 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:08.778553 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:08.779052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:08.779603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:08.780322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:08.780782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:08.781210 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:08.931516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:08.939345 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1ffb6c06-fdd4-49f8-9611-80db1659a557 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1362 microversion: 2.1 time: 0.174449 Sep 18 02:04:08.940015 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3429/6834] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:08 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:09.413259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1994970e-a17b-47fd-84ca-4e203ff09174 req-e3173f22-8730-4d2d-83d8-ce50175a971f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f67797b-a5b6-4537-8107-e542566ab2d4", "tag": "9786eb9b-e909-4e9c-8307-cfaa54ee4388"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:04:09.432842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1994970e-a17b-47fd-84ca-4e203ff09174 req-e3173f22-8730-4d2d-83d8-ce50175a971f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:09.433445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1994970e-a17b-47fd-84ca-4e203ff09174 req-e3173f22-8730-4d2d-83d8-ce50175a971f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:09.434054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1994970e-a17b-47fd-84ca-4e203ff09174 req-e3173f22-8730-4d2d-83d8-ce50175a971f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:09.447075 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1994970e-a17b-47fd-84ca-4e203ff09174 req-e3173f22-8730-4d2d-83d8-ce50175a971f service nova] Creating event network-changed:9786eb9b-e909-4e9c-8307-cfaa54ee4388 for instance 6f67797b-a5b6-4537-8107-e542566ab2d4 on n-h1-master-1 Sep 18 02:04:09.452445 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1994970e-a17b-47fd-84ca-4e203ff09174 req-e3173f22-8730-4d2d-83d8-ce50175a971f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046804 Sep 18 02:04:09.453106 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3406/6835] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:04:09.963168 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:09.963778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:09.970808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:09.971216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:09.972278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:09.973387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:09.974088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:09.974699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:10.103754 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:10.111461 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0c93ce71-e54c-4ae4-bebe-e49afc6cea57 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1362 microversion: 2.1 time: 0.152401 Sep 18 02:04:10.112031 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3430/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:09 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:11.136635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:11.137786 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:11.140451 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:11.146740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:11.147244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:11.147698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:11.148431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:11.148892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:11.149334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:11.281927 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:11.289617 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae991956-effa-4ed2-8c4c-9c982b4555fe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1362 microversion: 2.1 time: 0.157322 Sep 18 02:04:11.290183 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3407/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:11 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:12.312308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:12.312946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:12.315249 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=51 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:12.321127 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:12.321636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:12.322075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:12.322775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:12.323230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:12.323665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:12.464497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:12.472448 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3fa8d24a-9257-4e6c-b95a-aa38f0cd2a3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1362 microversion: 2.1 time: 0.164055 Sep 18 02:04:12.473867 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3431/6838] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:12 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:13.496598 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:13.497230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:13.505269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:13.505806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:13.506259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:13.506984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:13.507454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:13.507894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:13.648631 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:13.656317 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-10e85338-d897-4d58-9203-e0414d019478 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1362 microversion: 2.1 time: 0.163735 Sep 18 02:04:13.656896 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3408/6839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:13 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:14.680114 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:14.680719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:14.687975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:14.688402 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:14.688908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:14.689864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:14.690193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:14.690598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:14.825509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:14.833875 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fdd5ffe8-85fb-4670-b258-c3706de69a8a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1362 microversion: 2.1 time: 0.158264 Sep 18 02:04:14.834453 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3432/6840] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:14 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:15.305663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d05e4727-008e-4236-b089-a7426fb2a807 req-8bba2ca4-b45e-45da-84ea-86716ea820aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f67797b-a5b6-4537-8107-e542566ab2d4", "name": "network-vif-plugged", "status": "completed", "tag": "9786eb9b-e909-4e9c-8307-cfaa54ee4388"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:04:15.316232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d05e4727-008e-4236-b089-a7426fb2a807 req-8bba2ca4-b45e-45da-84ea-86716ea820aa service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:15.316791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d05e4727-008e-4236-b089-a7426fb2a807 req-8bba2ca4-b45e-45da-84ea-86716ea820aa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:15.317787 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d05e4727-008e-4236-b089-a7426fb2a807 req-8bba2ca4-b45e-45da-84ea-86716ea820aa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:15.328855 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d05e4727-008e-4236-b089-a7426fb2a807 req-8bba2ca4-b45e-45da-84ea-86716ea820aa service nova] Creating event network-vif-plugged:9786eb9b-e909-4e9c-8307-cfaa54ee4388 for instance 6f67797b-a5b6-4537-8107-e542566ab2d4 on n-h1-master-1 Sep 18 02:04:15.333756 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d05e4727-008e-4236-b089-a7426fb2a807 req-8bba2ca4-b45e-45da-84ea-86716ea820aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032693 Sep 18 02:04:15.334367 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3409/6841] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:04:15.856303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:15.856952 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:15.864356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:15.864842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:15.865275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:15.866002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:15.866459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:15.866887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:15.996919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:16.005238 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5ce0aec8-538c-46c3-9ab4-084b0982d382 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1362 microversion: 2.1 time: 0.152898 Sep 18 02:04:16.005879 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3433/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:15 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:17.026287 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:17.027070 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:17.031290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:17.031999 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:17.039562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:17.040062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:17.040509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:17.041214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:17.041731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:17.042171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:17.174715 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:17.183052 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a333abf-9d0e-4bb1-abd6-b55c5f68d08b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1549 microversion: 2.1 time: 0.158581 Sep 18 02:04:17.183620 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3410/6843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:17 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:17.205767 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:17.206327 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:17.208288 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:17.214493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:17.214978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:17.215408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:17.216098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:17.216549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:17.216968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:17.295154 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c1bf4f9c-280d-41fb-9456-ebb63b8acebd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093322 Sep 18 02:04:17.295764 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3434/6844] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 02:04:17 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:04:18.283488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8a29dee6-cb20-4f78-991e-b105c5224b1e req-9b4487bf-0339-42e5-8537-e3068b6165c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f67797b-a5b6-4537-8107-e542566ab2d4", "tag": "9786eb9b-e909-4e9c-8307-cfaa54ee4388"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:04:18.293011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8a29dee6-cb20-4f78-991e-b105c5224b1e req-9b4487bf-0339-42e5-8537-e3068b6165c4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:18.293501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8a29dee6-cb20-4f78-991e-b105c5224b1e req-9b4487bf-0339-42e5-8537-e3068b6165c4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:18.293970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8a29dee6-cb20-4f78-991e-b105c5224b1e req-9b4487bf-0339-42e5-8537-e3068b6165c4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:18.305704 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8a29dee6-cb20-4f78-991e-b105c5224b1e req-9b4487bf-0339-42e5-8537-e3068b6165c4 service nova] Creating event network-changed:9786eb9b-e909-4e9c-8307-cfaa54ee4388 for instance 6f67797b-a5b6-4537-8107-e542566ab2d4 on n-h1-master-1 Sep 18 02:04:18.310790 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8a29dee6-cb20-4f78-991e-b105c5224b1e req-9b4487bf-0339-42e5-8537-e3068b6165c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089271 Sep 18 02:04:18.311380 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3411/6845] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:04:51.142676 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=7 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:51.143396 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=46 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:51.147904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-193803e6-b016-40c5-bcea-2767e7db6cbe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:04:51.154724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-193803e6-b016-40c5-bcea-2767e7db6cbe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:51.155204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-193803e6-b016-40c5-bcea-2767e7db6cbe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:51.155634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-193803e6-b016-40c5-bcea-2767e7db6cbe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:51.178229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-193803e6-b016-40c5-bcea-2767e7db6cbe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Going to try to stop instance {{(pid=122374) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 02:04:51.219945 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-193803e6-b016-40c5-bcea-2767e7db6cbe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action" status: 202 len: 0 microversion: 2.1 time: 0.079371 Sep 18 02:04:51.220839 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3435/6846] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:04:51 2022] POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:04:51.227524 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=9 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:51.228937 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:04:51.233422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:51.234182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:51.242821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:51.243342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:51.243779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:51.244490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:51.244958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:51.245390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:51.375769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:51.384152 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-edc23964-8e3f-4929-bb54-7e34e31d1253 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.158806 Sep 18 02:04:51.384722 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3412/6847] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:51 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:52.407623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:52.408325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:52.415528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:52.416018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:52.416458 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:52.417156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:52.417640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:52.418071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:52.552007 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:52.560028 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1f4b0426-3a64-48fa-b471-d20bdada2496 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.156657 Sep 18 02:04:52.560616 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3436/6848] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:52 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:53.584692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:53.585315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:53.592087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:53.592641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:53.593091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:53.593814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:53.594278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:53.594709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:53.736055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:53.743890 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f6008bb7-d42e-41f8-a816-0a6f7b1021b9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.163649 Sep 18 02:04:53.744479 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3413/6849] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:53 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:04:54.768557 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:54.769195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:54.776020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:54.776523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:54.776955 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:54.777699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:54.778440 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:54.778612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:54.910002 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:54.919045 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-333ab18f-8a96-4cad-88a5-eb5e4a2c0ae7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.154359 Sep 18 02:04:54.919618 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3437/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:54 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:55.942525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:55.943153 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:55.949945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:55.950447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:55.950895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:55.951632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:55.952097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:55.952557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:56.101682 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:56.109587 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7e3b23de-11c7-4903-b44b-3d3d2d12e0f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.171914 Sep 18 02:04:56.110175 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3414/6851] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:55 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:57.134762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:57.135294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:57.142416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:57.142900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:57.143365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:57.144061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:57.144550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:57.144974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:57.279355 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:57.287182 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-61564ad9-7909-4db3-8b37-607722655f20 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.156456 Sep 18 02:04:57.287779 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3438/6852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:57 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:58.310079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:58.310703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:58.318041 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:58.318536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:58.318986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:58.319688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:58.320157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:58.320597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:58.452647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:58.461107 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-55488391-5aea-4072-ab2a-3b73117ec7f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.154974 Sep 18 02:04:58.461760 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3415/6853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:58 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:04:59.484313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:04:59.484930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:04:59.491813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:59.492297 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:59.492736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:59.493432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:04:59.494234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:04:59.494748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:04:59.628579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:04:59.636473 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6264c6f5-14f4-4809-b6bd-df9805e77eb2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.156082 Sep 18 02:04:59.637335 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3439/6854] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:04:59 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:00.659919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:00.661060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:00.668168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:00.668693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:00.669150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:00.669888 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:00.670361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:00.670803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:00.798736 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:00.807112 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a7ab9b2e-fd62-42ce-9d32-4c22a02a078c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.151132 Sep 18 02:05:00.807687 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3416/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:00 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:01.830293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:01.830903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:01.837919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:01.838401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:01.838841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:01.839528 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:01.839978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:01.840399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:01.974266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:01.981869 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af1dce13-5b34-4ee7-a21c-7d3f2f5d11cb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.155468 Sep 18 02:05:01.982440 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3440/6856] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:01 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:03.006088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:03.006714 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:03.013921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:03.014415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:03.014860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:03.015558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:03.016018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:03.016449 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:03.145308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:03.152512 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5abf14c3-964b-4ff8-a019-8280011d1a55 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.150944 Sep 18 02:05:03.153143 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3417/6857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:03 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:04.176501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:04.177133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:04.183913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:04.184386 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:04.184817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:04.185494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:04.185971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:04.186391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:04.319185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:04.327013 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1e480096-8bd0-4eba-9a3c-64b9ba84229e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.154608 Sep 18 02:05:04.327587 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3441/6858] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:04 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:05.351835 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:05.352474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:05.359435 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:05.359937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:05.360400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:05.361115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:05.361611 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:05.362057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:05.489721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:05.497471 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3a39ed9-d867-4b64-a617-6e19e28c8002 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.150376 Sep 18 02:05:05.498080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3418/6859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:05 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:06.521598 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:06.522213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:06.529024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:06.529510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:06.529989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:06.530681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:06.531136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:06.531561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:06.665628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:06.673849 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a86fe9e3-81c8-4007-bded-2eb7b60a8aab tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.156710 Sep 18 02:05:06.674429 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3442/6860] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:06 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:07.697054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:07.697716 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:07.704559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:07.705052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:07.705494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:07.706217 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:07.707176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:07.707644 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:07.842660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:07.851097 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f97f2021-7f9d-42f9-bcef-328f1c58b6a4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1654 microversion: 2.1 time: 0.158016 Sep 18 02:05:07.851677 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3419/6861] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:07 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:07.873413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:07.875715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:07.882695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:07.883177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:07.883607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:07.884298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:07.884747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:07.885167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:07.914751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:07.920298 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:05:07.926764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:05:07.927180 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:05:07.927647 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:05:07.928051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:05:07.928516 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:05:07.990259 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b0fe086-5ada-4614-b7f9-08c99016f69a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action" status: 202 len: 0 microversion: 2.1 time: 0.120781 Sep 18 02:05:07.991038 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3443/6862] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:05:07 2022] POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:05:07.999244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:07.999964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:08.006654 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:08.007224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:08.007746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:08.008521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:08.009060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:08.009677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:08.142079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:08.150647 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-401a15c8-2905-4ff6-876f-7c990ca00ffe tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.155350 Sep 18 02:05:08.151231 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3420/6863] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:07 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:09.175250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:09.176039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:09.186931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:09.187443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:09.187884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:09.188599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:09.189054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:09.189484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:09.328117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:09.335911 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-619ceba8-cc01-49b8-aa38-528bfd02ed84 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1677 microversion: 2.1 time: 0.165489 Sep 18 02:05:09.336496 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3444/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:09 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:10.360474 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:10.361083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:10.367972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:10.368474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:10.368931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:10.369700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:10.370171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:10.370609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:10.501540 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:10.509825 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cf06cc0b-1a9a-4300-bded-f4059326bfa8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1682 microversion: 2.1 time: 0.153594 Sep 18 02:05:10.510392 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3421/6865] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:10 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:11.534917 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:11.535513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:11.542952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:11.543435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:11.543878 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:11.544571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:11.545023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:11.545446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:11.688280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:11.696995 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9b1d7742-5024-4896-b0ed-c424b6cdf2f1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1682 microversion: 2.1 time: 0.166211 Sep 18 02:05:11.697613 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3445/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:11 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:12.218027 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-bfb31242-fc99-4364-8c92-87c0a7964bea req-d584f91f-6e70-4c3d-a707-e77cb31383a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f67797b-a5b6-4537-8107-e542566ab2d4", "name": "network-vif-unplugged", "status": "completed", "tag": "9786eb9b-e909-4e9c-8307-cfaa54ee4388"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:12.228843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bfb31242-fc99-4364-8c92-87c0a7964bea req-d584f91f-6e70-4c3d-a707-e77cb31383a9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:12.229346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bfb31242-fc99-4364-8c92-87c0a7964bea req-d584f91f-6e70-4c3d-a707-e77cb31383a9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:12.229808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-bfb31242-fc99-4364-8c92-87c0a7964bea req-d584f91f-6e70-4c3d-a707-e77cb31383a9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:12.242961 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-bfb31242-fc99-4364-8c92-87c0a7964bea req-d584f91f-6e70-4c3d-a707-e77cb31383a9 service nova] Creating event network-vif-unplugged:9786eb9b-e909-4e9c-8307-cfaa54ee4388 for instance 6f67797b-a5b6-4537-8107-e542566ab2d4 on n-h2-master-1 Sep 18 02:05:12.248326 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-bfb31242-fc99-4364-8c92-87c0a7964bea req-d584f91f-6e70-4c3d-a707-e77cb31383a9 service nova] Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:05:12.259932 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-bfb31242-fc99-4364-8c92-87c0a7964bea req-d584f91f-6e70-4c3d-a707-e77cb31383a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045868 Sep 18 02:05:12.260606 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3422/6867] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:05:12.722617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:12.724450 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:12.730909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:12.731491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:12.731999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:12.733001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:12.733579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:12.734064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:12.873505 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:12.887393 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-33579ed9-ebc2-448f-9744-fb2a74313b37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1681 microversion: 2.1 time: 0.168853 Sep 18 02:05:12.888180 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3446/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:12 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:13.914502 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:13.915291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:13.922995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:13.923663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:13.924313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:13.925316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:13.925967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:13.926630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:14.084518 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:14.092874 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dcfa644f-d37c-4baf-b6ed-34deedd50047 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1679 microversion: 2.1 time: 0.184589 Sep 18 02:05:14.093483 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3423/6869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:13 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:14.299281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a8d15fd4-2abe-4bd0-b7d2-787caef572f9 req-b76dfab5-3bac-4721-8aab-3fb6f8ced4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f67797b-a5b6-4537-8107-e542566ab2d4", "tag": "9786eb9b-e909-4e9c-8307-cfaa54ee4388"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:14.310495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8d15fd4-2abe-4bd0-b7d2-787caef572f9 req-b76dfab5-3bac-4721-8aab-3fb6f8ced4c4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:14.310992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8d15fd4-2abe-4bd0-b7d2-787caef572f9 req-b76dfab5-3bac-4721-8aab-3fb6f8ced4c4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:14.311399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a8d15fd4-2abe-4bd0-b7d2-787caef572f9 req-b76dfab5-3bac-4721-8aab-3fb6f8ced4c4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:14.324336 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a8d15fd4-2abe-4bd0-b7d2-787caef572f9 req-b76dfab5-3bac-4721-8aab-3fb6f8ced4c4 service nova] Creating event network-changed:9786eb9b-e909-4e9c-8307-cfaa54ee4388 for instance 6f67797b-a5b6-4537-8107-e542566ab2d4 on n-h2-master-1 Sep 18 02:05:14.330321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-a8d15fd4-2abe-4bd0-b7d2-787caef572f9 req-b76dfab5-3bac-4721-8aab-3fb6f8ced4c4 service nova] Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:05:14.346981 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a8d15fd4-2abe-4bd0-b7d2-787caef572f9 req-b76dfab5-3bac-4721-8aab-3fb6f8ced4c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051385 Sep 18 02:05:14.347703 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3447/6870] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:05:15.117924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:15.118545 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:15.125327 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:15.125860 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:15.126313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:15.127022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:15.127485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:15.127916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:15.608396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:15.627708 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e9cd52d0-1acb-4062-aaca-f0e5b3e3ef48 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1675 microversion: 2.1 time: 0.514228 Sep 18 02:05:15.628600 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3424/6871] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:15 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1675 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:15.656660 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:15.657222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:15.665475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:15.665998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:15.666435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:15.667139 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:15.667599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:15.668397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:15.711764 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:05:15.741040 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70d46abf-c90b-44d0-9e6e-b3d84241c1e3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action" status: 204 len: 0 microversion: 2.1 time: 0.088788 Sep 18 02:05:15.742401 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3448/6872] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:05:15 2022] POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:05:15.750854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:15.752739 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:15.760191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:15.760704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:15.761391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:15.762429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:15.762906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:15.763572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:15.927405 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:15.936273 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-154d08ae-2309-48a3-a36b-c38ec376ba37 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1675 microversion: 2.1 time: 0.189328 Sep 18 02:05:15.937138 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3425/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:15 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:16.963884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:16.964646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:16.974434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:16.975778 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:16.975960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:16.977117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:16.977930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:16.978652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:17.132352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:17.141160 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb646337-5bea-4eb4-bbe9-cbf64be41dc9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1675 microversion: 2.1 time: 0.182322 Sep 18 02:05:17.141920 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3449/6874] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:16 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:17.832473 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b6d5d6e5-a31c-4a64-a719-653e8b738742 req-09483c89-f618-4f37-ad9b-c39c6bcbbdca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f67797b-a5b6-4537-8107-e542566ab2d4", "name": "network-vif-plugged", "status": "completed", "tag": "9786eb9b-e909-4e9c-8307-cfaa54ee4388"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:17.843410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b6d5d6e5-a31c-4a64-a719-653e8b738742 req-09483c89-f618-4f37-ad9b-c39c6bcbbdca service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:17.843936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b6d5d6e5-a31c-4a64-a719-653e8b738742 req-09483c89-f618-4f37-ad9b-c39c6bcbbdca service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:17.844564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b6d5d6e5-a31c-4a64-a719-653e8b738742 req-09483c89-f618-4f37-ad9b-c39c6bcbbdca service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:17.859293 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b6d5d6e5-a31c-4a64-a719-653e8b738742 req-09483c89-f618-4f37-ad9b-c39c6bcbbdca service nova] Creating event network-vif-plugged:9786eb9b-e909-4e9c-8307-cfaa54ee4388 for instance 6f67797b-a5b6-4537-8107-e542566ab2d4 on n-h2-master-1 Sep 18 02:05:17.864365 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b6d5d6e5-a31c-4a64-a719-653e8b738742 req-09483c89-f618-4f37-ad9b-c39c6bcbbdca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097017 Sep 18 02:05:17.864970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3426/6875] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:05:18.165922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:18.166657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:18.173325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:18.173850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:18.174286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:18.174985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:18.175439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:18.175862 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:18.311947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:18.321873 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4011b2e9-afb6-4aa6-917f-d3776b6dc270 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1654 microversion: 2.1 time: 0.159729 Sep 18 02:05:18.322835 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3450/6876] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:18 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:18.347958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:18.348939 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:18.355829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:18.356312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:18.356761 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:18.357470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:18.357968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:18.358408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:18.506998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:18.515313 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4cc18425-4386-41c8-8f3c-d3645ab2c8b4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1654 microversion: 2.1 time: 0.173408 Sep 18 02:05:18.515888 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3427/6877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:18 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1654 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:18.541220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64999895-a0f8-4ded-aab3-ffdcf1e2b702 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:18.547552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64999895-a0f8-4ded-aab3-ffdcf1e2b702 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:18.547995 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64999895-a0f8-4ded-aab3-ffdcf1e2b702 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:18.548439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64999895-a0f8-4ded-aab3-ffdcf1e2b702 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:18.574903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-64999895-a0f8-4ded-aab3-ffdcf1e2b702 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Going to try to start instance {{(pid=122374) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 02:05:18.620896 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64999895-a0f8-4ded-aab3-ffdcf1e2b702 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action" status: 202 len: 0 microversion: 2.1 time: 0.083248 Sep 18 02:05:18.621522 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3451/6878] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:05:18 2022] POST /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:05:18.644071 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:18.644767 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:18.652709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:18.653266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:18.661324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:18.662209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:18.662828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:18.663288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:18.823083 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:18.832265 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c02f1fe-3694-4911-83da-047d9cde4ee4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1663 microversion: 2.1 time: 0.202388 Sep 18 02:05:18.832265 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3428/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:18 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1663 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:19.856531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:19.857494 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:19.865526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:19.866028 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:19.866498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:19.867257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:19.867719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:19.868143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:20.016991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:20.025107 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5d2b350-30d6-45d8-9c5f-88de48b88cae tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1667 microversion: 2.1 time: 0.172944 Sep 18 02:05:20.025715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3452/6880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:19 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1667 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:20.048111 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:20.048663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:20.058207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:20.058768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:20.059223 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:20.059941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:20.060420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:20.060862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:20.082265 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=100 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:05:20.089985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:05:20.183441 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-831a6e8b-4b24-42a7-8336-21f1bc7d7619 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 204 len: 0 microversion: 2.1 time: 0.138803 Sep 18 02:05:20.184503 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3429/6881] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:05:20 2022] DELETE /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:05:20.193514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:20.194167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:20.200589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:20.201248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:20.201913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:20.202763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:20.203221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:20.203644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:20.372670 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:20.380687 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-45c74334-32be-4b56-8d1f-4c0a7c01dcd3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1673 microversion: 2.1 time: 0.192047 Sep 18 02:05:20.381270 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3453/6882] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:20 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:21.413088 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:21.413836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:21.416642 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:05:21.422322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:21.422835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:21.423290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:21.424016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:21.424491 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:21.424933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:21.567177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:21.582833 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-74b380b3-6024-443d-b465-122b475db106 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1673 microversion: 2.1 time: 0.174538 Sep 18 02:05:21.583440 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3430/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:21 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:22.607184 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:22.607978 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:22.612039 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=43 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:05:22.617702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:22.618109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:22.618548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:22.619260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:22.619747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:22.620172 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:22.673037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-b671ba1a-c524-49fc-9eb2-02b763cd5efa req-f630569c-bf91-4206-ae2a-7360f2bb07c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f67797b-a5b6-4537-8107-e542566ab2d4", "name": "network-vif-deleted", "tag": "9786eb9b-e909-4e9c-8307-cfaa54ee4388"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:22.685400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b671ba1a-c524-49fc-9eb2-02b763cd5efa req-f630569c-bf91-4206-ae2a-7360f2bb07c6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:22.686218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b671ba1a-c524-49fc-9eb2-02b763cd5efa req-f630569c-bf91-4206-ae2a-7360f2bb07c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:22.686680 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-b671ba1a-c524-49fc-9eb2-02b763cd5efa req-f630569c-bf91-4206-ae2a-7360f2bb07c6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:22.699595 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-b671ba1a-c524-49fc-9eb2-02b763cd5efa req-f630569c-bf91-4206-ae2a-7360f2bb07c6 service nova] Creating event network-vif-deleted:9786eb9b-e909-4e9c-8307-cfaa54ee4388 for instance 6f67797b-a5b6-4537-8107-e542566ab2d4 on n-h2-master-1 Sep 18 02:05:22.706304 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-b671ba1a-c524-49fc-9eb2-02b763cd5efa req-f630569c-bf91-4206-ae2a-7360f2bb07c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036665 Sep 18 02:05:22.707931 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3431/6884] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:05:22.711109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:22.721001 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7e6b3173-2318-4049-b5d3-8240487b3632 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 200 len: 1606 microversion: 2.1 time: 0.117881 Sep 18 02:05:22.721624 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3454/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:22 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 1606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:23.747073 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:23.747780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:23.753996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:23.755011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:23.755455 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:23.756145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:23.756609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:23.757040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:23.771554 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 HTTP/1.1 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6f67797b-a5b6-4537-8107-e542566ab2d4'} Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:05:23.773187 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:05:23.778410 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f9b22999-7670-442f-bce6-1545364ed355 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 404 len: 111 microversion: 2.1 time: 0.032866 Sep 18 02:05:23.779192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3432/6886] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:23 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:05:23.791475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:23.792079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:23.798943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:23.799420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:23.799847 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:23.800524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:23.800988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:23.801387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:23.814615 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 HTTP/1.1 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6f67797b-a5b6-4537-8107-e542566ab2d4'} Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:05:23.816234 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad76f1c6-1eae-4251-84a4-640abfb8388d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 404 len: 111 microversion: 2.1 time: 0.030661 Sep 18 02:05:23.821618 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3455/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:23 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:05:23.867157 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1985766767", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "9a4d4763-3788-4522-9551-70a125575da8"}], "security_groups": [{"name": "tempest-securitygroup--165085111"}], "key_name": "tempest-keypair-505809236", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:23.974117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] validate_networks() for [('9a4d4763-3788-4522-9551-70a125575da8', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:05:24.398706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:05:24.399144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:05:24.399626 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:05:24.400045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:05:24.400514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:05:24.409310 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:24.409832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:24.410762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:24.411501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:24.411968 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:24.412402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:24.429185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:05:24.434454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for user fa377acabe334070b636ba282f080029 and project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:05:24.446657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:05:24.448942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:05:24.495626 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d641494a-88c0-4cd0-b17f-4d424601b202 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.632236 Sep 18 02:05:24.496284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3433/6888] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:05:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:05:24.507576 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3db9495a-9497-45e9-baad-e486e2902d27 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:24.508405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3db9495a-9497-45e9-baad-e486e2902d27 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:24.565100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3db9495a-9497-45e9-baad-e486e2902d27 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:24.572588 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3db9495a-9497-45e9-baad-e486e2902d27 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1238 microversion: 2.1 time: 0.068883 Sep 18 02:05:24.573160 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3456/6889] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:24 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:25.597886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:25.598528 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:25.608037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:25.609343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:25.609589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:25.610384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:25.611055 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:25.611758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:25.682458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:25.693231 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1b87ac8-b8c8-450d-8638-ec35bf535268 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1308 microversion: 2.1 time: 0.099916 Sep 18 02:05:25.694419 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3434/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:25 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:26.719667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:26.720289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:26.728144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:26.728665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:26.729105 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:26.730024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:26.730489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:26.730929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:26.868743 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:26.880207 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7582f3ff-ed62-434e-a02a-dc3771bd2b47 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1363 microversion: 2.1 time: 0.164306 Sep 18 02:05:26.881017 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3457/6891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:26 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:27.115675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ef2fa5a7-c133-40a0-8b22-75069cfebea3 req-1f5caa84-3e0f-4918-8cf0-12bbce71c283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:27.133579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ef2fa5a7-c133-40a0-8b22-75069cfebea3 req-1f5caa84-3e0f-4918-8cf0-12bbce71c283 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:27.134376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ef2fa5a7-c133-40a0-8b22-75069cfebea3 req-1f5caa84-3e0f-4918-8cf0-12bbce71c283 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:27.134912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ef2fa5a7-c133-40a0-8b22-75069cfebea3 req-1f5caa84-3e0f-4918-8cf0-12bbce71c283 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:27.147343 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ef2fa5a7-c133-40a0-8b22-75069cfebea3 req-1f5caa84-3e0f-4918-8cf0-12bbce71c283 service nova] Creating event network-changed:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h1-master-1 Sep 18 02:05:27.152103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ef2fa5a7-c133-40a0-8b22-75069cfebea3 req-1f5caa84-3e0f-4918-8cf0-12bbce71c283 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041079 Sep 18 02:05:27.152710 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3435/6892] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:05:27.904360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:27.905071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:27.913096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:27.913715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:27.914191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:27.914876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:27.915327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:27.915751 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:28.051506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:28.059312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5aa14d86-9cb3-42c3-8b3f-a049912f4944 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1363 microversion: 2.1 time: 0.158888 Sep 18 02:05:28.059889 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3458/6893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:27 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:29.084552 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:29.085258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:29.091468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:29.091914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:29.092342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:29.093045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:29.093503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:29.093965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:29.225182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:29.233025 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e24eb909-c2f3-4dd5-9fd6-751fb7b1d003 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1363 microversion: 2.1 time: 0.154154 Sep 18 02:05:29.233619 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3436/6894] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:29 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:30.256718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:30.257364 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:30.265009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:30.265487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:30.265950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:30.266644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:30.267101 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:30.267529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:30.403469 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:30.411732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-86c42382-fcc9-4ee2-bf7c-9292d72ca934 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1363 microversion: 2.1 time: 0.158977 Sep 18 02:05:30.412306 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3459/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:30 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:31.435653 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:31.436441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:31.443434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:31.444021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:31.444482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:31.445198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:31.445695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:31.446143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:31.578561 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:31.586935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1377d995-4748-4096-bba3-f55a23e30444 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1363 microversion: 2.1 time: 0.155219 Sep 18 02:05:31.587517 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3437/6896] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:31 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:05:32.611430 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:32.612106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:32.618953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:32.619437 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:32.619872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:32.620562 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:32.621016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:32.621434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:32.756083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:32.764002 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0ec3457e-78de-4db4-8ce7-11d976d0e499 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1363 microversion: 2.1 time: 0.156525 Sep 18 02:05:32.764577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3460/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:32 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:33.538798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-20232325-7f69-421c-ad3f-e6aee996ff48 req-720a8a12-a27a-4c0b-a9cf-2eb5b926767b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "name": "network-vif-plugged", "status": "completed", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:33.549240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-20232325-7f69-421c-ad3f-e6aee996ff48 req-720a8a12-a27a-4c0b-a9cf-2eb5b926767b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:33.549762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-20232325-7f69-421c-ad3f-e6aee996ff48 req-720a8a12-a27a-4c0b-a9cf-2eb5b926767b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:33.550224 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-20232325-7f69-421c-ad3f-e6aee996ff48 req-720a8a12-a27a-4c0b-a9cf-2eb5b926767b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:33.561447 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-20232325-7f69-421c-ad3f-e6aee996ff48 req-720a8a12-a27a-4c0b-a9cf-2eb5b926767b service nova] Creating event network-vif-plugged:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h1-master-1 Sep 18 02:05:33.566946 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-20232325-7f69-421c-ad3f-e6aee996ff48 req-720a8a12-a27a-4c0b-a9cf-2eb5b926767b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 Sep 18 02:05:33.567564 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3438/6898] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:05:33.787302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:33.787841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:33.794794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:33.795282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:33.795719 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:33.796410 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:33.796863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:33.797288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:33.928069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:33.935797 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4317529e-8ec3-45eb-b2b4-9b92c8482c4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1363 microversion: 2.1 time: 0.152547 Sep 18 02:05:33.936369 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3461/6899] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:33 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:34.957825 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:05:34.958646 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:05:34.963667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:34.964384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:34.971438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:34.971937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:34.972391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:34.973113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:34.973603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:34.974045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:35.106021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:05:35.113840 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0fb54fb4-07e3-42c7-be7c-59a892883e14 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1550 microversion: 2.1 time: 0.157639 Sep 18 02:05:35.114416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3439/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:05:34 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:05:35.137467 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:05:35.137983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:05:35.139769 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:05:35.146649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:35.147143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:35.147586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:35.148287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:35.148748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:35.149183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:35.233177 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-64ce212b-a573-432b-b46f-8d822632c676 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099940 Sep 18 02:05:35.233839 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3462/6901] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 02:05:35 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:05:36.163222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-426001b4-54fa-4d04-aa9d-63d862fc667f req-12bba743-5e9e-44bb-a78d-d65bb053d10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:05:36.176128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-426001b4-54fa-4d04-aa9d-63d862fc667f req-12bba743-5e9e-44bb-a78d-d65bb053d10a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:05:36.177014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-426001b4-54fa-4d04-aa9d-63d862fc667f req-12bba743-5e9e-44bb-a78d-d65bb053d10a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:05:36.177571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-426001b4-54fa-4d04-aa9d-63d862fc667f req-12bba743-5e9e-44bb-a78d-d65bb053d10a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:05:36.190163 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-426001b4-54fa-4d04-aa9d-63d862fc667f req-12bba743-5e9e-44bb-a78d-d65bb053d10a service nova] Creating event network-changed:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h1-master-1 Sep 18 02:05:36.196023 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-426001b4-54fa-4d04-aa9d-63d862fc667f req-12bba743-5e9e-44bb-a78d-d65bb053d10a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036802 Sep 18 02:05:36.196829 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3440/6902] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:12.175911 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:06:12.177023 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:06:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c/action (ip 10.222.0.25) !!! Sep 18 02:06:12.178466 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=19 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:12.179257 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=77,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:12.184151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:12.186390 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:12.198165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:12.198642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:12.199072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:12.199757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:12.200204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:12.200625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:12.228536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:12.234007 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:06:12.240894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:06:12.241308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:06:12.241807 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:06:12.242214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:06:12.242617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:06:12.307224 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-51177dbd-4f27-42d1-8602-6b5b5bd4b06f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c/action" status: 202 len: 0 microversion: 2.1 time: 0.133332 Sep 18 02:06:12.308027 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3463/6903] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:06:12 2022] POST /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:06:12.315180 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:06:12.315180 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:06:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c (ip 10.222.0.25) !!! Sep 18 02:06:12.317715 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:12.318643 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:12.322828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:12.323568 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:12.336754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:12.337331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:12.337833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:12.338549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:12.339193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:12.339634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:12.501501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:12.510293 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-530f1994-8eea-4c69-b4ea-b12ef5d1a709 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1677 microversion: 2.1 time: 0.197704 Sep 18 02:06:12.510877 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3441/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:12 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:13.536623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:13.537424 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:13.546655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:13.547174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:13.547682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:13.548622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:13.549283 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:13.550015 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:13.693099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:13.701221 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-486370aa-ced2-4dbf-8abb-ab78000975ef tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1677 microversion: 2.1 time: 0.170861 Sep 18 02:06:13.702495 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3464/6905] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:13 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:14.726413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:14.726981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:14.734117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:14.734641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:14.735091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:14.735825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:14.736297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:14.736721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:14.892366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:14.902901 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bc5cd66a-0ba1-4917-ae81-d8c2a4c9aba9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1677 microversion: 2.1 time: 0.180399 Sep 18 02:06:14.903382 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3442/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:14 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:15.927335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:15.927953 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:15.936595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:15.937098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:15.937594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:15.938397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:15.938808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:15.939244 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:16.071353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:16.079028 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e664a1c4-a377-44cc-bfbc-b30f2b08e1d2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.155658 Sep 18 02:06:16.079623 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3465/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:15 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:17.103423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:17.104053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:17.110825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:17.111322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:17.111770 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:17.112471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:17.112940 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:17.114108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:17.242350 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:17.250161 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7f68387-3443-4509-a20f-63011a8ebf36 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.150691 Sep 18 02:06:17.250749 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3443/6908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:17 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:18.273681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:18.274293 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:18.281035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:18.281512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:18.281975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:18.282657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:18.283106 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:18.283526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:18.416320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:18.423994 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e267ab9a-8e47-4e2b-9379-96bfd6a267df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.154735 Sep 18 02:06:18.424574 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3466/6909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:18 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:19.448735 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:19.449361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:19.456195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:19.456693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:19.457141 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:19.457878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:19.458350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:19.459454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:19.586833 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:19.594589 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a146c1a2-8009-45cc-950c-bdef14b185c8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.149846 Sep 18 02:06:19.595163 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3444/6910] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:19 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:06:20.617153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:20.617790 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:20.624527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:20.625002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:20.625456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:20.626169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:20.626616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:20.627032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:20.760514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:20.768496 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a9c740d0-3f1d-4904-9050-45cb2e3f9e85 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.155331 Sep 18 02:06:20.769067 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3467/6911] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:20 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:21.792976 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:21.793632 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:21.800443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:21.800972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:21.801425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:21.802153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:21.802627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:21.803072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:21.932477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:21.942209 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eb5cecf9-041c-4e09-b19a-56a8fe60db3e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.152877 Sep 18 02:06:21.942723 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3445/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:21 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:22.965647 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:22.966255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:22.973560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:22.974050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:22.974982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:22.975665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:22.976116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:22.976535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:23.107010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:23.114699 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d363bcb-6129-4630-ac94-46e5ded8d371 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.153066 Sep 18 02:06:23.115927 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3468/6913] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:22 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:24.139427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:24.140028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:24.147171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:24.147674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:24.148153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:24.148862 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:24.149338 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:24.149921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:24.284198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:24.292681 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b6580dcc-8535-49b9-866f-1e46061ddadb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.157594 Sep 18 02:06:24.293267 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3446/6914] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:24 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:25.316995 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:25.317810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:25.326111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:25.326625 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:25.327078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:25.327804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:25.328267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:25.328760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:25.466047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:25.473846 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07a98c4e-6567-4471-aaca-fe7e1df3e220 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.161096 Sep 18 02:06:25.474414 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3469/6915] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:25 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:26.497099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:26.497756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:26.504184 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:26.504678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:26.505125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:26.505850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:26.506319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:26.506746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:26.642205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:26.650650 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-235e0bf4-5d0a-4b70-a96d-fedccae94ce2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1682 microversion: 2.1 time: 0.157652 Sep 18 02:06:26.651237 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3447/6916] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:26 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:27.219792 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-58ee3e30-9381-44be-a1f7-7a42e80fe4ec req-15076c33-dff0-4209-9edd-4248f9acfea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "name": "network-vif-unplugged", "status": "completed", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:27.231175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-58ee3e30-9381-44be-a1f7-7a42e80fe4ec req-15076c33-dff0-4209-9edd-4248f9acfea2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:27.231789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-58ee3e30-9381-44be-a1f7-7a42e80fe4ec req-15076c33-dff0-4209-9edd-4248f9acfea2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:27.232221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-58ee3e30-9381-44be-a1f7-7a42e80fe4ec req-15076c33-dff0-4209-9edd-4248f9acfea2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:27.244420 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-58ee3e30-9381-44be-a1f7-7a42e80fe4ec req-15076c33-dff0-4209-9edd-4248f9acfea2 service nova] Creating event network-vif-unplugged:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h2-master-1 Sep 18 02:06:27.249910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-58ee3e30-9381-44be-a1f7-7a42e80fe4ec req-15076c33-dff0-4209-9edd-4248f9acfea2 service nova] Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:06:27.265907 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-58ee3e30-9381-44be-a1f7-7a42e80fe4ec req-15076c33-dff0-4209-9edd-4248f9acfea2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049936 Sep 18 02:06:27.266529 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3470/6917] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:27.674104 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:27.674741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:27.682880 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:27.683401 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:27.683894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:27.684635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:27.685110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:27.685567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:27.827239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:27.835042 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9f56c09a-716e-49a9-8528-67984651fce9 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1681 microversion: 2.1 time: 0.164915 Sep 18 02:06:27.835665 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3448/6918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:27 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:28.859279 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:28.859965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:28.866610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:28.867104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:28.867531 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:28.868233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:28.868685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:28.869125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:29.018887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:29.027722 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb2092cd-4b18-49bc-b0b2-3a92cbb3848c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1679 microversion: 2.1 time: 0.173706 Sep 18 02:06:29.028339 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3471/6919] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:28 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:29.303650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-570dadc3-519e-42b1-817f-bd6766764e8f req-f45bfbee-8080-454c-ada1-c9b1836817a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:29.313963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-570dadc3-519e-42b1-817f-bd6766764e8f req-f45bfbee-8080-454c-ada1-c9b1836817a4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:29.314472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-570dadc3-519e-42b1-817f-bd6766764e8f req-f45bfbee-8080-454c-ada1-c9b1836817a4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:29.314906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-570dadc3-519e-42b1-817f-bd6766764e8f req-f45bfbee-8080-454c-ada1-c9b1836817a4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:29.326935 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-570dadc3-519e-42b1-817f-bd6766764e8f req-f45bfbee-8080-454c-ada1-c9b1836817a4 service nova] Creating event network-changed:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h2-master-1 Sep 18 02:06:29.332716 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-570dadc3-519e-42b1-817f-bd6766764e8f req-f45bfbee-8080-454c-ada1-c9b1836817a4 service nova] Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:06:29.344787 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-570dadc3-519e-42b1-817f-bd6766764e8f req-f45bfbee-8080-454c-ada1-c9b1836817a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044842 Sep 18 02:06:29.345729 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3449/6920] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:30.055777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:30.056835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:30.065336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.066000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.066676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.067540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.068664 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.069466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.219646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:30.228988 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a0ec9e32-7394-4ab9-9ee7-38ddb805f6ec tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1676 microversion: 2.1 time: 0.180952 Sep 18 02:06:30.229613 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3472/6921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:30 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:30.254805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:30.256031 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:30.264785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.265311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.265808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.266564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.267052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.267514 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.315985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.316708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.316966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.317810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.318805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.319251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.342937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:06:30.350822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for user fa377acabe334070b636ba282f080029 and project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:06:30.468863 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6eb4a315-3184-4fcc-bdb9-e99c28f1eb74 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c/action" status: 202 len: 0 microversion: 2.1 time: 0.217691 Sep 18 02:06:30.469900 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3450/6922] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:06:30 2022] POST /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:06:30.479335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:30.479949 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:30.486787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.487393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.487816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.488618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:30.489179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:30.490230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:30.669188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:30.678767 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cca07af9-1ab6-4d8c-81b7-7db18c575e4b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1675 microversion: 2.1 time: 0.203269 Sep 18 02:06:30.679620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3473/6923] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:30 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:31.708862 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:31.711390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:31.717698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:31.718211 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:31.718660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:31.719375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:31.719838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:31.720271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:31.860368 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:31.870629 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac83ee91-3ac9-446e-b67f-c97f3a948c00 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1675 microversion: 2.1 time: 0.172023 Sep 18 02:06:31.871513 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3451/6924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:31 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:32.129517 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-70822847-1012-4158-9210-c015271db36c req-e07b92ee-a59d-4bdc-9e57-e91c98bace2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "name": "network-vif-plugged", "status": "completed", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:32.142888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-70822847-1012-4158-9210-c015271db36c req-e07b92ee-a59d-4bdc-9e57-e91c98bace2c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:32.143384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-70822847-1012-4158-9210-c015271db36c req-e07b92ee-a59d-4bdc-9e57-e91c98bace2c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:32.143817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-70822847-1012-4158-9210-c015271db36c req-e07b92ee-a59d-4bdc-9e57-e91c98bace2c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:32.156908 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-70822847-1012-4158-9210-c015271db36c req-e07b92ee-a59d-4bdc-9e57-e91c98bace2c service nova] Creating event network-vif-plugged:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h2-master-1 Sep 18 02:06:32.164716 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-70822847-1012-4158-9210-c015271db36c req-e07b92ee-a59d-4bdc-9e57-e91c98bace2c service nova] Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:06:32.178183 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-70822847-1012-4158-9210-c015271db36c req-e07b92ee-a59d-4bdc-9e57-e91c98bace2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051745 Sep 18 02:06:32.179201 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3474/6925] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:32.899660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:32.900297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:32.907279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:32.907785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:32.908243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:32.908960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:32.909437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:32.909911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:33.047448 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:33.055914 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3d273f6-066d-434f-a412-12695a3889a8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1675 microversion: 2.1 time: 0.160836 Sep 18 02:06:33.056498 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3452/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:32 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:33.759337 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c2ca7b0c-f68c-4fd3-9003-1ccad0b6a19d req-4db8f2be-4425-4bb7-a48c-c44da39d3757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "name": "network-vif-unplugged", "status": "completed", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:33.769420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c2ca7b0c-f68c-4fd3-9003-1ccad0b6a19d req-4db8f2be-4425-4bb7-a48c-c44da39d3757 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:33.770008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c2ca7b0c-f68c-4fd3-9003-1ccad0b6a19d req-4db8f2be-4425-4bb7-a48c-c44da39d3757 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:33.770455 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c2ca7b0c-f68c-4fd3-9003-1ccad0b6a19d req-4db8f2be-4425-4bb7-a48c-c44da39d3757 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:33.783929 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c2ca7b0c-f68c-4fd3-9003-1ccad0b6a19d req-4db8f2be-4425-4bb7-a48c-c44da39d3757 service nova] Creating event network-vif-unplugged:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h1-master-1 Sep 18 02:06:33.790271 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-c2ca7b0c-f68c-4fd3-9003-1ccad0b6a19d req-4db8f2be-4425-4bb7-a48c-c44da39d3757 service nova] Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:06:33.800934 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c2ca7b0c-f68c-4fd3-9003-1ccad0b6a19d req-4db8f2be-4425-4bb7-a48c-c44da39d3757 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046957 Sep 18 02:06:33.801568 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3475/6927] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:34.080040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:34.080593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:34.088559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:34.089073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:34.089524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:34.090304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:34.090768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:34.091204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:34.235910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:34.243715 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8de7e67-d9cb-4bd5-9109-1eec2255709e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1675 microversion: 2.1 time: 0.167838 Sep 18 02:06:34.244296 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3453/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:34 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:35.268594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:35.269212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:35.276056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:35.276530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:35.276962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:35.277670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:35.278123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:35.278541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:35.421073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:35.428886 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3954a013-3c20-412b-9e20-567aa0fe531e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1675 microversion: 2.1 time: 0.165566 Sep 18 02:06:35.429455 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3476/6929] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:35 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:35.816765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-de3a18f6-af8d-4a8e-8152-d67b3515fd48 req-2d737c97-4bd6-464a-a96d-6e658a0fa4da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:35.827362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-de3a18f6-af8d-4a8e-8152-d67b3515fd48 req-2d737c97-4bd6-464a-a96d-6e658a0fa4da service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:35.827845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-de3a18f6-af8d-4a8e-8152-d67b3515fd48 req-2d737c97-4bd6-464a-a96d-6e658a0fa4da service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:35.828284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-de3a18f6-af8d-4a8e-8152-d67b3515fd48 req-2d737c97-4bd6-464a-a96d-6e658a0fa4da service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:35.843103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-de3a18f6-af8d-4a8e-8152-d67b3515fd48 req-2d737c97-4bd6-464a-a96d-6e658a0fa4da service nova] Creating event network-changed:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h1-master-1 Sep 18 02:06:35.848381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-de3a18f6-af8d-4a8e-8152-d67b3515fd48 req-2d737c97-4bd6-464a-a96d-6e658a0fa4da service nova] Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:06:35.858922 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-de3a18f6-af8d-4a8e-8152-d67b3515fd48 req-2d737c97-4bd6-464a-a96d-6e658a0fa4da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045799 Sep 18 02:06:35.859497 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3454/6930] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:36.452415 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:36.453032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:36.459941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:36.460426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:36.460863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:36.461644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:36.462085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:36.462519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:36.606358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:36.616211 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48da841b-9553-4823-92a4-f7b801c571c1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1675 microversion: 2.1 time: 0.167755 Sep 18 02:06:36.624503 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3477/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:36 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:37.641870 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:37.642584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:37.649251 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:37.649803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:37.650263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:37.651000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:37.651470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:37.651912 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:37.656031 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:37.790690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:37.798709 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a4fb3f0-053c-4492-b65e-1d69b94630f8 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1668 microversion: 2.1 time: 0.162299 Sep 18 02:06:37.799284 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3455/6932] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:37 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:37.822074 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:37.822690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:37.829438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:37.829956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:37.830393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:37.831088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:37.831547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:37.831975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:37.975898 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:37.984726 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88ebed05-f985-44b0-858d-2a35d5ab13ca tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1668 microversion: 2.1 time: 0.167137 Sep 18 02:06:37.985520 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3478/6933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:37 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:38.010777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:38.011406 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:38.017707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:38.018208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:38.018655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:38.019362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:38.019830 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:38.020268 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:38.155966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:38.163633 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e9cb694e-1c84-4abe-b250-14716c81a5ed tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1668 microversion: 2.1 time: 0.157026 Sep 18 02:06:38.164211 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3456/6934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:38 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:38.186483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:38.187032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:38.193430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:38.193939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:38.194369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:38.195115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:38.195570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:38.196079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:38.200209 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:38.224775 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:06:38.308291 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d98b17d4-63f8-4ade-98b7-ba2841efbf1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 204 len: 0 microversion: 2.1 time: 0.125580 Sep 18 02:06:38.309300 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3479/6935] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:06:38 2022] DELETE /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:06:38.317424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:38.318979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:38.325505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:38.326311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:38.326966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:38.328082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:38.328562 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:38.329042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:38.457729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:38.465505 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-44543c71-e42b-4ba0-a780-b17fd09f0d1c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1674 microversion: 2.1 time: 0.152012 Sep 18 02:06:38.466100 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3457/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:38 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:39.489069 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:39.490123 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:39.497855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:39.498422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:39.498947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:39.499745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:39.500260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:39.500774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:39.634623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:39.642685 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1b630383-3769-44a8-9e1e-21a15fdf2a65 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1674 microversion: 2.1 time: 0.158063 Sep 18 02:06:39.643258 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3480/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:39 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:39.933019 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c5358d13-63f1-46a5-8c67-83fa9f236c5f req-750fb4be-fe06-43df-9c7c-ab4ab217aef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "name": "network-vif-plugged", "status": "completed", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:39.944904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5358d13-63f1-46a5-8c67-83fa9f236c5f req-750fb4be-fe06-43df-9c7c-ab4ab217aef8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:39.945493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5358d13-63f1-46a5-8c67-83fa9f236c5f req-750fb4be-fe06-43df-9c7c-ab4ab217aef8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:39.946099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c5358d13-63f1-46a5-8c67-83fa9f236c5f req-750fb4be-fe06-43df-9c7c-ab4ab217aef8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:39.958715 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c5358d13-63f1-46a5-8c67-83fa9f236c5f req-750fb4be-fe06-43df-9c7c-ab4ab217aef8 service nova] Creating event network-vif-plugged:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h1-master-1 Sep 18 02:06:39.964200 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c5358d13-63f1-46a5-8c67-83fa9f236c5f req-750fb4be-fe06-43df-9c7c-ab4ab217aef8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Sep 18 02:06:39.965250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3458/6938] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:40.618770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1082cc27-d075-4954-a669-599ebfd46c97 req-96011099-ed37-4306-a178-cfec589d932f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2225dd-b9ff-4108-b7b0-87da2a983d3c", "name": "network-vif-deleted", "tag": "b8b487e9-209c-44bd-a04e-4cd905224db0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:40.630841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1082cc27-d075-4954-a669-599ebfd46c97 req-96011099-ed37-4306-a178-cfec589d932f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:40.631322 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1082cc27-d075-4954-a669-599ebfd46c97 req-96011099-ed37-4306-a178-cfec589d932f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:40.631755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1082cc27-d075-4954-a669-599ebfd46c97 req-96011099-ed37-4306-a178-cfec589d932f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:40.652447 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1082cc27-d075-4954-a669-599ebfd46c97 req-96011099-ed37-4306-a178-cfec589d932f service nova] Creating event network-vif-deleted:b8b487e9-209c-44bd-a04e-4cd905224db0 for instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c on n-h1-master-1 Sep 18 02:06:40.657813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1082cc27-d075-4954-a669-599ebfd46c97 req-96011099-ed37-4306-a178-cfec589d932f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042838 Sep 18 02:06:40.658706 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3481/6939] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:40.664566 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:40.669042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:40.669970 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:40.676624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:40.677308 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:40.677855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:40.678720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:40.679263 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:40.679776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:40.744844 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:40.753100 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b9267ad2-8963-45ed-9e77-4271c873e9d5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 200 len: 1323 microversion: 2.1 time: 0.089451 Sep 18 02:06:40.753702 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3459/6940] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:40 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:41.777999 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:41.778692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:41.784908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:41.785338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:41.785790 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:41.787056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:41.787505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:41.787923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:41.801211 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c HTTP/1.1 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8c2225dd-b9ff-4108-b7b0-87da2a983d3c'} Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:06:41.803479 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3989d8f3-a394-42d1-97ee-80ba99c88482 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 404 len: 111 microversion: 2.1 time: 0.032160 Sep 18 02:06:41.808340 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3482/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:41 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:06:41.822500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:41.823196 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:41.829692 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:41.830185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:41.830631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:41.831336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:41.831801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:41.832236 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:41.845826 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c HTTP/1.1 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8c2225dd-b9ff-4108-b7b0-87da2a983d3c'} Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:06:41.847458 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09ae4a69-3de7-4d6b-a49a-f311663aaa1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 404 len: 111 microversion: 2.1 time: 0.030233 Sep 18 02:06:41.852531 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3460/6942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:41 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:06:41.898376 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-509427793", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "9a4d4763-3788-4522-9551-70a125575da8"}], "security_groups": [{"name": "tempest-securitygroup--165085111"}], "key_name": "tempest-keypair-505809236", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:42.004958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] validate_networks() for [('9a4d4763-3788-4522-9551-70a125575da8', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:06:42.413488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:06:42.414019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:06:42.414540 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:06:42.415178 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:06:42.415495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:06:42.417587 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:42.426669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:42.427159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:42.427603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:42.428338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:42.428800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:42.429234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:42.446488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:06:42.451713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for user fa377acabe334070b636ba282f080029 and project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:06:42.464665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:06:42.467014 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:06:42.514016 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-843f5381-d0a1-40eb-a7b4-4293924b2917 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.619406 Sep 18 02:06:42.514766 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3483/6943] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:06:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:06:42.526761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d6e26952-8f66-43ec-89e1-0d72b31e1322 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:42.527646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d6e26952-8f66-43ec-89e1-0d72b31e1322 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:42.531825 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:42.584606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d6e26952-8f66-43ec-89e1-0d72b31e1322 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:42.592022 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d6e26952-8f66-43ec-89e1-0d72b31e1322 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1237 microversion: 2.1 time: 0.069281 Sep 18 02:06:42.592581 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3461/6944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:42 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:06:43.617615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:43.618236 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:43.625630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:43.626161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:43.626601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:43.627300 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:43.627916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:43.628938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:43.694190 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:43.703286 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b6823e1-79a4-4114-a67a-fe5f10fe580b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1297 microversion: 2.1 time: 0.090934 Sep 18 02:06:43.705835 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3484/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:43 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:44.729002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:44.729612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:44.737480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:44.738006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:44.738461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:44.739173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:44.739641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:44.740726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:44.881274 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:44.889827 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3e7b81e-084c-41f6-8acd-85e46e0057e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1362 microversion: 2.1 time: 0.165317 Sep 18 02:06:44.890406 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3462/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:44 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:45.080302 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-15abd7fc-f167-4000-ad52-6d3df1b556ec req-44126f13-1653-4263-88c1-2d108d2ed8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:45.092755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-15abd7fc-f167-4000-ad52-6d3df1b556ec req-44126f13-1653-4263-88c1-2d108d2ed8af service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:45.093382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-15abd7fc-f167-4000-ad52-6d3df1b556ec req-44126f13-1653-4263-88c1-2d108d2ed8af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:45.093939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-15abd7fc-f167-4000-ad52-6d3df1b556ec req-44126f13-1653-4263-88c1-2d108d2ed8af service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:45.107944 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-15abd7fc-f167-4000-ad52-6d3df1b556ec req-44126f13-1653-4263-88c1-2d108d2ed8af service nova] Creating event network-changed:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h2-master-1 Sep 18 02:06:45.113608 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-15abd7fc-f167-4000-ad52-6d3df1b556ec req-44126f13-1653-4263-88c1-2d108d2ed8af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037119 Sep 18 02:06:45.114403 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3485/6947] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:45.914282 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:45.914906 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:45.922317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:45.922822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:45.923315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:45.924087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:45.924610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:45.925098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:46.073912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:46.081914 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e061541e-92f6-4dbb-aad3-923ecde56d2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1362 microversion: 2.1 time: 0.172108 Sep 18 02:06:46.082499 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3463/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:45 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:47.107637 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:47.108339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:47.114530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:47.115867 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:47.116185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:47.116803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:47.117256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:47.117713 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:47.251561 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:47.259315 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-605ab398-79ff-47e0-a394-3268adf96330 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1362 microversion: 2.1 time: 0.156739 Sep 18 02:06:47.259891 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3486/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:47 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:48.283770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:48.284390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:48.293450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:48.293916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:48.294365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:48.295090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:48.295564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:48.296001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:48.455290 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:48.464362 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b200b259-d4d1-4ce2-a0c0-de7b35ebd414 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1362 microversion: 2.1 time: 0.184443 Sep 18 02:06:48.464958 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3464/6950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:48 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:49.488309 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:49.488961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:49.496217 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:49.496707 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:49.497149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:49.497876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:49.498338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:49.498767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:49.630906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:49.639409 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6525b805-4a55-41de-af0a-8552796723dd tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1362 microversion: 2.1 time: 0.155004 Sep 18 02:06:49.640002 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3487/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:49 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:50.221820 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-59d6f3f7-2a85-49fb-aed2-4ebad9ce62a0 req-73f57bc6-c132-4109-b73c-1048e570f3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "name": "network-vif-plugged", "status": "completed", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:50.233167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-59d6f3f7-2a85-49fb-aed2-4ebad9ce62a0 req-73f57bc6-c132-4109-b73c-1048e570f3e4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:50.233708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-59d6f3f7-2a85-49fb-aed2-4ebad9ce62a0 req-73f57bc6-c132-4109-b73c-1048e570f3e4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:50.234160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-59d6f3f7-2a85-49fb-aed2-4ebad9ce62a0 req-73f57bc6-c132-4109-b73c-1048e570f3e4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:50.246438 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-59d6f3f7-2a85-49fb-aed2-4ebad9ce62a0 req-73f57bc6-c132-4109-b73c-1048e570f3e4 service nova] Creating event network-vif-plugged:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h2-master-1 Sep 18 02:06:50.251933 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-59d6f3f7-2a85-49fb-aed2-4ebad9ce62a0 req-73f57bc6-c132-4109-b73c-1048e570f3e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033822 Sep 18 02:06:50.253439 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3465/6952] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:50.668189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:50.668735 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:50.675534 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:50.676007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:50.676435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:50.677111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:50.678229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:50.678649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:50.814204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:50.820969 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-df2ac3c2-95dd-4dd1-bbad-e287008d1885 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1362 microversion: 2.1 time: 0.156787 Sep 18 02:06:50.821666 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3488/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:50 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:51.846843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:51.847549 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:51.853836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:51.854413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:51.854878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:51.855564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:51.856029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:51.856463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:51.988347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:06:51.996719 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-01ce66da-5ea1-4ba3-8bfe-52524e274262 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1548 microversion: 2.1 time: 0.155197 Sep 18 02:06:51.997287 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3466/6954] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:06:51 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:06:52.020742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:06:52.021283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:06:52.027987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:52.028463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:52.028894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:52.029591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:52.030045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:52.030464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:52.111989 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a5214931-cc3e-4522-a9d3-fec95d4304f4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095094 Sep 18 02:06:52.112620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3489/6955] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 18 02:06:52 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:06:53.365178 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d6d4c164-10b8-4d56-b890-c0acf3c97c9f req-360219e7-7401-4fff-8bd4-4087c581506e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:06:53.370161 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:06:53.376670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d6d4c164-10b8-4d56-b890-c0acf3c97c9f req-360219e7-7401-4fff-8bd4-4087c581506e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:06:53.377162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d6d4c164-10b8-4d56-b890-c0acf3c97c9f req-360219e7-7401-4fff-8bd4-4087c581506e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:06:53.377639 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d6d4c164-10b8-4d56-b890-c0acf3c97c9f req-360219e7-7401-4fff-8bd4-4087c581506e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:06:53.389819 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d6d4c164-10b8-4d56-b890-c0acf3c97c9f req-360219e7-7401-4fff-8bd4-4087c581506e service nova] Creating event network-changed:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h2-master-1 Sep 18 02:06:53.394842 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d6d4c164-10b8-4d56-b890-c0acf3c97c9f req-360219e7-7401-4fff-8bd4-4087c581506e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033884 Sep 18 02:06:53.395548 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3467/6956] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:07:27.625919 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:27.626692 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:27.628527 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:27.629157 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:27.633686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:27.634301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:27.643141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:27.643627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:27.644065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:27.644784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:27.645220 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:27.645670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:27.785121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:27.793337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e0458e8a-cc75-4080-af92-466975e6a460 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1666 microversion: 2.1 time: 0.168288 Sep 18 02:07:27.793948 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3490/6957] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:27 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:27.814270 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=15 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:27.815144 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=54 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:27.820247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "359de8f8-c5aa-4327-b951-123979942c22"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:07:27.822695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:27.829652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:27.830157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:27.830614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:27.831329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:27.831808 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:27.832255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:28.100683 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8762801a-a113-4e18-8de5-54a8c9d5f2fb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288196 Sep 18 02:07:28.101301 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3468/6958] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 02:07:27 2022] POST /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:07:38.820864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:07:38.823202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:38.825965 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:38.826619 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:38.832140 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:38.832626 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:38.833066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:38.834312 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:38.834777 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:38.835211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:38.864407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:38.869974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:07:38.877207 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:07:38.877658 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:07:38.878134 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:07:38.878538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:07:38.878945 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:07:38.942404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02bbef7f-2d2f-4051-9d7f-ae23e731f94e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/action" status: 202 len: 0 microversion: 2.1 time: 0.125358 Sep 18 02:07:38.946210 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3491/6959] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:07:38 2022] POST /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:07:38.952462 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:38.953191 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:38.956273 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:38.957237 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:07:38.965001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:38.965719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:38.966376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:38.967275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:38.967840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:38.968473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:39.103547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:39.112422 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-371feba3-ee9d-4fef-a271-e2f305694b4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1721 microversion: 2.1 time: 0.164273 Sep 18 02:07:39.112984 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3469/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:38 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:40.137031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:40.137611 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:40.145897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:40.146920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:40.147360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:40.148072 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:40.148530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:40.148958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:40.288265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:40.297238 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7729f297-ff33-4830-bc79-37c8ed14e8d4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1721 microversion: 2.1 time: 0.164591 Sep 18 02:07:40.297935 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3492/6961] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:40 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:41.321240 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:41.321931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:41.328666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:41.329159 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:41.329628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:41.330330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:41.330797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:41.331235 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:41.465242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:41.473574 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5206bf82-0221-40fc-b688-30cf3540ef88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.156225 Sep 18 02:07:41.474172 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3470/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:41 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:42.496919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:42.497531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:42.504147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:42.504622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:42.505057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:42.505807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:42.506264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:42.506681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:42.639315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:42.648234 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a4082eb7-c243-43fd-890f-7190ac93e26b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.155184 Sep 18 02:07:42.648810 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3493/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:42 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:43.672284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:43.673007 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:43.680555 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:43.681054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:43.681508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:43.682247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:43.682718 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:43.683152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:43.811882 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:43.820776 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1053cec9-6813-438b-8bca-9aa6f6ebdd1b tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.152455 Sep 18 02:07:43.821353 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3471/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:43 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:44.844155 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:44.845267 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:44.852776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:44.853250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:44.853715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:44.854401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:44.854851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:44.855270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:44.984653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:44.992914 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aca636d7-12d1-44dc-a72e-c7dd83de8799 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.152790 Sep 18 02:07:44.993535 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3494/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:44 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:46.016890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:46.017503 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:46.025465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:46.025990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:46.026440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:46.027149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:46.027619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:46.028056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:46.163139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:46.171579 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ba4f5eed-a512-436c-83a0-ac47b3532c8f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.158530 Sep 18 02:07:46.171993 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3472/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:46 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:07:47.195362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:47.195887 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:47.202659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:47.203136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:47.203565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:47.204243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:47.204692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:47.205110 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:47.333919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:47.342256 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f061c0d4-5fad-4274-8cd5-cef5511900d0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.150933 Sep 18 02:07:47.342829 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3495/6967] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:47 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:07:48.366655 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:48.367278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:48.374115 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:48.374609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:48.375058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:48.375755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:48.376218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:48.376652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:48.518430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:48.527586 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40a11223-a2bb-454f-8f9b-540bcb3a9a2f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.165628 Sep 18 02:07:48.528172 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3473/6968] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:48 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:49.550972 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:49.551590 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:49.558817 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:49.559303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:49.559742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:49.560461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:49.560947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:49.561372 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:49.691306 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:49.700208 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bc364d12-4e20-42b8-b0f4-a003d1fe291f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.153129 Sep 18 02:07:49.700775 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3496/6969] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:49 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:50.724524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:50.725154 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:50.732237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:50.732740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:50.733194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:50.733938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:50.734411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:50.734852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:50.885414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:50.895157 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e82d7f7f-2a75-4798-bf96-200c48f537cf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.174605 Sep 18 02:07:50.895756 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3474/6970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:50 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:51.919072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:51.919681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:51.926572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:51.927045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:51.927475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:51.928158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:51.928607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:51.929024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:52.063794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:52.072985 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7018646d-3499-4816-b142-98c3677edb88 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.157863 Sep 18 02:07:52.073577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3497/6971] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:51 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:53.157986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:53.158794 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:53.164879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:53.165369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:53.165842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:53.166542 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:53.167012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:53.167446 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:53.314941 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:53.324547 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7069bb0d-054f-44c8-8b04-1fb159628006 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.231703 Sep 18 02:07:53.325170 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3475/6972] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:53 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:54.349724 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:54.350929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:54.358384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:54.358858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:54.359288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:54.359974 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:54.360421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:54.360841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:54.495167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:54.503605 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d92ddd88-444f-4831-9e61-170e37820242 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.157738 Sep 18 02:07:54.504214 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3498/6973] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:54 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:55.527997 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:55.528535 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:55.535117 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:55.535610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:55.536062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:55.536762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:55.537233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:55.537704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:55.669204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:55.677526 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-50d7b42a-4891-41cb-b8a7-9d5f3e23103c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.153604 Sep 18 02:07:55.678137 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3476/6974] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:55 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:56.701480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:56.702233 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:56.709725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:56.710212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:56.710644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:56.711332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:56.711781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:56.712204 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:56.855710 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:56.864446 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb66c871-8ee0-4c0d-92d0-1db98281d1c3 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.166838 Sep 18 02:07:56.865049 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3499/6975] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:56 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:57.888500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:57.889125 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:57.896197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:57.896707 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:57.897155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:57.897905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:57.898379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:57.898818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:58.042374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:58.051110 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3972af3a-6bc8-4572-bf86-58d963daab7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.166957 Sep 18 02:07:58.051680 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3477/6976] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:57 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:07:59.076394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:07:59.077013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:07:59.083939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:59.084579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:59.085009 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:59.085727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:07:59.086180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:07:59.086597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:07:59.218664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:07:59.228110 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1607bc26-4e02-4278-9bb1-55f6785f0e6a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.155663 Sep 18 02:07:59.228691 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3500/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:07:59 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:00.252566 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:00.253230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:00.259828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:00.260320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:00.260773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:00.261774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:00.262244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:00.262683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:00.414099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:00.422830 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a836c2f0-e6f8-4b07-8d8b-c82ef0a79031 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1726 microversion: 2.1 time: 0.174627 Sep 18 02:08:00.432979 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3478/6978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:00 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:00.856334 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-59026c14-87ff-4b9c-a4b5-52f7219cb532 req-5ade60a4-b514-49e7-bd92-b2489ca6b0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "name": "network-vif-unplugged", "status": "completed", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:00.867445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-59026c14-87ff-4b9c-a4b5-52f7219cb532 req-5ade60a4-b514-49e7-bd92-b2489ca6b0d7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:00.867936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-59026c14-87ff-4b9c-a4b5-52f7219cb532 req-5ade60a4-b514-49e7-bd92-b2489ca6b0d7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:00.868371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-59026c14-87ff-4b9c-a4b5-52f7219cb532 req-5ade60a4-b514-49e7-bd92-b2489ca6b0d7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:00.888186 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-59026c14-87ff-4b9c-a4b5-52f7219cb532 req-5ade60a4-b514-49e7-bd92-b2489ca6b0d7 service nova] Creating event network-vif-unplugged:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h1-master-1 Sep 18 02:08:00.893879 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-59026c14-87ff-4b9c-a4b5-52f7219cb532 req-5ade60a4-b514-49e7-bd92-b2489ca6b0d7 service nova] Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:08:00.907706 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-59026c14-87ff-4b9c-a4b5-52f7219cb532 req-5ade60a4-b514-49e7-bd92-b2489ca6b0d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056802 Sep 18 02:08:00.908583 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3501/6979] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:08:01.447044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:01.447692 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:01.454647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:01.455147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:01.455598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:01.456312 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:01.456788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:01.457228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:01.596186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:01.604954 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5681b0a6-9c7b-43b2-9018-faba0efc146a tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1725 microversion: 2.1 time: 0.162479 Sep 18 02:08:01.606098 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3479/6980] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:01 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:02.630033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:02.630741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:02.638267 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:02.638754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:02.639190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:02.639889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:02.640338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:02.640756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:02.776947 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:02.785467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b8dfb4c2-4099-4978-8edb-272117bc6f67 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.160639 Sep 18 02:08:02.786075 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3502/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:02 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:02.922960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-45c0b4c8-ae1c-4a3e-8456-91d9e788445b req-4a992a24-71c2-42a5-bfe5-4dfc92211332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:02.934348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-45c0b4c8-ae1c-4a3e-8456-91d9e788445b req-4a992a24-71c2-42a5-bfe5-4dfc92211332 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:02.934849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-45c0b4c8-ae1c-4a3e-8456-91d9e788445b req-4a992a24-71c2-42a5-bfe5-4dfc92211332 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:02.935299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-45c0b4c8-ae1c-4a3e-8456-91d9e788445b req-4a992a24-71c2-42a5-bfe5-4dfc92211332 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:02.947114 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-45c0b4c8-ae1c-4a3e-8456-91d9e788445b req-4a992a24-71c2-42a5-bfe5-4dfc92211332 service nova] Creating event network-changed:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h1-master-1 Sep 18 02:08:02.952584 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-45c0b4c8-ae1c-4a3e-8456-91d9e788445b req-4a992a24-71c2-42a5-bfe5-4dfc92211332 service nova] Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:08:02.963622 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-45c0b4c8-ae1c-4a3e-8456-91d9e788445b req-4a992a24-71c2-42a5-bfe5-4dfc92211332 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044284 Sep 18 02:08:02.964246 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3480/6982] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:08:03.809124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:03.809691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:03.816805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:03.817290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:03.817826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:03.818563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:03.819020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:03.819449 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:03.964536 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:03.972918 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16f7b30a-135f-4914-9d00-91deccf7bbc5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.167857 Sep 18 02:08:03.973495 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3503/6983] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:03 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:04.998280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:04.999008 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:05.005379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:05.005920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:05.006382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:05.007108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:05.007581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:05.008025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:05.144047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:05.152526 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8e05126f-325f-47e3-8174-428d58de9ce4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.159461 Sep 18 02:08:05.153126 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3481/6984] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:04 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:06.176440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:06.177703 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:06.184770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:06.185657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:06.186150 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:06.187006 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:06.187482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:06.187913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:06.327054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:06.335450 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6d56a7c8-70da-4212-9dc3-3abd2a5d67df tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.162979 Sep 18 02:08:06.336029 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3504/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:06 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:07.358955 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:07.359592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:07.367157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:07.367674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:07.368197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:07.368874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:07.369358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:07.369921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:07.514605 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:07.523763 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f47818f4-01ea-407a-9c49-02bf10477fbf tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.168726 Sep 18 02:08:07.524350 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3482/6986] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:07 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:08.557173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:08.557773 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:08.564574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:08.565052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:08.565483 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:08.566193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:08.566644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:08.567063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:08.713824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:08.722342 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d38a5cbf-c098-4350-933f-d8551bf4e84e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.170177 Sep 18 02:08:08.722952 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3505/6987] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:08 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:09.746230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:09.746842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:09.750543 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=29 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:09.758508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:09.759028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:09.759488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:09.760220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:09.760701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:09.761414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:09.764740 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=83 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:09.913354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:09.921902 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f7ece792-a7aa-4fc8-8107-e785633c33f6 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.179616 Sep 18 02:08:09.922496 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3483/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:09 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:10.945678 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:10.946315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:10.949180 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=35 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:10.954185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:10.954673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:10.955104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:10.956081 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:10.956406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:10.956825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:10.960561 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:11.111803 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:11.120652 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-297f5fd9-f25d-4de2-822f-73a55e6e4bd4 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.178860 Sep 18 02:08:11.121240 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3506/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:10 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:12.144524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:12.145151 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:12.152478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:12.152973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:12.153418 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:12.154148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:12.154640 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:12.155071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:12.294627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:12.304640 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bfa8136a-a2c1-42f3-a9a2-15bc311cf80c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.164128 Sep 18 02:08:12.305239 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3484/6990] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:12 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:13.333009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:13.334377 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:13.342026 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:13.342506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:13.342953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:13.343685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:13.344179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:13.344601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:13.493799 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:13.502241 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f1a85db5-069e-4e31-b4cc-24261e4b8946 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1723 microversion: 2.1 time: 0.174165 Sep 18 02:08:13.502821 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3507/6991] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:13 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:14.528817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:14.529464 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:14.536480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.537110 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.537456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:14.538264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.538740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.539190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:14.681389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:14.690649 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fa016e2f-bbde-413a-9ed1-a301e0ea948e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1720 microversion: 2.1 time: 0.165734 Sep 18 02:08:14.691300 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3485/6992] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:14 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:14.716116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:14.716659 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:14.723653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.724199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.724634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:14.725337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.725826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.726252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:14.765998 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.766480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.766984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:14.767715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.768168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.768594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:14.788881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:08:14.794025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Getting quotas for user fa377acabe334070b636ba282f080029 and project 5635878f14df443cbcbbe618e9b0a496. Resources: {'ram', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:08:14.899842 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8237a320-1e7a-4fbd-a4ab-7dca975a2a4c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "POST /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/action" status: 202 len: 0 microversion: 2.1 time: 0.187557 Sep 18 02:08:14.900519 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3508/6993] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:08:14 2022] POST /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:08:14.908724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:14.909387 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:14.917406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.917934 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.918353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:14.919075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:14.919543 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:14.919984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:15.053059 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:15.061484 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bfd69689-c0b4-444c-ba79-a8294df91b25 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.156696 Sep 18 02:08:15.062109 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3486/6994] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:14 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:16.086234 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:16.086942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:16.093078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:16.093569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:16.094016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:16.094708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:16.095163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:16.095588 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:16.235435 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:16.244229 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a8f81b3b-73fc-485d-a43a-a6a7939ba4bb tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.163617 Sep 18 02:08:16.244814 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3509/6995] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:16 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:17.274866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:17.275488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:17.282222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:17.282717 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:17.283162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:17.283867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:17.284332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:17.284948 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:17.424421 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:17.433604 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e7654b7b-cf87-4646-bfc8-7e8d98074614 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.162803 Sep 18 02:08:17.434198 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3487/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:17 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:08:18.457255 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:18.457913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:18.465750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:18.466242 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:18.466682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:18.467390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:18.467876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:18.468302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:18.597321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:18.606412 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-90a3d108-f196-41ba-b12a-3ef191195e39 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.152966 Sep 18 02:08:18.607039 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3510/6997] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:18 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:19.631582 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:19.632215 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:19.639782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:19.640282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:19.640736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:19.641599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:19.642079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:19.642517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:19.780341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:19.789740 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fe030c94-c29a-4b71-bb30-9ab8075439f0 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.162330 Sep 18 02:08:19.790334 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3488/6998] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:19 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:20.551422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-67ea0756-9f34-4583-acca-b522fccf41c6 req-f368e46a-3fcf-492c-ae8d-766e24ea00d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:20.562940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67ea0756-9f34-4583-acca-b522fccf41c6 req-f368e46a-3fcf-492c-ae8d-766e24ea00d5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:20.563415 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67ea0756-9f34-4583-acca-b522fccf41c6 req-f368e46a-3fcf-492c-ae8d-766e24ea00d5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:20.563852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67ea0756-9f34-4583-acca-b522fccf41c6 req-f368e46a-3fcf-492c-ae8d-766e24ea00d5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:20.584515 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-67ea0756-9f34-4583-acca-b522fccf41c6 req-f368e46a-3fcf-492c-ae8d-766e24ea00d5 service nova] Creating event network-changed:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h2-master-1 Sep 18 02:08:20.590541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [req-67ea0756-9f34-4583-acca-b522fccf41c6 req-f368e46a-3fcf-492c-ae8d-766e24ea00d5 service nova] Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122374) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:08:20.602373 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-67ea0756-9f34-4583-acca-b522fccf41c6 req-f368e46a-3fcf-492c-ae8d-766e24ea00d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054366 Sep 18 02:08:20.603169 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3511/6999] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:08:20.814296 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:20.814943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:20.823249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:20.823751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:20.824201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:20.824946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:20.825422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:20.825887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:20.967363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:20.976656 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-40283304-76d7-487a-8a94-9206d82a24c2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.166399 Sep 18 02:08:20.977251 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3489/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:20 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:22.001375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:22.002266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:22.009505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:22.010079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:22.010618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:22.011830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:22.012409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:22.012938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:22.166955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:22.175894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-920ee5d9-f906-4b68-9bef-555cda774ba7 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.179103 Sep 18 02:08:22.186626 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3512/7001] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:21 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:23.199796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:23.200345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:23.207595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:23.208105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:23.208561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:23.209297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:23.209875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:23.210321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:23.344686 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:23.353644 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6418fbba-4db2-412d-82aa-8d804c9d95d1 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.158191 Sep 18 02:08:23.354219 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3490/7002] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:23 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:24.385572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:24.386522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:24.393390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:24.393984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:24.394422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:24.395116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:24.396176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:24.396538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:24.531119 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:24.539568 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d92bd3cc-086e-4c1b-ac9c-93e66baa48f2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.157906 Sep 18 02:08:24.540154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3513/7003] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:24 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:25.562880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:25.563630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:25.571253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:25.571766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:25.572231 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:25.572961 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:25.573445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:25.573915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:25.706477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:25.715309 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4f56cb0-4034-483c-9c43-2f6b0425502e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.156401 Sep 18 02:08:25.715888 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3491/7004] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:25 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:26.739867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:26.740413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:26.742355 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:26.748526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:26.749058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:26.749577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:26.750332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:26.750851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:26.751282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:26.892346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:26.900980 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f417afac-6cb8-4bf6-9c22-45e3fc10fa63 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.165629 Sep 18 02:08:26.901600 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3514/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:26 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:08:27.925062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:27.925719 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:27.933153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:27.933677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:27.934127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:27.934825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:27.935295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:27.935731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:28.070643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:28.078900 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca9e535e-5b81-4225-871a-36298b62fd75 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.157818 Sep 18 02:08:28.079477 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3492/7006] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:27 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:29.103495 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:29.104110 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:29.110943 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:29.111422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:29.111857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:29.112543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:29.112997 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:29.113419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:29.243075 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:29.251492 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-745d77f3-aaa1-49bb-97f9-4893607f682c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.153108 Sep 18 02:08:29.252080 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3515/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:29 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:30.275260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:30.275829 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:30.282970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:30.283460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:30.283907 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:30.284612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:30.285074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:30.285508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:30.421544 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:30.430349 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-62628d12-20da-4e2e-9ac5-d874fa3984f5 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.159186 Sep 18 02:08:30.430920 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3493/7008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:30 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:31.453260 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:31.453884 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:31.460975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:31.461452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:31.461910 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:31.462594 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:31.463046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:31.463463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:31.591487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:31.600316 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2529f0da-8b28-43d9-a4e8-5183e5ffe493 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.150921 Sep 18 02:08:31.600893 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3516/7009] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:31 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:32.624497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:32.625115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:32.633081 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:32.633619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:32.634080 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:32.634835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:32.635315 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:32.635766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:32.774058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:32.782676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-263a8d55-83d3-4a67-b45c-e1af7153cc52 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1719 microversion: 2.1 time: 0.162158 Sep 18 02:08:32.783542 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3494/7010] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:32 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:33.806358 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:33.806975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:33.813913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:33.814398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:33.814834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:33.815523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:33.815975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:33.816397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:33.949653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:33.957839 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-34468ae1-6353-46ca-8ac8-0ef27d024168 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1712 microversion: 2.1 time: 0.155960 Sep 18 02:08:33.958418 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3517/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:33 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:33.980702 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:33.981325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:33.988617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:33.989125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:33.990205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:33.990922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:33.991390 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:33.991825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:34.125923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:34.136361 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-512b7863-0503-48e4-ba42-9e79cd76ed22 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1712 microversion: 2.1 time: 0.159302 Sep 18 02:08:34.136955 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3495/7012] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:33 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:34.158441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:34.159055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:34.165001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:34.165486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:34.165965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:34.166654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:34.167112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:34.167533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:34.300642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:34.309493 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-07f76492-c29d-434f-8c20-cbe04094a2e2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1712 microversion: 2.1 time: 0.154914 Sep 18 02:08:34.310100 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3518/7013] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:34 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1712 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:34.333187 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:34.333671 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:34.339775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:34.340273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:34.340728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:34.341448 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:34.341951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:34.342394 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:34.367324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:08:34.449998 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64c71224-9cd1-4d40-8788-e55f145c8c42 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 204 len: 0 microversion: 2.1 time: 0.120391 Sep 18 02:08:34.450959 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3496/7014] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:08:34 2022] DELETE /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:08:34.460814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:34.460814 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:34.467115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:34.467616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:34.468239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:34.468920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:34.469675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:34.470108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:34.616488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:34.628801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8629ec33-7ff1-426d-9644-8a445ef7153f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1718 microversion: 2.1 time: 0.173291 Sep 18 02:08:34.641627 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3519/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:34 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:35.656143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:35.656894 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:35.664565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:35.665068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:35.665523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:35.666267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:35.666742 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:35.667288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:35.817938 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:35.826599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8bab7823-96c3-4520-b6f6-c5aa962feb6f tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1718 microversion: 2.1 time: 0.174734 Sep 18 02:08:35.827196 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3497/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:35 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1718 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:36.639001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3e59e703-cade-41ad-bc04-9cc2f9a8a569 req-340d02c3-bd96-42f7-9399-d073855fb213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "name": "network-vif-plugged", "status": "completed", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:36.650787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3e59e703-cade-41ad-bc04-9cc2f9a8a569 req-340d02c3-bd96-42f7-9399-d073855fb213 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:36.651271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3e59e703-cade-41ad-bc04-9cc2f9a8a569 req-340d02c3-bd96-42f7-9399-d073855fb213 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:36.651705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3e59e703-cade-41ad-bc04-9cc2f9a8a569 req-340d02c3-bd96-42f7-9399-d073855fb213 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:36.655883 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:36.667431 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3e59e703-cade-41ad-bc04-9cc2f9a8a569 req-340d02c3-bd96-42f7-9399-d073855fb213 service nova] Creating event network-vif-plugged:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h2-master-1 Sep 18 02:08:36.673474 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3e59e703-cade-41ad-bc04-9cc2f9a8a569 req-340d02c3-bd96-42f7-9399-d073855fb213 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038355 Sep 18 02:08:36.674122 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3520/7017] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:08:36.851357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:36.852006 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:36.858727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:36.859225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:36.859669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:36.860372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:36.860843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:36.861278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:36.866056 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:36.934263 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:36.942907 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20b7bd1d-57e1-420f-a293-fe629afe76ee tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1651 microversion: 2.1 time: 0.096009 Sep 18 02:08:36.943485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3498/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:36 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1651 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:37.208783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1fb36adf-16bc-4b2c-b8db-0e11bf0906df req-808be8fc-740f-4e96-be8d-2d2a3ad65334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b850b-57dc-4e52-b378-ff3c498cfa2f", "name": "network-vif-deleted", "tag": "6f958f30-7587-46a3-9c8b-c9d64581b869"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:37.220783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1fb36adf-16bc-4b2c-b8db-0e11bf0906df req-808be8fc-740f-4e96-be8d-2d2a3ad65334 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:37.221260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1fb36adf-16bc-4b2c-b8db-0e11bf0906df req-808be8fc-740f-4e96-be8d-2d2a3ad65334 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:37.221970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1fb36adf-16bc-4b2c-b8db-0e11bf0906df req-808be8fc-740f-4e96-be8d-2d2a3ad65334 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:37.234639 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1fb36adf-16bc-4b2c-b8db-0e11bf0906df req-808be8fc-740f-4e96-be8d-2d2a3ad65334 service nova] Creating event network-vif-deleted:6f958f30-7587-46a3-9c8b-c9d64581b869 for instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f on n-h2-master-1 Sep 18 02:08:37.240173 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1fb36adf-16bc-4b2c-b8db-0e11bf0906df req-808be8fc-740f-4e96-be8d-2d2a3ad65334 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Sep 18 02:08:37.241057 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3521/7019] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:08:37.966846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:37.967477 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:37.977720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:37.978794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:37.979267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:37.980005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:37.980481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:37.980919 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:38.045647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:38.055408 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-590532b7-2310-405e-9f88-88bdd4551e7c tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1368 microversion: 2.1 time: 0.092363 Sep 18 02:08:38.056436 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3499/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:37 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:39.080963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:39.081686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:39.088519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:39.089000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:39.089432 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:39.090147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:39.090605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:39.091021 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:39.156357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:39.164909 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0699b6d8-ede5-4224-8475-63586c4d0113 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1368 microversion: 2.1 time: 0.089164 Sep 18 02:08:39.165476 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3522/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:39 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:40.189062 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:40.189849 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:40.193328 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:40.198835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:40.199334 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:40.199782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:40.200484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:40.200952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:40.201385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:40.264536 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:40.273271 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee0cb21c-a1b6-4b74-bd57-bb9f38718f91 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1368 microversion: 2.1 time: 0.088299 Sep 18 02:08:40.273880 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3500/7022] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:40 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:41.296607 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:41.297283 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:41.300874 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:41.307462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:41.307947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:41.308447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:41.309111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:41.309587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:41.310003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:41.378160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377acabe334070b636ba282f080029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635878f14df443cbcbbe618e9b0a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:41.388769 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-45045f3f-60b2-4aa4-9c3e-a73cce5fbe9e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 200 len: 1368 microversion: 2.1 time: 0.096324 Sep 18 02:08:41.389639 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3523/7023] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:41 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:42.413764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:42.414387 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:42.420973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:42.421469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:42.421944 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:42.422636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:42.423103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:42.423536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:42.439480 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f HTTP/1.1 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5b6b850b-57dc-4e52-b378-ff3c498cfa2f'} Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:42.441107 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd802c9f-f49f-4414-9d29-decd72fa0207 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 404 len: 111 microversion: 2.1 time: 0.033752 Sep 18 02:08:42.445895 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3501/7024] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:42 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:42.504695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:42.507022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:42.513694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:42.514175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:42.514617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:42.515298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:42.515747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:42.516166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:42.529055 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/os-volume_attachments HTTP/1.1 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': '5b6b850b-57dc-4e52-b378-ff3c498cfa2f'} Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:42.530741 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88b27344-75b4-45e3-81da-0f3fa14e4787 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031446 Sep 18 02:08:42.535009 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3524/7025] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:08:42 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:45.853872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:45.854411 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:45.861588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.862086 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.862541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.863240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.863863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.864402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.878538 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f HTTP/1.1 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '5b6b850b-57dc-4e52-b378-ff3c498cfa2f'} Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:45.880728 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-11bf5786-c319-4f19-921c-4190367c9dfc tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 404 len: 111 microversion: 2.1 time: 0.032299 Sep 18 02:08:45.884703 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3502/7026] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:08:45 2022] DELETE /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:45.891047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:45.891656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 5b6b850b-57dc-4e52-b378-ff3c498cfa2f] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:45.899257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.899736 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.900163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.900838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.901286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.901792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.915128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f HTTP/1.1 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '5b6b850b-57dc-4e52-b378-ff3c498cfa2f'} Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.916625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 5b6b850b-57dc-4e52-b378-ff3c498cfa2f could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b93cb4dd-433c-4321-9160-38ee8174df8d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f" status: 404 len: 111 microversion: 2.1 time: 0.030848 Sep 18 02:08:45.921097 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3525/7027] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:45 2022] GET /compute/v2.1/servers/5b6b850b-57dc-4e52-b378-ff3c498cfa2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:45.927224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:45.927643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:45.934177 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.934687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.935137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.935871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.936345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.936785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.953147 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c HTTP/1.1 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8c2225dd-b9ff-4108-b7b0-87da2a983d3c'} Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:45.954814 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-759af510-2aca-47bf-8c23-fa1e6ff1c4a2 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 404 len: 111 microversion: 2.1 time: 0.033116 Sep 18 02:08:45.959891 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3503/7028] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:08:45 2022] DELETE /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:45.965864 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:45.966475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8c2225dd-b9ff-4108-b7b0-87da2a983d3c] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:45.972665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.973198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.973670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.974392 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:45.974827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:45.975248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:45.990151 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c HTTP/1.1 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8c2225dd-b9ff-4108-b7b0-87da2a983d3c'} Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:45.991695 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8c2225dd-b9ff-4108-b7b0-87da2a983d3c could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-20a4392d-13a2-4d80-a824-bde1eaf7e420 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c" status: 404 len: 111 microversion: 2.1 time: 0.031332 Sep 18 02:08:45.999546 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3526/7029] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:45 2022] GET /compute/v2.1/servers/8c2225dd-b9ff-4108-b7b0-87da2a983d3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:46.003247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:46.003247 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:46.009237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.009840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.010296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.011318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.011805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.012443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.026605 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 HTTP/1.1 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6f67797b-a5b6-4537-8107-e542566ab2d4'} Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:46.028096 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20b41c28-25a2-4e39-b0f8-9c861f40fd7e tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 404 len: 111 microversion: 2.1 time: 0.031750 Sep 18 02:08:46.032128 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3504/7030] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:08:45 2022] DELETE /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:46.039214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:46.039841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 6f67797b-a5b6-4537-8107-e542566ab2d4] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:46.046735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.047256 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.047695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.048398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.048855 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.049281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.063977 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 HTTP/1.1 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '6f67797b-a5b6-4537-8107-e542566ab2d4'} Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.065521 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 6f67797b-a5b6-4537-8107-e542566ab2d4 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-639ec25a-4cb7-44c6-9ebd-9cf0c5c8502d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4" status: 404 len: 111 microversion: 2.1 time: 0.032543 Sep 18 02:08:46.073601 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3527/7031] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:46 2022] GET /compute/v2.1/servers/6f67797b-a5b6-4537-8107-e542566ab2d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:46.076691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:46.077205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:46.083287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.083782 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.084227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.084931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.085397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.085885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.100052 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca HTTP/1.1 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '8228a998-6811-481b-8674-097b7ca751ca'} Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:46.101640 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8367885-5138-4b71-92de-3fd0dd05bd5d tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 404 len: 111 microversion: 2.1 time: 0.030414 Sep 18 02:08:46.109161 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3505/7032] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:08:46 2022] DELETE /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:46.116033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:46.116650 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] [instance: 8228a998-6811-481b-8674-097b7ca751ca] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:46.122760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.123249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.123690 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.124391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:46.124851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:46.125280 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:46.141843 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] HTTP exception thrown: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Request method failure captured: Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca HTTP/1.1 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJnxMsG7U93LbBpvCM9S9WIXi2DEo9fs1db9QChGY5BJBE-i_EVWWEtS1NJ_tIgVVeaAJ4sbTC2b9KmZ51t3usEbIfm87TiRK_prDqo92BiQ1lcLUSQwfzbe-56GgfgPSUNf3PSwx6o0_p1UYHCZMLs8smcJGFRr8ucuFg1xAYGKHpeg Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5635878f14df443cbcbbe618e9b0a496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 5635878f14df443cbcbbe618e9b0a496 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServerActionsTestJSON-2011382761 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: fa377acabe334070b636ba282f080029 Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServerActionsTestJSON-2011382761-project Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '8228a998-6811-481b-8674-097b7ca751ca'} Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:08:46.143362 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Returning 404 to user: Instance 8228a998-6811-481b-8674-097b7ca751ca could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3879223e-85d4-419d-8c9a-11b539c3b450 tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca" status: 404 len: 111 microversion: 2.1 time: 0.033328 Sep 18 02:08:46.148151 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3528/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:46 2022] GET /compute/v2.1/servers/8228a998-6811-481b-8674-097b7ca751ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:08:46.154039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f9c046b8-b980-4e59-a488-93f20b5d6ead tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] Calling method '.version_select at 0x7f700a6a4310>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:46.179980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f9c046b8-b980-4e59-a488-93f20b5d6ead tempest-ServerActionsTestJSON-2011382761 tempest-ServerActionsTestJSON-2011382761-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505809236" status: 202 len: 0 microversion: 2.1 time: 0.029708 Sep 18 02:08:46.180627 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3506/7034] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 18 02:08:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505809236 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:08:55.695265 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1076571515", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "35cb8146-9c44-421c-b910-35125d9c0c0f"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:55.752053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] validate_networks() for [('35cb8146-9c44-421c-b910-35125d9c0c0f', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:08:56.130519 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=25 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:56.198214 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:08:56.198638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:08:56.199111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:08:56.199707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:08:56.200118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:08:56.209389 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:56.209909 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:56.210345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:56.211070 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:56.211524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:56.211947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:56.229577 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Getting quotas for project 78096b93898948658060589dab017895. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:08:56.234970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Getting quotas for user abeba448964a4b82b67ce1f488b576b1 and project 78096b93898948658060589dab017895. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:08:56.249063 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:08:56.251439 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:08:56.297691 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2ba5895d-5781-4416-ad9c-3777a9d08c76 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729639 Sep 18 02:08:56.298534 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3529/7035] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:08:56.308733 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=27 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:56.309506 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:08:56.313780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b7fd6827-62b2-4e83-9b8c-c24d81bf3db4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:56.314413 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b7fd6827-62b2-4e83-9b8c-c24d81bf3db4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:56.374397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b7fd6827-62b2-4e83-9b8c-c24d81bf3db4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:56.381939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b7fd6827-62b2-4e83-9b8c-c24d81bf3db4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1217 microversion: 2.1 time: 0.075193 Sep 18 02:08:56.382792 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3507/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:56 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:57.408519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:57.409165 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:57.417143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:57.417643 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:57.418091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:57.418808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:57.419339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:57.419687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:57.536946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:57.545188 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-26cfa782-87a3-486e-b4d4-5d5f5dc7c6bb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1269 microversion: 2.1 time: 0.141423 Sep 18 02:08:57.546417 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3530/7037] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:57 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:58.570081 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:58.570712 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:58.578173 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:58.578576 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:58.579021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:58.579957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:58.580438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:58.580879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:58.791205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:08:58.805950 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5a02d8de-65b4-41df-ab2a-518492bba4e3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1317 microversion: 2.1 time: 0.240656 Sep 18 02:08:58.810046 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3508/7038] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:58 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:08:59.610813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f5c60328-7635-4be6-9c95-7a816dfbb360 req-41d92432-4067-44fb-a85f-b1e6d5f92177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3446c05-9667-482d-ba53-fe033a55e318", "tag": "fd02514e-1529-448e-be75-5b0816796f40"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:08:59.623397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f5c60328-7635-4be6-9c95-7a816dfbb360 req-41d92432-4067-44fb-a85f-b1e6d5f92177 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:59.623892 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f5c60328-7635-4be6-9c95-7a816dfbb360 req-41d92432-4067-44fb-a85f-b1e6d5f92177 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:59.624424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f5c60328-7635-4be6-9c95-7a816dfbb360 req-41d92432-4067-44fb-a85f-b1e6d5f92177 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:59.638943 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f5c60328-7635-4be6-9c95-7a816dfbb360 req-41d92432-4067-44fb-a85f-b1e6d5f92177 service nova] Creating event network-changed:fd02514e-1529-448e-be75-5b0816796f40 for instance d3446c05-9667-482d-ba53-fe033a55e318 on n-h2-master-1 Sep 18 02:08:59.644489 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f5c60328-7635-4be6-9c95-7a816dfbb360 req-41d92432-4067-44fb-a85f-b1e6d5f92177 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Sep 18 02:08:59.645072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3531/7039] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:08:59.835280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:08:59.836160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:08:59.843593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:59.844136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:59.844843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:08:59.845790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:08:59.846306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:08:59.846748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:00.080353 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:00.088657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e3132fef-0a13-43fd-8395-1173741f20d5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1317 microversion: 2.1 time: 0.258248 Sep 18 02:09:00.089520 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3509/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:08:59 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:01.114285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:01.115378 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:01.121987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:01.122476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:01.122920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:01.123619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:01.124133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:01.124499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:01.259095 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:01.267208 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e7aaf0e-860b-4b06-990a-4c70bbedf171 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1317 microversion: 2.1 time: 0.158587 Sep 18 02:09:01.267788 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3532/7041] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:01 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:02.290677 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:02.291302 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:02.298127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:02.298622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:02.299070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:02.299802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:02.300346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:02.301272 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:02.432784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:02.440487 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7be38c16-f969-4faf-aec7-27a29f5fdb59 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1317 microversion: 2.1 time: 0.153909 Sep 18 02:09:02.441067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3510/7042] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:02 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:03.464299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:03.464934 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:03.471921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:03.472406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:03.473429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:03.474159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:03.474615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:03.475035 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:03.609715 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:03.618066 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b66b52d0-4c32-45cf-883c-6788006228aa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1317 microversion: 2.1 time: 0.157807 Sep 18 02:09:03.618692 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3533/7043] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:03 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:04.641643 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:04.642289 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:04.650976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:04.651769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:04.652746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:04.655373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:04.655847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:04.656625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:04.773047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b3df7a73-30c0-48ee-963a-159f29585c45 req-a4db3654-a877-42b1-a418-65e418ceab84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3446c05-9667-482d-ba53-fe033a55e318", "name": "network-vif-plugged", "status": "completed", "tag": "fd02514e-1529-448e-be75-5b0816796f40"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:04.784533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b3df7a73-30c0-48ee-963a-159f29585c45 req-a4db3654-a877-42b1-a418-65e418ceab84 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:04.785350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b3df7a73-30c0-48ee-963a-159f29585c45 req-a4db3654-a877-42b1-a418-65e418ceab84 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:04.786814 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b3df7a73-30c0-48ee-963a-159f29585c45 req-a4db3654-a877-42b1-a418-65e418ceab84 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:04.799434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b3df7a73-30c0-48ee-963a-159f29585c45 req-a4db3654-a877-42b1-a418-65e418ceab84 service nova] Creating event network-vif-plugged:fd02514e-1529-448e-be75-5b0816796f40 for instance d3446c05-9667-482d-ba53-fe033a55e318 on n-h2-master-1 Sep 18 02:09:04.804961 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b3df7a73-30c0-48ee-963a-159f29585c45 req-a4db3654-a877-42b1-a418-65e418ceab84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035927 Sep 18 02:09:04.805519 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3534/7044] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:09:04.810887 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:04.820468 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8ddc0e5e-6f00-40c0-b15d-2b399907258b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1317 microversion: 2.1 time: 0.182756 Sep 18 02:09:04.821075 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3511/7045] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:04 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:05.846040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:05.846765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:05.853762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:05.854247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:05.854684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:05.855407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:05.856049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:05.856255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:06.001642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:06.010801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-10be48f0-808e-4db7-81ba-022bc19bec49 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1317 microversion: 2.1 time: 0.170101 Sep 18 02:09:06.011660 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3535/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:05 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:07.033931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:07.034556 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:07.037893 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:07.043589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:07.044078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:07.044525 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:07.045226 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:07.045721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:07.046160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:07.174600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:07.182494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56d617c4-872f-4e90-a379-1db00f133a01 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1507 microversion: 2.1 time: 0.152487 Sep 18 02:09:07.183069 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3512/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:07 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:07.243133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-327242425", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "35cb8146-9c44-421c-b910-35125d9c0c0f"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:07.251565 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:07.252226 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:07.302103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] validate_networks() for [('35cb8146-9c44-421c-b910-35125d9c0c0f', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:09:07.670614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:09:07.671037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:09:07.671508 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:09:07.671915 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:09:07.672330 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:09:07.681731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:07.682214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:07.682651 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:07.683385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:07.683888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:07.684323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:07.701250 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Getting quotas for project 78096b93898948658060589dab017895. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:09:07.706512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Getting quotas for user abeba448964a4b82b67ce1f488b576b1 and project 78096b93898948658060589dab017895. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:09:07.719396 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:09:07.721732 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:09:07.767122 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-03cc2637-3358-4ecd-9aa5-d6ea3b611aff tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527792 Sep 18 02:09:07.767784 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3536/7048] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:09:07.779244 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-17e4f608-62e9-43d7-9d00-caef34a8cfb8 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:07.779867 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-17e4f608-62e9-43d7-9d00-caef34a8cfb8 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:07.840595 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-17e4f608-62e9-43d7-9d00-caef34a8cfb8 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:07.847912 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-17e4f608-62e9-43d7-9d00-caef34a8cfb8 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1216 microversion: 2.1 time: 0.072505 Sep 18 02:09:07.849142 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3513/7049] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:07 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:08.873318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:08.875129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:08.883929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:08.884398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:08.885029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:08.886768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:08.887361 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:08.888409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:08.957407 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:08.965441 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8ba3f551-7bb1-4f44-bcdb-f00cbcd1a5f5 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1286 microversion: 2.1 time: 0.098019 Sep 18 02:09:08.966264 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3537/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:08 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:09.988625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:09.989996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:09.997662 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:09.998168 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:09.998622 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:09.999343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:09.999816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:10.000427 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:10.134454 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:10.142873 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9d9b5633-ca54-4b23-a5f3-6b94ff84eddb tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1316 microversion: 2.1 time: 0.158207 Sep 18 02:09:10.143452 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3514/7051] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:09 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:10.351195 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-11eb3d46-11d0-4958-9233-ea6955ba5368 req-15369886-db4f-44bf-8b78-0cfabe9af603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3615c29d-5368-4be1-bf22-e1514a70e144", "tag": "5dd10447-1fad-43e1-9cc9-674122c5c570"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:10.360767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-11eb3d46-11d0-4958-9233-ea6955ba5368 req-15369886-db4f-44bf-8b78-0cfabe9af603 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:10.361246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-11eb3d46-11d0-4958-9233-ea6955ba5368 req-15369886-db4f-44bf-8b78-0cfabe9af603 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:10.361711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-11eb3d46-11d0-4958-9233-ea6955ba5368 req-15369886-db4f-44bf-8b78-0cfabe9af603 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:10.373409 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-11eb3d46-11d0-4958-9233-ea6955ba5368 req-15369886-db4f-44bf-8b78-0cfabe9af603 service nova] Creating event network-changed:5dd10447-1fad-43e1-9cc9-674122c5c570 for instance 3615c29d-5368-4be1-bf22-e1514a70e144 on n-h1-master-1 Sep 18 02:09:10.378544 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-11eb3d46-11d0-4958-9233-ea6955ba5368 req-15369886-db4f-44bf-8b78-0cfabe9af603 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091689 Sep 18 02:09:10.379324 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3538/7052] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:09:11.165964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:11.166614 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:11.173265 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:11.173792 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:11.174240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:11.174942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:11.175407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:11.175945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:11.308369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:11.316077 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-31f6315c-6314-4398-b781-a00412c4e3ac tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1316 microversion: 2.1 time: 0.154096 Sep 18 02:09:11.316893 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3515/7053] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:11 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:12.340191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:12.340890 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:12.342851 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:12.348782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:12.349262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:12.349725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:12.350414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:12.350865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:12.351282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:12.489889 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:12.498658 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6fc282a2-123f-4c98-8b2f-9e2e31f700f4 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1316 microversion: 2.1 time: 0.163619 Sep 18 02:09:12.501527 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3539/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:12 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:09:13.522431 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:13.523054 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:13.530111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:13.530603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:13.531054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:13.531776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:13.532242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:13.532674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:13.661115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:13.668883 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fba94868-1005-4c28-a385-e9448eb4ae61 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1316 microversion: 2.1 time: 0.151170 Sep 18 02:09:13.669452 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3516/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:13 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:14.691573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:14.692121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:14.698953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:14.699430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:14.699881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:14.700548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:14.700994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:14.701414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:14.833961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:14.842036 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6894332-b34d-4802-88d7-66c3a7baf9d3 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1316 microversion: 2.1 time: 0.154282 Sep 18 02:09:14.842845 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3540/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:14 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:15.866205 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:15.866841 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:15.873970 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:15.874391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:15.874854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:15.875579 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:15.876054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:15.876507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:16.008709 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:16.017465 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2b3772a7-25d9-4e9c-b71c-9eef5e78d423 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1316 microversion: 2.1 time: 0.155918 Sep 18 02:09:16.018080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3517/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:15 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:16.528005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-fb0d2a06-e98a-4912-b928-400b5990fb74 req-517a79ac-83d2-4f94-9112-2a825f046dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3615c29d-5368-4be1-bf22-e1514a70e144", "name": "network-vif-plugged", "status": "completed", "tag": "5dd10447-1fad-43e1-9cc9-674122c5c570"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:16.539086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fb0d2a06-e98a-4912-b928-400b5990fb74 req-517a79ac-83d2-4f94-9112-2a825f046dd8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:16.539569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fb0d2a06-e98a-4912-b928-400b5990fb74 req-517a79ac-83d2-4f94-9112-2a825f046dd8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:16.540001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fb0d2a06-e98a-4912-b928-400b5990fb74 req-517a79ac-83d2-4f94-9112-2a825f046dd8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:16.552140 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-fb0d2a06-e98a-4912-b928-400b5990fb74 req-517a79ac-83d2-4f94-9112-2a825f046dd8 service nova] Creating event network-vif-plugged:5dd10447-1fad-43e1-9cc9-674122c5c570 for instance 3615c29d-5368-4be1-bf22-e1514a70e144 on n-h1-master-1 Sep 18 02:09:16.557430 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-fb0d2a06-e98a-4912-b928-400b5990fb74 req-517a79ac-83d2-4f94-9112-2a825f046dd8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033121 Sep 18 02:09:16.558238 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3541/7058] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:09:17.042332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:17.042975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:17.050573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:17.051582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:17.052042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:17.052789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:17.053262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:17.053740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:17.192737 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:17.200748 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5acf54ef-fde0-4f52-a04d-3336f4fcd707 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1316 microversion: 2.1 time: 0.163007 Sep 18 02:09:17.201341 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3518/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:17 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:18.221466 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:18.222264 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:18.226343 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:18.227049 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:18.234175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:18.234655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:18.235085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:18.235770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:18.236222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:18.236644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:18.368720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:18.376975 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3d8b09e9-b582-49d3-8bcc-fb796a5cc6d2 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1506 microversion: 2.1 time: 0.157280 Sep 18 02:09:18.377800 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3542/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:18 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:18.403079 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:18.404706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:18.406616 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:18.414188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:18.414681 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:18.415163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:18.415871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:18.416339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:18.416775 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:18.443270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:09:18.522124 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a3e45c38-00f2-4980-a2dc-4d26a1de134d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 204 len: 0 microversion: 2.1 time: 0.125235 Sep 18 02:09:18.523223 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3519/7061] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:09:18 2022] DELETE /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:09:18.533573 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:18.534221 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:18.540176 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:18.540656 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:18.541083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:18.541788 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:18.542231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:18.542653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:18.691171 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:18.699006 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e682b7eb-b01b-421c-bbf1-06cf2364f860 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1512 microversion: 2.1 time: 0.169279 Sep 18 02:09:18.699587 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3543/7062] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:18 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:19.727351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:19.728068 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:19.736267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:19.736939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:19.738018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:19.738018 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:19.738346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:19.739595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:19.870113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:19.878156 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c5816e7-f919-4ecb-a4c2-fb070248889d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1512 microversion: 2.1 time: 0.158135 Sep 18 02:09:19.878743 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3520/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:19 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:20.407267 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-07bf344d-61a6-457a-bb91-fa2caf91742d req-89c0386b-7fb2-46c5-8bab-ffa80aaea521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3615c29d-5368-4be1-bf22-e1514a70e144", "name": "network-vif-deleted", "tag": "5dd10447-1fad-43e1-9cc9-674122c5c570"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:20.420208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-07bf344d-61a6-457a-bb91-fa2caf91742d req-89c0386b-7fb2-46c5-8bab-ffa80aaea521 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:20.420581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-07bf344d-61a6-457a-bb91-fa2caf91742d req-89c0386b-7fb2-46c5-8bab-ffa80aaea521 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:20.421343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-07bf344d-61a6-457a-bb91-fa2caf91742d req-89c0386b-7fb2-46c5-8bab-ffa80aaea521 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:20.440619 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-07bf344d-61a6-457a-bb91-fa2caf91742d req-89c0386b-7fb2-46c5-8bab-ffa80aaea521 service nova] Creating event network-vif-deleted:5dd10447-1fad-43e1-9cc9-674122c5c570 for instance 3615c29d-5368-4be1-bf22-e1514a70e144 on n-h1-master-1 Sep 18 02:09:20.446318 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-07bf344d-61a6-457a-bb91-fa2caf91742d req-89c0386b-7fb2-46c5-8bab-ffa80aaea521 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042717 Sep 18 02:09:20.447400 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3544/7064] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:09:20.902045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:20.902880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:20.912916 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:20.913426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:20.913918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:20.914646 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:20.915125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:20.915568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:20.951947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:20.952489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:20.952974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:20.953443 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lazy-loading 'fault' on Instance uuid 3615c29d-5368-4be1-bf22-e1514a70e144 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:09:20.996390 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:21.005253 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e952021e-5a9a-42ce-a8c3-73b13a0e0a27 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 200 len: 1306 microversion: 2.1 time: 0.107105 Sep 18 02:09:21.005875 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3521/7065] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:20 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:22.031716 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:22.032448 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.039286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.039765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.040197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.040882 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.041330 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.041782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.055133 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] HTTP exception thrown: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Request method failure captured: Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 HTTP/1.1 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn23NF2iF0Zb-4NpORV9J9D3nSU4hl-dJAw4INpvwlJ_VwSzbInEAOq6zQCxglae4m7TOQSIWjd9WwqTTyB5POJgonSOvJvhaNAEjKJT_gvwv45DOBlYIDkrvsfOo1NJN-BtXIQUddYqIWnOfbIXlS2NWDzH3auWwT8avemyVSxXhCI Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 78096b93898948658060589dab017895 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78096b93898948658060589dab017895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78096b93898948658060589dab017895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 78096b93898948658060589dab017895 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: abeba448964a4b82b67ce1f488b576b1 Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3615c29d-5368-4be1-bf22-e1514a70e144'} Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:22.056640 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Returning 404 to user: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0decc103-6554-4978-ae51-5a66a101e850 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 404 len: 111 microversion: 2.1 time: 0.031472 Sep 18 02:09:22.061625 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3545/7066] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:22 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 02:09:22.067299 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:22.067934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.074884 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.075387 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.075844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.076554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.077027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.077475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.210796 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:22.218526 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-23170d6c-7013-4a38-ba1e-1b97db673781 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1507 microversion: 2.1 time: 0.155241 Sep 18 02:09:22.219092 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3522/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:22 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:22.240849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-508255df-868c-42cb-906d-2b19b34f03bd tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:22.243100 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-508255df-868c-42cb-906d-2b19b34f03bd tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 841de4a0-9184-47f5-84d1-6abbb43457c1] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.248533 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-508255df-868c-42cb-906d-2b19b34f03bd tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] HTTP exception thrown: Instance 841de4a0-9184-47f5-84d1-6abbb43457c1 could not be found. Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-508255df-868c-42cb-906d-2b19b34f03bd tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Request method failure captured: Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/841de4a0-9184-47f5-84d1-6abbb43457c1/action HTTP/1.1 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 32 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn23NF2iF0Zb-4NpORV9J9D3nSU4hl-dJAw4INpvwlJ_VwSzbInEAOq6zQCxglae4m7TOQSIWjd9WwqTTyB5POJgonSOvJvhaNAEjKJT_gvwv45DOBlYIDkrvsfOo1NJN-BtXIQUddYqIWnOfbIXlS2NWDzH3auWwT8avemyVSxXhCI Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 78096b93898948658060589dab017895 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78096b93898948658060589dab017895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78096b93898948658060589dab017895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 78096b93898948658060589dab017895 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: abeba448964a4b82b67ce1f488b576b1 Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: {"resize": {"flavorRef": "452"}} Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 841de4a0-9184-47f5-84d1-6abbb43457c1 could not be found. Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '841de4a0-9184-47f5-84d1-6abbb43457c1', 'body': {'resize': {'flavorRef': '452'}}} Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841de4a0-9184-47f5-84d1-6abbb43457c1 could not be found. Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:09:22.250153 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841de4a0-9184-47f5-84d1-6abbb43457c1 could not be found. Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841de4a0-9184-47f5-84d1-6abbb43457c1 could not be found. Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-508255df-868c-42cb-906d-2b19b34f03bd tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Returning 404 to user: Instance 841de4a0-9184-47f5-84d1-6abbb43457c1 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:09:22.254485 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-508255df-868c-42cb-906d-2b19b34f03bd tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "POST /compute/v2.1/servers/841de4a0-9184-47f5-84d1-6abbb43457c1/action" status: 404 len: 111 microversion: 2.1 time: 0.014583 Sep 18 02:09:22.255289 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3546/7068] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:09:22 2022] POST /compute/v2.1/servers/841de4a0-9184-47f5-84d1-6abbb43457c1/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:09:22.259837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:22.260505 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.266740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.267242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.267703 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.268688 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.269057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.269493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.289004 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:22.406400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:22.414379 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-69a2f05a-de08-423d-9482-31253398442f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1507 microversion: 2.1 time: 0.158328 Sep 18 02:09:22.414960 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3523/7069] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:22 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:09:22.437539 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:22.438193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.445945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.446451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.446897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.447616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.448077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.448508 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.578449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:22.586960 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06486214-9eb8-4d12-80df-00db9a65efba tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1507 microversion: 2.1 time: 0.153255 Sep 18 02:09:22.587530 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3547/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:22 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:22.609255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "3e5e7568-300e-42c4-a04c-89f10fe7274d"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:22.611634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.617967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.618470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.618933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.619645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.620120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.620560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.650561 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:22.655395 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] HTTP exception thrown: Flavor 3e5e7568-300e-42c4-a04c-89f10fe7274d could not be found. Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Request method failure captured: Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: request: POST /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318/action HTTP/1.1 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 65 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn23NF2iF0Zb-4NpORV9J9D3nSU4hl-dJAw4INpvwlJ_VwSzbInEAOq6zQCxglae4m7TOQSIWjd9WwqTTyB5POJgonSOvJvhaNAEjKJT_gvwv45DOBlYIDkrvsfOo1NJN-BtXIQUddYqIWnOfbIXlS2NWDzH3auWwT8avemyVSxXhCI Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 78096b93898948658060589dab017895 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78096b93898948658060589dab017895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78096b93898948658060589dab017895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 78096b93898948658060589dab017895 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: abeba448964a4b82b67ce1f488b576b1 Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: {"resize": {"flavorRef": "3e5e7568-300e-42c4-a04c-89f10fe7274d"}} Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: exception: Flavor 3e5e7568-300e-42c4-a04c-89f10fe7274d could not be found. Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd3446c05-9667-482d-ba53-fe033a55e318', 'body': {'resize': {'flavorRef': '3e5e7568-300e-42c4-a04c-89f10fe7274d'}}} Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:22.661732 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3e5e7568-300e-42c4-a04c-89f10fe7274d could not be found. Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 3e5e7568-300e-42c4-a04c-89f10fe7274d could not be found. Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3e5e7568-300e-42c4-a04c-89f10fe7274d could not be found. Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Returning 400 to user: Flavor 3e5e7568-300e-42c4-a04c-89f10fe7274d could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47559c6c-9447-47bc-aa1c-572cb88eeb5f tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "POST /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318/action" status: 400 len: 107 microversion: 2.1 time: 0.058247 Sep 18 02:09:22.666751 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3524/7071] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:09:22 2022] POST /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318/action => generated 107 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 02:09:22.675189 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:22.675913 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.682183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.682665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.683096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.683784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.684235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.684653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.818284 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:22.826114 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7ad2ce77-c71d-4584-85b6-a0680f0e4270 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1507 microversion: 2.1 time: 0.155886 Sep 18 02:09:22.826713 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3548/7072] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:22 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:22.848660 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:22.849281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:22.855383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.855872 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.856313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.857007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:22.857468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:22.857977 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:22.989097 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:22.996808 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-89dbed57-875b-4e10-ac54-68361960907b tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1507 microversion: 2.1 time: 0.152044 Sep 18 02:09:22.997372 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3525/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:22 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:09:23.019886 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0eabbd1-235d-445c-81e7-627b0525242a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0eabbd1-235d-445c-81e7-627b0525242a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Request method failure captured: Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: request: POST /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318/action HTTP/1.1 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 29 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn23NF2iF0Zb-4NpORV9J9D3nSU4hl-dJAw4INpvwlJ_VwSzbInEAOq6zQCxglae4m7TOQSIWjd9WwqTTyB5POJgonSOvJvhaNAEjKJT_gvwv45DOBlYIDkrvsfOo1NJN-BtXIQUddYqIWnOfbIXlS2NWDzH3auWwT8avemyVSxXhCI Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 78096b93898948658060589dab017895 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78096b93898948658060589dab017895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78096b93898948658060589dab017895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 78096b93898948658060589dab017895 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: abeba448964a4b82b67ce1f488b576b1 Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: {"resize": {"flavorRef": ""}} Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'd3446c05-9667-482d-ba53-fe033a55e318', 'body': {'resize': {'flavorRef': ''}}} Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise error Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi '' Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.023465 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d0eabbd1-235d-445c-81e7-627b0525242a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d0eabbd1-235d-445c-81e7-627b0525242a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "POST /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318/action" status: 400 len: 113 microversion: 2.1 time: 0.009028 Sep 18 02:09:23.027902 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3549/7074] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:09:23 2022] POST /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 02:09:23.033327 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:23.033980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:23.039969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.040460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.040904 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.041637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.042106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.042540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.178036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:23.186017 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c20630ab-dd74-4f1f-9463-5c1a4bbf1fd1 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1507 microversion: 2.1 time: 0.156467 Sep 18 02:09:23.186598 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3526/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:23 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:23.212882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:23.213441 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:23.220562 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.221049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.221491 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.222219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.223178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.223619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.237098 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] HTTP exception thrown: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Request method failure captured: Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 HTTP/1.1 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn23NF2iF0Zb-4NpORV9J9D3nSU4hl-dJAw4INpvwlJ_VwSzbInEAOq6zQCxglae4m7TOQSIWjd9WwqTTyB5POJgonSOvJvhaNAEjKJT_gvwv45DOBlYIDkrvsfOo1NJN-BtXIQUddYqIWnOfbIXlS2NWDzH3auWwT8avemyVSxXhCI Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 78096b93898948658060589dab017895 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78096b93898948658060589dab017895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78096b93898948658060589dab017895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 78096b93898948658060589dab017895 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: abeba448964a4b82b67ce1f488b576b1 Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '3615c29d-5368-4be1-bf22-e1514a70e144'} Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:09:23.239311 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Returning 404 to user: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-897a688c-f313-4bba-9d20-9d2ca367f46d tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 404 len: 111 microversion: 2.1 time: 0.033155 Sep 18 02:09:23.243875 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3550/7076] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:09:23 2022] DELETE /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:09:23.249585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:23.250219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: 3615c29d-5368-4be1-bf22-e1514a70e144] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:23.256313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.256807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.257253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.258007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.258470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.258900 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.272969 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] HTTP exception thrown: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Request method failure captured: Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 HTTP/1.1 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn23NF2iF0Zb-4NpORV9J9D3nSU4hl-dJAw4INpvwlJ_VwSzbInEAOq6zQCxglae4m7TOQSIWjd9WwqTTyB5POJgonSOvJvhaNAEjKJT_gvwv45DOBlYIDkrvsfOo1NJN-BtXIQUddYqIWnOfbIXlS2NWDzH3auWwT8avemyVSxXhCI Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 78096b93898948658060589dab017895 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78096b93898948658060589dab017895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78096b93898948658060589dab017895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 78096b93898948658060589dab017895 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: abeba448964a4b82b67ce1f488b576b1 Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '3615c29d-5368-4be1-bf22-e1514a70e144'} Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:23.274622 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Returning 404 to user: Instance 3615c29d-5368-4be1-bf22-e1514a70e144 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b506e37f-8cbc-480b-8e1c-aeb84218bfde tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144" status: 404 len: 111 microversion: 2.1 time: 0.030557 Sep 18 02:09:23.279190 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3527/7077] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:23 2022] GET /compute/v2.1/servers/3615c29d-5368-4be1-bf22-e1514a70e144 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:09:23.284692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:23.285704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:23.291727 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.292203 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.292638 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.293326 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.293807 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.294225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.322223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:09:23.372249 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:23.406684 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c1e7d06-1b61-43cc-a062-1ef61dc17caa tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 204 len: 0 microversion: 2.1 time: 0.125448 Sep 18 02:09:23.407376 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3551/7078] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:09:23 2022] DELETE /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:09:23.417384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:23.418155 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:23.425593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.426194 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.428656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.428656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:23.428656 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:23.429063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:23.562569 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:23.570720 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-06140e05-9e6f-42cc-8393-c12911ee57f0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1513 microversion: 2.1 time: 0.157614 Sep 18 02:09:23.571309 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3528/7079] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:23 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:24.596027 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:24.596759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:24.604574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:24.605062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:24.605498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:24.606223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:24.606673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:24.607096 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:24.760770 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:24.770297 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aaf5d369-3a07-4886-beae-70a38fc33a35 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1513 microversion: 2.1 time: 0.178988 Sep 18 02:09:24.770927 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3552/7080] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:24 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:25.429269 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d4ccb819-265a-4507-a080-838f4612d7c9 req-24751de0-49a8-496d-b75b-1c62a1d1f8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3446c05-9667-482d-ba53-fe033a55e318", "name": "network-vif-deleted", "tag": "fd02514e-1529-448e-be75-5b0816796f40"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:25.443126 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d4ccb819-265a-4507-a080-838f4612d7c9 req-24751de0-49a8-496d-b75b-1c62a1d1f8bd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:25.443393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d4ccb819-265a-4507-a080-838f4612d7c9 req-24751de0-49a8-496d-b75b-1c62a1d1f8bd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:25.444000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d4ccb819-265a-4507-a080-838f4612d7c9 req-24751de0-49a8-496d-b75b-1c62a1d1f8bd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:25.460170 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d4ccb819-265a-4507-a080-838f4612d7c9 req-24751de0-49a8-496d-b75b-1c62a1d1f8bd service nova] Creating event network-vif-deleted:fd02514e-1529-448e-be75-5b0816796f40 for instance d3446c05-9667-482d-ba53-fe033a55e318 on n-h2-master-1 Sep 18 02:09:25.465840 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d4ccb819-265a-4507-a080-838f4612d7c9 req-24751de0-49a8-496d-b75b-1c62a1d1f8bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041981 Sep 18 02:09:25.467305 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3529/7081] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:09:25.795353 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:25.795970 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:25.804397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:25.805133 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:25.805695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:25.806299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:25.806748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:25.807561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:25.842829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:25.843303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:25.843741 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:25.844183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lazy-loading 'fault' on Instance uuid d3446c05-9667-482d-ba53-fe033a55e318 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:09:25.889687 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeba448964a4b82b67ce1f488b576b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78096b93898948658060589dab017895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:25.899710 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-50df5e65-d6a4-4ee1-81a1-84d0e2db10d0 tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 200 len: 1307 microversion: 2.1 time: 0.106053 Sep 18 02:09:25.899710 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3553/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:25 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:09:26.921037 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:26.921785 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] [instance: d3446c05-9667-482d-ba53-fe033a55e318] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:26.924559 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:26.930715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:26.931208 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:26.931651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:26.932374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:26.932842 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:26.933275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:26.947616 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] HTTP exception thrown: Instance d3446c05-9667-482d-ba53-fe033a55e318 could not be found. Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Request method failure captured: Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 HTTP/1.1 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn23NF2iF0Zb-4NpORV9J9D3nSU4hl-dJAw4INpvwlJ_VwSzbInEAOq6zQCxglae4m7TOQSIWjd9WwqTTyB5POJgonSOvJvhaNAEjKJT_gvwv45DOBlYIDkrvsfOo1NJN-BtXIQUddYqIWnOfbIXlS2NWDzH3auWwT8avemyVSxXhCI Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 78096b93898948658060589dab017895 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78096b93898948658060589dab017895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78096b93898948658060589dab017895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78096b93898948658060589dab017895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 78096b93898948658060589dab017895 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1861855730 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: abeba448964a4b82b67ce1f488b576b1 Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-ServersNegativeTestJSON-1861855730-project Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: exception: Instance d3446c05-9667-482d-ba53-fe033a55e318 could not be found. Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd3446c05-9667-482d-ba53-fe033a55e318'} Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3446c05-9667-482d-ba53-fe033a55e318 could not be found. Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3446c05-9667-482d-ba53-fe033a55e318 could not be found. Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:09:26.949255 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3446c05-9667-482d-ba53-fe033a55e318 could not be found. Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] Returning 404 to user: Instance d3446c05-9667-482d-ba53-fe033a55e318 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3b415adc-edb8-4096-a0e3-0a08f1fdd73a tempest-ServersNegativeTestJSON-1861855730 tempest-ServersNegativeTestJSON-1861855730-project] 10.222.0.25 "GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318" status: 404 len: 111 microversion: 2.1 time: 0.033931 Sep 18 02:09:26.953603 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3530/7083] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:26 2022] GET /compute/v2.1/servers/d3446c05-9667-482d-ba53-fe033a55e318 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:09:58.458695 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:09:58.459296 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Sep 18 02:09:58.461357 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:58.462701 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=14 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:58.662040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-db2bac61-7310-4bee-b8fb-ca2d63667c0d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: .version_select at 0x7f70050183a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1562426406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpsH+haSPbvXkXUzr00FTIc0wbTWQVQNNe1o7SuWruEpYuXgltZKWf6VRwOccYkdNqqAosPC9naO9Islq7I3LsepTvC9/9pYx8jA7OlpTVxDbf7Fp5prvsrcgc7k35rGQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:58.678620 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-db2bac61-7310-4bee-b8fb-ca2d63667c0d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for project 60d599951be4438cab91c7fbc3657e8f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:09:58.684322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-db2bac61-7310-4bee-b8fb-ca2d63667c0d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for user cd4d5944113542fda46655411ad40e9a and project 60d599951be4438cab91c7fbc3657e8f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:09:58.719712 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-db2bac61-7310-4bee-b8fb-ca2d63667c0d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.267343 Sep 18 02:09:58.720566 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3554/7084] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:09:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:09:58.781331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1283594997", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1562426406", "networks": [{"uuid": "c8fdc435-1953-42b9-abca-3df23d89b3be"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:09:58.791545 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=30 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:58.792271 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:09:58.844314 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] validate_networks() for [('c8fdc435-1953-42b9-abca-3df23d89b3be', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:09:59.233683 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:09:59.234117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:09:59.234601 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:09:59.235049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:09:59.235467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:09:59.245242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:59.245783 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:59.246239 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:59.247005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:09:59.247475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:09:59.247914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:09:59.264602 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for project 60d599951be4438cab91c7fbc3657e8f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:09:59.269961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for user cd4d5944113542fda46655411ad40e9a and project 60d599951be4438cab91c7fbc3657e8f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:09:59.285423 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:09:59.288115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:09:59.337280 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4819bed8-896e-4843-a14d-840abeb374f4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560391 Sep 18 02:09:59.337969 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3531/7085] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 02:09:59.349451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a759961-0c25-4100-b090-d3fa6b5a1007 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:09:59.350099 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a759961-0c25-4100-b090-d3fa6b5a1007 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:09:59.411675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5a759961-0c25-4100-b090-d3fa6b5a1007 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:09:59.419467 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a759961-0c25-4100-b090-d3fa6b5a1007 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1263 microversion: 2.1 time: 0.074464 Sep 18 02:09:59.420055 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3555/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:09:59 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:00.445018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:00.446286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:00.453632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:00.454163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:00.454619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:00.455346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:00.455875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:00.456317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:00.526066 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:00.534644 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ba677833-4e96-435f-ad67-7c62d0484c36 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1259 microversion: 2.1 time: 0.095128 Sep 18 02:10:00.535773 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3532/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:00 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1259 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:01.558833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:01.559861 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:01.568980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:01.569695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:01.570377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:01.571198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:01.571757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:01.572306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:01.640651 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:01.649962 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f655fe6-0fba-4f1c-bc57-7e6c9a64ac0f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1321 microversion: 2.1 time: 0.095050 Sep 18 02:10:01.650694 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3556/7088] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:01 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1321 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:02.632668 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-40b3e8a1-5c5f-45fe-9957-ecef5f98b6b7 req-caecaef8-61aa-4ecd-8710-ac0a21cca544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7ecfec-8c9a-48c2-b57c-7357a855c4cc", "tag": "05f1bac0-51d4-49ed-aa3b-88eea5ec53a4"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:02.645300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-40b3e8a1-5c5f-45fe-9957-ecef5f98b6b7 req-caecaef8-61aa-4ecd-8710-ac0a21cca544 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:02.646143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-40b3e8a1-5c5f-45fe-9957-ecef5f98b6b7 req-caecaef8-61aa-4ecd-8710-ac0a21cca544 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:02.646767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-40b3e8a1-5c5f-45fe-9957-ecef5f98b6b7 req-caecaef8-61aa-4ecd-8710-ac0a21cca544 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:02.662922 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-40b3e8a1-5c5f-45fe-9957-ecef5f98b6b7 req-caecaef8-61aa-4ecd-8710-ac0a21cca544 service nova] Creating event network-changed:05f1bac0-51d4-49ed-aa3b-88eea5ec53a4 for instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc on n-h2-master-1 Sep 18 02:10:02.668084 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-40b3e8a1-5c5f-45fe-9957-ecef5f98b6b7 req-caecaef8-61aa-4ecd-8710-ac0a21cca544 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039126 Sep 18 02:10:02.668693 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3533/7089] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:02.676412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:02.677206 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:02.684753 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:02.685600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:02.686258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:02.687183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:02.687865 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:02.688579 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:02.839897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:02.848742 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb5d7c59-2f88-4c89-a167-98fcbb507d77 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1363 microversion: 2.1 time: 0.177862 Sep 18 02:10:02.849514 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3557/7090] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:02 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:03.878252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:03.879089 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:03.886676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:03.887196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:03.887679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:03.888419 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:03.888896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:03.889345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:04.073781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:04.085668 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-19335316-01a0-46af-bfe1-3cd05a3f133f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1363 microversion: 2.1 time: 0.213295 Sep 18 02:10:04.087182 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3534/7091] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:03 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:05.110039 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:05.110656 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:05.118128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:05.118609 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:05.119045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:05.119733 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:05.120185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:05.120606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:05.261072 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:05.268931 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-704c308b-2ac8-4d35-89f6-53e49612a16d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1363 microversion: 2.1 time: 0.162752 Sep 18 02:10:05.269484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3558/7092] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:05 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:06.292577 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:06.293210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:06.300163 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:06.300661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:06.301112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:06.301855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:06.302329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:06.302771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:06.436295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:06.444103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a4d7aa19-fe2f-49c8-8788-d63508b9e8a3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1363 microversion: 2.1 time: 0.155490 Sep 18 02:10:06.444687 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3535/7093] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:06 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:07.187224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4bd1d877-1079-4a76-b0ad-b6dd556ae509 req-e4fd9f8d-741b-4295-8ea5-c10225c23efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7ecfec-8c9a-48c2-b57c-7357a855c4cc", "name": "network-vif-plugged", "status": "completed", "tag": "05f1bac0-51d4-49ed-aa3b-88eea5ec53a4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:07.198393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4bd1d877-1079-4a76-b0ad-b6dd556ae509 req-e4fd9f8d-741b-4295-8ea5-c10225c23efa service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:07.199481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4bd1d877-1079-4a76-b0ad-b6dd556ae509 req-e4fd9f8d-741b-4295-8ea5-c10225c23efa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:07.199919 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4bd1d877-1079-4a76-b0ad-b6dd556ae509 req-e4fd9f8d-741b-4295-8ea5-c10225c23efa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:07.212060 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4bd1d877-1079-4a76-b0ad-b6dd556ae509 req-e4fd9f8d-741b-4295-8ea5-c10225c23efa service nova] Creating event network-vif-plugged:05f1bac0-51d4-49ed-aa3b-88eea5ec53a4 for instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc on n-h2-master-1 Sep 18 02:10:07.217095 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4bd1d877-1079-4a76-b0ad-b6dd556ae509 req-e4fd9f8d-741b-4295-8ea5-c10225c23efa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Sep 18 02:10:07.217761 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3559/7094] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:07.467949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:07.468612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:07.476539 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:07.477042 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:07.477496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:07.478296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:07.478748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:07.479190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:07.616837 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:07.624563 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-49ee5f6a-bd52-441a-94b4-afba90108ade tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1363 microversion: 2.1 time: 0.160646 Sep 18 02:10:07.625142 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3536/7095] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:07 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:08.647771 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:08.648511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:08.657325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:08.657853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:08.658284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:08.659043 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:08.659566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:08.659915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:08.796897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:08.805466 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80dc966e-ced8-484f-8387-36051872a8e9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1555 microversion: 2.1 time: 0.161978 Sep 18 02:10:08.806084 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3560/7096] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:08 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:08.829045 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:08.830284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:08.836967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:08.837471 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:08.837958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:08.838669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:08.839134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:08.839571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:08.968101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:08.976377 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3f813ff-8d8c-4daf-8a5b-6ade654eb479 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1555 microversion: 2.1 time: 0.151284 Sep 18 02:10:08.976948 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3537/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:08 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:10.774866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "988fde58-ff36-49e1-810c-d16aaa6aa478"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:10.777351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:10.779387 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:10.785786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:10.786278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:10.786722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:10.787430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:10.787889 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:10.788317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:11.058793 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1fec3c7d-5137-478e-855a-c631cb4bc030 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287924 Sep 18 02:10:11.059690 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3561/7098] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 02:10:10 2022] POST /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:10:21.779730 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:21.780510 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:21.782163 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:21.782944 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=34 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:21.788681 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:21.789193 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:21.797273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:21.797914 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:21.798296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:21.799672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:21.800148 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:21.800591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:21.890783 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lazy-loading 'services' on Instance uuid ad7ecfec-8c9a-48c2-b57c-7357a855c4cc {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:10:21.963188 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6b8fbd4b-af28-4390-8e62-73148919f37f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments/988fde58-ff36-49e1-810c-d16aaa6aa478" status: 202 len: 0 microversion: 2.1 time: 0.184227 Sep 18 02:10:21.964034 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3538/7099] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:10:21 2022] DELETE /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments/988fde58-ff36-49e1-810c-d16aaa6aa478 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:10:21.974023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:21.976691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:21.980452 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:21.981217 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:21.986304 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:21.986897 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:21.987342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:21.988083 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:21.988617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:21.989068 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:22.025142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e214fc9-ba8f-4c60-bcb6-f1aaf58dc7ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056237 Sep 18 02:10:22.025942 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3562/7100] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:21 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:23.039529 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:23.041924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:23.048322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:23.048822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:23.049826 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:23.050548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:23.051011 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:23.051450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:23.083089 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60604ef2-b782-47b7-b70a-930590eda7e8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048793 Sep 18 02:10:23.083659 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3539/7101] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:23 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:24.096044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:24.098813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:24.106378 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:24.106872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:24.107314 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:24.108057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:24.108548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:24.108977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:24.144310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a8cc58e-2bbf-46db-a8d9-33f5809723b1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052487 Sep 18 02:10:24.144907 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3563/7102] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:24 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:25.156638 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:25.160204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:25.166935 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:25.167434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:25.167894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:25.168605 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:25.169106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:25.169710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:25.201289 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5db059f7-82c6-49e0-9649-2692322987b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048710 Sep 18 02:10:25.201916 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3540/7103] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:25 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:26.214692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:26.216853 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:26.224786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:26.225282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:26.225755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:26.226450 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:26.226899 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:26.227319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:26.258508 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-feaf7f06-4277-442d-9bb8-7626a222e9f6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Sep 18 02:10:26.259082 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3564/7104] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:26 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:27.272259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:27.274445 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:27.281284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:27.281813 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:27.282256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:27.282959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:27.283989 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:27.284485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:27.314968 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9207c58b-7dbf-41f0-94d4-822e5befabda tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047506 Sep 18 02:10:27.315538 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3541/7105] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:27 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 02:10:27.326193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:27.326706 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:27.334214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:27.334687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:27.335126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:27.335811 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:27.336265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:27.336683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:27.412613 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] HTTP exception thrown: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc is not attached to volume 988fde58-ff36-49e1-810c-d16aaa6aa478 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Request method failure captured: Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments/988fde58-ff36-49e1-810c-d16aaa6aa478 HTTP/1.1 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn3xM3JsvG5nC2tmcPH3uBTluJmz5wZ-hyTNL3KytJvsz2i8NEY2m2MhvE2HMSmY3efZ1okUHTdQchAE4rqFRcOJGvz3aCjhW7T7poRZFAiryosMz3yHVrHrRkMCJphodgXXc-Jf64vdJxoT2t1i8caRbS2dmTqH1TlA1vEBTWNdpog Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: cd4d5944113542fda46655411ad40e9a Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc is not attached to volume 988fde58-ff36-49e1-810c-d16aaa6aa478 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': 'ad7ecfec-8c9a-48c2-b57c-7357a855c4cc', 'id': '988fde58-ff36-49e1-810c-d16aaa6aa478'} Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 988fde58-ff36-49e1-810c-d16aaa6aa478. Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc is not attached to volume 988fde58-ff36-49e1-810c-d16aaa6aa478 Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:10:27.422984 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:10:27.427883 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:10:27.427883 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:10:27.427883 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc is not attached to volume 988fde58-ff36-49e1-810c-d16aaa6aa478 Sep 18 02:10:27.427883 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:27.427883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Returning 404 to user: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc is not attached to volume 988fde58-ff36-49e1-810c-d16aaa6aa478 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:10:27.427883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1fb6b4ce-98a1-4ad5-92a1-2c84f5acf70a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments/988fde58-ff36-49e1-810c-d16aaa6aa478" status: 404 len: 154 microversion: 2.1 time: 0.102356 Sep 18 02:10:27.427883 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3565/7106] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:10:27 2022] DELETE /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc/os-volume_attachments/988fde58-ff36-49e1-810c-d16aaa6aa478 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:10:30.794534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:30.795391 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:30.804510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:30.805354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:30.806228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:30.807520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:30.808325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:30.809121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:30.842583 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:10:30.927736 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-95f1d970-b6a2-4423-a8c7-fe336b0136d4 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 204 len: 0 microversion: 2.1 time: 0.137024 Sep 18 02:10:30.928642 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3542/7107] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:10:30 2022] DELETE /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 02:10:30.937733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:30.938480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:30.947059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:30.947655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:30.948041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:30.948702 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:30.949185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:30.949636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:31.105896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:31.115292 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7345b276-8b57-47d1-9205-5faba1adf4b0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1561 microversion: 2.1 time: 0.181963 Sep 18 02:10:31.115980 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3566/7108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:30 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:32.141534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:32.142325 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:32.155799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:32.155799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:32.155799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:32.156290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:32.156710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:32.157590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:32.296743 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:32.305754 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-30f76211-57ef-4eb2-a9ba-2bfb53fdf05f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1561 microversion: 2.1 time: 0.168586 Sep 18 02:10:32.306353 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3543/7109] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:32 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:33.211522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-0e0b7729-adbf-419c-954f-8caaabd2a6b9 req-c45de33e-817c-4e40-b1ed-a2b52e640eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7ecfec-8c9a-48c2-b57c-7357a855c4cc", "name": "network-vif-deleted", "tag": "05f1bac0-51d4-49ed-aa3b-88eea5ec53a4"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:33.225646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0e0b7729-adbf-419c-954f-8caaabd2a6b9 req-c45de33e-817c-4e40-b1ed-a2b52e640eb7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:33.226144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0e0b7729-adbf-419c-954f-8caaabd2a6b9 req-c45de33e-817c-4e40-b1ed-a2b52e640eb7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:33.226581 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-0e0b7729-adbf-419c-954f-8caaabd2a6b9 req-c45de33e-817c-4e40-b1ed-a2b52e640eb7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:33.243476 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-0e0b7729-adbf-419c-954f-8caaabd2a6b9 req-c45de33e-817c-4e40-b1ed-a2b52e640eb7 service nova] Creating event network-vif-deleted:05f1bac0-51d4-49ed-aa3b-88eea5ec53a4 for instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc on n-h2-master-1 Sep 18 02:10:33.248611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-0e0b7729-adbf-419c-954f-8caaabd2a6b9 req-c45de33e-817c-4e40-b1ed-a2b52e640eb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040835 Sep 18 02:10:33.249243 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3567/7110] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:33.329072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:33.329943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:33.337285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:33.338129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:33.338719 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:33.339341 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:33.339837 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:33.340280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:33.376484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:33.376915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:33.377398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:33.377971 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lazy-loading 'fault' on Instance uuid ad7ecfec-8c9a-48c2-b57c-7357a855c4cc {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:10:33.419810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:33.433088 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c248d32-4150-4513-a49a-0af2be9b25b5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 200 len: 1353 microversion: 2.1 time: 0.108311 Sep 18 02:10:33.434285 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3544/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:33 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:34.459456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:34.460156 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: ad7ecfec-8c9a-48c2-b57c-7357a855c4cc] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:34.466345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:34.466823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:34.467258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:34.467947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:34.468398 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:34.468828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:34.484543 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] HTTP exception thrown: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc could not be found. Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Request method failure captured: Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc HTTP/1.1 Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn3xM3JsvG5nC2tmcPH3uBTluJmz5wZ-hyTNL3KytJvsz2i8NEY2m2MhvE2HMSmY3efZ1okUHTdQchAE4rqFRcOJGvz3aCjhW7T7poRZFAiryosMz3yHVrHrRkMCJphodgXXc-Jf64vdJxoT2t1i8caRbS2dmTqH1TlA1vEBTWNdpog Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: cd4d5944113542fda46655411ad40e9a Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc could not be found. Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'ad7ecfec-8c9a-48c2-b57c-7357a855c4cc'} Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc could not be found. Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc could not be found. Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:10:34.486296 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc could not be found. Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Returning 404 to user: Instance ad7ecfec-8c9a-48c2-b57c-7357a855c4cc could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6686326-a49b-4e3f-ad09-c78d8104294d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc" status: 404 len: 111 microversion: 2.1 time: 0.034598 Sep 18 02:10:34.491783 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3568/7112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:34 2022] GET /compute/v2.1/servers/ad7ecfec-8c9a-48c2-b57c-7357a855c4cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:10:34.498620 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88639cf3-e154-4bc0-91cf-649e0e3bf953 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '.version_select at 0x7f7004ffa040>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:34.521416 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88639cf3-e154-4bc0-91cf-649e0e3bf953 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1562426406" status: 202 len: 0 microversion: 2.1 time: 0.026600 Sep 18 02:10:34.522028 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3545/7113] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 02:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1562426406 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:10:34.536464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-965467a0-931d-4406-81f3-3472eaf10e19 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: .version_select at 0x7f7004ff9f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1025390137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp1p797tdyjknfHzkYGR1mRAcN8SXzwO8IlMT3s32MbohwI+5JmkH+ZOKXOBF9lHD8xga7C8HK0AYGgZmldIwUE6D83TZl4Fv+9B5wCBqSXXCo3LHaGcGkABw2BdHP1XA=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:34.551739 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-965467a0-931d-4406-81f3-3472eaf10e19 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for project 60d599951be4438cab91c7fbc3657e8f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:10:34.556924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-965467a0-931d-4406-81f3-3472eaf10e19 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for user cd4d5944113542fda46655411ad40e9a and project 60d599951be4438cab91c7fbc3657e8f. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:10:34.580219 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-965467a0-931d-4406-81f3-3472eaf10e19 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.047714 Sep 18 02:10:34.581423 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3569/7114] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:10:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:34.631252 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-10657346", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1025390137", "networks": [{"uuid": "c8fdc435-1953-42b9-abca-3df23d89b3be"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:34.685099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] validate_networks() for [('c8fdc435-1953-42b9-abca-3df23d89b3be', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:10:35.168396 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:10:35.168842 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:10:35.169402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:10:35.169863 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:10:35.170292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:10:35.180630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:35.181135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:35.181684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:35.182463 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:35.182936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:35.183378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:35.201109 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for project 60d599951be4438cab91c7fbc3657e8f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:10:35.206685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for user cd4d5944113542fda46655411ad40e9a and project 60d599951be4438cab91c7fbc3657e8f. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:10:35.218777 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:10:35.221627 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:10:35.268061 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bd296d70-f144-4730-a206-151fd2a09abe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641224 Sep 18 02:10:35.268846 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3546/7115] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:10:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:10:35.280369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6afd7ee8-f6df-403d-81da-9f06cbc75db2 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:35.281089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6afd7ee8-f6df-403d-81da-9f06cbc75db2 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:35.337068 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6afd7ee8-f6df-403d-81da-9f06cbc75db2 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:35.345153 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6afd7ee8-f6df-403d-81da-9f06cbc75db2 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1261 microversion: 2.1 time: 0.068990 Sep 18 02:10:35.345755 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3570/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:35 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:36.369756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:36.370451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:36.376670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:36.377165 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:36.377667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:36.378380 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:36.378861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:36.379279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:36.443407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:36.451267 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0b5568a5-1943-4471-a336-b35f3d531894 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1313 microversion: 2.1 time: 0.086662 Sep 18 02:10:36.451885 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3547/7117] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:36 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1313 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:37.479511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:37.480065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:37.485981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:37.486464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:37.487677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:37.488377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:37.488830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:37.489251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:37.635405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:37.643533 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-23004097-08ec-4d23-9a89-14e1e2d752aa tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1361 microversion: 2.1 time: 0.172099 Sep 18 02:10:37.644117 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3571/7118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:37 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:37.891500 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-6d09d91f-77c7-4e61-8b70-5fa1f056121f req-a7d6ff1c-18fe-484b-9c03-998254c3cd6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae77eff-de35-4aef-b262-2fdde443b934", "tag": "173a0835-e9aa-4154-9108-e7c60e5f7dc9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:37.913092 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6d09d91f-77c7-4e61-8b70-5fa1f056121f req-a7d6ff1c-18fe-484b-9c03-998254c3cd6d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:37.913617 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6d09d91f-77c7-4e61-8b70-5fa1f056121f req-a7d6ff1c-18fe-484b-9c03-998254c3cd6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:37.914066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-6d09d91f-77c7-4e61-8b70-5fa1f056121f req-a7d6ff1c-18fe-484b-9c03-998254c3cd6d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:37.927911 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-6d09d91f-77c7-4e61-8b70-5fa1f056121f req-a7d6ff1c-18fe-484b-9c03-998254c3cd6d service nova] Creating event network-changed:173a0835-e9aa-4154-9108-e7c60e5f7dc9 for instance 7ae77eff-de35-4aef-b262-2fdde443b934 on n-h2-master-1 Sep 18 02:10:37.934361 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-6d09d91f-77c7-4e61-8b70-5fa1f056121f req-a7d6ff1c-18fe-484b-9c03-998254c3cd6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048574 Sep 18 02:10:37.935053 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3548/7119] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:38.667955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:38.668524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:38.676315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:38.676803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:38.677246 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:38.677984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:38.678439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:38.678868 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:38.818410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:38.826292 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-705ef3e9-fcb5-43d4-a777-9bf98ad32f9c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1361 microversion: 2.1 time: 0.162451 Sep 18 02:10:38.826874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3572/7120] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:38 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:39.850979 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:39.851698 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:39.857996 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:39.858497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:39.858947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:39.859661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:39.860288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:39.860584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:39.992861 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:40.000710 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ac20accf-c68c-4a6e-8c57-d7638b4345d6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1361 microversion: 2.1 time: 0.155121 Sep 18 02:10:40.001286 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3549/7121] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:39 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:41.024705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:41.025224 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:41.032126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:41.032613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:41.033054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:41.034425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:41.034890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:41.035320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:41.167380 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:41.175388 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-89cd185c-4d53-4c9b-8ec0-439aff5b095d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1361 microversion: 2.1 time: 0.154636 Sep 18 02:10:41.176232 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3573/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:41 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:42.199122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:42.199675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:42.207316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:42.207823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:42.208284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:42.209031 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:42.209500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:42.210619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:42.345813 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:42.354191 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-88c69c04-859b-49af-bda8-ecee1c139746 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1361 microversion: 2.1 time: 0.159213 Sep 18 02:10:42.354762 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3550/7123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:42 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:43.359646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-98a9941d-6b27-460e-8485-7bf273209544 req-15a2939c-1969-4a4a-a7d1-bafedeb3a98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae77eff-de35-4aef-b262-2fdde443b934", "name": "network-vif-plugged", "status": "completed", "tag": "173a0835-e9aa-4154-9108-e7c60e5f7dc9"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:43.369815 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-98a9941d-6b27-460e-8485-7bf273209544 req-15a2939c-1969-4a4a-a7d1-bafedeb3a98b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:43.370323 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-98a9941d-6b27-460e-8485-7bf273209544 req-15a2939c-1969-4a4a-a7d1-bafedeb3a98b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:43.370754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-98a9941d-6b27-460e-8485-7bf273209544 req-15a2939c-1969-4a4a-a7d1-bafedeb3a98b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:43.376365 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:43.377009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:43.384810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:43.385320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:43.386063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:43.386789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:43.387260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:43.387710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:43.389845 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-98a9941d-6b27-460e-8485-7bf273209544 req-15a2939c-1969-4a4a-a7d1-bafedeb3a98b service nova] Creating event network-vif-plugged:173a0835-e9aa-4154-9108-e7c60e5f7dc9 for instance 7ae77eff-de35-4aef-b262-2fdde443b934 on n-h2-master-1 Sep 18 02:10:43.395583 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-98a9941d-6b27-460e-8485-7bf273209544 req-15a2939c-1969-4a4a-a7d1-bafedeb3a98b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096390 Sep 18 02:10:43.396110 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3574/7124] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:43.531926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:43.540592 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7917f57b-ad93-4ed9-a479-395421513656 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1361 microversion: 2.1 time: 0.168128 Sep 18 02:10:43.541299 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3551/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:43 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:10:44.565718 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:44.566935 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:44.573476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:44.574005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:44.574447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:44.575214 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:44.575706 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:44.576131 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:44.732766 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:44.744025 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ae4b4aae-9899-42b2-8935-89efaa3998bd tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1361 microversion: 2.1 time: 0.183263 Sep 18 02:10:44.744545 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3575/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:44 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:45.768271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:45.768898 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:45.772249 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:45.772924 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:45.778854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:45.779442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:45.779806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:45.780512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:45.780978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:45.781454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:45.912433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:45.920764 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-90d7f5bd-3711-41e1-8186-c70c7bdc5502 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1553 microversion: 2.1 time: 0.156366 Sep 18 02:10:45.921373 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3552/7127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:45 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:45.943908 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:45.944520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:45.946497 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:45.952871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:45.953351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:45.953806 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:45.954489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:45.954938 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:45.955359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:46.093818 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:10:46.101509 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aa96e706-c9eb-4d29-86fa-383f45d242f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1553 microversion: 2.1 time: 0.162116 Sep 18 02:10:46.102166 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3576/7128] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:10:45 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:10:47.607953 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38eb5c67-d98c-4935-82e4-40ba2628c662"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:10:47.610478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:47.617269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:47.617794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:47.618241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:47.618937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:47.619404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:47.619861 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:47.772148 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:47.899810 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26e924b6-0d1f-4a83-8272-b33e6ec778e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295758 Sep 18 02:10:47.900465 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3553/7129] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 02:10:47 2022] POST /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:58.620281 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:58.620752 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:58.623536 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:58.624536 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=66 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:58.631221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:58.631710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:58.632143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:58.632837 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:58.633287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:58.633732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:58.717369 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lazy-loading 'services' on Instance uuid 7ae77eff-de35-4aef-b262-2fdde443b934 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:10:58.791948 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-13c4f18b-b40e-40c6-9e4d-59db80a1895b tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments/38eb5c67-d98c-4935-82e4-40ba2628c662" status: 202 len: 0 microversion: 2.1 time: 0.175395 Sep 18 02:10:58.792651 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3577/7130] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:10:58 2022] DELETE /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments/38eb5c67-d98c-4935-82e4-40ba2628c662 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:10:58.802894 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:58.804316 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:10:58.814550 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:58.820720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:58.831465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:58.832497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:58.832941 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:58.833691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:58.834158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:58.834590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:58.874666 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-906a5326-40b7-4191-865a-ebb737dc2111 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075383 Sep 18 02:10:58.875249 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3554/7131] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:58 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:10:59.890406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:10:59.892804 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:10:59.899976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:59.900466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:59.900906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:59.901688 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:10:59.902151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:10:59.902576 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:10:59.943596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5753b211-620e-4185-9bb6-f802a98bc1e5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058796 Sep 18 02:10:59.944266 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3578/7132] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:10:59 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:00.957467 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:00.960020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:00.967287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:00.967791 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:00.968426 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:00.969179 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:00.969823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:00.970271 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:01.005002 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3535201f-7c9a-4e05-bdce-0153c4be39b6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051761 Sep 18 02:11:01.005625 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3555/7133] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:00 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:02.018461 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:02.021686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:02.028627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:02.029115 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:02.029545 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:02.030332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:02.030798 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:02.031226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:02.063337 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-21e74c2f-1f06-4963-85a9-94217d4f0359 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048892 Sep 18 02:11:02.064038 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3579/7134] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:02 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:03.076572 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:03.078868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:03.086887 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:03.087389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:03.087844 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:03.088565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:03.089035 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:03.089475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:03.120615 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-052283d0-5d93-4b46-af2f-22f7b5fa68bf tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Sep 18 02:11:03.121192 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3556/7135] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:03 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:04.133244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:04.135340 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:04.142654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:04.143135 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:04.143563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:04.144258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:04.144708 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:04.145129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:04.174940 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a406836-92f9-4441-b672-acf8d259b8c7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045717 Sep 18 02:11:04.176175 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3580/7136] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:04 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 02:11:04.187086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:04.187621 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:04.194603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:04.195101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:04.195552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:04.196256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:04.196725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:04.197161 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:04.277417 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] HTTP exception thrown: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 is not attached to volume 38eb5c67-d98c-4935-82e4-40ba2628c662 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Request method failure captured: Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments/38eb5c67-d98c-4935-82e4-40ba2628c662 HTTP/1.1 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn3xM3JsvG5nC2tmcPH3uBTluJmz5wZ-hyTNL3KytJvsz2i8NEY2m2MhvE2HMSmY3efZ1okUHTdQchAE4rqFRcOJGvz3aCjhW7T7poRZFAiryosMz3yHVrHrRkMCJphodgXXc-Jf64vdJxoT2t1i8caRbS2dmTqH1TlA1vEBTWNdpog Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cd4d5944113542fda46655411ad40e9a Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 is not attached to volume 38eb5c67-d98c-4935-82e4-40ba2628c662 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '7ae77eff-de35-4aef-b262-2fdde443b934', 'id': '38eb5c67-d98c-4935-82e4-40ba2628c662'} Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 38eb5c67-d98c-4935-82e4-40ba2628c662. Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 is not attached to volume 38eb5c67-d98c-4935-82e4-40ba2628c662 Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:04.279446 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:04.283836 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:11:04.283836 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:11:04.283836 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 is not attached to volume 38eb5c67-d98c-4935-82e4-40ba2628c662 Sep 18 02:11:04.283836 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:04.283836 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Returning 404 to user: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 is not attached to volume 38eb5c67-d98c-4935-82e4-40ba2628c662 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:11:04.283836 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-77c901d5-951f-4c7f-a2bd-5a84b6b9286e tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments/38eb5c67-d98c-4935-82e4-40ba2628c662" status: 404 len: 154 microversion: 2.1 time: 0.097937 Sep 18 02:11:04.283836 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3557/7137] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:11:04 2022] DELETE /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934/os-volume_attachments/38eb5c67-d98c-4935-82e4-40ba2628c662 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:11:07.652313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:07.652928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:07.658977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:07.660030 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:07.660468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:07.661166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:07.661657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:07.662193 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:07.688371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:11:07.777349 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4366186b-2c52-4347-89b5-feac08e01756 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 204 len: 0 microversion: 2.1 time: 0.129437 Sep 18 02:11:07.778025 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3581/7138] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:11:07 2022] DELETE /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:11:07.787646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:07.788903 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:07.798385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:07.798930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:07.799481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:07.803047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:07.803675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:07.806393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:07.964397 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:07.973361 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-05557d69-da14-4a4b-9553-161e6a6e8d7a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1559 microversion: 2.1 time: 0.190157 Sep 18 02:11:07.974606 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3558/7139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:07 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:08.998342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:09.000342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:09.006716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:09.007438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:09.007646 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:09.008574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:09.008783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:09.009188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:09.160066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:09.168327 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2f2a12da-0dd4-4ea6-b349-d465cbe647ee tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1559 microversion: 2.1 time: 0.174714 Sep 18 02:11:09.168921 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3582/7140] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:08 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:10.092360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e76daac9-ba54-40c1-8ead-df5c41f238d0 req-22362a23-fa44-4a48-94ca-f2140ff27175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae77eff-de35-4aef-b262-2fdde443b934", "name": "network-vif-deleted", "tag": "173a0835-e9aa-4154-9108-e7c60e5f7dc9"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:11:10.105628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e76daac9-ba54-40c1-8ead-df5c41f238d0 req-22362a23-fa44-4a48-94ca-f2140ff27175 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:10.106158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e76daac9-ba54-40c1-8ead-df5c41f238d0 req-22362a23-fa44-4a48-94ca-f2140ff27175 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:10.106610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e76daac9-ba54-40c1-8ead-df5c41f238d0 req-22362a23-fa44-4a48-94ca-f2140ff27175 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:10.120420 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e76daac9-ba54-40c1-8ead-df5c41f238d0 req-22362a23-fa44-4a48-94ca-f2140ff27175 service nova] Creating event network-vif-deleted:173a0835-e9aa-4154-9108-e7c60e5f7dc9 for instance 7ae77eff-de35-4aef-b262-2fdde443b934 on n-h2-master-1 Sep 18 02:11:10.127151 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e76daac9-ba54-40c1-8ead-df5c41f238d0 req-22362a23-fa44-4a48-94ca-f2140ff27175 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038642 Sep 18 02:11:10.128230 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3559/7141] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:10.191925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:10.192528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:10.199970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:10.200511 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:10.201155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:10.201959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:10.202739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:10.204232 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:10.240358 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:10.240843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:10.241275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:10.241764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lazy-loading 'fault' on Instance uuid 7ae77eff-de35-4aef-b262-2fdde443b934 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:11:10.286447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:10.294103 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf6d9dd7-e660-460b-88d4-ee74e07038c1 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 200 len: 1351 microversion: 2.1 time: 0.106350 Sep 18 02:11:10.294675 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3583/7142] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:10 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:11.319543 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:11.320169 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 7ae77eff-de35-4aef-b262-2fdde443b934] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:11.327197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:11.327687 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:11.328136 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:11.328841 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:11.329303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:11.329768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:11.343510 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] HTTP exception thrown: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 could not be found. Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Request method failure captured: Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 HTTP/1.1 Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn3xM3JsvG5nC2tmcPH3uBTluJmz5wZ-hyTNL3KytJvsz2i8NEY2m2MhvE2HMSmY3efZ1okUHTdQchAE4rqFRcOJGvz3aCjhW7T7poRZFAiryosMz3yHVrHrRkMCJphodgXXc-Jf64vdJxoT2t1i8caRbS2dmTqH1TlA1vEBTWNdpog Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cd4d5944113542fda46655411ad40e9a Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 could not be found. Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '7ae77eff-de35-4aef-b262-2fdde443b934'} Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 could not be found. Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 could not be found. Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:11.345128 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 could not be found. Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Returning 404 to user: Instance 7ae77eff-de35-4aef-b262-2fdde443b934 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f89afaa8-a43d-4e17-a034-399be28b1a72 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934" status: 404 len: 111 microversion: 2.1 time: 0.032224 Sep 18 02:11:11.349468 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3560/7143] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:11 2022] GET /compute/v2.1/servers/7ae77eff-de35-4aef-b262-2fdde443b934 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:11:11.355444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-316577f5-aa9d-4bd1-8a1c-29e7e8fa4188 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '.version_select at 0x7f70053c81f0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:11.375251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-316577f5-aa9d-4bd1-8a1c-29e7e8fa4188 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1025390137" status: 202 len: 0 microversion: 2.1 time: 0.023641 Sep 18 02:11:11.375819 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3584/7144] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 02:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1025390137 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:11:11.393881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e0d65b5f-5a6d-4792-a855-d700b4583fd3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: .version_select at 0x7f70055b8310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1249803471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPzfiUjmFxHC8LLNHK9Xq/Fx940uwm48M0bPolEJTrG94gNXTRNyHtULPax5psQLsy51XdYjTQSAsoXlvJjieAQE9V7sq8lGsJlyhXbQ+CgQENZshA8C/4ORu7WufgGmg=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:11:11.409185 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-e0d65b5f-5a6d-4792-a855-d700b4583fd3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for project 60d599951be4438cab91c7fbc3657e8f. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:11:11.414360 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-e0d65b5f-5a6d-4792-a855-d700b4583fd3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for user cd4d5944113542fda46655411ad40e9a and project 60d599951be4438cab91c7fbc3657e8f. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:11:11.438239 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e0d65b5f-5a6d-4792-a855-d700b4583fd3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048382 Sep 18 02:11:11.438838 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3561/7145] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:11:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:11.489709 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2017079135", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1249803471", "networks": [{"uuid": "c8fdc435-1953-42b9-abca-3df23d89b3be"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:11:11.542639 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] validate_networks() for [('c8fdc435-1953-42b9-abca-3df23d89b3be', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:11:11.906357 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:11:11.906780 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:11:11.907251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:11:11.907657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:11:11.908091 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:11:11.917362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:11.917873 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:11.918306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:11.919020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:11.919471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:11.919907 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:11.936520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for project 60d599951be4438cab91c7fbc3657e8f. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:11:11.941832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Getting quotas for user cd4d5944113542fda46655411ad40e9a and project 60d599951be4438cab91c7fbc3657e8f. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:11:11.954676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:11:11.957504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:11:12.004070 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8474567f-55b2-4f8e-b787-963a905928ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518849 Sep 18 02:11:12.005014 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3585/7146] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:11:12.016117 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-608c4a4d-c42b-4aa1-9a30-5c770a2eb9dc tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:12.016740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-608c4a4d-c42b-4aa1-9a30-5c770a2eb9dc tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:12.070271 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-608c4a4d-c42b-4aa1-9a30-5c770a2eb9dc tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:12.078494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-608c4a4d-c42b-4aa1-9a30-5c770a2eb9dc tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1263 microversion: 2.1 time: 0.066194 Sep 18 02:11:12.079067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3562/7147] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:12 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:13.103272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:13.104509 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:13.111976 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:13.113338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:13.113982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:13.114843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:13.115447 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:13.116054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:13.190931 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:13.199972 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-51a28f74-a043-4624-9233-8daa64b99c86 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1333 microversion: 2.1 time: 0.101403 Sep 18 02:11:13.209516 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3586/7148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:13 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:14.224347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:14.224981 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:14.231973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:14.232475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:14.232932 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:14.233678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:14.234152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:14.234591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:14.371086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:14.378915 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1f73f0de-60a9-4388-bca5-028f7e269775 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1363 microversion: 2.1 time: 0.159246 Sep 18 02:11:14.379485 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3563/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:14 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:14.540084 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-fa668e53-63b0-49e6-9e6b-e9bd874f154b req-9b8a05da-0f48-43ea-b80a-3fd5ff16c31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73fd7199-23af-4871-ab08-c28d4542c583", "tag": "ebb26c6d-59fd-40aa-83f6-7173ca7ef413"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:11:14.552547 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fa668e53-63b0-49e6-9e6b-e9bd874f154b req-9b8a05da-0f48-43ea-b80a-3fd5ff16c31d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:14.553136 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fa668e53-63b0-49e6-9e6b-e9bd874f154b req-9b8a05da-0f48-43ea-b80a-3fd5ff16c31d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:14.553671 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-fa668e53-63b0-49e6-9e6b-e9bd874f154b req-9b8a05da-0f48-43ea-b80a-3fd5ff16c31d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:14.565173 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-fa668e53-63b0-49e6-9e6b-e9bd874f154b req-9b8a05da-0f48-43ea-b80a-3fd5ff16c31d service nova] Creating event network-changed:ebb26c6d-59fd-40aa-83f6-7173ca7ef413 for instance 73fd7199-23af-4871-ab08-c28d4542c583 on n-h1-master-1 Sep 18 02:11:14.570665 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-fa668e53-63b0-49e6-9e6b-e9bd874f154b req-9b8a05da-0f48-43ea-b80a-3fd5ff16c31d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Sep 18 02:11:14.571281 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3587/7150] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:15.402594 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:15.403319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:15.410784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:15.411280 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:15.411728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:15.412431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:15.412896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:15.413332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:15.540809 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:15.548556 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aef75861-b7ce-4565-b5d0-88fc3aeb209c tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1363 microversion: 2.1 time: 0.149914 Sep 18 02:11:15.549116 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3564/7151] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:15 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:16.573120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:16.573774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:16.579993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:16.580475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:16.580950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:16.581662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:16.582118 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:16.582544 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:16.714691 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:16.722894 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-349d085d-0835-4081-ace6-09acc08f4cb0 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1363 microversion: 2.1 time: 0.154974 Sep 18 02:11:16.723460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3588/7152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:16 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:17.746409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:17.746951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:17.754242 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:17.754732 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:17.755174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:17.755865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:17.756329 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:17.756758 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:17.893579 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:17.901351 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6e29e56f-ede4-4310-9635-325af748ae96 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1363 microversion: 2.1 time: 0.158901 Sep 18 02:11:17.901957 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3565/7153] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:17 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:18.924218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:18.924828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:18.931828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:18.932306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:18.932739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:18.933426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:18.933908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:18.934335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:19.073965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:19.082860 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1d41d859-7283-44ab-8149-bc21fdce5ae3 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1363 microversion: 2.1 time: 0.162506 Sep 18 02:11:19.083444 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3589/7154] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:18 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:19.142070 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-1a9d25c9-5f2b-4ffb-9f2f-e4f9922d84b1 req-0a5eadde-c238-404a-a3aa-fbaf55ffd8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd7199-23af-4871-ab08-c28d4542c583", "name": "network-vif-plugged", "status": "completed", "tag": "ebb26c6d-59fd-40aa-83f6-7173ca7ef413"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:11:19.154489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a9d25c9-5f2b-4ffb-9f2f-e4f9922d84b1 req-0a5eadde-c238-404a-a3aa-fbaf55ffd8c4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:19.154991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a9d25c9-5f2b-4ffb-9f2f-e4f9922d84b1 req-0a5eadde-c238-404a-a3aa-fbaf55ffd8c4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:19.155444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-1a9d25c9-5f2b-4ffb-9f2f-e4f9922d84b1 req-0a5eadde-c238-404a-a3aa-fbaf55ffd8c4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:19.166732 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-1a9d25c9-5f2b-4ffb-9f2f-e4f9922d84b1 req-0a5eadde-c238-404a-a3aa-fbaf55ffd8c4 service nova] Creating event network-vif-plugged:ebb26c6d-59fd-40aa-83f6-7173ca7ef413 for instance 73fd7199-23af-4871-ab08-c28d4542c583 on n-h1-master-1 Sep 18 02:11:19.171958 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-1a9d25c9-5f2b-4ffb-9f2f-e4f9922d84b1 req-0a5eadde-c238-404a-a3aa-fbaf55ffd8c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Sep 18 02:11:19.172687 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3566/7155] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:20.106219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:20.106833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:20.113701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:20.114129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:20.114568 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:20.115359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:20.115822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:20.116247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:20.244146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:20.252017 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c5a5a4f0-19e2-4d5e-9250-f12cf4ae84bb tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1363 microversion: 2.1 time: 0.149855 Sep 18 02:11:20.252586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3590/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:20 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:21.277235 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:21.277918 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:21.284127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:21.284624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:21.285076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:21.285814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:21.286287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:21.286729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:21.413674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:21.421385 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e815bc6e-6009-4935-a0da-b39fe2b4d0f5 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1555 microversion: 2.1 time: 0.149488 Sep 18 02:11:21.421976 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3567/7157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:21 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:21.444152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:21.444764 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:21.451760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:21.452245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:21.452685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:21.453371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:21.453859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:21.454282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:21.586546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:21.594194 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe49ba34-4f12-4939-a536-81a85481c102 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1555 microversion: 2.1 time: 0.154446 Sep 18 02:11:21.594767 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3591/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:21 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:23.094616 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc51c994-5b58-4a25-ae76-f68bed258d45"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:11:23.097034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:23.099064 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:11:23.105407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:23.105922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:23.106369 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:23.107075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:23.107538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:23.107974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:23.373865 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ecbafe65-7645-40b7-b29e-61e6d35940ac tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "POST /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283075 Sep 18 02:11:23.374495 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3568/7159] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 02:11:23 2022] POST /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:34.092422 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:34.092981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:34.094900 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:11:34.095565 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:11:34.097299 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:11:34.097958 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:11:34.105149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:34.105669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:34.106113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:34.106813 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:34.107271 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:34.107699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:34.192820 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lazy-loading 'services' on Instance uuid 73fd7199-23af-4871-ab08-c28d4542c583 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:11:34.262415 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-afe138a9-6dd1-466c-8506-7b1022e92c11 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments/cc51c994-5b58-4a25-ae76-f68bed258d45" status: 202 len: 0 microversion: 2.1 time: 0.173751 Sep 18 02:11:34.263031 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3592/7160] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:11:34 2022] DELETE /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments/cc51c994-5b58-4a25-ae76-f68bed258d45 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:11:34.270169 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:11:34.271024 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:11:34.276400 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:34.278548 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:34.287671 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:34.288176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:34.288627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:34.289354 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:34.289889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:34.290420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:34.323642 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96bccbc1-46fa-417b-a148-2e2c0e900cf6 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056082 Sep 18 02:11:34.324205 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3569/7161] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:34 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:35.338412 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:35.340784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:35.347965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:35.348462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:35.348905 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:35.349647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:35.350108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:35.350536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:35.380679 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1a130557-e339-4e24-9b9d-d28134a29445 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047604 Sep 18 02:11:35.381259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3593/7162] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:35 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:36.392769 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:36.395067 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:36.402286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:36.402793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:36.403245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:36.403985 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:36.404472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:36.404890 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:36.438144 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c37540c-081d-4e5c-bec7-c48f76809fd9 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049383 Sep 18 02:11:36.439087 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3570/7163] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:36 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:37.450821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:37.453051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:37.459983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:37.460473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:37.460915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:37.461653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:37.462123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:37.462546 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:37.493736 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f42a181-2b6e-4e83-9cdd-90d599f315fe tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046977 Sep 18 02:11:37.494306 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3594/7164] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:37 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:38.506825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:38.509375 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:38.516587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:38.517082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:38.517527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:38.518946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:38.519416 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:38.519852 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:38.552346 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-185c0afd-c030-4b4b-9365-3a46e2b7037f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050044 Sep 18 02:11:38.552918 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3571/7165] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:38 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:39.564938 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:39.567197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:39.577640 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:39.578125 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:39.578561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:39.579257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:39.579715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:39.580138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:39.609674 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4f327dd0-eb69-41b7-b78f-f4feca4268b8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048702 Sep 18 02:11:39.610371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3595/7166] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:11:39 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 02:11:39.621318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:39.621825 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:39.629045 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:39.629582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:39.630025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:39.630724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:39.631185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:39.631614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:39.708313 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] HTTP exception thrown: Instance 73fd7199-23af-4871-ab08-c28d4542c583 is not attached to volume cc51c994-5b58-4a25-ae76-f68bed258d45 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Request method failure captured: Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments/cc51c994-5b58-4a25-ae76-f68bed258d45 HTTP/1.1 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn3xM3JsvG5nC2tmcPH3uBTluJmz5wZ-hyTNL3KytJvsz2i8NEY2m2MhvE2HMSmY3efZ1okUHTdQchAE4rqFRcOJGvz3aCjhW7T7poRZFAiryosMz3yHVrHrRkMCJphodgXXc-Jf64vdJxoT2t1i8caRbS2dmTqH1TlA1vEBTWNdpog Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cd4d5944113542fda46655411ad40e9a Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 73fd7199-23af-4871-ab08-c28d4542c583 is not attached to volume cc51c994-5b58-4a25-ae76-f68bed258d45 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '73fd7199-23af-4871-ab08-c28d4542c583', 'id': 'cc51c994-5b58-4a25-ae76-f68bed258d45'} Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cc51c994-5b58-4a25-ae76-f68bed258d45. Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fd7199-23af-4871-ab08-c28d4542c583 is not attached to volume cc51c994-5b58-4a25-ae76-f68bed258d45 Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:39.709951 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:39.714666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:11:39.714666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:11:39.714666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fd7199-23af-4871-ab08-c28d4542c583 is not attached to volume cc51c994-5b58-4a25-ae76-f68bed258d45 Sep 18 02:11:39.714666 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:39.714666 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Returning 404 to user: Instance 73fd7199-23af-4871-ab08-c28d4542c583 is not attached to volume cc51c994-5b58-4a25-ae76-f68bed258d45 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:11:39.714666 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-37ec603f-c899-42fc-bae3-2b0c0500d2b7 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments/cc51c994-5b58-4a25-ae76-f68bed258d45" status: 404 len: 154 microversion: 2.1 time: 0.094408 Sep 18 02:11:39.714666 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3572/7167] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:11:39 2022] DELETE /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583/os-volume_attachments/cc51c994-5b58-4a25-ae76-f68bed258d45 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:11:43.059750 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:43.060315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:43.066614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:43.067120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:43.067532 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:43.068239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:43.068698 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:43.069117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:43.096749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:11:43.175649 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-40845e08-66d5-4d33-b7a8-fa35a9116580 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 204 len: 0 microversion: 2.1 time: 0.119695 Sep 18 02:11:43.176308 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3596/7168] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:11:43 2022] DELETE /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:11:43.184731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:43.185346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:43.192695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:43.193199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:43.194119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:43.195007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:43.195007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:43.195266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:43.327591 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:43.335923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1edc3c3f-b887-487b-8234-7f0218ab7cd8 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1561 microversion: 2.1 time: 0.155208 Sep 18 02:11:43.336489 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3573/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:43 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:44.360159 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:44.360847 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:44.367853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:44.368327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:44.368757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:44.369605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:44.370061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:44.370482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:44.833446 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:44.841148 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-67942915-010e-41d4-b638-587b4ec7e13f tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1561 microversion: 2.1 time: 0.485302 Sep 18 02:11:44.841752 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3597/7170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:44 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1561 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:45.360791 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-97f6b635-1d59-4c86-be9f-68b58af7f2dc req-87675703-325c-4b63-b19f-8cc8ba71c192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd7199-23af-4871-ab08-c28d4542c583", "name": "network-vif-deleted", "tag": "ebb26c6d-59fd-40aa-83f6-7173ca7ef413"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:11:45.375596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-97f6b635-1d59-4c86-be9f-68b58af7f2dc req-87675703-325c-4b63-b19f-8cc8ba71c192 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:45.376185 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-97f6b635-1d59-4c86-be9f-68b58af7f2dc req-87675703-325c-4b63-b19f-8cc8ba71c192 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:45.376983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-97f6b635-1d59-4c86-be9f-68b58af7f2dc req-87675703-325c-4b63-b19f-8cc8ba71c192 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:45.401518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-97f6b635-1d59-4c86-be9f-68b58af7f2dc req-87675703-325c-4b63-b19f-8cc8ba71c192 service nova] Creating event network-vif-deleted:ebb26c6d-59fd-40aa-83f6-7173ca7ef413 for instance 73fd7199-23af-4871-ab08-c28d4542c583 on n-h1-master-1 Sep 18 02:11:45.407934 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-97f6b635-1d59-4c86-be9f-68b58af7f2dc req-87675703-325c-4b63-b19f-8cc8ba71c192 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051076 Sep 18 02:11:45.409472 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3574/7171] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:11:45.864328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:45.864946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:45.872113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:45.872861 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:45.873302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:45.874364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:45.874489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:45.874918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:45.909045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:45.909564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:45.910013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:45.910458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lazy-loading 'fault' on Instance uuid 73fd7199-23af-4871-ab08-c28d4542c583 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:11:45.951695 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d5944113542fda46655411ad40e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d599951be4438cab91c7fbc3657e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:11:45.959641 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d9d21c69-3981-4e24-a45a-cf2869b8ac10 tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 200 len: 1353 microversion: 2.1 time: 0.099259 Sep 18 02:11:45.960224 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3598/7172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:45 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:11:46.987585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:46.988848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] [instance: 73fd7199-23af-4871-ab08-c28d4542c583] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:11:46.995127 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:46.995623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:46.996071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:46.996778 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:11:46.997244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:11:46.997712 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:11:47.013355 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] HTTP exception thrown: Instance 73fd7199-23af-4871-ab08-c28d4542c583 could not be found. Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Request method failure captured: Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 HTTP/1.1 Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn3xM3JsvG5nC2tmcPH3uBTluJmz5wZ-hyTNL3KytJvsz2i8NEY2m2MhvE2HMSmY3efZ1okUHTdQchAE4rqFRcOJGvz3aCjhW7T7poRZFAiryosMz3yHVrHrRkMCJphodgXXc-Jf64vdJxoT2t1i8caRbS2dmTqH1TlA1vEBTWNdpog Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60d599951be4438cab91c7fbc3657e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 60d599951be4438cab91c7fbc3657e8f Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-507784318 Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: cd4d5944113542fda46655411ad40e9a Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestEncryptedCinderVolumes-507784318-project Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 73fd7199-23af-4871-ab08-c28d4542c583 could not be found. Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '73fd7199-23af-4871-ab08-c28d4542c583'} Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fd7199-23af-4871-ab08-c28d4542c583 could not be found. Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fd7199-23af-4871-ab08-c28d4542c583 could not be found. Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:11:47.015051 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fd7199-23af-4871-ab08-c28d4542c583 could not be found. Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Returning 404 to user: Instance 73fd7199-23af-4871-ab08-c28d4542c583 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-067cf584-654f-442f-b6a5-6d3be916b89a tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583" status: 404 len: 111 microversion: 2.1 time: 0.035820 Sep 18 02:11:47.019450 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3575/7173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:11:46 2022] GET /compute/v2.1/servers/73fd7199-23af-4871-ab08-c28d4542c583 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:11:47.025473 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b71dc4d6-0a9f-49c3-8fca-65b27f39624d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] Calling method '.version_select at 0x7f70065b5790>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:11:47.045813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b71dc4d6-0a9f-49c3-8fca-65b27f39624d tempest-TestEncryptedCinderVolumes-507784318 tempest-TestEncryptedCinderVolumes-507784318-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1249803471" status: 202 len: 0 microversion: 2.1 time: 0.024092 Sep 18 02:11:47.046395 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3599/7174] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 02:11:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1249803471 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:12:13.965649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-450f0cbc-fef8-4368-8b66-20e7fa7ae9d9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'create', calling method: .version_select at 0x7f70055d0790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1564666580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0T95svPEcok3lZBpw9G0R1GflMPsNq2byo/ARi5lcUM6bMnt0kbqmeO8vXzCI9TETMaaNn1OVZJe5ZCOgSNAFFGY+JuFAe0cL0VavdSgltGalGhyMq4Sy9v6EGokKqOA=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:13.971537 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=14 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:13.972198 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=34 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:13.983817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-450f0cbc-fef8-4368-8b66-20e7fa7ae9d9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:12:13.989217 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-450f0cbc-fef8-4368-8b66-20e7fa7ae9d9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for user 704f1bab0a694d3e9f16e51fa45ccae5 and project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:12:14.013603 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-450f0cbc-fef8-4368-8b66-20e7fa7ae9d9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052061 Sep 18 02:12:14.014206 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3576/7175] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:12:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:12:14.064976 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:14.065774 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:14.069974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-349394678", "imageRef": "b13a4961-bc3a-4b21-b241-080c716e1e75", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1564666580", "networks": [{"uuid": "3e0d7645-1465-49e9-904d-f4d314a464b8"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:14.123229 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] validate_networks() for [('3e0d7645-1465-49e9-904d-f4d314a464b8', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:12:14.601056 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:12:14.601482 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:12:14.601986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:12:14.602398 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:12:14.602809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:12:14.611578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:14.612058 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:14.612494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:14.613216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:14.613739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:14.614168 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:14.632707 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:12:14.638484 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for user 704f1bab0a694d3e9f16e51fa45ccae5 and project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:12:14.651454 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:12:14.653996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b13a4961-bc3a-4b21-b241-080c716e1e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:12:14.699860 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-08c0992c-c2ac-44e6-880b-f4ac63b0131c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637619 Sep 18 02:12:14.700507 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3600/7176] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:12:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:12:14.712198 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eff6683-de5f-4680-8c6a-3147e82c949a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:14.712831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3eff6683-de5f-4680-8c6a-3147e82c949a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:14.770395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3eff6683-de5f-4680-8c6a-3147e82c949a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:14.778492 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3eff6683-de5f-4680-8c6a-3147e82c949a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1258 microversion: 2.1 time: 0.070360 Sep 18 02:12:14.779420 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3577/7177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:14 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:15.802216 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:15.802830 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:15.809705 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:15.810205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:15.810636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:15.811346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:15.811799 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:15.812229 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:15.889005 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:15.899184 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-830dd295-e94a-4a87-8979-274ae9fdd35b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1318 microversion: 2.1 time: 0.101747 Sep 18 02:12:15.899779 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3601/7178] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:15 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:16.924684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:16.925251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:16.935113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:16.936153 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:16.936793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:16.937951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:16.938458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:16.939100 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:17.092855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:17.108467 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0c05c1e8-5704-42c8-9810-b80569bb2609 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.188797 Sep 18 02:12:17.109171 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3578/7179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:16 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:18.133266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:18.133856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:18.141109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:18.141662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:18.142103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:18.142810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:18.143265 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:18.143689 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:18.705470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:18.717258 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a6247d8-7f4b-4538-bf64-afdb19ae495a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.587888 Sep 18 02:12:18.729831 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3602/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:18 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:12:19.742133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:19.743617 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:19.751597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:19.752319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:19.752936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:19.754029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:19.754655 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:19.755247 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:19.909857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:19.918719 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3025eb3-2c8d-4570-914c-ff6f680b8984 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.180869 Sep 18 02:12:19.919540 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3579/7181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:19 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:20.945845 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:20.947379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:20.955805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:20.956631 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:20.957306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:20.958149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:20.958670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:20.959161 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:21.109107 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:21.118613 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e193150f-19eb-485e-9bae-7634c284f79c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.177127 Sep 18 02:12:21.119773 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3603/7182] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:20 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:22.145052 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:22.146362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:22.160328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:22.160853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:22.161314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:22.162098 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:22.162565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:22.163003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:22.316628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:22.325819 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee2f5f0b-c846-4a2e-b38b-d140be55b681 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.184630 Sep 18 02:12:22.326634 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3580/7183] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:22 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:23.350824 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:23.351463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:23.358529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:23.359295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:23.359735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:23.360961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:23.361409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:23.361856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:23.506116 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:23.514003 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b4ec921e-1911-429c-ab2c-9b704ddc8e79 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.167126 Sep 18 02:12:23.514586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3604/7184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:23 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:24.538208 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:24.538987 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:24.546367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:24.546874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:24.547324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:24.548564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:24.549032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:24.549474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:24.683093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:24.692745 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bed796ce-f078-474b-b6f0-31b067bc3e27 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.158088 Sep 18 02:12:24.693355 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3581/7185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:24 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:24.713169 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-206c7623-f9e4-4722-bf6b-2640a9106108 req-ec037fc9-bd4c-4a19-8951-2aacb04fabf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14669dc2-4b13-4cdf-b7e5-1d7afde90064", "tag": "8be74b70-03e2-406a-bc03-84c71ec64eac"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:24.721176 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:24.722076 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:24.730514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-206c7623-f9e4-4722-bf6b-2640a9106108 req-ec037fc9-bd4c-4a19-8951-2aacb04fabf9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:24.731180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-206c7623-f9e4-4722-bf6b-2640a9106108 req-ec037fc9-bd4c-4a19-8951-2aacb04fabf9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:24.731763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-206c7623-f9e4-4722-bf6b-2640a9106108 req-ec037fc9-bd4c-4a19-8951-2aacb04fabf9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:24.745453 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-206c7623-f9e4-4722-bf6b-2640a9106108 req-ec037fc9-bd4c-4a19-8951-2aacb04fabf9 service nova] Creating event network-changed:8be74b70-03e2-406a-bc03-84c71ec64eac for instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 on n-h2-master-1 Sep 18 02:12:24.750611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-206c7623-f9e4-4722-bf6b-2640a9106108 req-ec037fc9-bd4c-4a19-8951-2aacb04fabf9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043565 Sep 18 02:12:24.751847 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3605/7186] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:12:25.720147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:25.720746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:25.722735 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:25.728810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:25.729382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:25.729908 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:25.730711 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:25.731214 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:25.731631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:25.881432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:25.890237 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-764ab7c3-2896-450b-8ead-fb2700678a5a tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.174377 Sep 18 02:12:25.890894 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3582/7187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:25 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:26.915471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:26.916185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:26.923306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:26.923820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:26.924260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:26.924989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:26.925475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:26.925934 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:27.056258 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:27.064584 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a32c412-bb3f-48d1-9b67-7bf1ba3b7f41 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.154265 Sep 18 02:12:27.065155 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3606/7188] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:26 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:28.087574 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:28.088214 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:28.096057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:28.096571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:28.097050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:28.097816 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:28.098291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:28.098729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:28.234147 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:28.242646 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7c1b6c46-fba6-4fd4-ba6b-88e4b09659c5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.159017 Sep 18 02:12:28.243228 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3583/7189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:28 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:29.265948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:29.266564 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:29.273374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:29.273881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:29.274319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:29.275010 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:29.275461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:29.275884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:29.415867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:29.424325 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e55199b-8928-43f1-869b-2d6320c0be14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.162359 Sep 18 02:12:29.424898 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3607/7190] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:29 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:29.878940 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e56e3c2c-5cc2-4b85-8182-8e50ceb0ade8 req-a87051ca-843c-4f22-a75b-992b2cecae5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14669dc2-4b13-4cdf-b7e5-1d7afde90064", "name": "network-vif-plugged", "status": "completed", "tag": "8be74b70-03e2-406a-bc03-84c71ec64eac"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:29.891494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e56e3c2c-5cc2-4b85-8182-8e50ceb0ade8 req-a87051ca-843c-4f22-a75b-992b2cecae5d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:29.891999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e56e3c2c-5cc2-4b85-8182-8e50ceb0ade8 req-a87051ca-843c-4f22-a75b-992b2cecae5d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:29.892467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e56e3c2c-5cc2-4b85-8182-8e50ceb0ade8 req-a87051ca-843c-4f22-a75b-992b2cecae5d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:29.904357 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e56e3c2c-5cc2-4b85-8182-8e50ceb0ade8 req-a87051ca-843c-4f22-a75b-992b2cecae5d service nova] Creating event network-vif-plugged:8be74b70-03e2-406a-bc03-84c71ec64eac for instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 on n-h2-master-1 Sep 18 02:12:29.909817 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e56e3c2c-5cc2-4b85-8182-8e50ceb0ade8 req-a87051ca-843c-4f22-a75b-992b2cecae5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035768 Sep 18 02:12:29.910543 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3584/7191] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:12:30.447756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:30.448348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:30.455393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:30.455875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:30.456306 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:30.457004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:30.457452 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:30.457903 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:30.591350 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:30.599963 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d62631de-b3fb-4a72-b68a-bef426fda084 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1358 microversion: 2.1 time: 0.155994 Sep 18 02:12:30.600575 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3608/7192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:30 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:31.624339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:31.625053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:31.631381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:31.631876 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:31.632325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:31.633032 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:31.633498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:31.633962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:31.770248 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:31.778363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-08af36de-f6c4-499d-a9c0-70333f038ff6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1549 microversion: 2.1 time: 0.159064 Sep 18 02:12:31.778965 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3585/7193] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:31 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:31.801763 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:31.802374 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:31.809327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:31.809853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:31.810287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:31.810977 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:31.811430 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:31.811852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:31.941135 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:31.948948 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-97a72522-154a-4fb8-befe-455fb4b0479c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1549 microversion: 2.1 time: 0.151715 Sep 18 02:12:31.949518 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3609/7194] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:31 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:31.971228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:31.975923 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:31.976696 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Searching by: {'deleted': False, 'project_id': '1a22214c5d194d0f9f0000443afd19c7'} {{(pid=122373) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 02:12:31.982297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:31.982788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:31.983232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:31.983966 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:31.984460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:31.985459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:32.010204 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.multi_cell_list [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 02:12:32.040676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fc54387a-928f-4c9f-9282-449cedda5cfe tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.074055 Sep 18 02:12:32.041254 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3586/7195] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 02:12:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:12:32.053471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:32.054105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:32.060078 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:32.060558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:32.060990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:32.061805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:32.062255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:32.062677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:32.190289 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:32.198067 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-377f31ca-3a5d-4a5b-875c-e76e5650e95b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1549 microversion: 2.1 time: 0.148439 Sep 18 02:12:32.198637 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3610/7196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:32 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:33.741733 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d1073ac-2167-447f-89d2-6cf88004e9b6"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:33.744035 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:33.751564 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:33.752075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:33.752510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:33.753215 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:33.753724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:33.754167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:34.020056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6d011131-9e34-4afa-8977-2cd6c3664cf2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282224 Sep 18 02:12:34.020721 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3587/7197] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 02:12:33 2022] POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:12:47.090522 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:47.091131 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:47.093318 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:47.093997 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=58 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:47.101479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:47.101988 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:47.102424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:47.103111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:47.103564 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:47.103983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:47.240629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:47.249274 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be246305-f341-4264-bbc2-af07a8d18e98 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1595 microversion: 2.1 time: 0.162929 Sep 18 02:12:47.249890 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3611/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:47 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:48.946747 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:48.948354 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:48.950725 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:12:49.123316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-188355a2-34d3-4381-beba-01379fa338d5 req-1e7ba814-e628-4152-8c59-3bfe6738a00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14669dc2-4b13-4cdf-b7e5-1d7afde90064", "tag": "8be74b70-03e2-406a-bc03-84c71ec64eac"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:49.146451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-188355a2-34d3-4381-beba-01379fa338d5 req-1e7ba814-e628-4152-8c59-3bfe6738a00f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:49.146958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-188355a2-34d3-4381-beba-01379fa338d5 req-1e7ba814-e628-4152-8c59-3bfe6738a00f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:49.147404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-188355a2-34d3-4381-beba-01379fa338d5 req-1e7ba814-e628-4152-8c59-3bfe6738a00f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:49.161664 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-188355a2-34d3-4381-beba-01379fa338d5 req-1e7ba814-e628-4152-8c59-3bfe6738a00f service nova] Creating event network-changed:8be74b70-03e2-406a-bc03-84c71ec64eac for instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 on n-h2-master-1 Sep 18 02:12:49.169075 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-188355a2-34d3-4381-beba-01379fa338d5 req-1e7ba814-e628-4152-8c59-3bfe6738a00f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228842 Sep 18 02:12:49.170863 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3588/7199] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:12:50.086176 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1456246403"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:50.086723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:50.094768 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:50.095278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:50.095717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:50.096422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:50.096900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:50.097325 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:50.238563 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Adding security group b5f67238-8b56-4a59-8284-e5a0bc2c8fcf to port 8be74b70-03e2-406a-bc03-84c71ec64eac Sep 18 02:12:50.561855 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e550f1c0-a282-469f-8ef4-9af9e0ceb639 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/action" status: 202 len: 0 microversion: 2.1 time: 0.479733 Sep 18 02:12:50.562709 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3612/7200] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:12:50 2022] POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:12:50.572609 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:12:50.573308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:12:50.579863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:50.580365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:50.580817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:50.581603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:50.582064 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:50.582518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:50.762570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:12:50.771776 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-710fbb04-5ba8-48a5-9423-e327bb1e0b16 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1761 microversion: 2.1 time: 0.204403 Sep 18 02:12:50.772359 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3589/7201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:12:50 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1761 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:12:51.187304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1a04cba7-9e48-410a-8ae6-100536e298fc req-aec10575-5e99-4f80-aff2-0a5fcc9957ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14669dc2-4b13-4cdf-b7e5-1d7afde90064", "tag": "8be74b70-03e2-406a-bc03-84c71ec64eac"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:12:51.197920 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a04cba7-9e48-410a-8ae6-100536e298fc req-aec10575-5e99-4f80-aff2-0a5fcc9957ac service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:12:51.198395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a04cba7-9e48-410a-8ae6-100536e298fc req-aec10575-5e99-4f80-aff2-0a5fcc9957ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:12:51.199037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1a04cba7-9e48-410a-8ae6-100536e298fc req-aec10575-5e99-4f80-aff2-0a5fcc9957ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:12:51.216047 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1a04cba7-9e48-410a-8ae6-100536e298fc req-aec10575-5e99-4f80-aff2-0a5fcc9957ac service nova] Creating event network-changed:8be74b70-03e2-406a-bc03-84c71ec64eac for instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 on n-h2-master-1 Sep 18 02:12:51.226338 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1a04cba7-9e48-410a-8ae6-100536e298fc req-aec10575-5e99-4f80-aff2-0a5fcc9957ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043933 Sep 18 02:12:51.227045 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3613/7202] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:14:29.122825 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:14:29.123588 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:14:29.124444 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:14:29.124605 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/action (ip 10.222.0.25) !!! Sep 18 02:14:29.129446 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:14:29.131787 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:14:29.140337 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:14:29.140835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:14:29.141285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:14:29.142029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:14:29.142503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:14:29.142945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:14:29.217207 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8578cc7e-e11e-4112-8d3f-4156faa4df95 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/action" status: 202 len: 0 microversion: 2.1 time: 0.096469 Sep 18 02:14:29.218247 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3590/7203] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:14:29 2022] POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:14:29.226105 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:14:29.226869 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:14:29.228322 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 02:14:29.228657 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 (ip 10.222.0.25) !!! Sep 18 02:14:29.234193 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:14:29.234836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:14:29.244484 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:14:29.244979 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:14:29.245421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:14:29.246712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:14:29.246712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:14:29.247075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:14:29.462079 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:14:29.470558 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4e05fb9d-a0b7-4ed6-83cf-eda409ee18f3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1763 microversion: 2.1 time: 0.247624 Sep 18 02:14:29.470963 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3614/7204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:14:29 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1763 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:14:30.494589 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:14:30.495304 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:14:30.502549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:14:30.503046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:14:30.503496 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:14:30.504204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:14:30.504672 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:14:30.505109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:14:30.701074 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:14:30.709368 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-26b2e552-fec2-49e3-b2af-835fd8b508d8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1761 microversion: 2.1 time: 0.219158 Sep 18 02:14:30.710049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3591/7205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:14:30 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1761 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:15:44.593203 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:15:44.593991 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:15:44.598227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1456246403"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:15:44.598761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:44.605984 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:44.606492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:44.606930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:44.607608 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:44.608059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:44.608479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:44.743804 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Removing security group b5f67238-8b56-4a59-8284-e5a0bc2c8fcf from port 8be74b70-03e2-406a-bc03-84c71ec64eac Sep 18 02:15:45.049150 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-537b5e60-5d60-460d-8580-ec86f35416f1 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/action" status: 202 len: 0 microversion: 2.1 time: 0.457705 Sep 18 02:15:45.050148 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3615/7206] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:15:44 2022] POST /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:15:45.060646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-7004c241-0670-4c40-b631-ada5dfe62394 req-d93c71e7-5a0e-4287-8773-6f99cc658375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14669dc2-4b13-4cdf-b7e5-1d7afde90064", "tag": "8be74b70-03e2-406a-bc03-84c71ec64eac"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:15:45.067166 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:15:45.068734 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:15:45.073936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7004c241-0670-4c40-b631-ada5dfe62394 req-d93c71e7-5a0e-4287-8773-6f99cc658375 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:45.074649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7004c241-0670-4c40-b631-ada5dfe62394 req-d93c71e7-5a0e-4287-8773-6f99cc658375 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:45.074927 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-7004c241-0670-4c40-b631-ada5dfe62394 req-d93c71e7-5a0e-4287-8773-6f99cc658375 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:45.091874 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-7004c241-0670-4c40-b631-ada5dfe62394 req-d93c71e7-5a0e-4287-8773-6f99cc658375 service nova] Creating event network-changed:8be74b70-03e2-406a-bc03-84c71ec64eac for instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 on n-h2-master-1 Sep 18 02:15:45.097374 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-7004c241-0670-4c40-b631-ada5dfe62394 req-d93c71e7-5a0e-4287-8773-6f99cc658375 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042344 Sep 18 02:15:45.098396 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3592/7207] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:15:46.283335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:46.283881 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:46.289857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:46.290530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:46.290810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:46.291482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:46.291969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:46.292395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:46.377966 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lazy-loading 'services' on Instance uuid 14669dc2-4b13-4cdf-b7e5-1d7afde90064 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:15:46.449511 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [26138284-084d-46ea-b427-82b5249009d4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 02:15:47.115042 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-0f06cbd7-511f-44d0-902b-d6656a06b9a0 req-47541376-afa8-40ce-86f0-9a088896dbad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14669dc2-4b13-4cdf-b7e5-1d7afde90064", "tag": "8be74b70-03e2-406a-bc03-84c71ec64eac"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:15:47.126087 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f06cbd7-511f-44d0-902b-d6656a06b9a0 req-47541376-afa8-40ce-86f0-9a088896dbad service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:47.126506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f06cbd7-511f-44d0-902b-d6656a06b9a0 req-47541376-afa8-40ce-86f0-9a088896dbad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:47.127285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-0f06cbd7-511f-44d0-902b-d6656a06b9a0 req-47541376-afa8-40ce-86f0-9a088896dbad service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:47.139949 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-0f06cbd7-511f-44d0-902b-d6656a06b9a0 req-47541376-afa8-40ce-86f0-9a088896dbad service nova] Creating event network-changed:8be74b70-03e2-406a-bc03-84c71ec64eac for instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 on n-h2-master-1 Sep 18 02:15:47.145157 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-0f06cbd7-511f-44d0-902b-d6656a06b9a0 req-47541376-afa8-40ce-86f0-9a088896dbad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035396 Sep 18 02:15:47.146667 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3593/7208] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:15:47.457286 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [26138284-084d-46ea-b427-82b5249009d4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39964. Sep 18 02:15:47.461389 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-acbfded9-4e17-48b5-af1a-af2dfd5cb722 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments/0d1073ac-2167-447f-89d2-6cf88004e9b6" status: 202 len: 0 microversion: 2.1 time: 1.183074 Sep 18 02:15:47.462063 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3616/7209] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:15:46 2022] DELETE /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments/0d1073ac-2167-447f-89d2-6cf88004e9b6 => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:15:47.471224 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:47.474578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:47.487859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:47.488375 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:47.488843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:47.489569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:47.490048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:47.490480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:47.522971 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2cff5293-91e0-42bb-9738-be51aff440c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056141 Sep 18 02:15:47.523557 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3594/7210] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:15:47 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:15:48.539218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:48.541673 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:48.548858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:48.549341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:48.549804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:48.550497 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:48.550975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:48.551406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:48.581268 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aee874c0-0972-4aa6-a617-a7cba5e4cf15 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047229 Sep 18 02:15:48.581862 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3617/7211] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:15:48 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:15:49.594357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:49.596599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:49.604339 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:49.604843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:49.605297 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:49.606066 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:49.606540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:49.606978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:49.639959 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf8ea509-bfcc-4fdb-870b-d82e894f98c2 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049626 Sep 18 02:15:49.640728 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3595/7212] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:15:49 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:15:50.652535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:50.654828 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:50.661776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:50.662159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:50.662591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:50.663273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:50.663756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:50.664177 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:50.694874 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9c355c3a-cb3f-4a79-8bf0-ee28ce3c5504 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Sep 18 02:15:50.695431 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3618/7213] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:15:50 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:15:51.707134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:51.709378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:51.717033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:51.717530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:51.718013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:51.718751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:51.719351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:51.719785 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:51.749749 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6659eb54-475d-4c48-8435-877dd954dcfb tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046720 Sep 18 02:15:51.750320 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3596/7214] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:15:51 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:15:52.761692 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:52.763924 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:52.771285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:52.771462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:52.772201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:52.773573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:52.774057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:52.774494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:52.804153 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3614326e-b10e-4361-b851-b8413af8d625 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046744 Sep 18 02:15:52.804720 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3619/7215] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:15:52 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 02:15:52.816099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:52.816679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:52.823556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:52.824062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:52.824516 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:52.825228 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:52.825751 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:52.826195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:52.903421 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] HTTP exception thrown: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 is not attached to volume 0d1073ac-2167-447f-89d2-6cf88004e9b6 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Request method failure captured: Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: request: DELETE /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments/0d1073ac-2167-447f-89d2-6cf88004e9b6 HTTP/1.1 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn5vtyY7nFhcfgsfWtFEXqES1GPQbRBlnolrbJ9iY_bQT3ezgIAJlMn0AyEbvOT_PE4P1_YEOvcCeHSly2rIG5RI4L037x3d6pwQlJ0T2KSMvXQIZXZRPlK-4baqK-D5EUHF5mInRbH9QvTSo-9cKT_rmjSSpUwyWfmOywTk6OvT01U Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 704f1bab0a694d3e9f16e51fa45ccae5 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 is not attached to volume 0d1073ac-2167-447f-89d2-6cf88004e9b6 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: action_args: {'server_id': '14669dc2-4b13-4cdf-b7e5-1d7afde90064', 'id': '0d1073ac-2167-447f-89d2-6cf88004e9b6'} Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0d1073ac-2167-447f-89d2-6cf88004e9b6. Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 is not attached to volume 0d1073ac-2167-447f-89d2-6cf88004e9b6 Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:15:52.905029 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:15:52.909977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:15:52.909977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:15:52.909977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 is not attached to volume 0d1073ac-2167-447f-89d2-6cf88004e9b6 Sep 18 02:15:52.909977 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:52.909977 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Returning 404 to user: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 is not attached to volume 0d1073ac-2167-447f-89d2-6cf88004e9b6 {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:15:52.909977 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4889ad61-6878-4d91-a257-de956ac03e65 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments/0d1073ac-2167-447f-89d2-6cf88004e9b6" status: 404 len: 154 microversion: 2.1 time: 0.094586 Sep 18 02:15:52.909977 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3597/7216] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:15:52 2022] DELETE /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064/os-volume_attachments/0d1073ac-2167-447f-89d2-6cf88004e9b6 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:15:56.159362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:56.160185 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:56.167333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:56.167818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:56.168252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:56.168953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:56.169406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:56.169863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:56.194914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:15:56.273984 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7ed2eebb-91ea-400c-b4f6-a5dc2db4d387 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 204 len: 0 microversion: 2.1 time: 0.118759 Sep 18 02:15:56.278607 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3620/7217] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:15:56 2022] DELETE /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:15:56.286330 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:56.286951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:56.294291 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:56.294803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:56.295254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:56.295994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:56.296666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:56.297114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:56.449295 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:15:56.459453 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c3e6a45-4e4b-4a0b-867a-93f7ad3f9321 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1555 microversion: 2.1 time: 0.178841 Sep 18 02:15:56.460051 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3598/7218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:15:56 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:15:57.489019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:57.489745 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:57.498048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:57.498525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:57.498957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:57.499663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:57.500109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:57.500522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:57.639421 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:15:57.647738 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-17bceaf1-be83-4f99-b48a-7ed9d3f1523e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1555 microversion: 2.1 time: 0.162957 Sep 18 02:15:57.648329 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3621/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:15:57 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:15:58.611570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-3df391c2-93f2-4e0a-8f32-3dbcdde1a5d5 req-007a0bd7-47d0-4e76-bb9e-dd76b5f49208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14669dc2-4b13-4cdf-b7e5-1d7afde90064", "name": "network-vif-deleted", "tag": "8be74b70-03e2-406a-bc03-84c71ec64eac"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:15:58.623668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3df391c2-93f2-4e0a-8f32-3dbcdde1a5d5 req-007a0bd7-47d0-4e76-bb9e-dd76b5f49208 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:58.624169 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3df391c2-93f2-4e0a-8f32-3dbcdde1a5d5 req-007a0bd7-47d0-4e76-bb9e-dd76b5f49208 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:58.624614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3df391c2-93f2-4e0a-8f32-3dbcdde1a5d5 req-007a0bd7-47d0-4e76-bb9e-dd76b5f49208 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:58.640518 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-3df391c2-93f2-4e0a-8f32-3dbcdde1a5d5 req-007a0bd7-47d0-4e76-bb9e-dd76b5f49208 service nova] Creating event network-vif-deleted:8be74b70-03e2-406a-bc03-84c71ec64eac for instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 on n-h2-master-1 Sep 18 02:15:58.648012 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-3df391c2-93f2-4e0a-8f32-3dbcdde1a5d5 req-007a0bd7-47d0-4e76-bb9e-dd76b5f49208 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098121 Sep 18 02:15:58.649096 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3599/7220] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:15:58.677251 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:58.677910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:58.686563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:58.687054 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:58.687495 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:58.688227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:58.688853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:58.689277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:58.726224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:58.726628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:58.727056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:58.727502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lazy-loading 'fault' on Instance uuid 14669dc2-4b13-4cdf-b7e5-1d7afde90064 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:15:58.777523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:15:58.787120 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-27a121fa-43c5-40bc-ae56-c818ff50bb2e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 200 len: 1348 microversion: 2.1 time: 0.114035 Sep 18 02:15:58.787715 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3622/7221] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:15:58 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:15:59.812810 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:59.813424 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: 14669dc2-4b13-4cdf-b7e5-1d7afde90064] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:15:59.819879 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:59.820367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:59.820811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:59.821509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:15:59.822073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:15:59.822507 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:15:59.835746 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] HTTP exception thrown: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 could not be found. Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Request method failure captured: Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 HTTP/1.1 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn5vtyY7nFhcfgsfWtFEXqES1GPQbRBlnolrbJ9iY_bQT3ezgIAJlMn0AyEbvOT_PE4P1_YEOvcCeHSly2rIG5RI4L037x3d6pwQlJ0T2KSMvXQIZXZRPlK-4baqK-D5EUHF5mInRbH9QvTSo-9cKT_rmjSSpUwyWfmOywTk6OvT01U Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: 704f1bab0a694d3e9f16e51fa45ccae5 Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 could not be found. Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '14669dc2-4b13-4cdf-b7e5-1d7afde90064'} Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 could not be found. Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 could not be found. Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:15:59.837690 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 could not be found. Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Returning 404 to user: Instance 14669dc2-4b13-4cdf-b7e5-1d7afde90064 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a9aa53cc-19ec-4b85-92c9-756021080126 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064" status: 404 len: 111 microversion: 2.1 time: 0.032763 Sep 18 02:15:59.842834 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3600/7222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:15:59 2022] GET /compute/v2.1/servers/14669dc2-4b13-4cdf-b7e5-1d7afde90064 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:15:59.848474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93ae0408-c22a-4111-9475-11c08b5e5fd8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '.version_select at 0x7f700507dee0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:15:59.873378 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93ae0408-c22a-4111-9475-11c08b5e5fd8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1564666580" status: 202 len: 0 microversion: 2.1 time: 0.028672 Sep 18 02:15:59.873994 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3623/7223] 10.222.0.25 () {58 vars in 1272 bytes} [Sun Sep 18 02:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1564666580 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:16:09.162476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-efde9a3b-b3bc-47b4-abc6-e6fd0992d7ec tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'create', calling method: .version_select at 0x7f7005416160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-65561904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5spUxdEocxYTGovIJ0EE9pJxwms1aHPcAL3LsgA0sRszUN5U9YkHOVisKc8sEkE6G81f1s5uMhafbRpsdkfLrxyRN84Bz8oO28j4BHiC0IduVKeNHO6pqtTicVRcH0Ug=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:09.170518 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:16:09.170672 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Sep 18 02:16:09.183816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-efde9a3b-b3bc-47b4-abc6-e6fd0992d7ec tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:16:09.188874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-efde9a3b-b3bc-47b4-abc6-e6fd0992d7ec tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for user 704f1bab0a694d3e9f16e51fa45ccae5 and project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:16:09.214636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-efde9a3b-b3bc-47b4-abc6-e6fd0992d7ec tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.056055 Sep 18 02:16:09.215240 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3601/7224] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:16:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:16:09.265945 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:09.266822 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:16:09.267001 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 18 02:16:09.271826 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-797561276", "imageRef": "912822ca-7e64-452d-baa8-5bfa90be94a6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-65561904", "networks": [{"uuid": "3e0d7645-1465-49e9-904d-f4d314a464b8"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:09.326835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] validate_networks() for [('3e0d7645-1465-49e9-904d-f4d314a464b8', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:16:09.711259 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:16:09.711681 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:16:09.712149 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:16:09.712554 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:16:09.712992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:16:09.722084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:09.722561 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:09.722993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:09.723801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:09.724158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:09.724577 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:09.742097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:16:09.747800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Getting quotas for user 704f1bab0a694d3e9f16e51fa45ccae5 and project 1a22214c5d194d0f9f0000443afd19c7. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:16:09.760638 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:16:09.762843 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='912822ca-7e64-452d-baa8-5bfa90be94a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:16:09.809858 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d3527f1b-4a7e-4ea5-8128-78b4fbf06f14 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545597 Sep 18 02:16:09.810765 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3624/7225] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:16:09.822874 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d82e2aad-33b5-42a6-8f1b-d9aa50551baf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:09.823475 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d82e2aad-33b5-42a6-8f1b-d9aa50551baf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:09.828342 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=38 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:09.879917 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d82e2aad-33b5-42a6-8f1b-d9aa50551baf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:09.888262 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d82e2aad-33b5-42a6-8f1b-d9aa50551baf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1256 microversion: 2.1 time: 0.069940 Sep 18 02:16:09.888837 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3602/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:09 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1256 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:10.911860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc52519c-ae62-4591-a7d2-f0b9931d3885 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:10.912470 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc52519c-ae62-4591-a7d2-f0b9931d3885 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:10.968983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc52519c-ae62-4591-a7d2-f0b9931d3885 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:10.977226 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc52519c-ae62-4591-a7d2-f0b9931d3885 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1256 microversion: 2.1 time: 0.069988 Sep 18 02:16:10.977863 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3625/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:10 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1256 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:11.999912 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b26fcceb-4cba-419c-9beb-19c716729157 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:12.000623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b26fcceb-4cba-419c-9beb-19c716729157 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:12.392818 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b26fcceb-4cba-419c-9beb-19c716729157 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:12.402752 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b26fcceb-4cba-419c-9beb-19c716729157 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1256 microversion: 2.1 time: 0.406967 Sep 18 02:16:12.403435 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3603/7228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:11 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1256 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:13.427276 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:13.427797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:13.434023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:13.434499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:13.434929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:13.435612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:13.436336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:13.436760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:13.502672 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:13.513194 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3e06e41-7641-46da-bdb8-be9814736e38 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1260 microversion: 2.1 time: 0.090673 Sep 18 02:16:13.513812 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3626/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:13 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1260 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:14.536072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:14.536897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:14.545220 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:14.545755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:14.546205 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:14.547013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:14.547483 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:14.547939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:14.615852 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:14.624455 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-15208e26-08a1-4456-9eb0-ad71192a80c6 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1308 microversion: 2.1 time: 0.092379 Sep 18 02:16:14.625617 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3604/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:14 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:15.660431 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:15.662098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:15.667131 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:15.697926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:15.698422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:15.698856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:15.699571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:15.700024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:15.700445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:16.029886 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:16.038491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c854ec2-520b-4474-b794-c2acf29fd75d tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.393724 Sep 18 02:16:16.039192 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3627/7231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:15 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:16:17.064354 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:17.065005 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:17.068214 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:17.073592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:17.074106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:17.074559 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:17.075282 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:17.075756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:17.076198 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:17.230218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:17.239319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-845814d1-5176-4c62-982d-19bb79d7ba75 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.178788 Sep 18 02:16:17.240250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3605/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:17 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:18.264033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:18.264723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:18.272044 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:18.272550 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:18.272992 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:18.273744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:18.274206 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:18.274636 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:18.437930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:18.447355 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9f1bec6c-f1a6-4bf5-bb47-6fb57c379768 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.187888 Sep 18 02:16:18.458854 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3628/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:18 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:19.476103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:19.476651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:19.484561 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:19.485157 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:19.485706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:19.486585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:19.487125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:19.487632 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:19.635242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:19.644156 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-936b3442-f073-4c89-a36b-870b3c300066 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.171946 Sep 18 02:16:19.644757 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3606/7234] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:19 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:20.670077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:20.670878 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:20.673418 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:20.681787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:20.682286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:20.685024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:20.685932 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:20.686403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:20.686835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:20.851687 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:20.862244 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16c821af-0f5d-4a69-8919-5cbecc19cb6c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.196535 Sep 18 02:16:20.862941 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3629/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:20 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:16:21.891343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:21.891994 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:21.901241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:21.901798 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:21.902324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:21.903137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:21.903625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:21.904149 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:22.066272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:22.075594 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ecbce056-7499-480e-a731-fb347b0a8158 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.188067 Sep 18 02:16:22.076538 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3607/7236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:21 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:23.099433 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:23.100197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:23.102166 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:23.109147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:23.109930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:23.110373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:23.111189 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:23.111797 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:23.112225 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:23.254054 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:23.263711 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-53bc9d8c-824c-444f-80e5-c240b08d1185 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.168929 Sep 18 02:16:23.264854 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3630/7237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:23 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:24.012356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-edc7816e-0c4d-4f66-bfcd-a2baa9919912 req-f8f49f63-8f34-47d1-bac6-67786e880ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00", "tag": "06eebec2-6f13-4e17-908b-101aed18f11b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:24.019139 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:24.029609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-edc7816e-0c4d-4f66-bfcd-a2baa9919912 req-f8f49f63-8f34-47d1-bac6-67786e880ea8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:24.030075 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-edc7816e-0c4d-4f66-bfcd-a2baa9919912 req-f8f49f63-8f34-47d1-bac6-67786e880ea8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:24.030600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-edc7816e-0c4d-4f66-bfcd-a2baa9919912 req-f8f49f63-8f34-47d1-bac6-67786e880ea8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:24.043198 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-edc7816e-0c4d-4f66-bfcd-a2baa9919912 req-f8f49f63-8f34-47d1-bac6-67786e880ea8 service nova] Creating event network-changed:06eebec2-6f13-4e17-908b-101aed18f11b for instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 on n-h2-master-1 Sep 18 02:16:24.049222 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-edc7816e-0c4d-4f66-bfcd-a2baa9919912 req-f8f49f63-8f34-47d1-bac6-67786e880ea8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044149 Sep 18 02:16:24.050258 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3608/7238] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:16:24.290905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:24.291586 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:24.298478 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:24.298965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:24.299405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:24.300098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:24.300552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:24.300978 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:24.435765 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:24.443458 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ee4ab0b5-5782-4b16-bdd6-39294bf6440c tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.156471 Sep 18 02:16:24.444031 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3631/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:24 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:25.467866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:25.468497 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:25.475815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:25.476326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:25.476779 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:25.477498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:25.478000 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:25.478436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:25.612618 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:25.621780 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a467f46d-0d47-4a6f-8e3a-234f54851a7b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.158408 Sep 18 02:16:25.622365 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3609/7240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:25 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:26.645786 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:26.646394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:26.653151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:26.653662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:26.654107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:26.654800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:26.655249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:26.655673 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:26.787514 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:26.795649 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dce416f2-ae68-4eea-973c-4c8df7b12a93 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.153799 Sep 18 02:16:26.796218 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3632/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:26 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:27.819337 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:27.827634 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:27.831063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:27.831560 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:27.832007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:27.832715 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:27.833181 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:27.833649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:27.965919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:27.973593 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57fdd26e-3047-4370-8687-221caa4a9306 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.158305 Sep 18 02:16:27.974190 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3610/7242] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:27 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:28.996427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:28.997067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:29.004108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:29.004420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:29.004946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:29.005676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:29.006129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:29.006548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:29.148644 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:29.156612 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-614336ee-376f-440f-b192-d3b66fdb0963 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.164267 Sep 18 02:16:29.157202 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3633/7243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:28 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:30.178790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:30.179349 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:30.186760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:30.187254 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:30.187700 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:30.188398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:30.188863 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:30.189294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:30.318951 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:30.326722 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a7ad712-b3c4-44cf-9a6e-2a371a77cccd tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.151913 Sep 18 02:16:30.327527 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3611/7244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:30 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:31.087362 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-4b82c20e-f6bf-437d-9f7a-93b1724e6e6a req-cd5d0ea2-a756-4ca0-9fa0-63d1f996b0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00", "name": "network-vif-plugged", "status": "completed", "tag": "06eebec2-6f13-4e17-908b-101aed18f11b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:31.097202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b82c20e-f6bf-437d-9f7a-93b1724e6e6a req-cd5d0ea2-a756-4ca0-9fa0-63d1f996b0b2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:31.097723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b82c20e-f6bf-437d-9f7a-93b1724e6e6a req-cd5d0ea2-a756-4ca0-9fa0-63d1f996b0b2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:31.098166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-4b82c20e-f6bf-437d-9f7a-93b1724e6e6a req-cd5d0ea2-a756-4ca0-9fa0-63d1f996b0b2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:31.109298 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-4b82c20e-f6bf-437d-9f7a-93b1724e6e6a req-cd5d0ea2-a756-4ca0-9fa0-63d1f996b0b2 service nova] Creating event network-vif-plugged:06eebec2-6f13-4e17-908b-101aed18f11b for instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 on n-h2-master-1 Sep 18 02:16:31.114489 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-4b82c20e-f6bf-437d-9f7a-93b1724e6e6a req-cd5d0ea2-a756-4ca0-9fa0-63d1f996b0b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093793 Sep 18 02:16:31.115043 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3634/7245] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:16:31.350679 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:31.351315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:31.359119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:31.359628 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:31.360077 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:31.360810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:31.361275 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:31.361755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:31.501032 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:31.508757 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-31e7035a-609c-4b5d-811a-19d3e387c17e tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1356 microversion: 2.1 time: 0.162351 Sep 18 02:16:31.509329 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3612/7246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:31 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:32.533179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:32.533897 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:32.540075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.540552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.541526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:32.542252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.542700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.543117 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:32.674436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:32.683107 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c3d06423-b04c-4795-81ef-60ce8500fcef tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1546 microversion: 2.1 time: 0.154677 Sep 18 02:16:32.683781 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3635/7247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:32 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:32.705651 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:32.706278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:32.713266 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.713870 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.714325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:32.715038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.715512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.716190 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:32.846382 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:32.854587 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-01c08a43-ad44-42bc-a9c7-ca12f3ff6e30 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1546 microversion: 2.1 time: 0.152954 Sep 18 02:16:32.855157 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3613/7248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:32 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:32.876653 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:32.881565 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:32.882331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Searching by: {'deleted': False, 'project_id': '1a22214c5d194d0f9f0000443afd19c7'} {{(pid=122374) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 02:16:32.888084 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.888558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.888990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:32.889759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.890212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.890637 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:32.914018 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.multi_cell_list [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 02:16:32.942153 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11b8c59c-5777-4824-a81f-6efa31221f0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069391 Sep 18 02:16:32.942750 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3636/7249] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 18 02:16:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:16:32.954432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:32.955061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:32.960974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.961469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.961973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:32.963183 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:32.963657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:32.964094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:33.101657 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:33.110045 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57f872a3-176f-46b8-9fdd-13ada1ea6426 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1546 microversion: 2.1 time: 0.159454 Sep 18 02:16:33.110618 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3614/7250] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:32 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:34.627204 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56ce7adc-affc-4131-801b-4a3b83634d14"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:34.629571 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:34.637092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:34.637575 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:34.638018 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:34.638703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:34.639152 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:34.639595 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:34.909405 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-216f614c-11e9-4a95-a693-14cab7569d87 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285974 Sep 18 02:16:34.910218 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3637/7251] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 18 02:16:34 2022] POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:16:45.698571 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:45.699203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:45.701952 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=19 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:45.702647 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=62 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:45.708246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:45.708743 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:45.709195 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:45.709931 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:45.710405 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:45.710840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:45.842143 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:45.850799 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d8c32b20-9c30-4a89-9d7d-292a0758bace tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1592 microversion: 2.1 time: 0.156771 Sep 18 02:16:45.851372 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3615/7252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:45 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:47.474581 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:47.475407 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=21 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:47.476401 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:16:47.481696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3adf822e-2b2e-4889-b31c-2ca4c4ffb140 req-6b92ba3b-76bf-496d-9e5e-52449c8c8b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00", "tag": "06eebec2-6f13-4e17-908b-101aed18f11b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:47.494982 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3adf822e-2b2e-4889-b31c-2ca4c4ffb140 req-6b92ba3b-76bf-496d-9e5e-52449c8c8b50 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:47.495549 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3adf822e-2b2e-4889-b31c-2ca4c4ffb140 req-6b92ba3b-76bf-496d-9e5e-52449c8c8b50 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:47.496097 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3adf822e-2b2e-4889-b31c-2ca4c4ffb140 req-6b92ba3b-76bf-496d-9e5e-52449c8c8b50 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:47.511568 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3adf822e-2b2e-4889-b31c-2ca4c4ffb140 req-6b92ba3b-76bf-496d-9e5e-52449c8c8b50 service nova] Creating event network-changed:06eebec2-6f13-4e17-908b-101aed18f11b for instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 on n-h2-master-1 Sep 18 02:16:47.517915 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3adf822e-2b2e-4889-b31c-2ca4c4ffb140 req-6b92ba3b-76bf-496d-9e5e-52449c8c8b50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044915 Sep 18 02:16:47.519785 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3638/7253] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:16:48.761287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-358746389"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:48.762441 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:48.769615 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:48.770113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:48.770558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:48.771260 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:48.771724 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:48.772152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:48.901955 n-d-master-1 devstack@n-api.service[122373]: INFO nova.network.security_group_api [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Adding security group 40fb2fe5-6c99-41f0-9a22-a52897d54731 to port 06eebec2-6f13-4e17-908b-101aed18f11b Sep 18 02:16:49.220736 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a93ef67d-d4aa-4669-9078-09153b3252b5 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/action" status: 202 len: 0 microversion: 2.1 time: 0.464545 Sep 18 02:16:49.221475 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3616/7254] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:16:48 2022] POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 02:16:49.231901 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:16:49.232603 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:16:49.240434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:49.240849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:49.242000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:49.242000 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:49.242735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:49.243192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:49.420375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:16:49.430196 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f553e52-9104-485a-9960-0a7a0aff02c4 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1757 microversion: 2.1 time: 0.203862 Sep 18 02:16:49.430795 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3639/7255] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:16:49 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:16:49.532562 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-845c868c-c58c-48ef-ab89-85c61fff3a48 req-1d805f7f-0a89-4550-957e-9e14c51caaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00", "tag": "06eebec2-6f13-4e17-908b-101aed18f11b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:16:49.542771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-845c868c-c58c-48ef-ab89-85c61fff3a48 req-1d805f7f-0a89-4550-957e-9e14c51caaa4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:16:49.543259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-845c868c-c58c-48ef-ab89-85c61fff3a48 req-1d805f7f-0a89-4550-957e-9e14c51caaa4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:16:49.543705 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-845c868c-c58c-48ef-ab89-85c61fff3a48 req-1d805f7f-0a89-4550-957e-9e14c51caaa4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:16:49.555615 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-845c868c-c58c-48ef-ab89-85c61fff3a48 req-1d805f7f-0a89-4550-957e-9e14c51caaa4 service nova] Creating event network-changed:06eebec2-6f13-4e17-908b-101aed18f11b for instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 on n-h2-master-1 Sep 18 02:16:49.561418 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-845c868c-c58c-48ef-ab89-85c61fff3a48 req-1d805f7f-0a89-4550-957e-9e14c51caaa4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033720 Sep 18 02:16:49.562075 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3617/7256] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:17:06.427303 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:06.428051 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=8 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:06.476783 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:17:06.479625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:06.486552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:06.487042 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:06.487479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:06.488182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:06.488633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:06.489055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:06.562833 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b430f361-27fa-4230-b3c7-29810be50962 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/action" status: 202 len: 0 microversion: 2.1 time: 0.140711 Sep 18 02:17:06.563489 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3640/7257] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:17:06 2022] POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:17:06.570224 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:06.570998 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:06.575564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:06.576293 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:06.583653 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:06.584237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:06.584694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:06.585422 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:06.585926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:06.586367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:06.754744 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:06.764880 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c27ae54-4341-4bcb-99b1-88c9848045bc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1749 microversion: 2.1 time: 0.196665 Sep 18 02:17:06.765479 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3618/7258] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:06 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:07.790120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:07.790822 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:07.796983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:07.797463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:07.797931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:07.798619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:07.799075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:07.800109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:07.947841 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:07.957046 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5189e925-56d4-4026-af0b-9b7cfcd26a77 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.171908 Sep 18 02:17:07.957677 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3641/7259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:07 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:17:08.982203 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:08.982873 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:08.989991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:08.990488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:08.990933 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:08.991635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:08.992104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:08.992536 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:09.138654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:09.147146 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c6d58e69-72fd-4fa9-9495-ad1abdd99665 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.169593 Sep 18 02:17:09.147732 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3619/7260] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:08 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:10.171368 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:10.171914 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:10.179037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:10.179569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:10.180005 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:10.180699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:10.181153 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:10.181606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:10.323628 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:10.331877 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-997d3549-1bec-4ff9-b5fd-10673e9ff9c9 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.164599 Sep 18 02:17:10.332457 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3642/7261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:10 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:11.358650 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:11.359287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:11.365936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:11.366429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:11.366878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:11.367596 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:11.368065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:11.368502 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:11.519506 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:11.528106 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-94e861a6-3392-4af8-b46e-23fd692a8a34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.173519 Sep 18 02:17:11.528691 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3620/7262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:11 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:12.553605 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:12.554335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:12.561489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:12.562014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:12.562453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:12.563159 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:12.563612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:12.564032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:12.714133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:12.722384 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37f010ad-3bfc-4e33-a235-4b3a40080385 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.173947 Sep 18 02:17:12.722968 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3643/7263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:12 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:13.747460 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:13.748018 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:13.754831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:13.755328 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:13.755784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:13.756485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:13.756955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:13.757393 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:13.903623 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:13.911884 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fece2e72-962d-48fa-a087-116c04f22d4f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.168569 Sep 18 02:17:13.912454 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3621/7264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:13 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:14.934902 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:14.935506 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:14.942237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:14.942715 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:14.943149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:14.943828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:14.944277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:14.944697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:15.088319 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:15.096604 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4b7b9c7e-0192-4bea-974d-50016b052830 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.165591 Sep 18 02:17:15.097174 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3644/7265] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:14 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:16.120370 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:16.120998 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:16.127814 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:16.128313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:16.128764 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:16.129486 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:16.129973 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:16.130411 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:16.277622 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:16.285939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4c7c0ba1-fee5-41fe-84fe-cbcbb61682c8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.169576 Sep 18 02:17:16.286513 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3622/7266] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:16 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:17.309463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:17.310040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:17.317337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:17.317840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:17.318279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:17.318973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:17.319417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:17.319843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:17.464776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:17.472991 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5e1ab9b9-6553-4617-b6bd-b0a014dfeb60 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1754 microversion: 2.1 time: 0.167991 Sep 18 02:17:17.473586 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3645/7267] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:17 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:18.497537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:18.498212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:18.505256 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:18.505807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:18.506267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:18.507553 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:18.508038 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:18.508490 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:18.654516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:18.662995 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64da97d4-2ae5-496f-95fb-25cb2095fe9b tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1757 microversion: 2.1 time: 0.170013 Sep 18 02:17:18.663578 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3623/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:18 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:47.604719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-358746389"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:17:47.605352 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:47.607460 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:47.608125 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:47.614838 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:47.615337 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:47.615781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:47.616487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:47.616947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:47.617376 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:47.750433 n-d-master-1 devstack@n-api.service[122374]: INFO nova.network.security_group_api [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Removing security group 40fb2fe5-6c99-41f0-9a22-a52897d54731 from port 06eebec2-6f13-4e17-908b-101aed18f11b Sep 18 02:17:48.061242 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b5ac08a-2c67-4ddd-b4f6-253573c58b0f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/action" status: 202 len: 0 microversion: 2.1 time: 0.461250 Sep 18 02:17:48.061902 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3646/7269] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:17:47 2022] POST /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:17:48.072202 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=12 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:48.072833 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=36 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:17:48.137249 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-402706a5-4e8f-4072-8418-f12058ba01b6 req-76c4a8b5-24c4-48e0-a29e-63f320bb57b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00", "tag": "06eebec2-6f13-4e17-908b-101aed18f11b"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:17:48.147731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-402706a5-4e8f-4072-8418-f12058ba01b6 req-76c4a8b5-24c4-48e0-a29e-63f320bb57b9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:48.148238 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-402706a5-4e8f-4072-8418-f12058ba01b6 req-76c4a8b5-24c4-48e0-a29e-63f320bb57b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:48.149399 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-402706a5-4e8f-4072-8418-f12058ba01b6 req-76c4a8b5-24c4-48e0-a29e-63f320bb57b9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:48.171274 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-402706a5-4e8f-4072-8418-f12058ba01b6 req-76c4a8b5-24c4-48e0-a29e-63f320bb57b9 service nova] Creating event network-changed:06eebec2-6f13-4e17-908b-101aed18f11b for instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 on n-h2-master-1 Sep 18 02:17:48.178724 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-402706a5-4e8f-4072-8418-f12058ba01b6 req-76c4a8b5-24c4-48e0-a29e-63f320bb57b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112402 Sep 18 02:17:48.179970 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3624/7270] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:17:49.569758 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:49.570285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:49.578783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:49.579266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:49.579951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:49.580407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:49.580937 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:49.581331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:49.666618 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lazy-loading 'services' on Instance uuid ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:17:49.741335 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88db532d-d723-415f-ba4d-6e36abb165df tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments/56ce7adc-affc-4131-801b-4a3b83634d14" status: 202 len: 0 microversion: 2.1 time: 0.177270 Sep 18 02:17:49.745476 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3647/7271] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:17:49 2022] DELETE /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments/56ce7adc-affc-4131-801b-4a3b83634d14 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:17:49.749478 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:17:49.750046 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments (ip 10.222.0.25) !!! Sep 18 02:17:49.755356 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:49.757718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:49.770476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:49.770979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:49.771429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:49.772151 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:49.772619 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:49.773054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:49.806494 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-56ef0d29-bbde-4872-ad3c-269a5b313caf tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059261 Sep 18 02:17:49.807092 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3625/7272] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:17:49 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:17:50.196652 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-bd7cb2be-e3cf-4b68-abdb-ffbab1cbfd92 req-517199ca-9297-4ae7-9319-9b7ca47885b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00", "tag": "06eebec2-6f13-4e17-908b-101aed18f11b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:17:50.206334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bd7cb2be-e3cf-4b68-abdb-ffbab1cbfd92 req-517199ca-9297-4ae7-9319-9b7ca47885b1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:50.206747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bd7cb2be-e3cf-4b68-abdb-ffbab1cbfd92 req-517199ca-9297-4ae7-9319-9b7ca47885b1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:50.207181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-bd7cb2be-e3cf-4b68-abdb-ffbab1cbfd92 req-517199ca-9297-4ae7-9319-9b7ca47885b1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:50.218469 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-bd7cb2be-e3cf-4b68-abdb-ffbab1cbfd92 req-517199ca-9297-4ae7-9319-9b7ca47885b1 service nova] Creating event network-changed:06eebec2-6f13-4e17-908b-101aed18f11b for instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 on n-h2-master-1 Sep 18 02:17:50.223635 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-bd7cb2be-e3cf-4b68-abdb-ffbab1cbfd92 req-517199ca-9297-4ae7-9319-9b7ca47885b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 Sep 18 02:17:50.224403 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3648/7273] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:17:50.822338 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:50.826343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:50.844079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:50.846076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:50.846565 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:50.847392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:50.847938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:50.848389 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:50.887937 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae26ebf5-924f-4812-891b-28f2137b4815 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071893 Sep 18 02:17:50.888536 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3626/7274] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:17:50 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:17:51.902335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:51.904778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:51.911578 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:51.912076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:51.912519 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:51.913233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:51.913723 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:51.914155 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:51.946323 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42000ccd-97cd-4163-92bf-d356dc91d3ac tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049626 Sep 18 02:17:51.946933 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3649/7275] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:17:51 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:17:52.959113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:52.961974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:52.969111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:52.969641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:52.970091 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:52.970836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:52.971613 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:52.971748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:53.001585 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b60b1cdd-9292-4b32-803c-b5f6ec0f11d3 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Sep 18 02:17:53.002270 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3627/7276] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:17:52 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:17:54.015031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:54.017197 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:54.024739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:54.025221 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:54.025679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:54.026374 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:54.026818 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:54.027234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:54.059658 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-da3775a5-16d1-4653-a8f6-1fdc700bbbcc tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048588 Sep 18 02:17:54.060228 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3650/7277] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:17:54 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:17:55.071328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:55.073496 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:55.080124 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:55.080616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:55.081063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:55.081797 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:55.082262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:55.082694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:55.111096 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d765c0c3-f402-4a34-b8a6-c2edf8e0ec72 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043797 Sep 18 02:17:55.111646 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3628/7278] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 18 02:17:55 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 02:17:55.122849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:55.123371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:55.130090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:55.130502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:55.130930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:55.131605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:55.132057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:55.132477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:55.207697 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] HTTP exception thrown: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 is not attached to volume 56ce7adc-affc-4131-801b-4a3b83634d14 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Request method failure captured: Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: request: DELETE /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments/56ce7adc-affc-4131-801b-4a3b83634d14 HTTP/1.1 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn5vtyY7nFhcfgsfWtFEXqES1GPQbRBlnolrbJ9iY_bQT3ezgIAJlMn0AyEbvOT_PE4P1_YEOvcCeHSly2rIG5RI4L037x3d6pwQlJ0T2KSMvXQIZXZRPlK-4baqK-D5EUHF5mInRbH9QvTSo-9cKT_rmjSSpUwyWfmOywTk6OvT01U Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 704f1bab0a694d3e9f16e51fa45ccae5 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 is not attached to volume 56ce7adc-affc-4131-801b-4a3b83634d14 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: action_args: {'server_id': 'ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00', 'id': '56ce7adc-affc-4131-801b-4a3b83634d14'} Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 56ce7adc-affc-4131-801b-4a3b83634d14. Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 is not attached to volume 56ce7adc-affc-4131-801b-4a3b83634d14 Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:17:55.209347 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:17:55.214399 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:17:55.214399 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:17:55.214399 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 is not attached to volume 56ce7adc-affc-4131-801b-4a3b83634d14 Sep 18 02:17:55.214399 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:17:55.214399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Returning 404 to user: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 is not attached to volume 56ce7adc-affc-4131-801b-4a3b83634d14 {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:17:55.214399 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fe55c456-65b7-4744-b49e-ce766e62867f tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments/56ce7adc-affc-4131-801b-4a3b83634d14" status: 404 len: 154 microversion: 2.1 time: 0.092649 Sep 18 02:17:55.214399 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3651/7279] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 18 02:17:55 2022] DELETE /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00/os-volume_attachments/56ce7adc-affc-4131-801b-4a3b83634d14 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:17:58.460883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:58.461409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:58.469597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:58.470106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:58.470550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:58.471288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:58.471755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:58.472191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:58.499305 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:17:58.573958 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-aabe7237-beb4-4f6c-a851-4647639056e8 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 204 len: 0 microversion: 2.1 time: 0.116598 Sep 18 02:17:58.574584 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3629/7280] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:17:58 2022] DELETE /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:17:58.588019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:58.588019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:58.593258 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:58.593783 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:58.594216 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:58.594926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:58.595375 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:58.595800 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:58.756589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:58.772708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7a3dd2df-e87e-4533-a7ac-67c979369f70 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1552 microversion: 2.1 time: 0.192554 Sep 18 02:17:58.773462 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3652/7281] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:58 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:17:59.797985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:17:59.798711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:17:59.806663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:59.807188 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:59.807649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:59.808374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:17:59.808847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:17:59.809285 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:17:59.945625 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:17:59.954286 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8b7a13b0-09fe-42fe-aa65-214558d4e057 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1552 microversion: 2.1 time: 0.160640 Sep 18 02:17:59.954879 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3630/7282] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:17:59 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:00.937488 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ef27a551-af2c-4249-9b06-c19aadf00bd8 req-e952b2fd-7f8c-446e-96a4-0f39a0b26b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00", "name": "network-vif-deleted", "tag": "06eebec2-6f13-4e17-908b-101aed18f11b"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:18:00.949023 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ef27a551-af2c-4249-9b06-c19aadf00bd8 req-e952b2fd-7f8c-446e-96a4-0f39a0b26b05 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:00.949502 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ef27a551-af2c-4249-9b06-c19aadf00bd8 req-e952b2fd-7f8c-446e-96a4-0f39a0b26b05 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:00.949964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ef27a551-af2c-4249-9b06-c19aadf00bd8 req-e952b2fd-7f8c-446e-96a4-0f39a0b26b05 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:00.963960 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ef27a551-af2c-4249-9b06-c19aadf00bd8 req-e952b2fd-7f8c-446e-96a4-0f39a0b26b05 service nova] Creating event network-vif-deleted:06eebec2-6f13-4e17-908b-101aed18f11b for instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 on n-h2-master-1 Sep 18 02:18:00.971008 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ef27a551-af2c-4249-9b06-c19aadf00bd8 req-e952b2fd-7f8c-446e-96a4-0f39a0b26b05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038161 Sep 18 02:18:00.971620 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3653/7283] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:18:00.978704 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:00.979346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:00.989454 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:00.990244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:00.990701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:00.992538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:00.992538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:00.992538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:01.063802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704f1bab0a694d3e9f16e51fa45ccae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22214c5d194d0f9f0000443afd19c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:01.075034 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c52d5b01-40b6-4de3-ad33-f7a458b56f29 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 200 len: 1341 microversion: 2.1 time: 0.100190 Sep 18 02:18:01.075991 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3631/7284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:00 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 1341 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:02.099774 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:02.100474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] [instance: ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:02.107804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:02.108285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:02.108714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:02.109401 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:02.109874 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:02.110295 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:02.123744 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] HTTP exception thrown: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 could not be found. Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Request method failure captured: Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 HTTP/1.1 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn5vtyY7nFhcfgsfWtFEXqES1GPQbRBlnolrbJ9iY_bQT3ezgIAJlMn0AyEbvOT_PE4P1_YEOvcCeHSly2rIG5RI4L037x3d6pwQlJ0T2KSMvXQIZXZRPlK-4baqK-D5EUHF5mInRbH9QvTSo-9cKT_rmjSSpUwyWfmOywTk6OvT01U Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a22214c5d194d0f9f0000443afd19c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: 1a22214c5d194d0f9f0000443afd19c7 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1442426599 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 704f1bab0a694d3e9f16e51fa45ccae5 Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestMinimumBasicScenario-1442426599-project Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: exception: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 could not be found. Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00'} Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 could not be found. Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 could not be found. Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:18:02.125405 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 could not be found. Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Returning 404 to user: Instance ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fada553f-b4dd-4089-9485-9caa1e3d9f34 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00" status: 404 len: 111 microversion: 2.1 time: 0.032035 Sep 18 02:18:02.133042 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3654/7285] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:02 2022] GET /compute/v2.1/servers/ffbb4dc2-c34f-4e7a-a1db-4bcfd41abf00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:18:02.136103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-817c86b0-9c08-4a92-b53a-8eed1eba9a45 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] Calling method '.version_select at 0x7f70050b2b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:02.156615 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-817c86b0-9c08-4a92-b53a-8eed1eba9a45 tempest-TestMinimumBasicScenario-1442426599 tempest-TestMinimumBasicScenario-1442426599-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-65561904" status: 202 len: 0 microversion: 2.1 time: 0.024650 Sep 18 02:18:02.157195 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3632/7286] 10.222.0.25 () {58 vars in 1266 bytes} [Sun Sep 18 02:18:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-65561904 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:18:11.638736 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11d77289-694a-4390-b82d-6d635e8c62f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: .version_select at 0x7f700507d940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-603117796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGAbUlubpktMaz2h8RDO6Rr7KoGH7dlUdpA3lQj974d2g6w3TTe4Z66SaRgT8P5xJhRNgfLl0BUGG4SKubAe+0hdqhWmQ9GiDPWnNIsDgd9IBpI7qeVLpCddoHuItcVcQ=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:18:11.655070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-11d77289-694a-4390-b82d-6d635e8c62f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:18:11.660386 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-11d77289-694a-4390-b82d-6d635e8c62f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:18:11.685572 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11d77289-694a-4390-b82d-6d635e8c62f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.220744 Sep 18 02:18:11.686183 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3655/7287] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:18:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:18:17.546242 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-455748526", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "4a1a44be-bb70-4023-87e7-757f68f45bb1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-603117796", "security_groups": [{"name": "tempest-secgroup-smoke-363400575"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:18:17.557834 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:17.559042 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:17.678002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] validate_networks() for [('4a1a44be-bb70-4023-87e7-757f68f45bb1', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:18:18.121845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:18:18.122288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:18:18.122781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:18:18.123218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:18:18.123646 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:18:18.134519 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:18.135771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:18.136302 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:18.137604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:18.138158 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:18.139189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:18.159351 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:18:18.165864 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:18:18.181273 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:18:18.183522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:18:18.239467 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d061bd6e-60e5-4077-990b-1b6ddaed3227 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697039 Sep 18 02:18:18.240340 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3633/7288] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:18:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:18:18.248848 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:18.253855 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c881baf5-ff7c-45c3-ad11-5832e5aca3fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:18.254471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c881baf5-ff7c-45c3-ad11-5832e5aca3fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:18.256521 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:18.316985 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c881baf5-ff7c-45c3-ad11-5832e5aca3fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:18.327897 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c881baf5-ff7c-45c3-ad11-5832e5aca3fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1265 microversion: 2.1 time: 0.079810 Sep 18 02:18:18.328575 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3656/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:18 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:19.354871 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-48ca033b-2e6c-4303-9e66-3ced36603499 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:19.355960 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-48ca033b-2e6c-4303-9e66-3ced36603499 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:19.426703 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-48ca033b-2e6c-4303-9e66-3ced36603499 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:19.433906 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-48ca033b-2e6c-4303-9e66-3ced36603499 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1265 microversion: 2.1 time: 0.086773 Sep 18 02:18:19.434497 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3634/7290] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:19 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:18:20.456285 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:20.456894 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:20.464428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:20.464911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:20.465349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:20.466079 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:20.466535 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:20.466959 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:20.532549 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:20.541070 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e5dd3690-e797-462c-9da7-ec7e6da4d5be tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1269 microversion: 2.1 time: 0.088695 Sep 18 02:18:20.541672 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3657/7291] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:20 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:21.565706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:21.566364 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:21.574119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:21.574755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:21.575199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:21.576102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:21.576600 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:21.577033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:21.649307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:21.657621 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-790e1931-9cf9-44e5-9c7f-1570fb51f3cc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1325 microversion: 2.1 time: 0.096427 Sep 18 02:18:21.658482 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3635/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:21 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1325 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:22.682261 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:22.683512 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:22.690435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:22.690922 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:22.691362 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:22.692062 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:22.692523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:22.692951 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:22.833328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:22.842248 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8a1b1a0f-10b9-4021-8f5e-31312c7698ad tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1390 microversion: 2.1 time: 0.164031 Sep 18 02:18:22.842838 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3658/7293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:22 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:23.060250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-88080cc3-e47b-436f-ac1e-302b169113ce req-5cc30d7f-4d2f-4fde-9c50-b5daea0f5aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d411f534-0080-460c-97cd-76bac0769650", "tag": "2963abda-ee1b-4f8e-96e9-9e4deec6c240"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:18:23.071630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-88080cc3-e47b-436f-ac1e-302b169113ce req-5cc30d7f-4d2f-4fde-9c50-b5daea0f5aa8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:23.072125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-88080cc3-e47b-436f-ac1e-302b169113ce req-5cc30d7f-4d2f-4fde-9c50-b5daea0f5aa8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:23.072567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-88080cc3-e47b-436f-ac1e-302b169113ce req-5cc30d7f-4d2f-4fde-9c50-b5daea0f5aa8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:23.084109 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-88080cc3-e47b-436f-ac1e-302b169113ce req-5cc30d7f-4d2f-4fde-9c50-b5daea0f5aa8 service nova] Creating event network-changed:2963abda-ee1b-4f8e-96e9-9e4deec6c240 for instance d411f534-0080-460c-97cd-76bac0769650 on n-h1-master-1 Sep 18 02:18:23.096637 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-88080cc3-e47b-436f-ac1e-302b169113ce req-5cc30d7f-4d2f-4fde-9c50-b5daea0f5aa8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040091 Sep 18 02:18:23.097295 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3636/7294] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:18:23.866105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:23.866720 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:23.874243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:23.874243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:23.874682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:23.875387 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:23.875839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:23.876262 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:24.009323 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:24.017042 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-32e135ba-1333-4d24-a370-16e2806c0b2d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1390 microversion: 2.1 time: 0.154776 Sep 18 02:18:24.017647 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3659/7295] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:23 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:25.042567 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:25.043230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:25.049440 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:25.049967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:25.050415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:25.051120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:25.051590 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:25.052025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:25.186272 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:25.194369 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-bf3cb774-090f-4371-90af-114158bc8d63 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1390 microversion: 2.1 time: 0.157185 Sep 18 02:18:25.194965 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3637/7296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:25 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:18:26.218047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:26.218629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:26.225344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:26.225857 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:26.226292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:26.226970 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:26.227418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:26.227835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:26.365092 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:26.373284 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2ce79e9-5a95-49e3-ad16-06df74b63498 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1390 microversion: 2.1 time: 0.159222 Sep 18 02:18:26.373890 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3660/7297] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:26 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:27.274177 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-66420375-ec1b-495b-b3e6-edb0aec0f67f req-cdeaf09c-bf9d-4f34-ab4d-a78458883edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d411f534-0080-460c-97cd-76bac0769650", "name": "network-vif-plugged", "status": "completed", "tag": "2963abda-ee1b-4f8e-96e9-9e4deec6c240"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:18:27.285371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-66420375-ec1b-495b-b3e6-edb0aec0f67f req-cdeaf09c-bf9d-4f34-ab4d-a78458883edb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:27.285911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-66420375-ec1b-495b-b3e6-edb0aec0f67f req-cdeaf09c-bf9d-4f34-ab4d-a78458883edb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:27.286357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-66420375-ec1b-495b-b3e6-edb0aec0f67f req-cdeaf09c-bf9d-4f34-ab4d-a78458883edb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:27.298795 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-66420375-ec1b-495b-b3e6-edb0aec0f67f req-cdeaf09c-bf9d-4f34-ab4d-a78458883edb service nova] Creating event network-vif-plugged:2963abda-ee1b-4f8e-96e9-9e4deec6c240 for instance d411f534-0080-460c-97cd-76bac0769650 on n-h1-master-1 Sep 18 02:18:27.303853 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-66420375-ec1b-495b-b3e6-edb0aec0f67f req-cdeaf09c-bf9d-4f34-ab4d-a78458883edb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Sep 18 02:18:27.305536 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3638/7298] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:18:27.396574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:27.397187 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:27.404144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:27.404627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:27.405064 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:27.405786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:27.406272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:27.406695 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:27.546300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:27.555091 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e577bcc5-1c4c-48d3-ba73-33414f7a8bc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1390 microversion: 2.1 time: 0.161670 Sep 18 02:18:27.555602 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3661/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:27 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:18:28.576014 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:28.582685 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:28.583412 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:28.589976 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:28.591250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:28.593083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:28.594189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:28.594674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:28.595343 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:28.745967 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:28.753786 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ca5d2fd6-cbaa-4eac-ad10-d769b2f60563 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1562 microversion: 2.1 time: 0.179794 Sep 18 02:18:28.754376 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3639/7300] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:28 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:28.776504 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:28.777097 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:28.779007 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:28.784980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:28.785469 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:28.785931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:28.786630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:28.787086 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:28.787512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:28.921762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:28.929203 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-534f978e-b01f-4732-a8a3-39403d17dfa6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1562 microversion: 2.1 time: 0.156579 Sep 18 02:18:28.929805 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3662/7301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:28 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:30.825765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:18:30.826395 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:30.828304 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:30.830437 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-41b7b527-376b-4131-aa6b-206e1f59f268 req-2350d7fc-eaf7-42b3-b454-2c4f4648ef89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d411f534-0080-460c-97cd-76bac0769650", "tag": "2963abda-ee1b-4f8e-96e9-9e4deec6c240"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:18:30.839558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:30.840105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:30.840604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:30.841332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:30.841487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41b7b527-376b-4131-aa6b-206e1f59f268 req-2350d7fc-eaf7-42b3-b454-2c4f4648ef89 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:30.841834 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:30.842188 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41b7b527-376b-4131-aa6b-206e1f59f268 req-2350d7fc-eaf7-42b3-b454-2c4f4648ef89 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:30.842296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:30.842616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-41b7b527-376b-4131-aa6b-206e1f59f268 req-2350d7fc-eaf7-42b3-b454-2c4f4648ef89 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:30.855251 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-41b7b527-376b-4131-aa6b-206e1f59f268 req-2350d7fc-eaf7-42b3-b454-2c4f4648ef89 service nova] Creating event network-changed:2963abda-ee1b-4f8e-96e9-9e4deec6c240 for instance d411f534-0080-460c-97cd-76bac0769650 on n-h1-master-1 Sep 18 02:18:30.860586 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-41b7b527-376b-4131-aa6b-206e1f59f268 req-2350d7fc-eaf7-42b3-b454-2c4f4648ef89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042192 Sep 18 02:18:30.861506 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3663/7302] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:18:30.992343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:18:31.000274 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-36e25463-d7e9-4380-9a18-ea1ac405bdc0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1562 microversion: 2.1 time: 0.183267 Sep 18 02:18:31.001258 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3640/7303] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:18:30 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:18:54.259416 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=17 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:54.260197 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=38 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:18:54.264563 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:18:54.267112 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:18:54.274250 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:54.274735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:54.275174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:54.275864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:18:54.276321 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:18:54.276745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:18:54.343571 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8f014d8d-3f04-4c3a-bb78-d898d257bf6f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action" status: 200 len: 24570 microversion: 2.1 time: 0.086702 Sep 18 02:18:54.344215 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3664/7304] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:18:54 2022] POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action => generated 24570 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:19:00.730284 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:00.730905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:00.732879 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:00.733714 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=30 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:00.739642 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:00.740143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:00.740597 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:00.741306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:00.741807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:00.742250 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:00.808679 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9299eaec-2294-4a83-88d5-4d5e7df20257 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action" status: 202 len: 0 microversion: 2.1 time: 0.082479 Sep 18 02:19:00.809381 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3641/7305] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:19:00 2022] POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:19:00.818266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:00.818974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:00.827435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:00.827927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:00.828365 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:00.829066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:00.829522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:00.829987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:00.967157 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:00.974854 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f0221b10-f671-4897-9337-529bb92947eb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1686 microversion: 2.1 time: 0.160883 Sep 18 02:19:00.975412 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3665/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:00 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:02.000559 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:02.001270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:02.007586 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:02.008078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:02.008523 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:02.009487 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:02.009984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:02.010417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:02.148433 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:02.156754 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-acef716f-7c61-46da-8670-f988c78315bb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1666 microversion: 2.1 time: 0.161512 Sep 18 02:19:02.157324 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3642/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:01 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:03.255762 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:03.257868 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:03.265780 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:03.266259 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:03.266694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:03.267377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:03.267826 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:03.268248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:03.333887 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4dda1530-f5d9-46c1-b78d-c5b92cbb3ac7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action" status: 200 len: 32641 microversion: 2.1 time: 0.081841 Sep 18 02:19:03.334850 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3666/7308] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:19:03 2022] POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action => generated 32641 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:19:03.346156 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:03.346706 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:03.354624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:03.355122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:03.355572 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:03.356284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:03.356753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:03.357193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:03.426489 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2d6f35b8-c3a2-4a95-8a6d-5f3cb51a928b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action" status: 202 len: 0 microversion: 2.1 time: 0.083996 Sep 18 02:19:03.427347 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3643/7309] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:19:03 2022] POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:19:03.436768 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:03.437466 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:03.444615 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:03.445104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:03.445580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:03.446443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:03.446902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:03.447329 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:03.581942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:03.590765 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9654820c-5a39-4dba-a64f-20d5346f24fb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1673 microversion: 2.1 time: 0.158451 Sep 18 02:19:03.591344 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3667/7310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:03 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:04.617096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:04.617914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:04.624784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:04.625284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:04.625765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:04.626476 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:04.626951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:04.627392 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:04.765146 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:04.773014 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61ec1df3-471a-4694-ad3e-fcfe2f065277 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1681 microversion: 2.1 time: 0.161058 Sep 18 02:19:04.773597 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3644/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:04 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:04.871676 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:04.873898 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:04.882075 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:04.882572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:04.883012 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:04.883717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:04.884442 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:04.884894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:04.951310 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e095061f-99ba-485a-be98-e50ebdd2794e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action" status: 200 len: 35997 microversion: 2.1 time: 0.083470 Sep 18 02:19:04.952222 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3668/7312] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:19:04 2022] POST /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650/action => generated 35997 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:19:06.001691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:06.002253 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:06.009863 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-a1b8ac64-8a05-4da2-9bac-46a31b6c3ca4 req-887014b9-5d38-4e0d-8356-a1d3e03fe6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d411f534-0080-460c-97cd-76bac0769650", "tag": "2963abda-ee1b-4f8e-96e9-9e4deec6c240"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:06.012371 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:06.012955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:06.013866 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:06.015160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:06.015695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:06.016207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:06.024285 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a1b8ac64-8a05-4da2-9bac-46a31b6c3ca4 req-887014b9-5d38-4e0d-8356-a1d3e03fe6fb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:06.025085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a1b8ac64-8a05-4da2-9bac-46a31b6c3ca4 req-887014b9-5d38-4e0d-8356-a1d3e03fe6fb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:06.026029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-a1b8ac64-8a05-4da2-9bac-46a31b6c3ca4 req-887014b9-5d38-4e0d-8356-a1d3e03fe6fb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:06.038534 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-a1b8ac64-8a05-4da2-9bac-46a31b6c3ca4 req-887014b9-5d38-4e0d-8356-a1d3e03fe6fb service nova] Creating event network-changed:2963abda-ee1b-4f8e-96e9-9e4deec6c240 for instance d411f534-0080-460c-97cd-76bac0769650 on n-h1-master-1 Sep 18 02:19:06.045189 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-a1b8ac64-8a05-4da2-9bac-46a31b6c3ca4 req-887014b9-5d38-4e0d-8356-a1d3e03fe6fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042581 Sep 18 02:19:06.047103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3669/7313] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:19:06.052812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:19:06.153117 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-201cf481-bced-4e2d-b6f2-1cdc501424fc tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 204 len: 0 microversion: 2.1 time: 0.156791 Sep 18 02:19:06.155674 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3645/7314] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:19:05 2022] DELETE /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:19:06.166813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:06.167570 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:06.174703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:06.175482 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:06.176191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:06.176906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:06.177364 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:06.178073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:06.316425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:06.324327 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-742e536b-736e-4e5a-954f-e79c3774de53 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1568 microversion: 2.1 time: 0.164163 Sep 18 02:19:06.324906 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3670/7315] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:06 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:07.350663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:07.351378 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:07.359854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:07.360350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:07.360804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:07.361505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:07.361994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:07.362432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:07.502058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:07.510813 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c92ea076-ef6e-4375-9862-04d30b861f3a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1568 microversion: 2.1 time: 0.164661 Sep 18 02:19:07.511406 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3646/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:07 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:08.506655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-82877c57-e6aa-4883-ad42-e2df738fe592 req-d9ea8c9a-f6ab-450d-a19f-982d50bda886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d411f534-0080-460c-97cd-76bac0769650", "name": "network-vif-deleted", "tag": "2963abda-ee1b-4f8e-96e9-9e4deec6c240"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:08.517459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-82877c57-e6aa-4883-ad42-e2df738fe592 req-d9ea8c9a-f6ab-450d-a19f-982d50bda886 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:08.517981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-82877c57-e6aa-4883-ad42-e2df738fe592 req-d9ea8c9a-f6ab-450d-a19f-982d50bda886 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:08.518408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-82877c57-e6aa-4883-ad42-e2df738fe592 req-d9ea8c9a-f6ab-450d-a19f-982d50bda886 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:08.531246 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-82877c57-e6aa-4883-ad42-e2df738fe592 req-d9ea8c9a-f6ab-450d-a19f-982d50bda886 service nova] Creating event network-vif-deleted:2963abda-ee1b-4f8e-96e9-9e4deec6c240 for instance d411f534-0080-460c-97cd-76bac0769650 on n-h1-master-1 Sep 18 02:19:08.536667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:08.537213 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-82877c57-e6aa-4883-ad42-e2df738fe592 req-d9ea8c9a-f6ab-450d-a19f-982d50bda886 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Sep 18 02:19:08.537345 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:08.537943 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3671/7317] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:19:08.546246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:08.546754 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:08.547206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:08.547930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:08.548402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:08.548843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:08.613910 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:08.622130 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-87f76173-edab-4379-879b-875bb09ba80e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 200 len: 1350 microversion: 2.1 time: 0.090543 Sep 18 02:19:08.622712 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3647/7318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:08 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:19:09.646971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:09.647688 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: d411f534-0080-460c-97cd-76bac0769650] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:09.653891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:09.654406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:09.654804 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:09.655488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:09.655935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:09.656351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:09.670294 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] HTTP exception thrown: Instance d411f534-0080-460c-97cd-76bac0769650 could not be found. Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Request method failure captured: Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 HTTP/1.1 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn_ioP4JgVXfvFlCB-Kdu8mRDjmTzH2sU1xUbGwF_sSq7AAskhOBFuFvc46OYAYb2RZyoocrEzPfX_JtYwoHj3QcB7ZNnoxgNH9ZHrUhcZuKrSRH1GI8w34liVw78ifXBxEGcRKtbiKkhAFuhcbznGVL98cmAffSmlSJ4E6cy0ZO_tI Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: b29f937843f141eeb3edc89594fcddca Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: exception: Instance d411f534-0080-460c-97cd-76bac0769650 could not be found. Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'd411f534-0080-460c-97cd-76bac0769650'} Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d411f534-0080-460c-97cd-76bac0769650 could not be found. Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d411f534-0080-460c-97cd-76bac0769650 could not be found. Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:19:09.671899 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d411f534-0080-460c-97cd-76bac0769650 could not be found. Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Returning 404 to user: Instance d411f534-0080-460c-97cd-76bac0769650 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-beaea76c-9a7d-4006-97f8-810b0f54d390 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650" status: 404 len: 111 microversion: 2.1 time: 0.031502 Sep 18 02:19:09.677231 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3672/7319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:09 2022] GET /compute/v2.1/servers/d411f534-0080-460c-97cd-76bac0769650 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:19:13.032430 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1b74b01b-a835-43be-ac5e-4137b65f3450 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '.version_select at 0x7f7005416820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:13.058225 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1b74b01b-a835-43be-ac5e-4137b65f3450 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-603117796" status: 202 len: 0 microversion: 2.1 time: 0.030066 Sep 18 02:19:13.063778 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3648/7320] 10.222.0.25 () {58 vars in 1281 bytes} [Sun Sep 18 02:19:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-603117796 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 02:19:13.080991 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fd6a4bc5-f492-4a9a-962c-97fb2b9ef3f7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: .version_select at 0x7f7004ef8d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1480409657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvDfc9lPICNyFKlGDyA0v8JfVq0SV0f3XO1dsgBc9XMFxlAjicc3D1SZjNv3AMvUIf9eZhqDLYRVOG0whyQwY6JLjxzOKwiWXqLpqg9ieBX2Wpw7uX0ruUgxvZoQatGCA=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:13.098200 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-fd6a4bc5-f492-4a9a-962c-97fb2b9ef3f7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:19:13.107574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-fd6a4bc5-f492-4a9a-962c-97fb2b9ef3f7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:19:13.131691 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fd6a4bc5-f492-4a9a-962c-97fb2b9ef3f7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054485 Sep 18 02:19:13.132305 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3673/7321] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:19:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:19:18.734802 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:18.739705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2011141123", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "5afb38e6-327f-49ef-b381-7e3fcf0310a7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1480409657", "security_groups": [{"name": "tempest-secgroup-smoke-1601147272"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:18.879675 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] validate_networks() for [('5afb38e6-327f-49ef-b381-7e3fcf0310a7', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:19:19.277258 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:19:19.277731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:19:19.278227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:19:19.278654 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:19:19.279386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:19:19.288906 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:19.289404 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:19.289891 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:19.290994 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:19.291508 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:19.291952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:19.309888 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:19:19.315805 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:19:19.329480 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:19:19.332022 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:19:19.391997 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-46525fc6-cd39-46e6-9ccd-a72c6d40ed7a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.659195 Sep 18 02:19:19.393490 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3649/7322] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:19:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:19:19.407857 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-308eb539-3a7b-4ab4-8138-ece7355e2c56 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:19.408674 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-308eb539-3a7b-4ab4-8138-ece7355e2c56 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:19.491420 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-308eb539-3a7b-4ab4-8138-ece7355e2c56 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:19.499653 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-308eb539-3a7b-4ab4-8138-ece7355e2c56 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1267 microversion: 2.1 time: 0.098475 Sep 18 02:19:19.500379 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3674/7323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:19 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:20.523883 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:20.524612 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:20.532773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:20.533498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:20.534587 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:20.535477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:20.536097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:20.536690 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:20.603381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:20.615272 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f79d8af2-c800-4e8e-8826-d5b5e80c5f39 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1319 microversion: 2.1 time: 0.095212 Sep 18 02:19:20.626172 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3650/7324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:20 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1319 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:21.640515 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:21.641133 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:21.644140 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=36 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:21.655499 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:21.655991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:21.656426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:21.657128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:21.657605 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:21.658033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:21.818686 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:21.828347 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-aac84adf-a8b8-4794-a777-2debb0dc790d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1393 microversion: 2.1 time: 0.191626 Sep 18 02:19:21.829925 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3675/7325] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:21 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1393 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:22.427053 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-86fd48e5-7021-454e-ba59-3e6786d3c49a req-2ba06388-747b-4fbf-94a5-a1f65175e5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800a6cb8-0f82-40c9-8c55-9ca097b05f40", "tag": "d9f7d6f9-0c91-413a-92b5-479e9bbb48d0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:22.439152 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-86fd48e5-7021-454e-ba59-3e6786d3c49a req-2ba06388-747b-4fbf-94a5-a1f65175e5f8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:22.439877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-86fd48e5-7021-454e-ba59-3e6786d3c49a req-2ba06388-747b-4fbf-94a5-a1f65175e5f8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:22.440569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-86fd48e5-7021-454e-ba59-3e6786d3c49a req-2ba06388-747b-4fbf-94a5-a1f65175e5f8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:22.453378 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-86fd48e5-7021-454e-ba59-3e6786d3c49a req-2ba06388-747b-4fbf-94a5-a1f65175e5f8 service nova] Creating event network-changed:d9f7d6f9-0c91-413a-92b5-479e9bbb48d0 for instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 on n-h2-master-1 Sep 18 02:19:22.458835 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-86fd48e5-7021-454e-ba59-3e6786d3c49a req-2ba06388-747b-4fbf-94a5-a1f65175e5f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041003 Sep 18 02:19:22.459559 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3651/7326] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:19:22.852701 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:22.853360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:22.860558 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:22.861049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:22.861494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:22.862208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:22.862675 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:22.863090 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:23.006713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:23.016106 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a7e09b49-525b-4456-b431-cdb09405e63b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1393 microversion: 2.1 time: 0.167573 Sep 18 02:19:23.016706 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3676/7327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:22 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:24.042004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:24.042746 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:24.049421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:24.049922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:24.050406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:24.051120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:24.051594 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:24.052028 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:24.196347 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:24.204781 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91dd38e1-723b-4297-a203-2091dcbd758a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1393 microversion: 2.1 time: 0.168416 Sep 18 02:19:24.205358 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3652/7328] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:24 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:25.227904 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:25.228456 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:25.231176 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:25.236529 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:25.237016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:25.237460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:25.238183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:25.238649 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:25.239077 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:25.371262 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:25.378891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-dab86589-0e4e-4268-b0e0-e728f6cdc299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1393 microversion: 2.1 time: 0.154960 Sep 18 02:19:25.379469 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3677/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:25 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:26.402608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:26.403393 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:26.409913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:26.410414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:26.411060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:26.411585 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:26.412054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:26.412492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:26.555250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:26.563049 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1640ce4b-6ae2-4768-861a-80c48f6d2600 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1393 microversion: 2.1 time: 0.164819 Sep 18 02:19:26.563624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3653/7330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:26 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:27.586836 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:27.587449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:27.594174 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:27.594650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:27.595076 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:27.595755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:27.596201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:27.596619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:27.726524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:27.735424 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-39d7fc19-0aae-44a0-95dc-3c733071a44a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1393 microversion: 2.1 time: 0.152465 Sep 18 02:19:27.736018 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3678/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:27 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:27.893060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5130bc98-b99a-4c96-b4f3-bd1313b96cb8 req-38a9b947-5652-4ff3-be39-45b724f5feb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800a6cb8-0f82-40c9-8c55-9ca097b05f40", "name": "network-vif-plugged", "status": "completed", "tag": "d9f7d6f9-0c91-413a-92b5-479e9bbb48d0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:27.904116 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5130bc98-b99a-4c96-b4f3-bd1313b96cb8 req-38a9b947-5652-4ff3-be39-45b724f5feb4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:27.904612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5130bc98-b99a-4c96-b4f3-bd1313b96cb8 req-38a9b947-5652-4ff3-be39-45b724f5feb4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:27.905058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5130bc98-b99a-4c96-b4f3-bd1313b96cb8 req-38a9b947-5652-4ff3-be39-45b724f5feb4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:27.917124 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5130bc98-b99a-4c96-b4f3-bd1313b96cb8 req-38a9b947-5652-4ff3-be39-45b724f5feb4 service nova] Creating event network-vif-plugged:d9f7d6f9-0c91-413a-92b5-479e9bbb48d0 for instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 on n-h2-master-1 Sep 18 02:19:27.922321 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5130bc98-b99a-4c96-b4f3-bd1313b96cb8 req-38a9b947-5652-4ff3-be39-45b724f5feb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032899 Sep 18 02:19:27.923201 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3654/7332] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:19:28.759071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:28.759751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:28.768582 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:28.769406 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:28.770488 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:28.771641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:28.772212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:28.772745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:28.919223 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:28.927568 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a8c059c2-458f-4dcc-858a-a145daff82ce tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1393 microversion: 2.1 time: 0.172692 Sep 18 02:19:28.928088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3679/7333] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:28 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:29.950542 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:29.951362 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:29.956884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:29.957639 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:29.965103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:29.965696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:29.966155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:29.966917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:29.967412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:29.967859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:30.099260 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:30.108149 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1394d097-1ca7-48a3-8531-871fa084e209 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1566 microversion: 2.1 time: 0.159745 Sep 18 02:19:30.108719 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3655/7334] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:29 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:30.130654 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:30.131331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:30.133219 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:30.134721 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:19:30.134867 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:19:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 (ip 10.222.0.25) !!! Sep 18 02:19:30.145525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:30.146037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:30.146475 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:30.147178 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:30.147635 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:30.148063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:30.344325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:30.353096 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-936d71c5-58fa-4455-a2c1-08ecd9030ae4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1566 microversion: 2.1 time: 0.226696 Sep 18 02:19:30.353646 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3680/7335] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:30 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:31.953351 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3471121d-295e-4158-9cca-eb75bb1f338b req-597f5aa8-3122-4674-92d2-cae28491aa54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800a6cb8-0f82-40c9-8c55-9ca097b05f40", "tag": "d9f7d6f9-0c91-413a-92b5-479e9bbb48d0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:31.955237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:19:31.955741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:31.959505 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:31.964434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:31.964945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:31.965406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:31.972859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:31.973353 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:31.973838 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:31.976197 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3471121d-295e-4158-9cca-eb75bb1f338b req-597f5aa8-3122-4674-92d2-cae28491aa54 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:31.976728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3471121d-295e-4158-9cca-eb75bb1f338b req-597f5aa8-3122-4674-92d2-cae28491aa54 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:31.977158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3471121d-295e-4158-9cca-eb75bb1f338b req-597f5aa8-3122-4674-92d2-cae28491aa54 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:31.989227 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3471121d-295e-4158-9cca-eb75bb1f338b req-597f5aa8-3122-4674-92d2-cae28491aa54 service nova] Creating event network-changed:d9f7d6f9-0c91-413a-92b5-479e9bbb48d0 for instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 on n-h2-master-1 Sep 18 02:19:31.994596 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3471121d-295e-4158-9cca-eb75bb1f338b req-597f5aa8-3122-4674-92d2-cae28491aa54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044784 Sep 18 02:19:31.995420 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3681/7336] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:19:32.187725 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:19:32.199313 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-91bdd817-43e5-456e-911c-b3d1148487dd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1566 microversion: 2.1 time: 0.254081 Sep 18 02:19:32.200080 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3656/7337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:19:31 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:19:53.446034 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=9 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:53.446725 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=38 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:19:53.451033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:19:53.453301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:19:53.460443 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:53.461573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:53.462022 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:53.462721 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:19:53.463182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:19:53.463603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:19:53.536152 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7774b5c1-db56-41eb-9810-a029c300d57d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40/action" status: 200 len: 24569 microversion: 2.1 time: 0.092474 Sep 18 02:19:53.536821 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3682/7338] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:19:53 2022] POST /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:20:04.501078 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:20:04.503451 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:04.505617 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:04.506295 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=36 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:04.513313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:04.513878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:04.514330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:04.515053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:04.515538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:04.515980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:04.589871 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5b2a52e4-9947-4867-b40f-c307953822ee tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40/action" status: 202 len: 0 microversion: 2.1 time: 0.093364 Sep 18 02:20:04.590558 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3657/7339] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:20:04 2022] POST /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:20:04.604404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:04.605168 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:04.608229 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:04.608889 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:04.619199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:04.619199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:04.619199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:04.619199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:04.619199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:04.619199 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:04.774958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:04.784312 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e2d20225-8d09-4f89-8b1a-bfc667b5c787 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1677 microversion: 2.1 time: 0.187038 Sep 18 02:20:04.785016 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3683/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:04 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:05.810886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:05.811599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:05.818807 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:05.819305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:05.819756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:05.820468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:05.821592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:05.822040 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:05.964942 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:05.972867 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-351d8fb3-e217-4b13-9af9-48f977d1747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.166556 Sep 18 02:20:05.973444 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3658/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:05 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:06.998004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:06.998623 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:07.005456 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:07.005975 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:07.006419 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:07.007143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:07.007606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:07.008073 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:07.141501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:07.150006 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11a7dc03-7bb7-4fbb-a908-cca8aae4447e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.155996 Sep 18 02:20:07.150577 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3684/7342] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:06 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:08.174040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:08.174741 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:08.181756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:08.182313 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:08.184616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:08.184616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:08.184616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:08.184616 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:08.324308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:08.332056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-cb75cf3c-e950-42a6-ac4e-67b3a5e74783 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.162272 Sep 18 02:20:08.332623 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3659/7343] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:08 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:09.356464 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:09.357109 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:09.363969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:09.364486 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:09.364927 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:09.365653 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:09.366113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:09.366543 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:09.497152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:09.504891 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3c502055-8fb2-4727-a8ac-88328719aa4b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.152992 Sep 18 02:20:09.505463 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3685/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:09 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:10.529721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:10.530328 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:10.537283 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:10.537817 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:10.538278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:10.539002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:10.540134 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:10.540610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:10.679524 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:10.687881 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-71002436-7ad0-462b-9537-c086fe2c8286 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.162304 Sep 18 02:20:10.688453 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3660/7345] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:10 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:11.712339 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:11.712937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:11.719724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:11.720202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:11.720633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:11.721318 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:11.721795 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:11.722218 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:11.854001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:11.861613 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-be376de9-6400-4ec8-8d00-84b1f6ea61f8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.154014 Sep 18 02:20:11.862182 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3686/7346] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:11 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:12.887339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:12.887972 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:12.894965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:12.895467 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:12.895917 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:12.896637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:12.897204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:12.897664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:13.035363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:13.044764 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e5d95827-725c-423c-935e-69319b05c941 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.162488 Sep 18 02:20:13.045602 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3661/7347] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:12 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:14.071270 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:14.071963 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:14.078346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:14.078829 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:14.079270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:14.079960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:14.080413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:14.080839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:14.220010 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:14.227676 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b6a62f3-16e9-4767-a1b9-708ade690b40 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.161126 Sep 18 02:20:14.228263 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3687/7348] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:14 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:15.251322 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:15.251872 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:15.259701 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:15.260199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:15.260648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:15.261352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:15.261849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:15.262292 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:15.402254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:15.410006 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5c5af224-a199-4d5e-8fd6-21ef3ae437a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.162700 Sep 18 02:20:15.410571 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3662/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:15 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:16.433585 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:16.434132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:16.440956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:16.441435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:16.441902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:16.442591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:16.443040 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:16.443459 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:16.577606 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:16.585340 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ea30bf4f-7b42-4b75-919c-a2c5355ce911 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.156346 Sep 18 02:20:16.586565 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3688/7350] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:16 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:17.609199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:17.609854 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:17.616755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:17.617311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:17.617806 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:17.618526 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:17.619003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:17.619475 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:17.754649 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:17.763165 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ea3d0621-1518-4247-a740-d7b41953dc5f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.157994 Sep 18 02:20:17.763739 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3663/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:17 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:18.787263 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:18.787808 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:18.794748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:18.795237 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:18.795662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:18.796343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:18.796791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:18.797211 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:18.932643 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:18.940480 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0d96054e-f623-41c7-9f19-2ab0d0bae4f6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.157282 Sep 18 02:20:18.941057 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3689/7352] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:18 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:19.964886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:19.965517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:19.972748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:19.973249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:19.973759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:19.974473 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:19.974945 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:19.975384 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:20.118699 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:20.126617 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d6661da7-5f21-40e7-be84-eb5b24d4a8e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1682 microversion: 2.1 time: 0.166260 Sep 18 02:20:20.127130 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3664/7353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:19 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:21.151994 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:21.152550 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:21.159501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:21.159990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:21.160434 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:21.161143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:21.161950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:21.162143 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:21.309475 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:21.317508 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9fd9e079-3258-46c7-9a3b-c2d543e03156 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1685 microversion: 2.1 time: 0.170124 Sep 18 02:20:21.318133 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3690/7354] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:21 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:45.508635 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:20:45.511002 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:45.513429 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=16 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:45.514185 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:45.519979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:45.520520 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:45.520986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:45.521839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:45.522325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:45.522774 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:45.600923 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-736784de-4031-4fb7-ab75-a6692deb747f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40/action" status: 200 len: 69106 microversion: 2.1 time: 0.096447 Sep 18 02:20:45.601647 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3665/7355] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:20:45 2022] POST /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40/action => generated 69106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:20:53.145646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:53.146737 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:53.147286 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e584c937-72e6-46df-be8f-e6cef49e647b req-31fe73a3-f2bf-440f-8a22-55ab3ee48fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800a6cb8-0f82-40c9-8c55-9ca097b05f40", "tag": "d9f7d6f9-0c91-413a-92b5-479e9bbb48d0"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:20:53.149161 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=16 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:53.149848 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=48 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:20:53.156451 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:53.157207 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:53.157680 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:53.158405 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:53.158869 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:53.159026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e584c937-72e6-46df-be8f-e6cef49e647b req-31fe73a3-f2bf-440f-8a22-55ab3ee48fa0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:53.159307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:53.159489 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e584c937-72e6-46df-be8f-e6cef49e647b req-31fe73a3-f2bf-440f-8a22-55ab3ee48fa0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:53.159951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e584c937-72e6-46df-be8f-e6cef49e647b req-31fe73a3-f2bf-440f-8a22-55ab3ee48fa0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:53.171740 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e584c937-72e6-46df-be8f-e6cef49e647b req-31fe73a3-f2bf-440f-8a22-55ab3ee48fa0 service nova] Creating event network-changed:d9f7d6f9-0c91-413a-92b5-479e9bbb48d0 for instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 on n-h2-master-1 Sep 18 02:20:53.178293 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e584c937-72e6-46df-be8f-e6cef49e647b req-31fe73a3-f2bf-440f-8a22-55ab3ee48fa0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034304 Sep 18 02:20:53.182067 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3666/7356] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:20:53.189784 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:20:53.288746 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e3a08d88-af86-42ab-96e5-3a5e9688f4fd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 204 len: 0 microversion: 2.1 time: 0.146477 Sep 18 02:20:53.289998 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3691/7357] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:20:53 2022] DELETE /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:20:53.303417 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:53.304988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:53.317957 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:53.319204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:53.320174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:53.321991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:53.323296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:53.324176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:53.484619 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:53.493143 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8d7f36c-170f-496a-b8ae-ae25fb194b7f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1691 microversion: 2.1 time: 0.198738 Sep 18 02:20:53.493767 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3667/7358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:53 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:54.518903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:54.519591 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:54.526754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:54.527166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:54.527598 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:54.528293 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:54.528744 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:54.529164 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:54.668721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:54.676728 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a01779c6-c17b-49e6-9adb-b583535da099 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1691 microversion: 2.1 time: 0.162229 Sep 18 02:20:54.677315 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3692/7359] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:54 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:20:55.701218 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:55.702429 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:55.709512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:55.710103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:55.710556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:55.711281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:55.711835 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:55.712287 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:55.757222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-7fb12973-888a-406a-9cf8-9ea1474c546b req-05afedb1-c1c6-4795-ba8c-71f3cefaf034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800a6cb8-0f82-40c9-8c55-9ca097b05f40", "name": "network-vif-deleted", "tag": "d9f7d6f9-0c91-413a-92b5-479e9bbb48d0"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:20:55.770947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7fb12973-888a-406a-9cf8-9ea1474c546b req-05afedb1-c1c6-4795-ba8c-71f3cefaf034 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:55.771424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7fb12973-888a-406a-9cf8-9ea1474c546b req-05afedb1-c1c6-4795-ba8c-71f3cefaf034 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:55.771848 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7fb12973-888a-406a-9cf8-9ea1474c546b req-05afedb1-c1c6-4795-ba8c-71f3cefaf034 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:55.784122 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:20:55.784795 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-7fb12973-888a-406a-9cf8-9ea1474c546b req-05afedb1-c1c6-4795-ba8c-71f3cefaf034 service nova] Creating event network-vif-deleted:d9f7d6f9-0c91-413a-92b5-479e9bbb48d0 for instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 on n-h2-master-1 Sep 18 02:20:55.790767 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-7fb12973-888a-406a-9cf8-9ea1474c546b req-05afedb1-c1c6-4795-ba8c-71f3cefaf034 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037392 Sep 18 02:20:55.791830 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3693/7360] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:20:55.794967 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-951e1bca-f274-4809-a5f7-785fc978b476 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 200 len: 1504 microversion: 2.1 time: 0.097955 Sep 18 02:20:55.795588 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3668/7361] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:55 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 1504 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:20:56.819572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:20:56.820273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 800a6cb8-0f82-40c9-8c55-9ca097b05f40] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:20:56.826467 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:56.827552 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:56.827996 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:56.828687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:20:56.829142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:20:56.829586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:20:56.846399 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] HTTP exception thrown: Instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 could not be found. Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Request method failure captured: Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 HTTP/1.1 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn_ioP4JgVXfvFlCB-Kdu8mRDjmTzH2sU1xUbGwF_sSq7AAskhOBFuFvc46OYAYb2RZyoocrEzPfX_JtYwoHj3QcB7ZNnoxgNH9ZHrUhcZuKrSRH1GI8w34liVw78ifXBxEGcRKtbiKkhAFuhcbznGVL98cmAffSmlSJ4E6cy0ZO_tI Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: b29f937843f141eeb3edc89594fcddca Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 could not be found. Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '800a6cb8-0f82-40c9-8c55-9ca097b05f40'} Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 could not be found. Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 could not be found. Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:20:56.848031 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 could not be found. Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Returning 404 to user: Instance 800a6cb8-0f82-40c9-8c55-9ca097b05f40 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ab5bba80-ddd8-47d2-bae3-7c2c9893401b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40" status: 404 len: 111 microversion: 2.1 time: 0.035022 Sep 18 02:20:56.852844 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3694/7362] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:20:56 2022] GET /compute/v2.1/servers/800a6cb8-0f82-40c9-8c55-9ca097b05f40 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:21:00.139531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-65b81574-9945-449d-a65c-70607709057a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '.version_select at 0x7f7005e96940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:00.162405 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-65b81574-9945-449d-a65c-70607709057a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1480409657" status: 202 len: 0 microversion: 2.1 time: 0.027396 Sep 18 02:21:00.163085 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3669/7363] 10.222.0.25 () {58 vars in 1284 bytes} [Sun Sep 18 02:21:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1480409657 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 02:21:00.193916 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8dd5366b-e728-464d-8085-5050e903b6a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: .version_select at 0x7f7006698b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1251999870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Behe+UunAGkS1CbhjgDnjYq/Z2TdrQPEarC7g5GboLhE5cT0tQfPyIYM256VhSsfhF5NFvxDF1yxH4dnoC6wiv1WMu8kKbaPCTtI47JwKxa5Ii/IrH1C5oUhzdjdpPg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:21:00.209968 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8dd5366b-e728-464d-8085-5050e903b6a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:21:00.215866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-8dd5366b-e728-464d-8085-5050e903b6a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:21:00.240539 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8dd5366b-e728-464d-8085-5050e903b6a2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050537 Sep 18 02:21:00.241142 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3695/7364] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:21:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:21:05.863362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-383827305", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "dad0ab0f-1a6e-4274-bac8-042b2ca4a454"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1251999870", "security_groups": [{"name": "tempest-secgroup-smoke-124425620"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:21:05.891805 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=18 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:06.000526 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] validate_networks() for [('dad0ab0f-1a6e-4274-bac8-042b2ca4a454', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:21:06.412880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:21:06.413321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:21:06.413839 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:21:06.414265 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:21:06.414687 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:21:06.424459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:06.424965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:06.425417 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:06.426189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:06.426667 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:06.427109 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:06.447029 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:21:06.453082 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:21:06.466172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:21:06.469028 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:21:06.518809 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-184e1116-4997-4e90-8f3b-e4fade9ef3cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.658946 Sep 18 02:21:06.525846 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3670/7365] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:21:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:21:06.533519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b6203d5e-069f-4f22-859f-c5ca1562acd9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:06.534299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b6203d5e-069f-4f22-859f-c5ca1562acd9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:06.590324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6203d5e-069f-4f22-859f-c5ca1562acd9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:06.598159 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b6203d5e-069f-4f22-859f-c5ca1562acd9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1266 microversion: 2.1 time: 0.070698 Sep 18 02:21:06.598742 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3696/7366] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:06 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:07.624376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:07.625866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:07.634326 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:07.634833 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:07.635279 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:07.635991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:07.636456 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:07.636894 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:07.719832 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:07.734702 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d19b71e4-c17e-454f-beb9-2939c27af49a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1318 microversion: 2.1 time: 0.115492 Sep 18 02:21:07.736442 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3671/7367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:07 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:08.759905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:08.761277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:08.763332 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:08.773357 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:08.773856 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:08.774305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:08.775147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:08.775622 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:08.776037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:08.926262 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:08.933957 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bb00ea6c-d180-4f82-9a0f-0df43352e513 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1391 microversion: 2.1 time: 0.178321 Sep 18 02:21:08.934536 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3697/7368] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:08 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:09.419099 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-17b7eda5-a285-4a8d-9298-d3422fa16541 req-5e96b047-2315-4343-8b9d-2914d5e2fab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:21:09.428877 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-17b7eda5-a285-4a8d-9298-d3422fa16541 req-5e96b047-2315-4343-8b9d-2914d5e2fab0 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:09.429361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-17b7eda5-a285-4a8d-9298-d3422fa16541 req-5e96b047-2315-4343-8b9d-2914d5e2fab0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:09.429923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-17b7eda5-a285-4a8d-9298-d3422fa16541 req-5e96b047-2315-4343-8b9d-2914d5e2fab0 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:09.442203 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-17b7eda5-a285-4a8d-9298-d3422fa16541 req-5e96b047-2315-4343-8b9d-2914d5e2fab0 service nova] Creating event network-changed:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h1-master-1 Sep 18 02:21:09.455939 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-17b7eda5-a285-4a8d-9298-d3422fa16541 req-5e96b047-2315-4343-8b9d-2914d5e2fab0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121935 Sep 18 02:21:09.456546 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3672/7369] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:21:09.957974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:09.958587 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:09.965506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:09.966149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:09.966606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:09.967341 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:09.967792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:09.968212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:10.107943 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:10.115928 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3587c6e4-d00d-4069-b384-98bd8461c551 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1391 microversion: 2.1 time: 0.161933 Sep 18 02:21:10.116513 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3698/7370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:09 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:11.141773 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:11.142404 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:11.148868 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:11.149358 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:11.149840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:11.150552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:11.151024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:11.151460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:11.290366 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:11.298657 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b4d07cd8-a943-4dd3-ac01-f668558eff8b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1391 microversion: 2.1 time: 0.163218 Sep 18 02:21:11.299250 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3673/7371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:11 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:12.321759 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:12.323106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:12.331343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:12.331946 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:12.332630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:12.333607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:12.334275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:12.334774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:12.480919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:12.499091 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9550809f-c052-4c2f-8539-25285f715299 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1391 microversion: 2.1 time: 0.181189 Sep 18 02:21:12.499898 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3699/7372] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:12 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:13.522210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:13.522740 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:13.530356 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:13.530859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:13.531304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:13.532021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:13.532485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:13.532928 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:13.667721 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:13.676515 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-187d511f-d881-4b22-b50d-a642b3b01d2e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1391 microversion: 2.1 time: 0.158095 Sep 18 02:21:13.677105 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3674/7373] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:13 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:13.937929 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-072375a7-56b0-494d-a637-b787a48146ee req-12029866-438a-4b91-93a7-75dbaaec0fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "name": "network-vif-plugged", "status": "completed", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:21:13.948710 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-072375a7-56b0-494d-a637-b787a48146ee req-12029866-438a-4b91-93a7-75dbaaec0fbe service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:13.949201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-072375a7-56b0-494d-a637-b787a48146ee req-12029866-438a-4b91-93a7-75dbaaec0fbe service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:13.949662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-072375a7-56b0-494d-a637-b787a48146ee req-12029866-438a-4b91-93a7-75dbaaec0fbe service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:13.960936 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-072375a7-56b0-494d-a637-b787a48146ee req-12029866-438a-4b91-93a7-75dbaaec0fbe service nova] Creating event network-vif-plugged:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h1-master-1 Sep 18 02:21:13.966064 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-072375a7-56b0-494d-a637-b787a48146ee req-12029866-438a-4b91-93a7-75dbaaec0fbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Sep 18 02:21:13.967697 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3700/7374] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:21:14.700128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:14.700757 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:14.707923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:14.708424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:14.709001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:14.709684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:14.710119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:14.710569 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:14.843435 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:14.851266 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4d73a833-4178-4f56-a342-072d8acac127 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1391 microversion: 2.1 time: 0.155122 Sep 18 02:21:14.851846 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3675/7375] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:14 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:15.876733 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:15.877434 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:15.883981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:15.884463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:15.884893 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:15.885632 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:15.886085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:15.886509 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:16.014928 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:16.022735 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-48c93fc4-eeba-4735-96aa-1c50cd32e521 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1563 microversion: 2.1 time: 0.151722 Sep 18 02:21:16.023312 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3701/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:15 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:21:16.046040 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:16.046667 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:16.049439 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:16.054867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:16.055365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:16.055818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:16.056528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:16.057002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:16.057444 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:16.194324 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:16.202057 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f00228c1-9170-44e7-a4e0-83fe76aabc50 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1563 microversion: 2.1 time: 0.160485 Sep 18 02:21:16.202635 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3676/7377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:16 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:17.790152 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:17.791001 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:17.793178 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:17.793335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-687a6faa-032b-4f6c-b844-f64160929c25 req-e6edc90c-3787-4745-8807-f027ba89572c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:21:17.799503 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:17.800500 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:17.801586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:17.802347 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:17.802827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:17.803836 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:17.804876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:17.805616 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:17.808683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-687a6faa-032b-4f6c-b844-f64160929c25 req-e6edc90c-3787-4745-8807-f027ba89572c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:17.809178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-687a6faa-032b-4f6c-b844-f64160929c25 req-e6edc90c-3787-4745-8807-f027ba89572c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:17.809652 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-687a6faa-032b-4f6c-b844-f64160929c25 req-e6edc90c-3787-4745-8807-f027ba89572c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:17.821222 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-687a6faa-032b-4f6c-b844-f64160929c25 req-e6edc90c-3787-4745-8807-f027ba89572c service nova] Creating event network-changed:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h1-master-1 Sep 18 02:21:17.827430 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-687a6faa-032b-4f6c-b844-f64160929c25 req-e6edc90c-3787-4745-8807-f027ba89572c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038575 Sep 18 02:21:17.828395 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3677/7378] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:21:17.959188 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:17.968983 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9efc5335-d81b-4495-a9e6-3a1a2187a8c9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1563 microversion: 2.1 time: 0.182651 Sep 18 02:21:17.970319 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3702/7379] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:17 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:39.216069 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:39.217635 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=36 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:39.221846 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:21:39.224132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:39.231142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:39.231664 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:39.232097 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:39.232805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:39.233278 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:39.233744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:39.305995 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1390a840-da19-4247-afc2-28b10b88ab8a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action" status: 200 len: 24572 microversion: 2.1 time: 0.091532 Sep 18 02:21:39.306636 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3678/7380] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:21:39 2022] POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action => generated 24572 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:21:50.391723 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:21:50.393981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:50.395987 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:50.396690 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=32 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:50.402496 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:50.402983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:50.403425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:50.404119 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:50.404580 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:50.405007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:50.489480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:50.495646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Old instance type m1.heat2, new instance type m1.heat {{(pid=122374) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 18 02:21:50.502925 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:21:50.503341 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:21:50.503809 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:21:50.504213 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:21:50.504624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:21:50.569484 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-541a1973-a824-4a21-a5da-358a0f9b95d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action" status: 202 len: 0 microversion: 2.1 time: 0.181650 Sep 18 02:21:50.570136 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3703/7381] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:21:50 2022] POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:21:50.579647 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:50.580361 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:50.584576 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:50.585394 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=4 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:21:50.590053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:50.590571 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:50.591067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:50.591878 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:50.592434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:50.592881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:50.752438 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:50.760699 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e4d973a6-371e-4998-bdb4-b77c94f385f9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1691 microversion: 2.1 time: 0.185934 Sep 18 02:21:50.761270 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3679/7382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:50 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:51.786449 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:51.787231 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:51.795191 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:51.795677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:51.796114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:51.796820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:51.797277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:51.797732 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:51.941105 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:51.949133 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb58dc79-97cf-4591-9088-5e03eb73ab9c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1691 microversion: 2.1 time: 0.167284 Sep 18 02:21:51.949736 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3704/7383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:51 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:52.973759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:52.974425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:52.981445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:52.981974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:52.982425 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:52.983766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:52.984252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:52.984696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:53.123924 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:53.132153 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5415468b-c090-4931-b306-2c17d6eda59e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1691 microversion: 2.1 time: 0.162445 Sep 18 02:21:53.132796 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3680/7384] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:52 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:54.156465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:54.157087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:54.164080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:54.164573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:54.165014 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:54.165820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:54.166289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:54.166718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:54.305996 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:54.314067 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e948c17-988a-4555-903d-e08f883fb4c2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.161566 Sep 18 02:21:54.314648 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3705/7385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:54 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:55.337853 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:55.338476 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:55.344938 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:55.345437 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:55.345924 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:55.346631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:55.347102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:55.347548 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:55.475895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:55.484108 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4799da62-f3c5-40cc-b677-d18a01d8f940 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.150401 Sep 18 02:21:55.484686 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3681/7386] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:55 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:56.507426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:56.508241 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:56.515299 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:56.515771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:56.516202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:56.516884 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:56.517338 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:56.517781 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:56.659629 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:56.667473 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-45e1f1ad-ac34-49fe-8e57-d233ac9dec21 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.164006 Sep 18 02:21:56.668041 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3706/7387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:56 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:57.692084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:57.692717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:57.699625 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:57.700125 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:57.700575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:57.701284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:57.701819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:57.702262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:57.832402 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:57.840155 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20ddfeda-34ea-4482-82b5-0074092eb2e9 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.152032 Sep 18 02:21:57.840733 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3682/7388] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:57 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:21:58.864173 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:21:58.864811 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:21:58.871774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:58.872263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:58.872725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:58.873441 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:21:58.874024 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:21:58.874346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:21:59.008675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:21:59.016413 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-32126743-85cd-4db7-a7a2-a4fcaa428b09 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.156163 Sep 18 02:21:59.016989 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3707/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:21:58 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:00.040270 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:00.040901 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:00.048335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:00.048840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:00.049296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:00.050036 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:00.050513 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:00.050958 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:00.182308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:00.190636 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1abd38f0-81ad-453e-8776-221ad708f006 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.154309 Sep 18 02:22:00.191222 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3683/7390] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:00 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:01.214404 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:01.215020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:01.222047 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:01.222530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:01.222966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:01.223652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:01.224107 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:01.224530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:01.355502 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:01.363289 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-018ddce0-19b9-41f3-b1ea-fda189d9e4f5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.152753 Sep 18 02:22:01.363865 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3708/7391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:01 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:02.387553 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:02.388175 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:02.396073 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:02.396566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:02.397016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:02.397744 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:02.398484 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:02.398918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:02.533291 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:02.541053 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-de699772-d118-4ccf-9c6b-dae6458492bd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.157694 Sep 18 02:22:02.541633 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3684/7392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:02 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:03.565179 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:03.565829 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:03.572659 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:03.573142 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:03.573600 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:03.574292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:03.574748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:03.575167 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:03.706040 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:03.713862 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a4f6b72-9568-4df1-91e5-79f5690582d7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.153485 Sep 18 02:22:03.714429 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3709/7393] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:03 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:04.737166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:04.737851 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:04.744658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:04.745162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:04.745641 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:04.746350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:04.746821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:04.747261 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:04.886472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:04.894227 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f0dc790f-4f12-467a-9f1c-198cd5bbc793 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.161706 Sep 18 02:22:04.894820 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3685/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:04 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:05.918324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:05.918867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:05.926266 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:05.926747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:05.927180 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:05.927864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:05.928315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:05.928734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:06.067303 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:06.075288 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-233f740c-afbf-4279-96c0-24df4223025f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.160948 Sep 18 02:22:06.075873 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3710/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:05 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:07.099174 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:07.099812 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:07.106668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:07.107170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:07.107621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:07.108332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:07.108805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:07.109245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:07.243084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:07.251275 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1781b647-56fe-4053-9ac6-618d4e4390c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.155622 Sep 18 02:22:07.251851 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3686/7396] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:07 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:08.275243 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:08.275866 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:08.283466 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:08.283944 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:08.284382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:08.285069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:08.285523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:08.285973 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:08.415322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:08.423324 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-82d86d34-bf60-4cf8-8bff-2713aff4625e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.151949 Sep 18 02:22:08.423954 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3711/7397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:08 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:09.447656 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:09.448281 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:09.455827 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:09.456325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:09.456777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:09.457481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:09.457975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:09.458412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:09.590026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:09.597846 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7fb2388a-ce50-4a58-b615-1ff4bdea8c7d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1696 microversion: 2.1 time: 0.154325 Sep 18 02:22:09.598423 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3687/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:09 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:10.622528 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:10.623153 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:10.630185 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:10.630677 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:10.631121 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:10.631820 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:10.632281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:10.632711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:10.777063 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:10.785314 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e507586-0677-422f-b012-e9c8846f65e2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1695 microversion: 2.1 time: 0.166696 Sep 18 02:22:10.785918 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3712/7399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:10 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:10.849001 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-871d306f-64de-49ac-8579-194976c22445 req-e877f18a-335d-4ce4-a3f6-a3e0aec9c2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "name": "network-vif-unplugged", "status": "completed", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:10.860629 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-871d306f-64de-49ac-8579-194976c22445 req-e877f18a-335d-4ce4-a3f6-a3e0aec9c2fd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:10.861171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-871d306f-64de-49ac-8579-194976c22445 req-e877f18a-335d-4ce4-a3f6-a3e0aec9c2fd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:10.861829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-871d306f-64de-49ac-8579-194976c22445 req-e877f18a-335d-4ce4-a3f6-a3e0aec9c2fd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:10.875193 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-871d306f-64de-49ac-8579-194976c22445 req-e877f18a-335d-4ce4-a3f6-a3e0aec9c2fd service nova] Creating event network-vif-unplugged:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h2-master-1 Sep 18 02:22:10.882828 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-871d306f-64de-49ac-8579-194976c22445 req-e877f18a-335d-4ce4-a3f6-a3e0aec9c2fd service nova] Instance 480e6254-c544-47d8-bc57-32e6be744b98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:22:10.898871 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-871d306f-64de-49ac-8579-194976c22445 req-e877f18a-335d-4ce4-a3f6-a3e0aec9c2fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050706 Sep 18 02:22:10.898871 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3688/7400] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:22:11.809984 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:11.811313 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:11.818924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:11.820291 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:11.821957 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:11.822725 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:11.823230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:11.823663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:11.977801 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:11.987278 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4dbdb25a-adbf-4546-a7f6-6d52137ac11d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1695 microversion: 2.1 time: 0.181527 Sep 18 02:22:11.997271 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3713/7401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:11 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:12.915450 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2a15b01b-b67c-4961-927a-7f3768b526a9 req-9aa2a6c8-693f-4969-ad27-17e568e35210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:12.928204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2a15b01b-b67c-4961-927a-7f3768b526a9 req-9aa2a6c8-693f-4969-ad27-17e568e35210 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:12.928734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2a15b01b-b67c-4961-927a-7f3768b526a9 req-9aa2a6c8-693f-4969-ad27-17e568e35210 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:12.929541 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2a15b01b-b67c-4961-927a-7f3768b526a9 req-9aa2a6c8-693f-4969-ad27-17e568e35210 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:12.943206 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2a15b01b-b67c-4961-927a-7f3768b526a9 req-9aa2a6c8-693f-4969-ad27-17e568e35210 service nova] Creating event network-changed:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h2-master-1 Sep 18 02:22:12.949307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [req-2a15b01b-b67c-4961-927a-7f3768b526a9 req-9aa2a6c8-693f-4969-ad27-17e568e35210 service nova] Instance 480e6254-c544-47d8-bc57-32e6be744b98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122373) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 18 02:22:12.962086 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2a15b01b-b67c-4961-927a-7f3768b526a9 req-9aa2a6c8-693f-4969-ad27-17e568e35210 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051820 Sep 18 02:22:12.962950 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3689/7402] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:22:13.011410 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:13.012348 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:13.019816 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:13.020320 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:13.020769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:13.021490 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:13.022179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:13.022830 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:13.179174 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:13.189185 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b7588059-0ac3-463b-a869-b778fe978078 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1693 microversion: 2.1 time: 0.182007 Sep 18 02:22:13.204755 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3714/7403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:13 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:14.214222 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:14.214935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:14.223207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.223721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.224172 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.224896 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.225406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.225823 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.360789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:14.369521 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1dbba3ef-f4f2-49c4-8de4-62478c411fc5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1690 microversion: 2.1 time: 0.159584 Sep 18 02:22:14.370125 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3690/7404] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:14 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:22:14.398896 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:14.399463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:14.406247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.407284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.407752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.408439 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.408890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.409310 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.470027 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7c0e4d7d-19af-467f-ae31-88de505f433e tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action" status: 204 len: 0 microversion: 2.1 time: 0.074968 Sep 18 02:22:14.470699 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3715/7405] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:22:14 2022] POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:22:14.479076 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:14.479802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:14.485952 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.486509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.486925 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.487691 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.488222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.488677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.643020 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:14.657253 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-13e2c3cc-07ce-480c-bb3a-5c7994dc20a8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1690 microversion: 2.1 time: 0.181704 Sep 18 02:22:14.658031 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3691/7406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:14 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:22:14.687225 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:14.688556 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:14.695597 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.696173 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.696685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.697470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:14.698067 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:14.698585 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:14.896521 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:14.909206 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-991abaca-7bc3-44e7-9e1c-454fbbbb987b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1690 microversion: 2.1 time: 0.228107 Sep 18 02:22:14.915236 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3716/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:14 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:22:15.933948 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:15.934522 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:15.942014 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:15.942524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:15.942969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:15.943676 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:15.944174 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:15.944689 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:16.087278 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:16.096590 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae73f8f8-b0b6-4e6e-b834-f560e46d4f11 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1690 microversion: 2.1 time: 0.166512 Sep 18 02:22:16.097454 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3692/7408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:15 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:16.881299 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ab036302-3d27-443d-832e-efb6b17713c0 req-d6af921c-f735-4ed1-b163-a12f4e4c04b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "name": "network-vif-plugged", "status": "completed", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:16.891251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ab036302-3d27-443d-832e-efb6b17713c0 req-d6af921c-f735-4ed1-b163-a12f4e4c04b5 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:16.891724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ab036302-3d27-443d-832e-efb6b17713c0 req-d6af921c-f735-4ed1-b163-a12f4e4c04b5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:16.892148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ab036302-3d27-443d-832e-efb6b17713c0 req-d6af921c-f735-4ed1-b163-a12f4e4c04b5 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:16.894777 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:22:16.904691 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ab036302-3d27-443d-832e-efb6b17713c0 req-d6af921c-f735-4ed1-b163-a12f4e4c04b5 service nova] Creating event network-vif-plugged:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h2-master-1 Sep 18 02:22:16.910848 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ab036302-3d27-443d-832e-efb6b17713c0 req-d6af921c-f735-4ed1-b163-a12f4e4c04b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110917 Sep 18 02:22:16.911389 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3717/7409] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:22:17.120267 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:17.120884 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:17.127710 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:17.128196 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:17.128648 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:17.129345 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:17.129839 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:17.130276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:17.268374 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:17.276182 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-991dfbdd-eee4-4cda-9cf5-e6b6d80b0cc7 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1682 microversion: 2.1 time: 0.159828 Sep 18 02:22:17.276777 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3693/7410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:17 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:22:39.457170 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=34 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:22:39.461797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:39.464129 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:39.472003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:39.472489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:39.472928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:39.473642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:39.474093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:39.474516 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:39.544997 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-741c9c5f-ca40-4d16-9297-b045351f6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action" status: 200 len: 24574 microversion: 2.1 time: 0.089701 Sep 18 02:22:39.545805 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3718/7411] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:22:39 2022] POST /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98/action => generated 24574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:22:46.655843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:46.656389 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:46.658700 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=30 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:22:46.659769 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=86 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:22:46.659922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-d3016c39-73e1-42f2-b8af-7a41c770f028 req-a45b15b5-8c8a-49b3-8dc3-9863f74c2fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:46.666477 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:46.666988 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:46.667438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:46.668407 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:46.668881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:46.669333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:46.672501 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d3016c39-73e1-42f2-b8af-7a41c770f028 req-a45b15b5-8c8a-49b3-8dc3-9863f74c2fa7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:46.672985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d3016c39-73e1-42f2-b8af-7a41c770f028 req-a45b15b5-8c8a-49b3-8dc3-9863f74c2fa7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:46.673418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-d3016c39-73e1-42f2-b8af-7a41c770f028 req-a45b15b5-8c8a-49b3-8dc3-9863f74c2fa7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:46.685409 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-d3016c39-73e1-42f2-b8af-7a41c770f028 req-a45b15b5-8c8a-49b3-8dc3-9863f74c2fa7 service nova] Creating event network-changed:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h2-master-1 Sep 18 02:22:46.691565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-d3016c39-73e1-42f2-b8af-7a41c770f028 req-a45b15b5-8c8a-49b3-8dc3-9863f74c2fa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035940 Sep 18 02:22:46.692185 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3719/7412] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:22:46.697973 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:22:46.792319 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-33e25dac-9a7e-4d6d-8b2a-ec3e8eaaa1cf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 204 len: 0 microversion: 2.1 time: 0.140497 Sep 18 02:22:46.793636 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3694/7413] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:22:46 2022] DELETE /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:22:46.804081 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:46.804794 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:46.812103 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:46.812592 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:46.813031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:46.813785 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:46.814245 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:46.814668 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:46.974082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:46.982730 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-092bf838-8bc6-43e2-b008-35c1d9077bb2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1688 microversion: 2.1 time: 0.182667 Sep 18 02:22:46.983329 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3720/7414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:46 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:48.010678 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:48.011312 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:48.021848 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:48.022668 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:48.023464 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:48.024773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:48.025684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:48.026495 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:48.181009 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:48.190484 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1b449793-df85-4170-8708-578b73d7c726 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1688 microversion: 2.1 time: 0.185780 Sep 18 02:22:48.191089 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3695/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:48 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:49.027671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3fb17bcb-2758-4c7c-9086-1232cd128f46 req-fab60874-adc6-4166-b028-399b283f9f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480e6254-c544-47d8-bc57-32e6be744b98", "name": "network-vif-deleted", "tag": "deed2870-4f3c-4aa9-b486-3bacd8005526"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:49.039122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3fb17bcb-2758-4c7c-9086-1232cd128f46 req-fab60874-adc6-4166-b028-399b283f9f62 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:49.039603 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3fb17bcb-2758-4c7c-9086-1232cd128f46 req-fab60874-adc6-4166-b028-399b283f9f62 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:49.040036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3fb17bcb-2758-4c7c-9086-1232cd128f46 req-fab60874-adc6-4166-b028-399b283f9f62 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:49.051375 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3fb17bcb-2758-4c7c-9086-1232cd128f46 req-fab60874-adc6-4166-b028-399b283f9f62 service nova] Creating event network-vif-deleted:deed2870-4f3c-4aa9-b486-3bacd8005526 for instance 480e6254-c544-47d8-bc57-32e6be744b98 on n-h2-master-1 Sep 18 02:22:49.056715 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3fb17bcb-2758-4c7c-9086-1232cd128f46 req-fab60874-adc6-4166-b028-399b283f9f62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032703 Sep 18 02:22:49.057339 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3721/7416] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:22:49.214415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:49.215036 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:49.221972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:49.222567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:49.223017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:49.223735 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:49.224204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:49.224638 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:49.257635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:49.258651 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:49.259104 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:49.259570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lazy-loading 'fault' on Instance uuid 480e6254-c544-47d8-bc57-32e6be744b98 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:22:49.302676 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:22:49.311079 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-965ed53a-4d88-482e-8da5-6d837f72d844 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 200 len: 1356 microversion: 2.1 time: 0.100494 Sep 18 02:22:49.311679 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3696/7417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:49 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:22:50.341023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:50.341740 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 480e6254-c544-47d8-bc57-32e6be744b98] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:22:50.347989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:50.348463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:50.348894 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:50.349841 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:50.350045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:50.350461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:50.366816 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] HTTP exception thrown: Instance 480e6254-c544-47d8-bc57-32e6be744b98 could not be found. Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Request method failure captured: Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 HTTP/1.1 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn_ioP4JgVXfvFlCB-Kdu8mRDjmTzH2sU1xUbGwF_sSq7AAskhOBFuFvc46OYAYb2RZyoocrEzPfX_JtYwoHj3QcB7ZNnoxgNH9ZHrUhcZuKrSRH1GI8w34liVw78ifXBxEGcRKtbiKkhAFuhcbznGVL98cmAffSmlSJ4E6cy0ZO_tI Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: b29f937843f141eeb3edc89594fcddca Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 480e6254-c544-47d8-bc57-32e6be744b98 could not be found. Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '480e6254-c544-47d8-bc57-32e6be744b98'} Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480e6254-c544-47d8-bc57-32e6be744b98 could not be found. Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480e6254-c544-47d8-bc57-32e6be744b98 could not be found. Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:22:50.368444 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480e6254-c544-47d8-bc57-32e6be744b98 could not be found. Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Returning 404 to user: Instance 480e6254-c544-47d8-bc57-32e6be744b98 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a16d041-f142-4027-b1e5-132b83ead764 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98" status: 404 len: 111 microversion: 2.1 time: 0.034205 Sep 18 02:22:50.374004 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3722/7418] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:22:50 2022] GET /compute/v2.1/servers/480e6254-c544-47d8-bc57-32e6be744b98 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:22:53.715102 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9c4e599e-13a6-47ec-91fd-19dcea1630b6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '.version_select at 0x7f7005281b80>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:22:53.736805 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9c4e599e-13a6-47ec-91fd-19dcea1630b6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1251999870" status: 202 len: 0 microversion: 2.1 time: 0.025453 Sep 18 02:22:53.737612 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3697/7419] 10.222.0.25 () {58 vars in 1284 bytes} [Sun Sep 18 02:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1251999870 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:22:53.766657 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3af317b3-22b6-45b5-bff1-95e7d24e66e4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: .version_select at 0x7f7004f9d700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1072388950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiVOfwj69wy8KP6yDejclARE6uUhkjw80z3afm1STWOvm55pDpJXMclI1x1AwywuCzp045wqAgpmG/tLqV1GhSWFTnEsBGYV7Sd6Mu/jk8ToAAqJS9YQR9arOYkpSqWVA=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:53.786015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3af317b3-22b6-45b5-bff1-95e7d24e66e4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:22:53.791122 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3af317b3-22b6-45b5-bff1-95e7d24e66e4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:22:53.817199 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3af317b3-22b6-45b5-bff1-95e7d24e66e4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054670 Sep 18 02:22:53.817839 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3723/7420] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:22:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:22:59.367870 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:22:59.373387 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-873135398", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "0278798b-495a-4b11-8a46-9fca64558b4d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1072388950", "security_groups": [{"name": "tempest-secgroup-smoke-820462331"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:22:59.491334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] validate_networks() for [('0278798b-495a-4b11-8a46-9fca64558b4d', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:22:59.917988 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:22:59.918673 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:22:59.919171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:22:59.919606 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:22:59.920039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:22:59.929372 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:59.929920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:59.930378 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:59.931129 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:22:59.931626 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:22:59.932056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:22:59.951230 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:22:59.958641 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:22:59.972784 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:22:59.975268 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:23:00.026980 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-96ec10be-2516-45b8-864c-4eda8efbb559 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660927 Sep 18 02:23:00.034323 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3698/7421] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:22:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:23:00.041468 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37929e8a-1ed4-40ac-a9af-065483cbfc51 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:00.042121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37929e8a-1ed4-40ac-a9af-065483cbfc51 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:00.117534 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37929e8a-1ed4-40ac-a9af-065483cbfc51 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:00.126271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37929e8a-1ed4-40ac-a9af-065483cbfc51 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1266 microversion: 2.1 time: 0.089733 Sep 18 02:23:00.126853 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3724/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:00 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:01.151607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:01.152816 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:01.160967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:01.161503 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:01.161980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:01.162695 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:01.163170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:01.163603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:01.237472 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:01.247071 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ae5b0cd2-8ae1-47f9-a172-d77d1ed0d7a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1318 microversion: 2.1 time: 0.100013 Sep 18 02:23:01.248157 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3699/7423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:01 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:23:02.272862 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:02.273471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:02.275603 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=17 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:02.285729 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:02.286438 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:02.287063 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:02.287949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:02.288563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:02.289154 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:02.480483 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:02.488845 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5f5fc441-1125-4f2d-80be-3dafc14da9ca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1391 microversion: 2.1 time: 0.219718 Sep 18 02:23:02.490143 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3725/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:02 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:02.903926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5fa6237b-d2c0-4786-8e76-480eb82cc0f6 req-74c3b749-535e-46e5-a667-31e6d04575b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b457a046-c22a-4446-9fa6-0ba6a0e3c23e", "tag": "fe624ee8-613f-4927-ad99-9be85e6d4755"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:23:02.916897 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5fa6237b-d2c0-4786-8e76-480eb82cc0f6 req-74c3b749-535e-46e5-a667-31e6d04575b3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:02.917581 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5fa6237b-d2c0-4786-8e76-480eb82cc0f6 req-74c3b749-535e-46e5-a667-31e6d04575b3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:02.918050 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5fa6237b-d2c0-4786-8e76-480eb82cc0f6 req-74c3b749-535e-46e5-a667-31e6d04575b3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:02.932842 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5fa6237b-d2c0-4786-8e76-480eb82cc0f6 req-74c3b749-535e-46e5-a667-31e6d04575b3 service nova] Creating event network-changed:fe624ee8-613f-4927-ad99-9be85e6d4755 for instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e on n-h2-master-1 Sep 18 02:23:02.939562 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5fa6237b-d2c0-4786-8e76-480eb82cc0f6 req-74c3b749-535e-46e5-a667-31e6d04575b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040206 Sep 18 02:23:02.940537 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3700/7425] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:23:03.514436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:03.515048 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:03.522208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:03.522699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:03.523144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:03.523840 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:03.524298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:03.524722 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:03.671432 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:03.679372 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8c0753ff-b2e8-4d02-8fe3-0634d5e6c9f0 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1391 microversion: 2.1 time: 0.168760 Sep 18 02:23:03.679961 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3726/7426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:03 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:04.704711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:04.705578 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:04.715002 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:04.715649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:04.716101 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:04.717072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:04.718057 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:04.718500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:04.856830 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:04.865301 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0cf161a7-4942-45db-8e69-1d0c45a9fe14 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1391 microversion: 2.1 time: 0.166642 Sep 18 02:23:04.865917 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3701/7427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:04 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:05.888655 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:05.889267 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:05.896621 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:05.897093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:05.897524 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:05.898231 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:05.898682 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:05.899102 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:06.033053 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:06.041152 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e79ea0ab-fd67-4a1f-9145-e76834ea3528 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1391 microversion: 2.1 time: 0.156450 Sep 18 02:23:06.041750 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3727/7428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:05 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:07.065525 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:07.066256 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:07.073643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:07.074155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:07.074716 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:07.075342 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:07.075820 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:07.076262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:07.232103 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:07.242734 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4403c8d2-f8c0-43b6-81d1-c9fa046fa84d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1391 microversion: 2.1 time: 0.181925 Sep 18 02:23:07.243327 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3702/7429] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:07 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:23:08.266671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:08.267294 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:08.274234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:08.274720 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:08.275160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:08.275854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:08.276315 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:08.276739 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:08.411320 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:08.419002 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-8182c8e6-9048-476a-8c8c-6e3c5405a013 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1391 microversion: 2.1 time: 0.156294 Sep 18 02:23:08.419578 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3728/7430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:08 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:09.020895 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-eac5398f-24e5-45ea-8bd0-6c1c1c9975cd req-8a6cbde5-ed3b-4568-bbb4-88d96d949e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b457a046-c22a-4446-9fa6-0ba6a0e3c23e", "name": "network-vif-plugged", "status": "completed", "tag": "fe624ee8-613f-4927-ad99-9be85e6d4755"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:23:09.033593 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-eac5398f-24e5-45ea-8bd0-6c1c1c9975cd req-8a6cbde5-ed3b-4568-bbb4-88d96d949e1b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:09.034521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-eac5398f-24e5-45ea-8bd0-6c1c1c9975cd req-8a6cbde5-ed3b-4568-bbb4-88d96d949e1b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:09.038234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-eac5398f-24e5-45ea-8bd0-6c1c1c9975cd req-8a6cbde5-ed3b-4568-bbb4-88d96d949e1b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:09.047175 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-eac5398f-24e5-45ea-8bd0-6c1c1c9975cd req-8a6cbde5-ed3b-4568-bbb4-88d96d949e1b service nova] Creating event network-vif-plugged:fe624ee8-613f-4927-ad99-9be85e6d4755 for instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e on n-h2-master-1 Sep 18 02:23:09.052426 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-eac5398f-24e5-45ea-8bd0-6c1c1c9975cd req-8a6cbde5-ed3b-4568-bbb4-88d96d949e1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035224 Sep 18 02:23:09.053416 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3703/7431] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:23:09.442436 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:09.442964 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:09.449880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:09.450366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:09.450808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:09.451506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:09.451966 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:09.452396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:09.598037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:09.605893 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4a0624bd-5f8b-4f96-a1e6-1df7f07ba07c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1391 microversion: 2.1 time: 0.167380 Sep 18 02:23:09.606479 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3729/7432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:09 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:10.630210 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:10.630934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:10.633172 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:10.633859 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:10.641432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:10.641955 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:10.642402 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:10.643107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:10.643574 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:10.644007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:10.776702 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:10.784626 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d0389eb6-5e29-439d-93f4-a5a9c187380c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1563 microversion: 2.1 time: 0.158711 Sep 18 02:23:10.785213 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3704/7433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:10 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:10.806663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:10.807272 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:10.809129 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:10.810630 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:10.817001 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:10.817479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:10.817962 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:10.818644 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:10.819092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:10.819525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:10.960440 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:10.968523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11700e3a-58a4-43ea-86b5-ee22256c2395 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1563 microversion: 2.1 time: 0.165661 Sep 18 02:23:10.969154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3730/7434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:10 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:12.721530 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:12.722415 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:12.731094 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:12.732089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:12.732869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:12.734300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:12.734930 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:12.735776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:12.780993 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-c5b4cb50-e0cb-418d-ad8a-9665ad3f26a9 req-b0b67055-8ca2-4aec-a6d1-1d98ae0c1c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b457a046-c22a-4446-9fa6-0ba6a0e3c23e", "tag": "fe624ee8-613f-4927-ad99-9be85e6d4755"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:23:12.791163 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5b4cb50-e0cb-418d-ad8a-9665ad3f26a9 req-b0b67055-8ca2-4aec-a6d1-1d98ae0c1c10 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:12.791767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5b4cb50-e0cb-418d-ad8a-9665ad3f26a9 req-b0b67055-8ca2-4aec-a6d1-1d98ae0c1c10 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:12.792263 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-c5b4cb50-e0cb-418d-ad8a-9665ad3f26a9 req-b0b67055-8ca2-4aec-a6d1-1d98ae0c1c10 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:12.804355 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-c5b4cb50-e0cb-418d-ad8a-9665ad3f26a9 req-b0b67055-8ca2-4aec-a6d1-1d98ae0c1c10 service nova] Creating event network-changed:fe624ee8-613f-4927-ad99-9be85e6d4755 for instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e on n-h2-master-1 Sep 18 02:23:12.809720 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-c5b4cb50-e0cb-418d-ad8a-9665ad3f26a9 req-b0b67055-8ca2-4aec-a6d1-1d98ae0c1c10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145575 Sep 18 02:23:12.810595 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3731/7435] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:23:12.882297 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:12.891889 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-662c238c-5752-4094-bbdd-b1e1423e5957 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1563 microversion: 2.1 time: 0.234690 Sep 18 02:23:12.893269 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3705/7436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:12 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1563 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:34.171637 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:34.172372 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=38 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:34.177719 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:23:34.180022 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:34.187045 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:34.187533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:34.188088 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:34.188796 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:34.189255 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:34.189742 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:34.262487 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f6b55733-0b90-4b81-a7e3-f6f350a44b82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action" status: 200 len: 24555 microversion: 2.1 time: 0.092717 Sep 18 02:23:34.263333 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3732/7437] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:23:34 2022] POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action => generated 24555 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:23:45.353961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f1afa923-3ded-4b2a-b42f-fbc207ffdd36 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:23:45.356422 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:45.357233 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=36 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:45.362936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1afa923-3ded-4b2a-b42f-fbc207ffdd36 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:45.363439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1afa923-3ded-4b2a-b42f-fbc207ffdd36 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:45.364357 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f1afa923-3ded-4b2a-b42f-fbc207ffdd36 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:45.390996 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f1afa923-3ded-4b2a-b42f-fbc207ffdd36 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Going to try to stop instance {{(pid=122373) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 02:23:45.437089 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f1afa923-3ded-4b2a-b42f-fbc207ffdd36 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action" status: 202 len: 0 microversion: 2.1 time: 0.086917 Sep 18 02:23:45.437988 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3706/7438] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:23:45 2022] POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:23:45.448311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:45.450103 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:45.452980 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:45.453677 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:23:45.460230 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:45.460735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:45.461169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:45.467342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:45.467342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:45.467342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:45.609300 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:45.617943 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8f466f2-d263-4fa6-ba01-f3cdfb2ebf80 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.174439 Sep 18 02:23:45.618531 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3733/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:45 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:46.647532 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:46.648308 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:46.654510 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:46.655003 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:46.655450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:46.656150 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:46.656643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:46.657076 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:46.790239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:46.798357 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2612b04-0712-4b1f-a44c-ac3f6e47d5b5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.156073 Sep 18 02:23:46.798931 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3707/7440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:46 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:47.822447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:47.823342 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:47.830353 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:47.830842 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:47.831287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:47.832634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:47.833094 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:47.833526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:47.976675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:47.984941 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-42186a32-96cc-4d2f-8b38-80a42f839672 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.166496 Sep 18 02:23:47.985517 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3734/7441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:47 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:49.008868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:49.009488 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:49.016410 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:49.016903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:49.017349 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:49.018093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:49.018573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:49.018991 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:49.150344 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:49.158102 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0f8c232c-d09b-4dd4-8c2c-e680c7ccf55a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.153430 Sep 18 02:23:49.158681 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3708/7442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:49 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:50.182975 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:50.183523 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:50.190286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:50.190762 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:50.191349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:50.192711 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:50.193165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:50.193614 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:50.326524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:50.334397 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a85cc952-7165-4031-b7f5-8fc19d03cc0c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.155429 Sep 18 02:23:50.334977 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3735/7443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:50 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:51.358163 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:51.358800 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:51.366492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:51.366986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:51.367431 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:51.368135 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:51.368601 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:51.369034 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:51.503124 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:51.511566 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d60b26f0-4345-4c3e-be68-0d9b1c89639b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.157349 Sep 18 02:23:51.512143 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3709/7444] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:51 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:23:52.534877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:52.535955 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:52.542958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:52.543436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:52.543863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:52.544586 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:52.545034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:52.545453 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:52.674559 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:52.682992 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c25d93a3-8319-4fa4-82e4-e5bc1872f315 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.152112 Sep 18 02:23:52.683560 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3736/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:52 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:53.705943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:53.706570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:53.714540 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:53.715048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:53.715532 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:53.716252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:53.716755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:53.717201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:53.851624 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:53.859619 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-981b5ce4-3e3b-440b-a090-81c67ea077b8 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.157604 Sep 18 02:23:53.860211 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3710/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:53 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:54.884625 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:54.885240 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:54.891288 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:54.891775 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:54.892219 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:54.892913 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:54.893371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:54.893839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:55.030163 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:55.037998 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83899a3e-f1bd-438f-a6cf-62d52af8306a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.158906 Sep 18 02:23:55.038581 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3737/7447] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:54 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:56.061897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:56.062534 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:56.069926 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:56.070432 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:56.070893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:56.071604 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:56.072082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:56.072527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:56.556132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:56.563916 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5714b54f-2209-4b32-b13a-0310f3c1055a tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.506138 Sep 18 02:23:56.564504 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3711/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:56 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:57.587883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:57.588499 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:57.595428 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:57.595915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:57.596360 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:57.597050 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:57.597505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:57.598629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:57.731150 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:57.738903 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-40389c44-8a51-4ea9-83a4-3592723e9ff2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.154954 Sep 18 02:23:57.739484 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3738/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:57 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:58.762478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:58.763110 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:58.770660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:58.771160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:58.771609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:58.772322 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:58.772789 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:58.773229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:58.925025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:23:58.933399 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-498474bb-9fa7-41df-9be3-ed3f8da68ffb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.174950 Sep 18 02:23:58.934010 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3712/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:58 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:23:59.957911 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:23:59.958519 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:23:59.965317 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:59.965823 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:59.966254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:23:59.966935 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:23:59.967383 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:23:59.967803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:00.096568 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:00.104246 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-4871d742-d7d6-4080-98a6-f4c3bec5b804 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1692 microversion: 2.1 time: 0.150872 Sep 18 02:24:00.104813 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3739/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:23:59 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:01.127840 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:01.128514 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:01.135645 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:01.136145 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:01.136623 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:01.137331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:01.137832 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:01.138273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:01.272966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:01.282046 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-38b9f25f-2869-4331-a607-bbfd6f3a2fdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1669 microversion: 2.1 time: 0.158261 Sep 18 02:24:01.282621 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3713/7452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:01 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:02.374566 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:02.377120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:02.384480 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:02.384952 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:02.385380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:02.386092 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:02.386540 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:02.386960 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:02.448660 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2e1a7533-b3c2-40ac-b6a3-fae307801aca tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action" status: 200 len: 38414 microversion: 2.1 time: 0.077754 Sep 18 02:24:02.449357 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3740/7453] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:24:02 2022] POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action => generated 38414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:24:02.461334 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ec8e84f7-d78b-4eee-87a0-0a586deb6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:02.468321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec8e84f7-d78b-4eee-87a0-0a586deb6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:02.468825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec8e84f7-d78b-4eee-87a0-0a586deb6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:02.469286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec8e84f7-d78b-4eee-87a0-0a586deb6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:02.492376 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ec8e84f7-d78b-4eee-87a0-0a586deb6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Going to try to start instance {{(pid=122373) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 02:24:02.534013 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ec8e84f7-d78b-4eee-87a0-0a586deb6b73 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action" status: 202 len: 0 microversion: 2.1 time: 0.076236 Sep 18 02:24:02.534558 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3714/7454] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:24:02 2022] POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:24:02.548212 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:02.548919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:02.556965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:02.557481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:02.557947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:02.558658 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:02.559113 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:02.559557 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:02.700277 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:02.708870 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a6391b8-5577-402a-8017-c6162b30b3c1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1678 microversion: 2.1 time: 0.164840 Sep 18 02:24:02.709463 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3741/7455] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:02 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:03.735093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:03.735827 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:03.742765 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:03.743267 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:03.743723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:03.744453 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:03.744923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:03.745364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:03.886096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:03.894056 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f46a76f1-8c0d-4718-84d1-f9de2e898d01 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1678 microversion: 2.1 time: 0.164245 Sep 18 02:24:03.894651 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3715/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:03 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:04.918749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:04.919394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:04.927157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:04.927703 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:04.928144 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:04.928843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:04.929613 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:04.930049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:05.059642 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:05.068117 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b2bae2cc-0a5c-449d-8104-7432a8bb91a3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1682 microversion: 2.1 time: 0.153372 Sep 18 02:24:05.068688 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3742/7457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:04 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:29.257729 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:29.260132 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:29.262502 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=20 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:24:29.263263 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:24:29.269391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:29.269923 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:29.270376 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:29.271090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:29.271557 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:29.271992 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:29.343468 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c9ba727-e28c-4cfd-9457-6f5b0b36d699 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action" status: 200 len: 62972 microversion: 2.1 time: 0.089936 Sep 18 02:24:29.344256 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3716/7458] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:24:29 2022] POST /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e/action => generated 62972 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 02:24:36.719798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:36.720311 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:36.723100 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=20 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:24:36.723770 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=58 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:24:36.730357 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-2d428d2b-328c-440b-87ca-193dc4c3b338 req-aa4914ad-b823-480a-aac7-768cab47206c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b457a046-c22a-4446-9fa6-0ba6a0e3c23e", "tag": "fe624ee8-613f-4927-ad99-9be85e6d4755"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:36.737848 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:24:36.738030 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e (ip 10.222.0.25) !!! Sep 18 02:24:36.745450 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2d428d2b-328c-440b-87ca-193dc4c3b338 req-aa4914ad-b823-480a-aac7-768cab47206c service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:36.745986 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2d428d2b-328c-440b-87ca-193dc4c3b338 req-aa4914ad-b823-480a-aac7-768cab47206c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:36.746434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-2d428d2b-328c-440b-87ca-193dc4c3b338 req-aa4914ad-b823-480a-aac7-768cab47206c service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:36.755619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:36.756274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:36.757714 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:36.758520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:36.759093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:36.759326 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-2d428d2b-328c-440b-87ca-193dc4c3b338 req-aa4914ad-b823-480a-aac7-768cab47206c service nova] Creating event network-changed:fe624ee8-613f-4927-ad99-9be85e6d4755 for instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e on n-h2-master-1 Sep 18 02:24:36.759870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:36.764449 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-2d428d2b-328c-440b-87ca-193dc4c3b338 req-aa4914ad-b823-480a-aac7-768cab47206c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038145 Sep 18 02:24:36.765123 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3717/7459] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:24:36.800322 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:24:36.896271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-882f5f48-f7d6-4ff5-be91-df083385235f tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 204 len: 0 microversion: 2.1 time: 0.180166 Sep 18 02:24:36.896880 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3743/7460] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:24:36 2022] DELETE /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:24:36.911093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:36.911982 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:36.919227 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:36.919736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:36.920186 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:36.920903 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:36.921367 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:36.921969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:37.136212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:37.144522 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ff39984d-6b4d-41f3-8fb4-e84e64259598 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1688 microversion: 2.1 time: 0.238501 Sep 18 02:24:37.145103 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3718/7461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:36 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1688 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:38.170426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:38.171067 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:38.178494 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:38.179033 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:38.179465 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:38.180157 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:38.180601 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:38.181013 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:38.383037 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:38.392159 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a3f921e4-b610-4d40-8554-92b675782bbb tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1688 microversion: 2.1 time: 0.226138 Sep 18 02:24:38.392755 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3744/7462] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:38 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:39.417288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:39.423199 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:39.430769 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:39.431213 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:39.431748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:39.432395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:39.432828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:39.433264 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:39.511020 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-79ee4522-ccd4-450c-b535-9a13530f0e05 req-70945977-497f-484f-9a29-8a13fb04d8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b457a046-c22a-4446-9fa6-0ba6a0e3c23e", "name": "network-vif-deleted", "tag": "fe624ee8-613f-4927-ad99-9be85e6d4755"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:39.519171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:39.521756 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-79ee4522-ccd4-450c-b535-9a13530f0e05 req-70945977-497f-484f-9a29-8a13fb04d8e6 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:39.522971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-79ee4522-ccd4-450c-b535-9a13530f0e05 req-70945977-497f-484f-9a29-8a13fb04d8e6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:39.523599 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-79ee4522-ccd4-450c-b535-9a13530f0e05 req-70945977-497f-484f-9a29-8a13fb04d8e6 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:39.535380 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a636fade-3ba3-4ff9-9857-cadddc803033 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 200 len: 1502 microversion: 2.1 time: 0.122267 Sep 18 02:24:39.536577 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3719/7463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:39 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 1502 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:39.539090 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-79ee4522-ccd4-450c-b535-9a13530f0e05 req-70945977-497f-484f-9a29-8a13fb04d8e6 service nova] Creating event network-vif-deleted:fe624ee8-613f-4927-ad99-9be85e6d4755 for instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e on n-h2-master-1 Sep 18 02:24:39.550666 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-79ee4522-ccd4-450c-b535-9a13530f0e05 req-70945977-497f-484f-9a29-8a13fb04d8e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047394 Sep 18 02:24:39.551490 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3745/7464] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:24:40.560766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:40.561315 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: b457a046-c22a-4446-9fa6-0ba6a0e3c23e] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:40.568112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:40.568606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:40.569603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:40.570301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:40.570767 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:40.571200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:40.584448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] HTTP exception thrown: Instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e could not be found. Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Request method failure captured: Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e HTTP/1.1 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJn_ioP4JgVXfvFlCB-Kdu8mRDjmTzH2sU1xUbGwF_sSq7AAskhOBFuFvc46OYAYb2RZyoocrEzPfX_JtYwoHj3QcB7ZNnoxgNH9ZHrUhcZuKrSRH1GI8w34liVw78ifXBxEGcRKtbiKkhAFuhcbznGVL98cmAffSmlSJ4E6cy0ZO_tI Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: b29f937843f141eeb3edc89594fcddca Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: exception: Instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e could not be found. Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'b457a046-c22a-4446-9fa6-0ba6a0e3c23e'} Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e could not be found. Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e could not be found. Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:24:40.586722 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e could not be found. Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Returning 404 to user: Instance b457a046-c22a-4446-9fa6-0ba6a0e3c23e could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3eef40c6-87d3-4182-a579-7f3772833466 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e" status: 404 len: 111 microversion: 2.1 time: 0.031597 Sep 18 02:24:40.591717 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3720/7465] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:40 2022] GET /compute/v2.1/servers/b457a046-c22a-4446-9fa6-0ba6a0e3c23e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:24:43.563800 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c9a1731a-f3d0-4ea5-8238-1759e5af5654 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '.version_select at 0x7f7004eddb80>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:43.588240 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c9a1731a-f3d0-4ea5-8238-1759e5af5654 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072388950" status: 202 len: 0 microversion: 2.1 time: 0.029567 Sep 18 02:24:43.588841 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3746/7466] 10.222.0.25 () {58 vars in 1284 bytes} [Sun Sep 18 02:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072388950 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:24:43.623101 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c4a5e7cb-6626-459f-9224-ccb532cd428b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: .version_select at 0x7f70050d5280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-35331887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk/zq8nGXX/Zw4Xy8+laZ1kkgtxYbJFVCpgDifrHb46TjKz/lxkTbVeYBPMoAIiZFB1U2u98AfVHdKMHDMHefH4qolZppGbP8Nx+1yl9e57PemqYu3uI28eqpMqGyzfkQ=="}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:43.642780 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c4a5e7cb-6626-459f-9224-ccb532cd428b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:24:43.650307 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-c4a5e7cb-6626-459f-9224-ccb532cd428b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'key_pairs'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:24:43.676208 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c4a5e7cb-6626-459f-9224-ccb532cd428b tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.057189 Sep 18 02:24:43.676822 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3721/7467] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:24:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:24:49.700190 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:24:49.704513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1073154605", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "networks": [{"uuid": "202bd623-3f67-43dc-b357-fc9029deb224"}], "key_name": "tempest-TestNetworkAdvancedServerOps-35331887", "security_groups": [{"name": "tempest-secgroup-smoke-472260559"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:49.826308 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] validate_networks() for [('202bd623-3f67-43dc-b357-fc9029deb224', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:24:50.236634 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:24:50.237055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:24:50.237531 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:24:50.237962 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:24:50.238371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:24:50.248284 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:50.248769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:50.249205 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:50.249964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:50.250436 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:50.250850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:50.269867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:24:50.275275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Getting quotas for user b29f937843f141eeb3edc89594fcddca and project fdea448ce1ca40dab29c357a902fe244. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:24:50.288325 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:24:50.290753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:24:50.343389 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6f2ea514-56ba-4da3-8d70-b84ee640d332 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.645272 Sep 18 02:24:50.344360 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3747/7468] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:24:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:24:50.356995 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f8fc6501-30b9-4e90-b2e8-b56692edce02 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:50.358459 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f8fc6501-30b9-4e90-b2e8-b56692edce02 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:50.415814 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-f8fc6501-30b9-4e90-b2e8-b56692edce02 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:50.423356 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f8fc6501-30b9-4e90-b2e8-b56692edce02 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1265 microversion: 2.1 time: 0.070732 Sep 18 02:24:50.424271 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3722/7469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:50 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:24:51.448856 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9a915e7d-e45e-4d76-997d-8a55cb136af3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:51.450143 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9a915e7d-e45e-4d76-997d-8a55cb136af3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:51.510033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9a915e7d-e45e-4d76-997d-8a55cb136af3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:51.517123 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9a915e7d-e45e-4d76-997d-8a55cb136af3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1265 microversion: 2.1 time: 0.072363 Sep 18 02:24:51.529663 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3748/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:51 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:52.541407 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3e68fe8-8ef6-49fb-8370-c251e96ecd70 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:52.542004 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3e68fe8-8ef6-49fb-8370-c251e96ecd70 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:52.544035 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=20 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:24:52.613123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3e68fe8-8ef6-49fb-8370-c251e96ecd70 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:52.620827 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3e68fe8-8ef6-49fb-8370-c251e96ecd70 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1265 microversion: 2.1 time: 0.084266 Sep 18 02:24:52.621414 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3723/7471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:52 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:53.644275 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7ae15a26-6422-4d0f-886d-638b052c9322 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:53.644892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7ae15a26-6422-4d0f-886d-638b052c9322 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:53.699983 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7ae15a26-6422-4d0f-886d-638b052c9322 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:53.707404 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7ae15a26-6422-4d0f-886d-638b052c9322 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1265 microversion: 2.1 time: 0.067007 Sep 18 02:24:53.707977 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3749/7472] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:53 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:54.731173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:54.732044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:54.738788 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:54.739284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:54.739756 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:54.740506 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:54.741005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:54.741441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:54.802688 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:54.810447 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-afd84759-9cba-4562-81b0-ae5d27e2b51d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1269 microversion: 2.1 time: 0.083731 Sep 18 02:24:54.811025 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3724/7473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:54 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:55.833951 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:55.835076 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:55.842767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:55.843254 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:55.843692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:55.844395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:55.844849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:55.845274 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:55.907579 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:55.917308 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-9fedc4e5-9363-463c-aabd-bf803d4431d3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1323 microversion: 2.1 time: 0.087373 Sep 18 02:24:55.918260 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3750/7474] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:55 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1323 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:56.942362 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:56.943123 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:56.950298 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:56.950911 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:56.951439 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:56.952219 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:56.952766 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:56.953281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:56.984877 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-96119cb1-9121-438e-be1a-8f14cbeab7f1 req-f6297b5d-7ca9-4d91-b194-d343bab496b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0381a659-7f42-4a34-9eaf-4e59ebf3fee2", "tag": "90698381-dca8-4fc8-af7d-d73928835676"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:24:57.032385 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-96119cb1-9121-438e-be1a-8f14cbeab7f1 req-f6297b5d-7ca9-4d91-b194-d343bab496b8 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:57.033286 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-96119cb1-9121-438e-be1a-8f14cbeab7f1 req-f6297b5d-7ca9-4d91-b194-d343bab496b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:57.033945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-96119cb1-9121-438e-be1a-8f14cbeab7f1 req-f6297b5d-7ca9-4d91-b194-d343bab496b8 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:57.048807 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-96119cb1-9121-438e-be1a-8f14cbeab7f1 req-f6297b5d-7ca9-4d91-b194-d343bab496b8 service nova] Creating event network-changed:90698381-dca8-4fc8-af7d-d73928835676 for instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 on n-h1-master-1 Sep 18 02:24:57.061102 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-96119cb1-9121-438e-be1a-8f14cbeab7f1 req-f6297b5d-7ca9-4d91-b194-d343bab496b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081474 Sep 18 02:24:57.064838 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3751/7475] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:24:57.129975 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:57.140336 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d3ec1169-c7fc-4909-ad32-de864cdcdcc1 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1390 microversion: 2.1 time: 0.203644 Sep 18 02:24:57.140944 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3725/7476] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:56 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:58.165711 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:58.166406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:58.172692 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:58.173208 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:58.173699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:58.174559 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:58.175034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:58.175520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:58.313140 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:58.321281 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b02d7287-6a46-4192-bc27-e090e0613360 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1390 microversion: 2.1 time: 0.161231 Sep 18 02:24:58.321873 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3752/7477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:58 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:24:59.344457 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:24:59.345142 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:24:59.347816 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:24:59.354162 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:59.354634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:59.355079 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:59.355780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:24:59.356246 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:24:59.356682 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:24:59.493723 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:24:59.501397 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-54ae4963-0a5d-479a-afd8-9850e0994bbf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1390 microversion: 2.1 time: 0.161036 Sep 18 02:24:59.501998 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3726/7478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:24:59 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:00.525457 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:00.526126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:00.528969 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:25:00.534999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:00.535487 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:00.535926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:00.536628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:00.537128 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:00.537584 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:00.675793 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:00.685783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-836ee8ca-feea-45d3-af66-d8d416d1fe82 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1390 microversion: 2.1 time: 0.164308 Sep 18 02:25:00.686384 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3753/7479] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:00 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:01.710206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:01.710822 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:01.717726 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:01.718225 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:01.718679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:01.719381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:01.719949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:01.720388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:01.853186 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:01.861077 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ecb0437f-58ee-49d5-80e0-fd59a17c8489 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1390 microversion: 2.1 time: 0.155473 Sep 18 02:25:01.861676 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3727/7480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:01 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:25:02.846892 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-67c3c590-8fda-4618-89b6-eb812fd63fad req-a817ad8a-673d-45d6-bd12-486fe8a2b723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0381a659-7f42-4a34-9eaf-4e59ebf3fee2", "name": "network-vif-plugged", "status": "completed", "tag": "90698381-dca8-4fc8-af7d-d73928835676"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:02.858296 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67c3c590-8fda-4618-89b6-eb812fd63fad req-a817ad8a-673d-45d6-bd12-486fe8a2b723 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:02.858685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67c3c590-8fda-4618-89b6-eb812fd63fad req-a817ad8a-673d-45d6-bd12-486fe8a2b723 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:02.859108 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-67c3c590-8fda-4618-89b6-eb812fd63fad req-a817ad8a-673d-45d6-bd12-486fe8a2b723 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:02.870547 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-67c3c590-8fda-4618-89b6-eb812fd63fad req-a817ad8a-673d-45d6-bd12-486fe8a2b723 service nova] Creating event network-vif-plugged:90698381-dca8-4fc8-af7d-d73928835676 for instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 on n-h1-master-1 Sep 18 02:25:02.875647 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-67c3c590-8fda-4618-89b6-eb812fd63fad req-a817ad8a-673d-45d6-bd12-486fe8a2b723 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032489 Sep 18 02:25:02.876259 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3754/7481] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:25:02.884674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:02.885313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:02.887289 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=8 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:25:02.893262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:02.893793 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:02.894335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:02.895047 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:02.895511 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:02.895946 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:03.041817 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:03.049664 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1107219a-d921-4ad0-834e-b73209328e6c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1390 microversion: 2.1 time: 0.169286 Sep 18 02:25:03.050269 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3728/7482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:02 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:04.069747 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=10 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:25:04.074717 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:04.075458 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:04.082275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:04.082761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:04.083198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:04.084422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:04.084880 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:04.085311 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:04.231367 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:04.239168 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-af951365-2bfb-4d77-ab51-28580f1239d2 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1562 microversion: 2.1 time: 0.170471 Sep 18 02:25:04.239747 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3755/7483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:04 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:25:04.261753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:04.262377 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:04.269121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:04.269677 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:04.270132 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:04.270857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:04.271882 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:04.272317 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:04.408875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:04.417428 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ef72e4d6-41b4-48b5-a58b-f717d2fa0c05 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1562 microversion: 2.1 time: 0.159856 Sep 18 02:25:04.418035 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3729/7484] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:04 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:06.339170 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:06.340032 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:06.343507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-dce850c4-6c78-4b4c-b204-ed801e0698ad req-02eae872-58e7-47c7-b3a3-aecf1a2da9dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0381a659-7f42-4a34-9eaf-4e59ebf3fee2", "tag": "90698381-dca8-4fc8-af7d-d73928835676"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:06.348066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:06.348870 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:06.350541 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:06.352198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:06.352769 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:06.353279 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:06.354589 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dce850c4-6c78-4b4c-b204-ed801e0698ad req-02eae872-58e7-47c7-b3a3-aecf1a2da9dc service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:06.355083 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dce850c4-6c78-4b4c-b204-ed801e0698ad req-02eae872-58e7-47c7-b3a3-aecf1a2da9dc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:06.355533 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-dce850c4-6c78-4b4c-b204-ed801e0698ad req-02eae872-58e7-47c7-b3a3-aecf1a2da9dc service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:06.373286 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-dce850c4-6c78-4b4c-b204-ed801e0698ad req-02eae872-58e7-47c7-b3a3-aecf1a2da9dc service nova] Creating event network-changed:90698381-dca8-4fc8-af7d-d73928835676 for instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 on n-h1-master-1 Sep 18 02:25:06.379599 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-dce850c4-6c78-4b4c-b204-ed801e0698ad req-02eae872-58e7-47c7-b3a3-aecf1a2da9dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039686 Sep 18 02:25:06.380686 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3730/7485] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:25:06.492664 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:06.501010 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74eddf35-626f-4536-ab5d-c3bef3bd4248 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1562 microversion: 2.1 time: 0.166178 Sep 18 02:25:06.501606 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3756/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:06 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:29.751318 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:29.753695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:29.756885 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=9 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:25:29.757869 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=38 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:25:29.764024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:29.764524 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:29.764978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:29.765728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:29.766201 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:29.766636 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:29.835612 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47219ca7-b9b3-4798-ba92-e0499672fdc6 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action" status: 200 len: 24574 microversion: 2.1 time: 0.087723 Sep 18 02:25:29.836515 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3731/7487] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:25:29 2022] POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action => generated 24574 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 02:25:36.275429 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:36.276033 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:36.278189 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:25:36.278855 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=36 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:25:36.285032 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:36.285522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:36.285991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:36.286699 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:36.287166 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:36.287618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:36.312447 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lazy-loading 'flavor' on Instance uuid 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:25:36.379227 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-986d20d1-0f01-46d3-ba1b-2c996d7f8bc4 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action" status: 202 len: 0 microversion: 2.1 time: 0.108241 Sep 18 02:25:36.379811 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3757/7488] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:25:36 2022] POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:25:36.389517 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:36.390254 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:36.397650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:36.398143 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:36.398595 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:36.399303 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:36.399772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:36.400204 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:36.532485 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:36.540658 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c884b295-914f-4bdf-a5fb-930da996bbdd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1688 microversion: 2.1 time: 0.155424 Sep 18 02:25:36.541229 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3732/7489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:36 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:37.566497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:37.567198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:37.574282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:37.574760 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:37.575198 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:37.575885 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:37.576336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:37.576757 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:37.719047 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:37.727308 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f108f1be-44b6-46f9-8e37-079445d1f25d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1671 microversion: 2.1 time: 0.165126 Sep 18 02:25:37.727880 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3758/7490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:37 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:38.820866 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:38.823086 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:38.830777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:38.831276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:38.831728 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:38.832443 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:38.832915 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:38.833355 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:38.894064 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ee205a50-e232-404c-8a18-7b09dfeb3f49 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action" status: 200 len: 35327 microversion: 2.1 time: 0.077600 Sep 18 02:25:38.894783 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3733/7491] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:25:38 2022] POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action => generated 35327 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:25:38.906555 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:38.907090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:38.914421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:38.914902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:38.915366 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:38.916061 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:38.916522 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:38.916947 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:38.982407 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-5a14cb09-50a4-4c77-b7c8-b12d6a7e80c3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action" status: 202 len: 0 microversion: 2.1 time: 0.079584 Sep 18 02:25:38.983035 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3759/7492] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:25:38 2022] POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:25:38.992958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:38.993705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:39.000521 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:39.001052 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:39.001470 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:39.002207 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:39.002708 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:39.003171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:39.145824 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:39.153762 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6b916a45-8d62-4bf5-9354-ee0d35cb61e3 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1677 microversion: 2.1 time: 0.165831 Sep 18 02:25:39.154342 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3734/7493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:38 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:40.179459 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:40.180082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:40.186228 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:40.186709 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:40.187147 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:40.187839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:40.188292 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:40.188716 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:40.318124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:40.326758 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-83b00a25-ab98-4bc8-942c-dcdeee94c874 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1677 microversion: 2.1 time: 0.152951 Sep 18 02:25:40.327337 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3760/7494] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:40 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:41.349511 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:41.350168 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:41.357423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:41.357960 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:41.358413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:41.359122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:41.359591 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:41.360027 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:41.493628 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:41.501331 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-95be8fc7-9a0c-4f91-a6db-f5c28db6f2a5 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1680 microversion: 2.1 time: 0.155717 Sep 18 02:25:41.501941 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3735/7495] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:41 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:41.599999 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:41.602219 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:41.609036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:41.609418 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:41.609891 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:41.610589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:41.611049 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:41.611476 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:41.675781 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19362d96-bce4-4eab-9b75-c5d50939012d tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action" status: 200 len: 35327 microversion: 2.1 time: 0.079758 Sep 18 02:25:41.676778 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3761/7496] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:25:41 2022] POST /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2/action => generated 35327 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 02:25:42.648269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-ca41fec5-55db-4d7f-8939-e891441ef54f req-e7767dee-3e89-4b22-bbf9-5efce3cd9d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0381a659-7f42-4a34-9eaf-4e59ebf3fee2", "tag": "90698381-dca8-4fc8-af7d-d73928835676"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:42.656537 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:42.657049 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:42.664043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:42.664333 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ca41fec5-55db-4d7f-8939-e891441ef54f req-e7767dee-3e89-4b22-bbf9-5efce3cd9d37 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:42.664550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:42.665001 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:42.665122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ca41fec5-55db-4d7f-8939-e891441ef54f req-e7767dee-3e89-4b22-bbf9-5efce3cd9d37 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:42.665424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-ca41fec5-55db-4d7f-8939-e891441ef54f req-e7767dee-3e89-4b22-bbf9-5efce3cd9d37 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:42.665802 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:42.666281 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:42.666720 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:42.676666 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-ca41fec5-55db-4d7f-8939-e891441ef54f req-e7767dee-3e89-4b22-bbf9-5efce3cd9d37 service nova] Creating event network-changed:90698381-dca8-4fc8-af7d-d73928835676 for instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 on n-h1-master-1 Sep 18 02:25:42.682128 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-ca41fec5-55db-4d7f-8939-e891441ef54f req-e7767dee-3e89-4b22-bbf9-5efce3cd9d37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038644 Sep 18 02:25:42.682759 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3762/7497] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:25:42.698585 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:25:42.794214 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f593cb11-0d8b-41e7-8f61-613e676dd943 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 204 len: 0 microversion: 2.1 time: 0.153022 Sep 18 02:25:42.795060 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3736/7498] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:25:42 2022] DELETE /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 02:25:42.804344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:42.805082 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:42.812257 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:42.812759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:42.813202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:42.813931 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:42.814396 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:42.814925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:42.951932 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:42.960589 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b685a2bd-c213-4855-a58c-bef41960ba2c tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1686 microversion: 2.1 time: 0.160988 Sep 18 02:25:42.961181 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3763/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:42 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:43.985781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:43.986498 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:43.993368 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:43.993895 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:43.994350 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:43.995054 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:43.995527 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:43.995963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:44.129738 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:44.138212 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9bf266a0-30b1-42c7-8c51-0c3bf859bcbd tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1686 microversion: 2.1 time: 0.156807 Sep 18 02:25:44.138786 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3737/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:43 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:45.115336 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-3b53368f-5c88-4ba7-a5ac-70dba81aa017 req-46f4f614-adb6-4677-8b93-1e8a18b3f76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0381a659-7f42-4a34-9eaf-4e59ebf3fee2", "name": "network-vif-deleted", "tag": "90698381-dca8-4fc8-af7d-d73928835676"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:25:45.127003 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3b53368f-5c88-4ba7-a5ac-70dba81aa017 req-46f4f614-adb6-4677-8b93-1e8a18b3f76b service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:45.127470 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3b53368f-5c88-4ba7-a5ac-70dba81aa017 req-46f4f614-adb6-4677-8b93-1e8a18b3f76b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:45.127890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-3b53368f-5c88-4ba7-a5ac-70dba81aa017 req-46f4f614-adb6-4677-8b93-1e8a18b3f76b service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:45.141053 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-3b53368f-5c88-4ba7-a5ac-70dba81aa017 req-46f4f614-adb6-4677-8b93-1e8a18b3f76b service nova] Creating event network-vif-deleted:90698381-dca8-4fc8-af7d-d73928835676 for instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 on n-h1-master-1 Sep 18 02:25:45.148183 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-3b53368f-5c88-4ba7-a5ac-70dba81aa017 req-46f4f614-adb6-4677-8b93-1e8a18b3f76b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036506 Sep 18 02:25:45.148792 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3764/7501] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:25:45.162229 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:45.162865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:45.170803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:45.171321 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:45.171781 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:45.172505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:45.173033 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:45.173753 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:45.238592 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29f937843f141eeb3edc89594fcddca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdea448ce1ca40dab29c357a902fe244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:25:45.247256 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dfd34ef9-b6bb-4f09-9a29-fba12119f4bf tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 200 len: 1350 microversion: 2.1 time: 0.089001 Sep 18 02:25:45.247958 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3738/7502] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:45 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:25:46.272546 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:46.273166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] [instance: 0381a659-7f42-4a34-9eaf-4e59ebf3fee2] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:25:46.280281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:46.280763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:46.281200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:46.281921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:25:46.282377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:25:46.282803 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:25:46.296483 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] HTTP exception thrown: Instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 could not be found. Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Request method failure captured: Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 HTTP/1.1 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJn_ioP4JgVXfvFlCB-Kdu8mRDjmTzH2sU1xUbGwF_sSq7AAskhOBFuFvc46OYAYb2RZyoocrEzPfX_JtYwoHj3QcB7ZNnoxgNH9ZHrUhcZuKrSRH1GI8w34liVw78ifXBxEGcRKtbiKkhAFuhcbznGVL98cmAffSmlSJ4E6cy0ZO_tI Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdea448ce1ca40dab29c357a902fe244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: fdea448ce1ca40dab29c357a902fe244 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-338554149 Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: b29f937843f141eeb3edc89594fcddca Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestNetworkAdvancedServerOps-338554149-project Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 could not be found. Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '0381a659-7f42-4a34-9eaf-4e59ebf3fee2'} Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 could not be found. Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 could not be found. Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:25:46.298111 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 could not be found. Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Returning 404 to user: Instance 0381a659-7f42-4a34-9eaf-4e59ebf3fee2 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a41ccb19-57a0-46db-a07a-e8b623154d92 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2" status: 404 len: 111 microversion: 2.1 time: 0.031813 Sep 18 02:25:46.302704 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3765/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:25:46 2022] GET /compute/v2.1/servers/0381a659-7f42-4a34-9eaf-4e59ebf3fee2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:25:49.982259 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4dca04b1-16aa-46e2-8ed1-7e6f790d0d29 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] Calling method '.version_select at 0x7f700521f0d0>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:25:50.008364 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4dca04b1-16aa-46e2-8ed1-7e6f790d0d29 tempest-TestNetworkAdvancedServerOps-338554149 tempest-TestNetworkAdvancedServerOps-338554149-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-35331887" status: 202 len: 0 microversion: 2.1 time: 0.029871 Sep 18 02:25:50.008891 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3739/7504] 10.222.0.25 () {58 vars in 1278 bytes} [Sun Sep 18 02:25:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-35331887 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 02:26:00.912506 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=18 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:26:00.913343 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:26:01.082971 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-afb442fe-f3dc-4dae-b466-191ce5ce9e35 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'create', calling method: .version_select at 0x7f7004e26040>, body: {"keypair": {"name": "tempest-TestShelveInstance-2031896247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfDNQEovOJZXRLdRARWJso1PWMUkTd4XX6udcQsyzfN5jg35tTsULRuvfZxtqtZgcsa1kkglB6hrA3BNghkb4npLGfHCz1pw1R98LfwdFkXnHDPImcIcQX0oPAbTSu7Jw=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:26:01.099051 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-afb442fe-f3dc-4dae-b466-191ce5ce9e35 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for project d6fccd66a6ad499083a7b46235239633. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:26:01.108222 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-afb442fe-f3dc-4dae-b466-191ce5ce9e35 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for user 38d787a341d340cd9abdb09cf377cd43 and project d6fccd66a6ad499083a7b46235239633. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:26:01.135683 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-afb442fe-f3dc-4dae-b466-191ce5ce9e35 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.228970 Sep 18 02:26:01.136225 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3766/7505] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:26:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:26:02.228910 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:26:02.229702 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:26:02.234038 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1026982565", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2031896247", "security_groups": [{"name": "tempest-secgroup-smoke-1235299153"}], "networks": [{"uuid": "eaec2d60-9c4b-44ad-8ef6-d3b08ee83fe4"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:26:02.348414 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] validate_networks() for [('eaec2d60-9c4b-44ad-8ef6-d3b08ee83fe4', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:26:02.860358 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:26:02.860804 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:26:02.861288 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:26:02.861764 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:26:02.862197 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:26:02.874528 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:02.874669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:02.875113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:02.875990 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:02.876959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:02.877592 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:02.902868 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for project d6fccd66a6ad499083a7b46235239633. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:26:02.909859 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for user 38d787a341d340cd9abdb09cf377cd43 and project d6fccd66a6ad499083a7b46235239633. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:26:02.923724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:26:02.926363 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:26:02.972546 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [730c7e74-21c9-4893-a0e7-8445aa48eb7d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 02:26:03.980561 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [730c7e74-21c9-4893-a0e7-8445aa48eb7d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41620. Sep 18 02:26:03.985373 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3c75aaf6-d872-4b9d-9248-b8887ab31aa4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.759572 Sep 18 02:26:03.986075 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3740/7506] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:26:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:26:03.998304 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c049a1de-96d9-4718-ab49-089b1fb27a7d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:03.998920 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c049a1de-96d9-4718-ab49-089b1fb27a7d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:04.084648 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c049a1de-96d9-4718-ab49-089b1fb27a7d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:04.095059 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c049a1de-96d9-4718-ab49-089b1fb27a7d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1247 microversion: 2.1 time: 0.101055 Sep 18 02:26:04.096072 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3767/7507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:03 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1247 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:05.119399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:05.120161 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:05.133400 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:05.133936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:05.134386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:05.135112 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:05.135582 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:05.136021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:05.211790 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:05.220676 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2f590a17-037f-4610-b515-bc517a45848c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1299 microversion: 2.1 time: 0.105960 Sep 18 02:26:05.221679 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3741/7508] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:05 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:06.251614 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:06.252734 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:06.263002 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:06.263505 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:06.263961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:06.264930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:06.265394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:06.265852 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:06.447246 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:06.456117 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ad6c3b1e-2842-40af-b189-c8cb745e2278 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1373 microversion: 2.1 time: 0.211060 Sep 18 02:26:06.456949 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3768/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:06 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:06.994697 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-8ddbd47e-56a1-4886-8463-c4b76ce810f8 req-c51acab1-32d2-4b67-b5f3-8fe2680e8018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:26:07.009740 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8ddbd47e-56a1-4886-8463-c4b76ce810f8 req-c51acab1-32d2-4b67-b5f3-8fe2680e8018 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:07.010232 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8ddbd47e-56a1-4886-8463-c4b76ce810f8 req-c51acab1-32d2-4b67-b5f3-8fe2680e8018 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:07.010679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-8ddbd47e-56a1-4886-8463-c4b76ce810f8 req-c51acab1-32d2-4b67-b5f3-8fe2680e8018 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:07.023202 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-8ddbd47e-56a1-4886-8463-c4b76ce810f8 req-c51acab1-32d2-4b67-b5f3-8fe2680e8018 service nova] Creating event network-changed:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h2-master-1 Sep 18 02:26:07.028920 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-8ddbd47e-56a1-4886-8463-c4b76ce810f8 req-c51acab1-32d2-4b67-b5f3-8fe2680e8018 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038531 Sep 18 02:26:07.029639 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3742/7510] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:26:07.480944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:07.481574 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:07.488726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:07.489200 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:07.490272 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:07.490969 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:07.491380 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:07.491834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:07.626227 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:07.634272 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d8e200d9-ac5d-4517-a291-abc6f1efafe9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1373 microversion: 2.1 time: 0.157192 Sep 18 02:26:07.634833 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3769/7511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:07 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:08.656963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:08.657705 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:08.664889 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:08.665386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:08.665855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:08.666567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:08.667048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:08.668120 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:08.810280 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:08.819256 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a16f9c7-7fb9-4bf8-85d9-0032366a971c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1373 microversion: 2.1 time: 0.166532 Sep 18 02:26:08.819832 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3743/7512] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:08 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:09.843927 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:09.844542 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:09.852810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:09.853302 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:09.853773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:09.854956 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:09.855536 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:09.855971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:10.005860 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:10.013995 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-88e9dd91-d007-4bbb-b8a5-8a95d1736ffc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1373 microversion: 2.1 time: 0.173982 Sep 18 02:26:10.014588 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3770/7513] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:09 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:11.038369 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:11.038991 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:11.045606 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:11.046102 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:11.046549 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:11.047244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:11.047709 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:11.048142 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:11.178516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:11.186355 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-10cfa30c-139c-44c3-b56c-abc7e3bbadb9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1373 microversion: 2.1 time: 0.152875 Sep 18 02:26:11.186922 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3744/7514] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:11 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:11.826360 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-8e95cf67-6b89-4aed-b384-88cd1070c219 req-fba995a0-f658-4568-9b5b-929e826f36be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "name": "network-vif-plugged", "status": "completed", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:26:11.837141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8e95cf67-6b89-4aed-b384-88cd1070c219 req-fba995a0-f658-4568-9b5b-929e826f36be service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:11.837639 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8e95cf67-6b89-4aed-b384-88cd1070c219 req-fba995a0-f658-4568-9b5b-929e826f36be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:11.838066 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-8e95cf67-6b89-4aed-b384-88cd1070c219 req-fba995a0-f658-4568-9b5b-929e826f36be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:11.853111 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-8e95cf67-6b89-4aed-b384-88cd1070c219 req-fba995a0-f658-4568-9b5b-929e826f36be service nova] Creating event network-vif-plugged:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h2-master-1 Sep 18 02:26:11.859200 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-8e95cf67-6b89-4aed-b384-88cd1070c219 req-fba995a0-f658-4568-9b5b-929e826f36be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036724 Sep 18 02:26:11.860204 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3771/7515] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:26:12.209179 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:12.209832 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:12.216647 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:12.217147 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:12.217637 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:12.218351 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:12.218822 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:12.219259 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:12.360128 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:12.368730 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-60a122cb-ba91-4a6d-b5ef-1f67c97f9083 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1373 microversion: 2.1 time: 0.163356 Sep 18 02:26:12.371624 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3745/7516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:12 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:13.393198 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:13.393987 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:13.400298 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:13.400776 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:13.401209 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:13.401953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:13.402403 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:13.402821 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:13.537910 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:13.546256 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-71c9823f-0b0a-418d-a9ad-401145262746 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1557 microversion: 2.1 time: 0.157703 Sep 18 02:26:13.548152 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3772/7517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:13 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:13.571547 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:26:13.572206 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:26:13.574215 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:26:13.575090 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:26:13.581855 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:13.582362 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:13.582840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:13.583550 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:13.584021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:13.584458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:13.717795 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:26:13.726191 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6a89ef24-76d3-450c-b73f-790973ef6061 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1557 microversion: 2.1 time: 0.158876 Sep 18 02:26:13.726774 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3746/7518] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:26:13 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:26:16.156576 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:26:16.229379 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-edd3e51f-89e3-415e-a58b-db647650181b req-d50f8ae5-8104-4381-bbc0-3efc51713c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:26:16.239120 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-edd3e51f-89e3-415e-a58b-db647650181b req-d50f8ae5-8104-4381-bbc0-3efc51713c54 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:26:16.239591 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-edd3e51f-89e3-415e-a58b-db647650181b req-d50f8ae5-8104-4381-bbc0-3efc51713c54 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:26:16.240016 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-edd3e51f-89e3-415e-a58b-db647650181b req-d50f8ae5-8104-4381-bbc0-3efc51713c54 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:26:16.251682 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-edd3e51f-89e3-415e-a58b-db647650181b req-d50f8ae5-8104-4381-bbc0-3efc51713c54 service nova] Creating event network-changed:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h2-master-1 Sep 18 02:26:16.257862 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-edd3e51f-89e3-415e-a58b-db647650181b req-d50f8ae5-8104-4381-bbc0-3efc51713c54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105449 Sep 18 02:26:16.258516 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3773/7519] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:28:11.282625 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:28:11.284572 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:28:11.285022 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 02:28:11.285154 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89/action (ip 10.222.0.25) !!! Sep 18 02:28:11.286805 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:11.287705 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=34 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:11.292934 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:28:11.293141 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:11.302598 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:11.303106 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:11.303558 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:11.304269 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:11.304739 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:11.305182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:11.332695 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lazy-loading 'flavor' on Instance uuid aa67d08e-70fb-4fb6-836c-215b9f32ca89 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:28:11.528069 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-47efbb28-aceb-4d20-a7b9-5b50c186ce8c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89/action" status: 202 len: 0 microversion: 2.1 time: 0.247753 Sep 18 02:28:11.528691 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3747/7520] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:28:11 2022] POST /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 02:28:11.535578 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 02:28:11.536083 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 (ip 10.222.0.25) !!! Sep 18 02:28:11.538200 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:11.539164 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=28 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:11.544318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:11.545017 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:11.554750 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:11.555235 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:11.555670 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:11.556411 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:11.556965 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:11.557346 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:11.708427 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:11.718231 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-51bb87e5-5109-49af-b3e4-fe9bcd6e9ff6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.184789 Sep 18 02:28:11.718835 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3774/7521] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:11 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:12.747239 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:12.747897 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:12.759461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:12.760580 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:12.761062 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:12.761819 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:12.762294 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:12.762734 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:12.764050 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41716. Sep 18 02:28:12.767481 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41718. Sep 18 02:28:12.909892 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:12.918628 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00778e1d-fadb-44ab-aa92-9cab2236f685 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.177913 Sep 18 02:28:12.919224 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3748/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:12 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:13.942025 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:13.942675 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:13.949055 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:13.949572 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:13.950065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:13.950718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:13.951181 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:13.951612 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:14.089680 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:14.097354 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d202cdd7-a842-4a08-b002-fcd94c844fc0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.159317 Sep 18 02:28:14.097951 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3775/7523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:13 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:15.121819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:15.122478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:15.129386 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:15.129857 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:15.130318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:15.131024 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:15.131759 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:15.132200 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:15.269039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:15.278404 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-61ed6ffc-0bb5-4d44-8796-125ced47d4f3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.160684 Sep 18 02:28:15.278995 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3749/7524] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:15 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:16.301965 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:16.302582 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:16.310407 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:16.310896 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:16.311342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:16.312041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:16.312498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:16.312925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:16.453646 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:16.461887 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e914630d-a1fa-454f-9307-88d82d6c5020 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.163801 Sep 18 02:28:16.462488 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3776/7525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:16 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:17.489905 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:17.490533 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:17.497969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:17.498468 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:17.498920 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:17.499624 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:17.500096 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:17.500534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:17.629965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:17.638653 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8f931e31-ef90-4e82-be50-94daf5eac182 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.152753 Sep 18 02:28:17.639223 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3750/7526] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:17 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:18.662453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:18.663013 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:18.669872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:18.670352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:18.670782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:18.671472 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:18.671924 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:18.672345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:18.814787 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:18.822796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ea889e14-5e21-41a9-9a17-c651ece54151 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.164380 Sep 18 02:28:18.823372 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3777/7527] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:18 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:19.846251 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:19.846881 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:19.853748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:19.854244 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:19.854696 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:19.855397 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:19.855869 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:19.856305 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:19.986781 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:19.995001 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-996151cc-dfd7-4df6-8b4a-5159b653be82 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.152669 Sep 18 02:28:19.995572 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3751/7528] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:19 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:21.019226 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:21.019844 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:21.027647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:21.028305 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:21.028900 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:21.029911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:21.030560 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:21.030990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:21.162218 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:21.169905 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-388c219f-af38-44b4-ba7a-8f99c14a1d0d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.154536 Sep 18 02:28:21.170481 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3778/7529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:21 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:28:22.192561 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:22.193152 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:22.200881 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:22.201385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:22.201865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:22.202584 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:22.203058 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:22.203498 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:22.343652 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:22.352067 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-00ff733f-3a59-40fa-92d6-19269d247554 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1702 microversion: 2.1 time: 0.163468 Sep 18 02:28:22.352663 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3752/7530] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:22 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1702 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:23.375988 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:23.376615 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:23.384226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:23.384717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:23.385165 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:23.385908 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:23.386399 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:23.387336 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:23.530230 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:23.538283 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-74ec881e-562f-4499-ba22-0b1c3784b638 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1702 microversion: 2.1 time: 0.166142 Sep 18 02:28:23.538882 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3779/7531] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:23 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1702 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:24.561034 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:24.561700 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:24.568760 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:24.569252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:24.569729 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:24.570438 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:24.570901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:24.571335 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:24.726758 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:24.736231 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-725a5a8c-0ba3-4d86-8600-68558b512e12 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1702 microversion: 2.1 time: 0.179051 Sep 18 02:28:24.745857 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3753/7532] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:24 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1702 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:25.765513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:25.766168 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:25.773968 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:25.775567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:25.776037 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:25.776747 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:25.777492 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:25.777948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:25.967946 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:25.979048 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-60c7192c-5f92-4724-aba4-8d42146bd3be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1697 microversion: 2.1 time: 0.220271 Sep 18 02:28:25.980275 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3780/7533] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:25 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1697 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:26.574173 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-ba96f99f-4f94-4217-a780-82f51a1a6c0b req-e665687b-b0d9-497b-9742-938726e594fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "name": "network-vif-plugged", "status": "completed", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:28:26.593029 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ba96f99f-4f94-4217-a780-82f51a1a6c0b req-e665687b-b0d9-497b-9742-938726e594fa service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:26.593815 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ba96f99f-4f94-4217-a780-82f51a1a6c0b req-e665687b-b0d9-497b-9742-938726e594fa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:26.594461 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-ba96f99f-4f94-4217-a780-82f51a1a6c0b req-e665687b-b0d9-497b-9742-938726e594fa service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:26.610116 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-ba96f99f-4f94-4217-a780-82f51a1a6c0b req-e665687b-b0d9-497b-9742-938726e594fa service nova] Creating event network-vif-plugged:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h2-master-1 Sep 18 02:28:26.616984 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-ba96f99f-4f94-4217-a780-82f51a1a6c0b req-e665687b-b0d9-497b-9742-938726e594fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162330 Sep 18 02:28:26.617648 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3754/7534] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:28:27.004721 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:27.005335 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:27.015421 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:27.015915 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:27.016354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:27.017099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:27.017851 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:27.018282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:27.450344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:27.464104 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b6c78340-e30f-4d67-ada4-56822fda752c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1697 microversion: 2.1 time: 0.463151 Sep 18 02:28:27.467427 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3781/7535] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:26 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1697 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:28.494756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:28.497072 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:28.504975 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:28.505567 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:28.506202 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:28.507273 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:28.507810 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:28.508316 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:28.678597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:28.687608 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3f3101f7-ab21-43a9-ba7f-32f99e991e92 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1697 microversion: 2.1 time: 0.199599 Sep 18 02:28:28.688396 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3755/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:28 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1697 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:29.714202 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:29.714906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:29.722589 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:29.723685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:29.724416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:29.725377 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:29.726098 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:29.726789 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:29.877725 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:29.897528 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e81cb701-b689-4678-9323-80da14a7a1d8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1697 microversion: 2.1 time: 0.188730 Sep 18 02:28:29.898127 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3782/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:29 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:30.922711 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:30.923422 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:30.930610 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:30.931114 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:30.931974 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:30.932276 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:30.932741 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:30.933176 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:31.092084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:31.102774 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-786cf39f-3169-40ae-b4ad-5a1b61ce23cf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1697 microversion: 2.1 time: 0.184505 Sep 18 02:28:31.103800 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3756/7538] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:30 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:32.142626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:32.143956 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:32.154444 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:32.155069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:32.155981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:32.156791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:32.157332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:32.157864 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:32.307867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:32.320650 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-37a8dfcd-5c8e-45b0-9109-b236f10e03b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1697 microversion: 2.1 time: 0.192026 Sep 18 02:28:32.321435 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3783/7539] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:32 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:33.348166 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:33.348931 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:33.356563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:33.357171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:33.357768 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:33.358497 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:33.361241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:33.361241 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:33.519731 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:33.528584 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a35b009-d284-40a7-922c-90fc11cdba63 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1697 microversion: 2.1 time: 0.184449 Sep 18 02:28:33.529386 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3757/7540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:33 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:28:34.553451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:34.554077 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:34.561994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:34.562481 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:34.562916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:34.563619 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:34.564112 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:34.564498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:34.706690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:34.716015 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f7dc0998-2af9-4811-8da6-99f69b533587 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1679 microversion: 2.1 time: 0.167120 Sep 18 02:28:34.716806 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3784/7541] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:34 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:35.743765 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:35.744463 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:35.751776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:35.752286 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:35.752829 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:35.753722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:35.754199 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:35.754673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:35.890551 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:35.898500 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-db17e6ff-4020-42e9-b669-b4c9f7630205 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1679 microversion: 2.1 time: 0.159119 Sep 18 02:28:35.899088 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3758/7542] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:35 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:36.922547 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:36.923191 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:36.930233 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:36.930717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:36.931146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:36.931835 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:36.932290 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:36.932712 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:37.079520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:37.089363 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e7b07424-7357-4c85-9fb1-d76c56540da4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1682 microversion: 2.1 time: 0.170685 Sep 18 02:28:37.090476 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3785/7543] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:36 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:37.115134 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:28:37.115753 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:37.123363 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:37.123883 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:37.124330 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:37.125048 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:37.125518 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:37.125979 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:37.172428 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122373) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 02:28:37.237325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-675976ff-3da8-44f2-a572-6fea01ae96e9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89/action" status: 202 len: 0 microversion: 2.1 time: 0.126129 Sep 18 02:28:37.238006 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3759/7544] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:28:37 2022] POST /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:28:37.246146 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:37.246761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:37.252794 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:37.253273 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:37.253734 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:37.254425 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:37.254875 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:37.255303 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:37.393663 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:37.401460 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-df248d37-bc93-4020-8335-3e13252ca0e3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1630 microversion: 2.1 time: 0.159213 Sep 18 02:28:37.403293 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3786/7545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:37 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:38.428113 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:38.429055 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:38.439262 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:38.439803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:38.440229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:38.440949 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:38.441649 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:38.442090 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:38.454394 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-f80adbdc-3b7f-49cc-808c-a473f944fd55 req-dd91d5bd-9756-4a26-87c3-2d0718f29d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "name": "network-vif-unplugged", "status": "completed", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:28:38.466652 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f80adbdc-3b7f-49cc-808c-a473f944fd55 req-dd91d5bd-9756-4a26-87c3-2d0718f29d93 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:38.467369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f80adbdc-3b7f-49cc-808c-a473f944fd55 req-dd91d5bd-9756-4a26-87c3-2d0718f29d93 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:38.467971 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-f80adbdc-3b7f-49cc-808c-a473f944fd55 req-dd91d5bd-9756-4a26-87c3-2d0718f29d93 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:38.480318 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-f80adbdc-3b7f-49cc-808c-a473f944fd55 req-dd91d5bd-9756-4a26-87c3-2d0718f29d93 service nova] Creating event network-vif-unplugged:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h1-master-1 Sep 18 02:28:38.485813 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-f80adbdc-3b7f-49cc-808c-a473f944fd55 req-dd91d5bd-9756-4a26-87c3-2d0718f29d93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035734 Sep 18 02:28:38.486634 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3787/7546] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:28:38.584760 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:38.593304 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0ecc7c76-abad-46b2-8bd6-c78365abe669 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.171024 Sep 18 02:28:38.593922 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3760/7547] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:38 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:39.618117 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:39.618882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:39.625051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:39.625537 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:39.626004 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:39.626697 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:39.627151 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:39.627570 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:39.759903 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:39.768233 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cdb5c7a2-7fee-44ed-89e8-8a21efb4ba08 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.155207 Sep 18 02:28:39.768816 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3788/7548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:39 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:39.836608 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e549b97d-7bf8-4a15-a963-2b6674dbfae2 req-350b5c1b-9869-4c32-af21-c2dd15ba43b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:28:39.858786 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e549b97d-7bf8-4a15-a963-2b6674dbfae2 req-350b5c1b-9869-4c32-af21-c2dd15ba43b2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:39.859385 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e549b97d-7bf8-4a15-a963-2b6674dbfae2 req-350b5c1b-9869-4c32-af21-c2dd15ba43b2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:39.859901 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e549b97d-7bf8-4a15-a963-2b6674dbfae2 req-350b5c1b-9869-4c32-af21-c2dd15ba43b2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:39.863931 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:39.877950 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e549b97d-7bf8-4a15-a963-2b6674dbfae2 req-350b5c1b-9869-4c32-af21-c2dd15ba43b2 service nova] Creating event network-changed:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h1-master-1 Sep 18 02:28:39.884440 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e549b97d-7bf8-4a15-a963-2b6674dbfae2 req-350b5c1b-9869-4c32-af21-c2dd15ba43b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051396 Sep 18 02:28:39.885429 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3761/7549] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:28:40.807203 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:40.810291 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:40.829122 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:40.830426 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:40.831445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:40.835948 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:40.838130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:40.839179 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:41.008324 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:41.018398 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-93f8ae8f-ba88-4ca6-ad2b-e9ec9cf80e6a tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.230346 Sep 18 02:28:41.033576 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3789/7550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:40 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:42.047303 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:42.048491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:42.059131 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:42.065212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:42.065947 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:42.066406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:42.067139 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:42.067621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:42.068068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:42.221172 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:42.229290 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2322366f-6742-41ad-94eb-01c2ea7d9227 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.188905 Sep 18 02:28:42.230464 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3762/7551] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:42 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:43.254452 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:43.255058 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:43.257628 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=33 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:43.263424 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:43.263921 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:43.264369 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:43.265080 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:43.265538 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:43.265989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:43.268978 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=93 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:28:43.413520 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:43.422620 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-52387aee-299b-430a-ad0c-95f03366b8ba tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.172103 Sep 18 02:28:43.431874 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3790/7552] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:43 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:44.445962 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:44.446600 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:44.453679 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:44.454253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:44.454755 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:44.455379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:44.455875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:44.456296 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:44.608026 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:44.619495 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-258e3cfa-c12d-498e-96e6-f4752942fb62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.177118 Sep 18 02:28:44.621534 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3763/7553] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:44 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:45.646992 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:45.648269 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:45.655160 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:45.655647 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:45.656082 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:45.656782 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:45.657523 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:45.657981 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:45.805659 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:45.814863 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd7cee78-8c2d-4661-8090-b6d90e8f3faa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.174256 Sep 18 02:28:45.815650 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3791/7554] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:45 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:46.840332 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:46.842228 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:46.850436 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:46.851552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:46.852370 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:46.853323 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:46.854189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:46.855300 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:47.356015 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:47.363826 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5db45b22-c3b8-4c4d-88b0-612bd2964f70 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.528141 Sep 18 02:28:47.364418 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3764/7555] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:46 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:48.390118 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:48.390756 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:48.397879 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:48.398368 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:48.398810 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:48.399504 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:48.399964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:48.400394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:48.539465 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:48.547856 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-80a10207-fc9f-4f32-8750-2710e88bdc83 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.162289 Sep 18 02:28:48.548423 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3792/7556] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:48 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:49.571484 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:49.572069 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:49.578951 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:49.579447 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:49.579899 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:49.580603 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:49.581072 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:49.581509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:49.717321 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:49.725103 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-84713460-4820-46de-84c7-64adf15a5959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.157632 Sep 18 02:28:49.725701 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3765/7557] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:49 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:50.750345 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:50.751126 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:50.758123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:50.758784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:50.759100 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:50.759822 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:50.760351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:50.761518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:50.894166 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:50.901864 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-c014a612-55ee-4464-adbd-ca080f943625 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.156856 Sep 18 02:28:50.902445 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3793/7558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:50 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:51.925030 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:51.925684 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:51.932480 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:51.933043 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:51.933493 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:51.934234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:51.934702 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:51.935140 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:52.071929 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:52.080434 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eb3d7f44-1009-4f77-8cba-65ab75522fb5 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.159420 Sep 18 02:28:52.081115 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3766/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:51 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:53.104383 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:53.105120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:53.112479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:53.112958 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:53.113394 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:53.114114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:53.114569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:53.114991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:53.243124 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:53.251681 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-996ff2e2-6434-4380-980d-9fa902e8ba41 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.151206 Sep 18 02:28:53.252264 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3794/7560] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:53 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:54.040216 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-d0f41d0f-0f63-4ede-a601-4a4aca736fff req-a7217ed6-7fcc-4680-9703-20134b96b5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "name": "network-vif-plugged", "status": "completed", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:28:54.050999 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d0f41d0f-0f63-4ede-a601-4a4aca736fff req-a7217ed6-7fcc-4680-9703-20134b96b5f7 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:54.051984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d0f41d0f-0f63-4ede-a601-4a4aca736fff req-a7217ed6-7fcc-4680-9703-20134b96b5f7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:54.052424 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-d0f41d0f-0f63-4ede-a601-4a4aca736fff req-a7217ed6-7fcc-4680-9703-20134b96b5f7 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:54.064405 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-d0f41d0f-0f63-4ede-a601-4a4aca736fff req-a7217ed6-7fcc-4680-9703-20134b96b5f7 service nova] Creating event network-vif-plugged:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h1-master-1 Sep 18 02:28:54.069879 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-d0f41d0f-0f63-4ede-a601-4a4aca736fff req-a7217ed6-7fcc-4680-9703-20134b96b5f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Sep 18 02:28:54.070571 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3767/7561] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:28:54.275986 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:54.277087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:54.283929 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:54.284420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:54.284859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:54.285573 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:54.286038 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:54.286463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:54.416751 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:54.424704 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6a22477f-da26-414f-8b09-40f897c82616 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.152792 Sep 18 02:28:54.425289 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3795/7562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:54 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:55.449025 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:55.449762 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:55.457325 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:55.457913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:55.458361 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:55.459070 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:55.459535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:55.459969 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:55.605724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:55.614229 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0358b44f-1b61-4824-8a10-0fed677d27e8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1688 microversion: 2.1 time: 0.169202 Sep 18 02:28:55.619016 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3768/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:55 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:28:56.638849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:28:56.639477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:28:56.646363 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:56.646843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:56.647282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:56.647964 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:28:56.648416 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:28:56.648839 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:28:56.783382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:28:56.791136 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a09df5ac-cc51-423c-894c-14d0b1d8cd62 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1675 microversion: 2.1 time: 0.156279 Sep 18 02:28:56.791720 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3796/7564] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:28:56 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:06.504245 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=13 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:06.505027 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=38 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:06.509242 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-19e2f159-2301-4e16-aa51-84758a193657 req-37886406-7afe-4d46-b4d2-4dc91ec4d1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:30:06.510935 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:06.511455 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:06.514472 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=13 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:06.515997 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=41 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:06.517109 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:30:06.517344 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 18 02:30:06.522517 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:06.523099 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:06.523631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:06.524472 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:06.525021 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:06.525534 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:06.527008 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-19e2f159-2301-4e16-aa51-84758a193657 req-37886406-7afe-4d46-b4d2-4dc91ec4d1e4 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:06.527518 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-19e2f159-2301-4e16-aa51-84758a193657 req-37886406-7afe-4d46-b4d2-4dc91ec4d1e4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:06.527949 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-19e2f159-2301-4e16-aa51-84758a193657 req-37886406-7afe-4d46-b4d2-4dc91ec4d1e4 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:06.540849 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-19e2f159-2301-4e16-aa51-84758a193657 req-37886406-7afe-4d46-b4d2-4dc91ec4d1e4 service nova] Creating event network-changed:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h1-master-1 Sep 18 02:30:06.546597 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-19e2f159-2301-4e16-aa51-84758a193657 req-37886406-7afe-4d46-b4d2-4dc91ec4d1e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042826 Sep 18 02:30:06.547696 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3797/7565] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:30:06.555182 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:30:06.649546 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7d9f1b11-2bd2-4810-b81f-2fed7f44e6ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 204 len: 0 microversion: 2.1 time: 0.147643 Sep 18 02:30:06.650939 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3769/7566] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:30:06 2022] DELETE /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:30:06.662882 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:06.664144 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:06.671759 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:06.672618 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:06.673276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:06.674345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:06.675007 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:06.675633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:06.922749 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:06.930829 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-02b7127d-1590-4ec1-b36d-24ee545a68e7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.275248 Sep 18 02:30:06.931415 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3798/7567] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:06 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:07.955145 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:07.955770 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:07.962913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:07.963406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:07.963850 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:07.964733 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:07.965203 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:07.965660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:08.150879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:08.158961 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c3984252-16cd-4124-af62-364bdb648dff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1681 microversion: 2.1 time: 0.208194 Sep 18 02:30:08.159670 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3770/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:07 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:08.712388 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-b693abdc-1d80-40f8-81e0-cd0ac72d1579 req-2748500a-8caa-4103-908f-b150a8e10851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa67d08e-70fb-4fb6-836c-215b9f32ca89", "name": "network-vif-deleted", "tag": "1887c89b-5587-46d1-9ad8-c85067018625"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:30:08.725669 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b693abdc-1d80-40f8-81e0-cd0ac72d1579 req-2748500a-8caa-4103-908f-b150a8e10851 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:08.726202 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b693abdc-1d80-40f8-81e0-cd0ac72d1579 req-2748500a-8caa-4103-908f-b150a8e10851 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:08.726587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-b693abdc-1d80-40f8-81e0-cd0ac72d1579 req-2748500a-8caa-4103-908f-b150a8e10851 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:08.738950 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-b693abdc-1d80-40f8-81e0-cd0ac72d1579 req-2748500a-8caa-4103-908f-b150a8e10851 service nova] Creating event network-vif-deleted:1887c89b-5587-46d1-9ad8-c85067018625 for instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 on n-h1-master-1 Sep 18 02:30:08.745801 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-b693abdc-1d80-40f8-81e0-cd0ac72d1579 req-2748500a-8caa-4103-908f-b150a8e10851 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036978 Sep 18 02:30:08.746416 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3799/7569] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:30:09.184523 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:09.185219 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:09.200429 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:09.200936 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:09.201479 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:09.202488 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:09.202922 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:09.203365 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:09.235784 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:09.236182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:09.236634 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:09.237093 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.objects.instance [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lazy-loading 'fault' on Instance uuid aa67d08e-70fb-4fb6-836c-215b9f32ca89 {{(pid=122373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:30:09.279663 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:09.287486 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-5f39ebe4-9236-4bd4-b3ab-c6beda1554aa tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 200 len: 1337 microversion: 2.1 time: 0.107500 Sep 18 02:30:09.288071 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3771/7570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:09 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 1337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:10.312080 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:10.312704 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: aa67d08e-70fb-4fb6-836c-215b9f32ca89] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:10.319116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:10.319607 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:10.320048 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:10.320745 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:10.321201 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:10.321655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:10.338032 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] HTTP exception thrown: Instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 could not be found. Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Request method failure captured: Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 HTTP/1.1 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJoG0jF4lcDygMq9HEn9SlkFWbmGEHH7JDAg-rBRf6jJkMTMDWMZrqEHsVt4GA9YGh-ANnIEsU4Y6_h9dg6tPolRlaPdLu46Qeh4pPO9yPGtSYNp49A7m4iczFTTTn4XMs9sRIl70LPDLnm1sGDPDdP-VVTyw-FSUY3oRQk7ZnhiMmlc Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d6fccd66a6ad499083a7b46235239633 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestShelveInstance-1782638718 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6fccd66a6ad499083a7b46235239633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d6fccd66a6ad499083a7b46235239633"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d6fccd66a6ad499083a7b46235239633"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6fccd66a6ad499083a7b46235239633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestShelveInstance-1782638718 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d6fccd66a6ad499083a7b46235239633 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestShelveInstance-1782638718 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestShelveInstance-1782638718-project Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 38d787a341d340cd9abdb09cf377cd43 Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestShelveInstance-1782638718-project Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: exception: Instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 could not be found. Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': 'aa67d08e-70fb-4fb6-836c-215b9f32ca89'} Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 could not be found. Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 could not be found. Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:30:10.340301 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 could not be found. Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Returning 404 to user: Instance aa67d08e-70fb-4fb6-836c-215b9f32ca89 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cd327eb4-dd2d-44e8-b997-2055e3781026 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89" status: 404 len: 111 microversion: 2.1 time: 0.034929 Sep 18 02:30:10.345867 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3800/7571] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:10 2022] GET /compute/v2.1/servers/aa67d08e-70fb-4fb6-836c-215b9f32ca89 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:30:10.507250 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6886d9f5-700e-47c8-883c-0b6841ebf6b4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '.version_select at 0x7f7005197820>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:10.534510 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6886d9f5-700e-47c8-883c-0b6841ebf6b4 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031896247" status: 202 len: 0 microversion: 2.1 time: 0.032017 Sep 18 02:30:10.535123 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3772/7572] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Sep 18 02:30:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031896247 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:30:10.552813 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-06915a37-5a12-4bf3-806e-1bfb8bb20533 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'create', calling method: .version_select at 0x7f70064db9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-241468019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqfhyxWPeLaLk/rWPHUMuRfCmTgxrGCPjX62Cq/VfxEhmn4G5ZMKE4ZGkuOvTbd7Nn3Txbix6PMqXDWJy1lXrtrg28qX0M6vhBldPkOdXKgMMPSqLlxtbgAOLinR791Qg=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:30:10.568525 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-06915a37-5a12-4bf3-806e-1bfb8bb20533 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for project d6fccd66a6ad499083a7b46235239633. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:30:10.574209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-06915a37-5a12-4bf3-806e-1bfb8bb20533 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for user 38d787a341d340cd9abdb09cf377cd43 and project d6fccd66a6ad499083a7b46235239633. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:30:10.600027 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-06915a37-5a12-4bf3-806e-1bfb8bb20533 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.051153 Sep 18 02:30:10.600632 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3801/7573] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:30:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:30:26.800343 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:26.801165 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:26.809766 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-688422263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-241468019", "security_groups": [{"name": "tempest-secgroup-smoke-1269981744"}], "networks": [{"uuid": "eaec2d60-9c4b-44ad-8ef6-d3b08ee83fe4"}], "block_device_mapping_v2": [{"uuid": "a6edd5fb-fa22-4dce-9fd4-7aa7080a7fcc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:30:26.921965 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] validate_networks() for [('eaec2d60-9c4b-44ad-8ef6-d3b08ee83fe4', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:30:27.304051 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:30:27.304486 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:30:27.304963 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:30:27.305379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:30:27.305823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:30:27.315065 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:27.315552 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:27.315995 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:27.316723 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:27.317189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:27.317698 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:27.336379 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for project d6fccd66a6ad499083a7b46235239633. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:30:27.341658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Getting quotas for user 38d787a341d340cd9abdb09cf377cd43 and project d6fccd66a6ad499083a7b46235239633. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:30:27.399691 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:30:27.404164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6edd5fb-fa22-4dce-9fd4-7aa7080a7fcc',volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:30:27.533120 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1461d6b3-bc94-444b-942d-531d3cfd5ef7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734563 Sep 18 02:30:27.533814 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3773/7574] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:30:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:30:27.543354 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=12 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:27.544109 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=4 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:27.544942 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:27.548821 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6b32025d-9e0f-4c8e-a3a7-17adfec2eb43 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:27.549428 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6b32025d-9e0f-4c8e-a3a7-17adfec2eb43 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:27.607906 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6b32025d-9e0f-4c8e-a3a7-17adfec2eb43 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:27.614913 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6b32025d-9e0f-4c8e-a3a7-17adfec2eb43 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1087 microversion: 2.1 time: 0.073921 Sep 18 02:30:27.615489 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3802/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:27 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1087 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:28.640611 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:28.641964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:28.649374 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:28.650245 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:28.652413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:28.652413 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:28.653051 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:28.654089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:28.726593 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:28.734750 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3a702462-f510-4985-acdb-ba842c28b7ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1203 microversion: 2.1 time: 0.100073 Sep 18 02:30:28.735337 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3774/7576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:28 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:29.758264 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:29.759524 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:29.767471 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:29.768195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:29.768831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:29.769936 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:29.770566 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:29.771270 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:29.931778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:29.940179 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc5ccf92-1b50-4da0-85aa-82965ff6fc1d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1271 microversion: 2.1 time: 0.186054 Sep 18 02:30:29.941078 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3803/7577] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:29 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:30.134021 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-670feb95-b3ef-4a29-858d-5c9f48937dbb req-c7ed5e93-9962-406d-a1ac-863f6eb8fa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:30:30.146892 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-670feb95-b3ef-4a29-858d-5c9f48937dbb req-c7ed5e93-9962-406d-a1ac-863f6eb8fa29 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:30.147304 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-670feb95-b3ef-4a29-858d-5c9f48937dbb req-c7ed5e93-9962-406d-a1ac-863f6eb8fa29 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:30.147748 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-670feb95-b3ef-4a29-858d-5c9f48937dbb req-c7ed5e93-9962-406d-a1ac-863f6eb8fa29 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:30.162960 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-670feb95-b3ef-4a29-858d-5c9f48937dbb req-c7ed5e93-9962-406d-a1ac-863f6eb8fa29 service nova] Creating event network-changed:9cbccb05-760e-440c-b3ed-065163afe99d for instance 1a8db456-bec5-4276-909c-909f7e9683a8 on n-h2-master-1 Sep 18 02:30:30.170053 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-670feb95-b3ef-4a29-858d-5c9f48937dbb req-c7ed5e93-9962-406d-a1ac-863f6eb8fa29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040915 Sep 18 02:30:30.171749 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3775/7578] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:30:30.964406 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:30.965315 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:30.972461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:30.972945 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:30.973382 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:30.974175 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:30.974831 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:30.975527 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:31.121438 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:31.129781 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d3b5822b-f56c-4d15-af39-5a0be0931cc6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1271 microversion: 2.1 time: 0.169931 Sep 18 02:30:31.130460 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3804/7579] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:30 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:32.161047 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:32.163847 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:32.172821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:32.173314 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:32.173858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:32.174573 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:32.175037 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:32.175469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:32.314964 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:32.322862 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-ec52798d-56ac-45bc-83ba-6587e7b85275 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1271 microversion: 2.1 time: 0.172097 Sep 18 02:30:32.323434 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3776/7580] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:32 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:33.345413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:33.346066 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:33.353129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:33.353623 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:33.354069 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:33.354774 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:33.355234 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:33.355694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:33.493273 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:33.504732 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6198afee-9245-4288-8124-6e0ba051c7f2 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1271 microversion: 2.1 time: 0.163176 Sep 18 02:30:33.505516 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3805/7581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:33 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:34.528313 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:34.528937 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:34.535762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:34.536252 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:34.536706 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:34.537398 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:34.537965 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:34.538423 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:34.675277 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:34.683752 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-c7a99ea8-8d2d-4b99-9265-3be07528b93f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.159357 Sep 18 02:30:34.684331 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3777/7582] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:34 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:35.707344 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:35.707957 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:35.714942 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:35.715435 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:35.715877 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:35.716574 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:35.717036 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:35.717468 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:35.848535 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:35.856523 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11e3c85c-5f32-4b68-989a-434d88d3c181 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.153153 Sep 18 02:30:35.857103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3806/7583] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:35 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:36.879158 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:36.879823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:36.887824 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:36.888320 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:36.888772 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:36.889481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:36.889983 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:36.890420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:37.020432 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:37.028827 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-09edef22-93db-4557-a9b0-108d98ce72ef tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.153606 Sep 18 02:30:37.029411 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3778/7584] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:36 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:38.050696 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:38.051310 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:38.054158 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:38.060034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:38.060520 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:38.060961 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:38.061676 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:38.062137 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:38.062562 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:38.196905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:38.204682 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-31c1c058-cc23-4a8c-a64a-d664a0b477be tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.157887 Sep 18 02:30:38.205242 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3807/7585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:38 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:39.228949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:39.229590 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:39.231515 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:39.232179 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:30:39.238840 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:39.239434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:39.239803 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:39.240515 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:39.240984 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:39.241421 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:39.387510 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:39.395862 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-98e6320b-565b-4509-8719-87c26e832e42 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.171424 Sep 18 02:30:39.396466 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3779/7586] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:39 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:40.419872 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:40.420510 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:40.427460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:40.427939 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:40.428371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:40.429057 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:40.429510 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:40.429963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:40.570046 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:40.577796 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-16d7ec13-176c-4d64-92f4-2ff3bb6abf9c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.161878 Sep 18 02:30:40.578378 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3808/7587] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:40 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:41.600207 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:41.600989 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:41.608111 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:41.608612 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:41.609069 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:41.609812 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:41.610290 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:41.610737 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:41.749603 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:41.757921 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-0d5a583b-e1b8-4582-af0a-69b675b75049 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.161602 Sep 18 02:30:41.758516 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3780/7588] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:41 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:42.782106 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:42.782649 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:42.788850 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:42.789327 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:42.789791 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:42.790479 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:42.790930 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:42.791350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:42.936492 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:42.950950 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-600c1199-5ca1-49a6-9428-f7095bf3fa7b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.172529 Sep 18 02:30:42.952015 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3809/7589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:42 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:43.096319 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-51b60d5a-5001-4901-9bff-50ec8507edc7 req-4de0cf1b-6f66-48f3-b93c-1e928671a753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "name": "network-vif-plugged", "status": "completed", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:30:43.107959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-51b60d5a-5001-4901-9bff-50ec8507edc7 req-4de0cf1b-6f66-48f3-b93c-1e928671a753 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:43.107959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-51b60d5a-5001-4901-9bff-50ec8507edc7 req-4de0cf1b-6f66-48f3-b93c-1e928671a753 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:43.107959 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-51b60d5a-5001-4901-9bff-50ec8507edc7 req-4de0cf1b-6f66-48f3-b93c-1e928671a753 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:43.119612 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-51b60d5a-5001-4901-9bff-50ec8507edc7 req-4de0cf1b-6f66-48f3-b93c-1e928671a753 service nova] Creating event network-vif-plugged:9cbccb05-760e-440c-b3ed-065163afe99d for instance 1a8db456-bec5-4276-909c-909f7e9683a8 on n-h2-master-1 Sep 18 02:30:43.126777 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-51b60d5a-5001-4901-9bff-50ec8507edc7 req-4de0cf1b-6f66-48f3-b93c-1e928671a753 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033467 Sep 18 02:30:43.126777 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3781/7590] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:30:43.975132 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:43.975742 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:43.983282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:43.983761 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:43.984192 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:43.984881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:43.985331 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:43.985786 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:44.126974 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:44.135522 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-bf3a323d-2324-49e0-889b-56976d1ca1a9 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1259 microversion: 2.1 time: 0.164192 Sep 18 02:30:44.136088 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3810/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:43 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:45.159106 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:45.159730 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:45.166921 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:45.167415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:45.167858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:45.168554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:45.169017 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:45.169451 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:45.299724 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:45.307640 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-b3c3f340-a9e4-4c83-a364-33551ad9467b tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1444 microversion: 2.1 time: 0.152867 Sep 18 02:30:45.308245 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3782/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:45 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:45.329980 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:30:45.330602 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:30:45.337319 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:45.337863 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:45.338307 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:45.339617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:45.340074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:45.340498 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:45.475487 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:30:45.483322 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0d2d0aea-7d74-4571-b0ae-1aac06712023 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1444 microversion: 2.1 time: 0.157190 Sep 18 02:30:45.483901 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3811/7593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:30:45 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:30:47.115943 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-e39c2b33-03aa-4f86-bddc-42c4d31f0076 req-4fb7041c-f32d-451a-9d55-eda700e1bb95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:30:47.126306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e39c2b33-03aa-4f86-bddc-42c4d31f0076 req-4fb7041c-f32d-451a-9d55-eda700e1bb95 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:30:47.127067 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e39c2b33-03aa-4f86-bddc-42c4d31f0076 req-4fb7041c-f32d-451a-9d55-eda700e1bb95 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:30:47.127669 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-e39c2b33-03aa-4f86-bddc-42c4d31f0076 req-4fb7041c-f32d-451a-9d55-eda700e1bb95 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:30:47.140096 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-e39c2b33-03aa-4f86-bddc-42c4d31f0076 req-4fb7041c-f32d-451a-9d55-eda700e1bb95 service nova] Creating event network-changed:9cbccb05-760e-440c-b3ed-065163afe99d for instance 1a8db456-bec5-4276-909c-909f7e9683a8 on n-h2-master-1 Sep 18 02:30:47.145727 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-e39c2b33-03aa-4f86-bddc-42c4d31f0076 req-4fb7041c-f32d-451a-9d55-eda700e1bb95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090225 Sep 18 02:30:47.146515 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3783/7594] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:32:42.294981 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:32:42.296039 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:32:42.296614 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=22 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:32:42.297737 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=54 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:32:42.298623 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:32:42.298759 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:32:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8/action (ip 10.222.0.25) !!! Sep 18 02:32:42.356541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:32:42.357073 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:42.363278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:42.363755 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:42.364190 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:42.364902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:42.365354 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:42.365802 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:42.388967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lazy-loading 'flavor' on Instance uuid 1a8db456-bec5-4276-909c-909f7e9683a8 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:32:42.468500 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ac9f8e53-5d32-4eaa-815a-56f12da5b062 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8/action" status: 202 len: 0 microversion: 2.1 time: 0.171146 Sep 18 02:32:42.468500 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3812/7595] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:32:42 2022] POST /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:32:42.472027 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:32:42.473144 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:32:42.473793 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:32:42.474730 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=50 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:32:42.475973 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 02:32:42.476111 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:32:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 (ip 10.222.0.25) !!! Sep 18 02:32:42.481615 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:42.482333 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:42.498614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:42.498867 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:42.499253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:42.499972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:42.500441 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:42.501459 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:42.658558 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:42.666882 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4177d33b-2321-4318-8ec8-ef0bae364ef0 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.196906 Sep 18 02:32:42.667467 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3784/7596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:42 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:43.695328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:43.696059 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:43.704628 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:43.705183 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:43.705650 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:43.706393 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:43.706854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:43.707277 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:43.712222 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42254. Sep 18 02:32:43.712953 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42256. Sep 18 02:32:43.841354 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:43.850033 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0a0de346-fe7f-44f6-a207-2dd81abed9ff tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.161702 Sep 18 02:32:43.850652 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3813/7597] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:43 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:44.873848 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:44.874570 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:44.884500 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:44.885016 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:44.885474 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:44.886229 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:44.886699 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:44.887155 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:44.894635 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42262. Sep 18 02:32:44.895367 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42260. Sep 18 02:32:45.031060 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:45.038908 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-d76606b0-5d44-4490-88d3-22c4bcf52fce tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.169068 Sep 18 02:32:45.039489 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3785/7598] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:44 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:46.063115 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:46.063831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:46.070773 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:46.071276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:46.071696 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:46.072390 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:46.072843 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:46.073268 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:46.207359 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:46.215122 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-1c90efad-e844-4151-9ab8-5a39e0b3ee33 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.156057 Sep 18 02:32:46.215700 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3814/7599] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:46 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:47.239630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:47.240331 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:47.247122 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:47.247621 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:47.248068 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:47.248771 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:47.249234 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:47.249694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:47.388094 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:47.395952 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1a3657d2-ad91-48ea-8ab7-fe04095fbace tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.160907 Sep 18 02:32:47.396535 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3786/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:47 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:48.419838 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:48.420477 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:48.427420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:48.427902 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:48.428339 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:48.429034 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:48.429489 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:48.429940 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:48.559019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:48.567504 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-7d7226cc-07ea-4a5f-8b94-94a3c59ae5ed tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.151623 Sep 18 02:32:48.568093 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3815/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:48 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:49.590287 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:49.590890 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:49.598233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:49.598725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:49.599167 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:49.599858 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:49.600319 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:49.600749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:49.732986 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:49.740875 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e2b206d4-3dbb-477f-93f9-c17daf02ba5c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.154443 Sep 18 02:32:49.741461 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3787/7602] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:49 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:50.764425 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:50.765071 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:50.772099 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:50.772853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:50.773350 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:50.774548 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:50.774740 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:50.775170 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:50.925034 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:50.933416 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-fc01f5a7-f639-47d2-94f7-a1ae4ddc635e tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.172935 Sep 18 02:32:50.934058 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3816/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:50 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:51.958096 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:51.958759 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:51.965683 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:51.966182 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:51.966631 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:51.967331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:51.967799 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:51.968237 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:52.096194 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:52.103894 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-696a4254-e30b-4569-b4e1-e860e22c12d3 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.150316 Sep 18 02:32:52.104460 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3788/7604] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:51 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:53.128055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:53.128671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:53.135849 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:53.136335 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:53.136770 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:53.137473 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:53.137950 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:53.138371 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:53.274776 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:53.283708 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0b6e0544-1e58-4a4a-9e1e-87c8ca9b5723 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.159568 Sep 18 02:32:53.284371 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3817/7605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:53 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:54.308058 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:54.308761 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:54.316485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:54.316980 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:54.317442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:54.318191 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:54.318674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:54.319089 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:54.463346 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:54.471083 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-558e05c9-2036-4220-aace-bc5e4e3cf30f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.166932 Sep 18 02:32:54.471657 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3789/7606] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:54 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:55.494220 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:55.494797 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:55.501663 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:55.502148 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:55.502583 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:55.503278 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:55.503731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:55.504158 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:55.637175 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:55.646142 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-b17c5a36-ccde-4785-a746-c834e2b59881 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.155973 Sep 18 02:32:55.646741 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3818/7607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:55 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:56.673046 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:56.673789 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:56.680738 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:56.681243 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:56.681777 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:56.682485 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:56.683013 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:56.683445 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:56.833061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:56.841400 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-dc1d8238-dd60-4cbf-8256-902289719b60 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1569 microversion: 2.1 time: 0.172928 Sep 18 02:32:56.842025 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3790/7608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:56 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:56.865714 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:32:56.866328 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:56.873463 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:56.873991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:56.874460 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:56.875171 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:56.875633 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:56.876060 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:56.962922 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122374) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 02:32:57.041280 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6735fa4d-de65-421b-950c-8a030c2b1b78 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "POST /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8/action" status: 202 len: 0 microversion: 2.1 time: 0.179437 Sep 18 02:32:57.041842 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3819/7609] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:32:56 2022] POST /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:32:57.052797 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:57.053409 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:57.059780 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:57.060284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:57.060736 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:57.061482 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:57.061978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:57.062391 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:57.224845 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:57.232846 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-4bcb7a40-d6a7-4930-84ea-5f9a569a8331 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1577 microversion: 2.1 time: 0.184638 Sep 18 02:32:57.233476 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3791/7610] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:57 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:58.257671 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:58.258331 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:58.264429 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:58.264918 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:58.265356 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:58.266590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:58.267046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:58.267667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:58.410346 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:58.418826 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0d5cd691-9bd6-43de-bdb8-23a647268070 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1519 microversion: 2.1 time: 0.166356 Sep 18 02:32:58.419627 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3820/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:58 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:59.443127 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:32:59.443775 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:32:59.450725 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:59.451218 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:59.451663 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:59.452366 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:59.452831 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:59.453288 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:59.592961 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:32:59.602116 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-31a3b299-f5f4-44e3-ba8b-61ef5ea3e8ea tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1519 microversion: 2.1 time: 0.162954 Sep 18 02:32:59.602716 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3792/7612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:32:59 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:32:59.647104 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-729021f3-d001-4736-9ad6-342f1a4d3de5 req-ceb035d7-37a7-4bef-b6df-00c48850d1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "name": "network-vif-unplugged", "status": "completed", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:32:59.660717 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-729021f3-d001-4736-9ad6-342f1a4d3de5 req-ceb035d7-37a7-4bef-b6df-00c48850d1db service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:32:59.662726 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-729021f3-d001-4736-9ad6-342f1a4d3de5 req-ceb035d7-37a7-4bef-b6df-00c48850d1db service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:32:59.663162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-729021f3-d001-4736-9ad6-342f1a4d3de5 req-ceb035d7-37a7-4bef-b6df-00c48850d1db service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:32:59.677183 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.compute.server_external_events [req-729021f3-d001-4736-9ad6-342f1a4d3de5 req-ceb035d7-37a7-4bef-b6df-00c48850d1db service nova] Unable to find a host for instance 1a8db456-bec5-4276-909c-909f7e9683a8. Dropping event network-vif-unplugged {{(pid=122374) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 18 02:32:59.678649 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-729021f3-d001-4736-9ad6-342f1a4d3de5 req-ceb035d7-37a7-4bef-b6df-00c48850d1db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035424 Sep 18 02:32:59.679763 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3821/7613] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 18 02:33:00.627843 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:00.628674 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:00.636107 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:00.636633 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:00.637082 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:00.637836 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:00.638299 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:00.638731 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:00.779399 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:00.787363 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-724a5fcb-2d04-4a2b-bcf1-7b5c3dbe7c2d tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1519 microversion: 2.1 time: 0.164786 Sep 18 02:33:00.788052 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3793/7614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:00 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:01.811689 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:01.812318 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:01.819808 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:01.820289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:01.820718 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:01.821409 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:01.821890 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:01.822334 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:01.955552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:01.964451 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-022f03fb-8fe2-4cfb-968e-dc08104d0408 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1519 microversion: 2.1 time: 0.156782 Sep 18 02:33:01.965038 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3822/7615] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:01 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:02.987521 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:02.988164 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:02.995060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:02.995554 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:02.996025 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:02.996727 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:02.997189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:02.997658 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:03.132531 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:03.140430 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-1216eafd-ef2c-4cae-bdd1-575b766231f8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.156920 Sep 18 02:33:03.141024 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3794/7616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:02 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:33:03.882453 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-06950b90-a06d-4294-b7bb-a10f3ed171bc req-5a766a48-e561-4548-b0d9-019e1b2733e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:33:03.893212 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-06950b90-a06d-4294-b7bb-a10f3ed171bc req-5a766a48-e561-4548-b0d9-019e1b2733e2 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:03.893728 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-06950b90-a06d-4294-b7bb-a10f3ed171bc req-5a766a48-e561-4548-b0d9-019e1b2733e2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:03.894156 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-06950b90-a06d-4294-b7bb-a10f3ed171bc req-5a766a48-e561-4548-b0d9-019e1b2733e2 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:03.905347 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-06950b90-a06d-4294-b7bb-a10f3ed171bc req-5a766a48-e561-4548-b0d9-019e1b2733e2 service nova] Creating event network-changed:9cbccb05-760e-440c-b3ed-065163afe99d for instance 1a8db456-bec5-4276-909c-909f7e9683a8 on n-h1-master-1 Sep 18 02:33:03.911199 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-06950b90-a06d-4294-b7bb-a10f3ed171bc req-5a766a48-e561-4548-b0d9-019e1b2733e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096476 Sep 18 02:33:03.911866 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3823/7617] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:33:04.164316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:04.164945 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:04.171747 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:04.172249 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:04.173284 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:04.174022 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:04.174501 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:04.174943 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:04.318425 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:04.326853 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a534f1b0-3e7a-4b09-b261-a9e4f1ae7438 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.166389 Sep 18 02:33:04.327450 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3795/7618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:04 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:05.352120 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:05.352833 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:05.359276 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:05.359923 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:05.360400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:05.361104 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:05.362243 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:05.362679 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:05.500919 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:05.508980 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-de34bd83-aece-475e-8ba1-b106848a4cf1 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.162398 Sep 18 02:33:05.509563 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3824/7619] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:05 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:06.533865 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:06.534516 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:06.540530 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:06.541012 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:06.541457 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:06.542206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:06.542673 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:06.543108 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:06.673494 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:06.681336 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3cb565fc-0e51-421d-92c1-be9876aaf3bf tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.152889 Sep 18 02:33:06.681940 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3796/7620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:06 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:07.705624 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:07.706238 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:07.713287 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:07.713805 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:07.714251 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:07.714941 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:07.715400 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:07.715825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:07.847088 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:07.854837 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-6415d97b-ae58-452a-8298-0b72f736a239 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.154157 Sep 18 02:33:07.855411 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3825/7621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:07 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:08.877985 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:08.878607 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:08.885805 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:08.886684 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:08.887128 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:08.887854 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:08.888318 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:08.888749 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:09.021576 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:09.029337 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8a8ff07a-e4dc-4fb1-ad4a-c6c5018fec99 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.155451 Sep 18 02:33:09.030310 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3797/7622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:08 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:10.054589 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:10.055167 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:10.062020 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:10.062512 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:10.063065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:10.063765 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:10.064227 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:10.064657 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:10.194558 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:10.198111 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:33:10.204030 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-12787983-faba-4348-ac27-7bbfd972581f tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.152938 Sep 18 02:33:10.204610 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3826/7623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:10 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:11.228144 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:11.228670 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:11.236509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:11.237007 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:11.237458 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:11.238197 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:11.238665 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:11.239103 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:11.372880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:11.381159 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-839566fe-26c6-4758-8301-3592fb038b80 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.156846 Sep 18 02:33:11.381776 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3798/7624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:11 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:12.404321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:12.404930 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:12.410092 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:33:12.414169 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:12.414665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:12.415109 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:12.415825 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:12.416282 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:12.416700 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:12.557349 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:12.565229 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-11b44580-eb53-4438-889f-74783a36a8cc tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.164845 Sep 18 02:33:12.565860 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3827/7625] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:12 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:13.588294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:13.588911 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:13.591596 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=31 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:33:13.597821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:13.598324 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:13.598773 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:13.599478 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:13.599942 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:13.600379 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:13.604792 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=91 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:33:13.736279 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:13.748325 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-08122d25-56c9-4c6a-b85c-6ae936d37d27 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.163811 Sep 18 02:33:13.748934 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3799/7626] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:13 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:14.774511 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:14.775244 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:14.782925 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:14.783420 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:14.784116 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:14.784846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:14.785384 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:14.785917 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:14.931849 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:14.944292 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-789cf069-46b6-473f-8f2d-afa683cf15f6 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.173942 Sep 18 02:33:14.945154 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3828/7627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:14 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:15.159908 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "name": "network-vif-plugged", "status": "completed", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:33:15.169972 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:15.172849 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:15.173295 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:15.185760 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] Creating event network-vif-plugged:9cbccb05-760e-440c-b3ed-065163afe99d for instance 1a8db456-bec5-4276-909c-909f7e9683a8 on n-h1-master-1 Sep 18 02:33:15.189796 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] [0ac0a6fc-3ba7-4d4b-9993-63a5a09d4395] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 02:33:15.968064 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:15.968665 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:15.976052 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:15.976525 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:15.976953 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:15.977662 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:15.978111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:15.978530 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:16.108028 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:16.116496 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-def914f5-2783-4b59-a811-9e95db6d2f55 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.152414 Sep 18 02:33:16.117066 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3829/7628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:15 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:33:16.198687 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] [0ac0a6fc-3ba7-4d4b-9993-63a5a09d4395] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42340. Sep 18 02:33:16.202253 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4efc67f2-1a10-49c9-ac44-c8154414fbcf req-6c359e89-b147-4c16-a052-b8da09404399 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.046626 Sep 18 02:33:16.202967 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3800/7629] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:33:17.139942 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:17.140490 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:17.147876 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:17.148391 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:17.148828 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:17.149515 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:17.149991 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:17.150413 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:17.283413 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:17.291209 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f5145e5d-a8b9-496d-85a7-dda076267145 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1575 microversion: 2.1 time: 0.155306 Sep 18 02:33:17.291786 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3830/7630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:17 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:33:18.316436 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:33:18.317160 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:33:18.323406 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:18.323937 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:18.324388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:18.325093 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:33:18.325614 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:33:18.326056 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:33:18.462599 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:33:18.470835 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-68b2df94-7292-4010-91ef-abd75247f2b8 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1562 microversion: 2.1 time: 0.160189 Sep 18 02:33:18.471395 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3801/7631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:33:18 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:34:34.831287 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=7 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:34:34.832559 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=24 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:34:34.833716 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:34:34.834173 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 (ip 10.222.0.25) !!! Sep 18 02:34:34.834462 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=5 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:34:34.835709 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=13 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:34:34.837016 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:34:34.837738 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 18 02:34:34.842728 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-affce9bd-fe30-4eb8-8efa-0f17dfc6d701 req-77275cfc-4886-4c83-b9bb-360cf9c177d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:34:34.843538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:34.844044 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:34.857722 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-affce9bd-fe30-4eb8-8efa-0f17dfc6d701 req-77275cfc-4886-4c83-b9bb-360cf9c177d9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:34.858666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-affce9bd-fe30-4eb8-8efa-0f17dfc6d701 req-77275cfc-4886-4c83-b9bb-360cf9c177d9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:34.859121 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-affce9bd-fe30-4eb8-8efa-0f17dfc6d701 req-77275cfc-4886-4c83-b9bb-360cf9c177d9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:34.859461 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:34.860123 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:34.860565 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:34.861264 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:34.861827 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:34.862454 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:34.874263 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-affce9bd-fe30-4eb8-8efa-0f17dfc6d701 req-77275cfc-4886-4c83-b9bb-360cf9c177d9 service nova] Creating event network-changed:9cbccb05-760e-440c-b3ed-065163afe99d for instance 1a8db456-bec5-4276-909c-909f7e9683a8 on n-h1-master-1 Sep 18 02:34:34.879788 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-affce9bd-fe30-4eb8-8efa-0f17dfc6d701 req-77275cfc-4886-4c83-b9bb-360cf9c177d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047469 Sep 18 02:34:34.881251 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3802/7632] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:34:34.896668 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:34:34.985012 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3414a2eb-107f-46b2-ad58-5d31d7e8b0df tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 204 len: 0 microversion: 2.1 time: 0.156199 Sep 18 02:34:34.988748 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3831/7633] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:34:34 2022] DELETE /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:34:34.995499 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:34.996320 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:35.004383 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:35.005678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:35.005678 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:35.006364 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:35.006818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:35.007253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:35.151507 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:34:35.159904 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-708fe78b-9bd6-4fd8-9c9e-4043cd67a3b7 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.168769 Sep 18 02:34:35.160489 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3803/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:34:34 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:34:36.184314 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:36.185015 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:36.192162 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:36.192641 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:36.193071 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:36.193787 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:36.194239 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:36.194655 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:36.326399 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:34:36.335021 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cb0e80bc-a6e9-421d-9801-5fb202991959 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1568 microversion: 2.1 time: 0.154933 Sep 18 02:34:36.335535 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3832/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:34:36 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:34:37.224202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-fdcd853c-fb9d-4a25-ae5d-77101b1832b5 req-79c89397-8d3a-46ed-84f3-4ef9e32121ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8db456-bec5-4276-909c-909f7e9683a8", "name": "network-vif-deleted", "tag": "9cbccb05-760e-440c-b3ed-065163afe99d"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:34:37.235293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fdcd853c-fb9d-4a25-ae5d-77101b1832b5 req-79c89397-8d3a-46ed-84f3-4ef9e32121ac service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:37.235776 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fdcd853c-fb9d-4a25-ae5d-77101b1832b5 req-79c89397-8d3a-46ed-84f3-4ef9e32121ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:37.236212 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-fdcd853c-fb9d-4a25-ae5d-77101b1832b5 req-79c89397-8d3a-46ed-84f3-4ef9e32121ac service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:37.248824 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-fdcd853c-fb9d-4a25-ae5d-77101b1832b5 req-79c89397-8d3a-46ed-84f3-4ef9e32121ac service nova] Creating event network-vif-deleted:9cbccb05-760e-440c-b3ed-065163afe99d for instance 1a8db456-bec5-4276-909c-909f7e9683a8 on n-h1-master-1 Sep 18 02:34:37.255608 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-fdcd853c-fb9d-4a25-ae5d-77101b1832b5 req-79c89397-8d3a-46ed-84f3-4ef9e32121ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037147 Sep 18 02:34:37.256370 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3804/7636] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:34:37.359451 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:37.360098 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:37.367667 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:37.368247 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:37.368824 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:37.369617 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:37.370141 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:37.370629 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:37.435463 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:34:37.444141 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf0396e4-75df-4f50-85aa-144524ea874c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1218 microversion: 2.1 time: 0.088865 Sep 18 02:34:37.444729 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3833/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:34:37 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:34:38.468819 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:38.469457 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:38.475913 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:38.476412 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:38.476865 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:38.477588 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:38.478063 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:38.478509 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:38.543831 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:34:38.551656 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fb14942b-8da2-4c8f-9891-2fbf609d75ad tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1218 microversion: 2.1 time: 0.088113 Sep 18 02:34:38.552243 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3805/7638] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:34:38 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:34:39.575007 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:39.575617 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:39.583126 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:39.583606 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:39.584041 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:39.584731 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:39.585187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:39.585630 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:39.998091 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:34:40.007106 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-d4cbc950-3a22-4489-91b9-d97271b93d34 tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1218 microversion: 2.1 time: 0.435977 Sep 18 02:34:40.007813 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3834/7639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:34:39 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1218 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:34:41.033644 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:41.034294 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:41.041253 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:41.041790 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:41.042248 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:41.042964 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:41.043434 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:41.043874 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:41.108246 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d787a341d340cd9abdb09cf377cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fccd66a6ad499083a7b46235239633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:34:41.117148 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-6bf25b44-0016-49ce-a7b2-74c912d30afe tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 200 len: 1218 microversion: 2.1 time: 0.087602 Sep 18 02:34:41.117754 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3806/7640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:34:41 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:34:42.141541 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:42.142209 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] [instance: 1a8db456-bec5-4276-909c-909f7e9683a8] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:34:42.149344 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:42.149904 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:42.150352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:42.151065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:34:42.151533 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:34:42.151963 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:34:42.167491 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.wsgi [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] HTTP exception thrown: Instance 1a8db456-bec5-4276-909c-909f7e9683a8 could not be found. Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Request method failure captured: Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: request: GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 HTTP/1.1 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: Accept: application/json Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: Accept-Encoding: identity Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: Connection: close Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: Content-Length: 0 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: Content-Type: application/json Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: Host: 10.222.0.25 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: Openstack-System-Scope: None Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: User-Agent: python-urllib3/1.26.12 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Auth-Token: gAAAAABjJoG0jF4lcDygMq9HEn9SlkFWbmGEHH7JDAg-rBRf6jJkMTMDWMZrqEHsVt4GA9YGh-ANnIEsU4Y6_h9dg6tPolRlaPdLu46Qeh4pPO9yPGtSYNp49A7m4iczFTTTn4XMs9sRIl70LPDLnm1sGDPDdP-VVTyw-FSUY3oRQk7ZnhiMmlc Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Id: None Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Domain-Name: None Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Identity-Status: Confirmed Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Is-Admin-Project: True Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Id: default Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Project-Domain-Name: Default Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Project-Id: d6fccd66a6ad499083a7b46235239633 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Project-Name: tempest-TestShelveInstance-1782638718 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Role: reader,member Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Roles: reader,member Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6fccd66a6ad499083a7b46235239633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d6fccd66a6ad499083a7b46235239633"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d6fccd66a6ad499083a7b46235239633"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6fccd66a6ad499083a7b46235239633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Tenant: tempest-TestShelveInstance-1782638718 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Id: d6fccd66a6ad499083a7b46235239633 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-Tenant-Name: tempest-TestShelveInstance-1782638718 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-User: tempest-TestShelveInstance-1782638718-project Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Id: default Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-User-Domain-Name: Default Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-User-Id: 38d787a341d340cd9abdb09cf377cd43 Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: X-User-Name: tempest-TestShelveInstance-1782638718-project Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: method: > Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: exception: Instance 1a8db456-bec5-4276-909c-909f7e9683a8 could not be found. Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: action_args: {'id': '1a8db456-bec5-4276-909c-909f7e9683a8'} Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a8db456-bec5-4276-909c-909f7e9683a8 could not be found. Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a8db456-bec5-4276-909c-909f7e9683a8 could not be found. Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:34:42.169321 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a8db456-bec5-4276-909c-909f7e9683a8 could not be found. Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: ERROR nova.api.openstack.wsgi Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Returning 404 to user: Instance 1a8db456-bec5-4276-909c-909f7e9683a8 could not be found. {{(pid=122374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-ec63f0ce-c264-4fe8-9617-7ec38513473c tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8" status: 404 len: 111 microversion: 2.1 time: 0.033293 Sep 18 02:34:42.174761 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3835/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:34:42 2022] GET /compute/v2.1/servers/1a8db456-bec5-4276-909c-909f7e9683a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:34:42.339597 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-21d937f5-1485-4831-ac8a-905ea2d2b1eb tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] Calling method '.version_select at 0x7f700539b940>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:34:42.382401 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-21d937f5-1485-4831-ac8a-905ea2d2b1eb tempest-TestShelveInstance-1782638718 tempest-TestShelveInstance-1782638718-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-241468019" status: 202 len: 0 microversion: 2.1 time: 0.046547 Sep 18 02:34:42.383454 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3807/7642] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 18 02:34:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-241468019 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 02:34:59.696814 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:34:59.698797 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:34:59.915382 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-3e323e92-e2bd-4d00-85e1-1db7551c1025 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Action: 'create', calling method: .version_select at 0x7f70064db550>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1924420267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGbFK3ULL2XtpbsXzAM94LuhDlfCc3d1tRIUTqQfTTFQrtvAv+5w95iQy26FtTweAlSnwqlsoNDwF2RZuPWrhFTZRMdd4HoD5jGoFCthrauz2BBGvcL1oNIsfCLVmLs+Q=="}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:34:59.932967 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3e323e92-e2bd-4d00-85e1-1db7551c1025 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Getting quotas for project 8006bb47b8d342e0bc7d4c5024cbbf82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:34:59.941019 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-3e323e92-e2bd-4d00-85e1-1db7551c1025 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Getting quotas for user fdfa830987a2442b9bf98161181ab23f and project 8006bb47b8d342e0bc7d4c5024cbbf82. Resources: {'key_pairs'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:34:59.981023 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-3e323e92-e2bd-4d00-85e1-1db7551c1025 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.289981 Sep 18 02:34:59.981804 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3836/7643] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 18 02:34:59 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:35:01.024807 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-279420705", "imageRef": "6f723c18-9162-4fbf-98cf-c1c9072c0368", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1924420267", "security_groups": [{"name": "tempest-secgroup-smoke-768756168"}], "networks": [{"uuid": "b54aaaae-7dc4-40ba-b94a-5c4e93dfe697"}]}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:35:01.035004 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=22 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:35:01.035797 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:35:01.135855 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.network.neutron [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] validate_networks() for [('b54aaaae-7dc4-40ba-b94a-5c4e93dfe697', None, None, None, None, None)] {{(pid=122373) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:35:01.627292 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Flavor limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:35:01.628139 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Image limits 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:35:01.629966 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Flavor pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:35:01.630672 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Image pref 0:0:0 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:35:01.631115 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.virt.hardware [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:35:01.640670 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:01.641189 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:01.641661 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:01.642403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:01.642871 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:01.643306 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:01.661756 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Getting quotas for project 8006bb47b8d342e0bc7d4c5024cbbf82. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:35:01.667133 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.quota [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Getting quotas for user fdfa830987a2442b9bf98161181ab23f and project 8006bb47b8d342e0bc7d4c5024cbbf82. Resources: {'ram', 'instances', 'cores'} {{(pid=122373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:35:01.680902 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Going to run 1 instances... {{(pid=122373) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:35:01.683564 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f723c18-9162-4fbf-98cf-c1c9072c0368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:35:01.733533 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-8c42ea34-cd53-4996-8dcc-083b3c5357dd tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712624 Sep 18 02:35:01.734224 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3808/7644] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:35:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:35:01.747905 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-49c0edc8-6052-454c-b1d0-6196339b30e0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:01.748530 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-49c0edc8-6052-454c-b1d0-6196339b30e0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:01.813228 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-49c0edc8-6052-454c-b1d0-6196339b30e0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:01.821232 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-49c0edc8-6052-454c-b1d0-6196339b30e0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1248 microversion: 2.1 time: 0.077992 Sep 18 02:35:01.821887 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3837/7645] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:01 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:02.849341 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:02.850039 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:02.857535 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:02.858137 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:02.858693 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:02.859333 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:02.859875 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:02.860331 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:02.950720 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:02.963848 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-a535a8b4-cc56-47b3-81e8-c1e49993da28 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1300 microversion: 2.1 time: 0.118305 Sep 18 02:35:02.966384 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3809/7646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:02 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:03.989471 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:03.990381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:04.002801 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:04.003642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:04.004359 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:04.006332 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:04.007149 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:04.007754 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:04.180403 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:04.192021 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-eca960aa-c3ae-48e5-b2e5-c00aae6439b3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1373 microversion: 2.1 time: 0.206928 Sep 18 02:35:04.192947 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3838/7647] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:03 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:04.724930 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-9ee39f15-c035-429e-a0ed-098dca4fa71a req-7ddcec0c-276a-4986-99a9-cfd1c38971d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b628ac7-bf75-4c2e-91b5-ab530e55e973", "tag": "ccba6e2e-d7e6-4757-8280-e42fffc462ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:35:04.744178 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9ee39f15-c035-429e-a0ed-098dca4fa71a req-7ddcec0c-276a-4986-99a9-cfd1c38971d3 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:04.744825 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9ee39f15-c035-429e-a0ed-098dca4fa71a req-7ddcec0c-276a-4986-99a9-cfd1c38971d3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:04.745546 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-9ee39f15-c035-429e-a0ed-098dca4fa71a req-7ddcec0c-276a-4986-99a9-cfd1c38971d3 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:04.759621 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-9ee39f15-c035-429e-a0ed-098dca4fa71a req-7ddcec0c-276a-4986-99a9-cfd1c38971d3 service nova] Creating event network-changed:ccba6e2e-d7e6-4757-8280-e42fffc462ea for instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 on n-h2-master-1 Sep 18 02:35:04.766875 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-9ee39f15-c035-429e-a0ed-098dca4fa71a req-7ddcec0c-276a-4986-99a9-cfd1c38971d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051883 Sep 18 02:35:04.767864 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3810/7648] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:35:05.216121 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:05.216831 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:05.224743 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:05.225241 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:05.225724 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:05.226448 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:05.226914 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:05.227349 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:05.368375 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:05.377166 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-2d56974f-c204-44b2-b727-2638ef1b17c2 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1373 microversion: 2.1 time: 0.164512 Sep 18 02:35:05.377782 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3839/7649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:05 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:06.401335 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:06.402914 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:06.414442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:06.414442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:06.414442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:06.414442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:06.414442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:06.414442 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:06.565384 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:06.574474 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e24315d5-58f7-4d3e-ae71-28436cf87cb3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1373 microversion: 2.1 time: 0.177563 Sep 18 02:35:06.575102 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3811/7650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:06 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:07.596727 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:07.597883 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:07.604735 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:07.605224 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:07.605694 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:07.606397 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:07.606859 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:07.607289 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:07.793501 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:07.801209 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-374987d2-100b-4a3e-9e2e-1b7fac7f985c tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1373 microversion: 2.1 time: 0.208506 Sep 18 02:35:07.801811 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3840/7651] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:07 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1373 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:08.529718 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-5ade84fe-1247-4bc3-9a20-9055b7523d67 req-ef409398-544d-403b-9196-4afafedb4f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b628ac7-bf75-4c2e-91b5-ab530e55e973", "name": "network-vif-plugged", "status": "completed", "tag": "ccba6e2e-d7e6-4757-8280-e42fffc462ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:35:08.540209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ade84fe-1247-4bc3-9a20-9055b7523d67 req-ef409398-544d-403b-9196-4afafedb4f0a service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:08.540694 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ade84fe-1247-4bc3-9a20-9055b7523d67 req-ef409398-544d-403b-9196-4afafedb4f0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:08.541180 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-5ade84fe-1247-4bc3-9a20-9055b7523d67 req-ef409398-544d-403b-9196-4afafedb4f0a service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:08.552172 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-5ade84fe-1247-4bc3-9a20-9055b7523d67 req-ef409398-544d-403b-9196-4afafedb4f0a service nova] Creating event network-vif-plugged:ccba6e2e-d7e6-4757-8280-e42fffc462ea for instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 on n-h2-master-1 Sep 18 02:35:08.557347 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-5ade84fe-1247-4bc3-9a20-9055b7523d67 req-ef409398-544d-403b-9196-4afafedb4f0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094862 Sep 18 02:35:08.558066 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3812/7652] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:35:08.824087 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:08.824713 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:08.832414 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:08.832906 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:08.833351 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:08.834093 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:08.834554 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:08.834985 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:08.969480 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:08.977527 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-70603ecd-531c-4b7b-9759-d67f51e5380d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1373 microversion: 2.1 time: 0.157515 Sep 18 02:35:08.978132 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3841/7653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:08 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:10.001171 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:10.001919 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:10.008963 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:10.009460 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:10.009939 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:10.010650 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:10.011222 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:10.011666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:10.192565 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:10.200353 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3da91859-e366-4d70-97db-942bd1e972b4 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1559 microversion: 2.1 time: 0.204288 Sep 18 02:35:10.200934 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3813/7654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:09 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:10.222626 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:35:10.223245 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:35:10.230248 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:10.230738 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:10.231182 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:10.231881 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:10.232342 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:10.232771 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:10.370810 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:35:10.379225 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-05f6537a-b7e1-48ca-ac21-d81243cd383e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1559 microversion: 2.1 time: 0.160448 Sep 18 02:35:10.379811 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3842/7655] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:35:10 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:35:12.008343 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-3e62fd3c-dc2c-4c35-94f9-ad87d04ec83a req-c8fd7ec1-2110-4c40-9b46-d4efa2ca4dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b628ac7-bf75-4c2e-91b5-ab530e55e973", "tag": "ccba6e2e-d7e6-4757-8280-e42fffc462ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:35:12.014342 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:35:12.015037 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=6 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:35:12.022818 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3e62fd3c-dc2c-4c35-94f9-ad87d04ec83a req-c8fd7ec1-2110-4c40-9b46-d4efa2ca4dcd service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:35:12.023309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3e62fd3c-dc2c-4c35-94f9-ad87d04ec83a req-c8fd7ec1-2110-4c40-9b46-d4efa2ca4dcd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:35:12.024060 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3e62fd3c-dc2c-4c35-94f9-ad87d04ec83a req-c8fd7ec1-2110-4c40-9b46-d4efa2ca4dcd service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:35:12.035760 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-3e62fd3c-dc2c-4c35-94f9-ad87d04ec83a req-c8fd7ec1-2110-4c40-9b46-d4efa2ca4dcd service nova] Creating event network-changed:ccba6e2e-d7e6-4757-8280-e42fffc462ea for instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 on n-h2-master-1 Sep 18 02:35:12.041073 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-3e62fd3c-dc2c-4c35-94f9-ad87d04ec83a req-c8fd7ec1-2110-4c40-9b46-d4efa2ca4dcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036745 Sep 18 02:35:12.041971 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3814/7656] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:37:09.380962 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:37:09.382344 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 18 02:37:09.382999 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:09.383870 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:09.384815 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=30 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:09.386128 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 02:37:09.386308 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973/action (ip 10.222.0.25) !!! Sep 18 02:37:09.387555 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:37:09.387709 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973/action (ip 10.222.0.25) !!! Sep 18 02:37:09.392497 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-734299531"}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:37:09.394837 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:09.407539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:09.408031 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:09.408474 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:09.409187 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:09.409687 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:09.410124 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:09.610434 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cdf3ee75-9406-4517-92a8-53892b255cd0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "POST /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973/action" status: 202 len: 0 microversion: 2.1 time: 0.231373 Sep 18 02:37:09.611103 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3843/7657] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:37:09 2022] POST /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 18 02:37:13.162448 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 02:37:13.163307 n-d-master-1 devstack@n-api.service[122373]: ERROR oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 18 02:37:13.163805 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:13.165046 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=26 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:13.166655 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 18 02:37:13.166655 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 18 02:37:13.184519 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-49102052-27c3-4858-b4a4-c868a0ff545d req-d5935598-9c61-476e-92fd-a8b08f21a4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b628ac7-bf75-4c2e-91b5-ab530e55e973", "name": "network-vif-plugged", "status": "completed", "tag": "ccba6e2e-d7e6-4757-8280-e42fffc462ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:37:13.214164 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49102052-27c3-4858-b4a4-c868a0ff545d req-d5935598-9c61-476e-92fd-a8b08f21a4d9 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:13.219332 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49102052-27c3-4858-b4a4-c868a0ff545d req-d5935598-9c61-476e-92fd-a8b08f21a4d9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:13.221885 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-49102052-27c3-4858-b4a4-c868a0ff545d req-d5935598-9c61-476e-92fd-a8b08f21a4d9 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:13.237672 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-49102052-27c3-4858-b4a4-c868a0ff545d req-d5935598-9c61-476e-92fd-a8b08f21a4d9 service nova] Creating event network-vif-plugged:ccba6e2e-d7e6-4757-8280-e42fffc462ea for instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 on n-h2-master-1 Sep 18 02:37:13.244818 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-49102052-27c3-4858-b4a4-c868a0ff545d req-d5935598-9c61-476e-92fd-a8b08f21a4d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085036 Sep 18 02:37:13.246049 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3815/7658] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:37:24.214821 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:24.215600 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:24.221538 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-123306266", "imageRef": "2e78c0ec-1081-4fff-a5c7-71abb11bc5c5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1924420267", "security_groups": [{"name": "tempest-secgroup-smoke-768756168"}], "networks": [{"uuid": "b54aaaae-7dc4-40ba-b94a-5c4e93dfe697"}]}} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:37:24.248039 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42766. Sep 18 02:37:24.248493 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42764. Sep 18 02:37:24.343249 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.network.neutron [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] validate_networks() for [('b54aaaae-7dc4-40ba-b94a-5c4e93dfe697', None, None, None, None, None)] {{(pid=122374) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 02:37:24.751958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Flavor limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 02:37:24.751958 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Image limits 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 02:37:24.752426 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Flavor pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 02:37:24.752835 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Image pref 0:0:0 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 02:37:24.753266 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.virt.hardware [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 02:37:24.763404 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:24.763911 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:24.764352 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:24.765085 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:24.765563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:24.765994 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:24.788278 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Getting quotas for project 8006bb47b8d342e0bc7d4c5024cbbf82. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 02:37:24.793778 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.quota [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Getting quotas for user fdfa830987a2442b9bf98161181ab23f and project 8006bb47b8d342e0bc7d4c5024cbbf82. Resources: {'ram', 'instances', 'cores'} {{(pid=122374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 02:37:24.807055 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Going to run 1 instances... {{(pid=122374) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 02:37:24.809669 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e78c0ec-1081-4fff-a5c7-71abb11bc5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 02:37:24.858611 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-567eba8d-bc9b-4c54-b4f8-98f5a070237b tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.646699 Sep 18 02:37:24.859511 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3844/7659] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 18 02:37:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 02:37:24.870862 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:24.872164 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:24.878658 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-eb319058-b397-43b9-a52b-aee1d95a864e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:24.879491 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-eb319058-b397-43b9-a52b-aee1d95a864e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:24.899712 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [db2085be-f3f2-422f-bb25-a4adfeacc459] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42782. Sep 18 02:37:24.904741 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] [823c5e3f-9f7a-41b1-af0b-fac24bb69a88] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42784. Sep 18 02:37:24.952572 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-eb319058-b397-43b9-a52b-aee1d95a864e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:24.959961 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-eb319058-b397-43b9-a52b-aee1d95a864e tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1248 microversion: 2.1 time: 0.091147 Sep 18 02:37:24.960362 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3816/7660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:24 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:37:25.983513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:25.984182 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:25.991260 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:25.991752 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:25.992195 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:25.992990 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:25.993345 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:25.993871 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:26.059705 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:26.069533 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-05f4bb68-b3fe-4ab6-9c58-b0a6d5f9b0d0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1308 microversion: 2.1 time: 0.090616 Sep 18 02:37:26.070551 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3845/7661] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:25 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:27.094974 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:27.096212 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:27.105381 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:27.106074 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:27.106630 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:27.107666 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:27.108382 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:27.109044 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:27.337920 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:27.339875 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-7e394b4c-f1fd-40d1-af17-0c97be596078 req-7b559620-cecb-47c1-adfb-2e133edb072e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b628ac7-bf75-4c2e-91b5-ab530e55e973", "name": "network-vif-unplugged", "status": "completed", "tag": "ccba6e2e-d7e6-4757-8280-e42fffc462ea"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:37:27.354192 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-e31aab5d-be63-45ae-85bf-a6b9a4b4652a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.264332 Sep 18 02:37:27.358132 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3817/7662] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:27 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:37:27.362249 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7e394b4c-f1fd-40d1-af17-0c97be596078 req-7b559620-cecb-47c1-adfb-2e133edb072e service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:27.363056 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7e394b4c-f1fd-40d1-af17-0c97be596078 req-7b559620-cecb-47c1-adfb-2e133edb072e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:27.363748 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-7e394b4c-f1fd-40d1-af17-0c97be596078 req-7b559620-cecb-47c1-adfb-2e133edb072e service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:27.376939 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-7e394b4c-f1fd-40d1-af17-0c97be596078 req-7b559620-cecb-47c1-adfb-2e133edb072e service nova] Creating event network-vif-unplugged:ccba6e2e-d7e6-4757-8280-e42fffc462ea for instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 on n-h2-master-1 Sep 18 02:37:27.387028 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-7e394b4c-f1fd-40d1-af17-0c97be596078 req-7b559620-cecb-47c1-adfb-2e133edb072e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054262 Sep 18 02:37:27.388096 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3846/7663] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:37:28.381798 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:28.382575 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:28.389660 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:28.390171 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:28.390627 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:28.391348 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:28.391821 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:28.392293 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:28.534857 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:28.543241 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-9dbd4a2d-7f53-4c5a-be95-0619dd6fd915 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.165931 Sep 18 02:37:28.543819 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3818/7664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:28 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:29.569937 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:29.570690 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:29.577642 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:29.578146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:29.578590 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:29.579446 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:29.580129 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:29.580563 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:29.721777 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:29.730168 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-19f704be-1f50-43d8-8168-baad93b07c29 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.166437 Sep 18 02:37:29.730748 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3847/7665] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:29 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:30.756879 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:30.759044 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:30.770240 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:30.771119 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:30.771804 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:30.773409 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:30.774563 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:30.775170 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:30.927823 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:30.937384 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-35d445fe-056f-4806-b26f-a44ed724e797 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.187461 Sep 18 02:37:30.954776 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3819/7666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:30 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:31.965381 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:31.967507 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:31.978989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:31.979634 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:31.980138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:31.980987 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:31.981571 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:31.982059 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:32.133366 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:32.158814 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-38495b34-493d-4fd8-a535-3e37c1824d99 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.200704 Sep 18 02:37:32.159737 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3848/7667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:31 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:33.182381 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:33.183061 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:33.189967 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:33.190469 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:33.190918 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:33.191635 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:33.192105 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:33.193193 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:33.372880 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:33.381029 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-358c46d3-1eda-42bb-923e-920c3bc0beae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.202485 Sep 18 02:37:33.381625 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3820/7668] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:33 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:34.404162 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:34.404816 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:34.411926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:34.412417 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:34.412858 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:34.413587 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:34.414046 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:34.414477 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:34.552090 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:34.560474 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f67f09c4-b714-4e7a-acde-d6ae3572ead8 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.160363 Sep 18 02:37:34.561057 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3849/7669] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:34 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:35.584339 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:35.585033 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:35.587653 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell0:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:35.593893 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:35.594395 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:35.594847 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:35.595556 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:35.596026 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:35.596466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:35.737359 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:35.745386 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-55681438-849c-4a55-8608-68db904988af tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.165659 Sep 18 02:37:35.745986 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3821/7670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:35 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:36.772445 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:36.773089 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:36.775096 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=2 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:36.775785 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell0:SELECT=6 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:37:36.782926 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:36.783412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:36.783854 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:36.784551 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:36.784999 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:36.785422 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:36.840913 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-440504fd-38f6-4745-bd6f-8567b3af1915 req-e736c96f-3acc-4f3d-9ae1-f10e6b49545f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d357b13a-6320-4847-aab8-a7fc0484b256", "tag": "560dc2fc-ad82-41f2-a2cd-d58ed1a64019"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:37:36.854575 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-440504fd-38f6-4745-bd6f-8567b3af1915 req-e736c96f-3acc-4f3d-9ae1-f10e6b49545f service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:36.855566 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-440504fd-38f6-4745-bd6f-8567b3af1915 req-e736c96f-3acc-4f3d-9ae1-f10e6b49545f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:36.856192 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-440504fd-38f6-4745-bd6f-8567b3af1915 req-e736c96f-3acc-4f3d-9ae1-f10e6b49545f service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:36.882435 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-440504fd-38f6-4745-bd6f-8567b3af1915 req-e736c96f-3acc-4f3d-9ae1-f10e6b49545f service nova] Creating event network-changed:560dc2fc-ad82-41f2-a2cd-d58ed1a64019 for instance d357b13a-6320-4847-aab8-a7fc0484b256 on n-h1-master-1 Sep 18 02:37:36.887637 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-440504fd-38f6-4745-bd6f-8567b3af1915 req-e736c96f-3acc-4f3d-9ae1-f10e6b49545f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051994 Sep 18 02:37:36.888932 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3822/7671] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:37:36.937769 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:36.946565 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-e37d3f82-19ae-4566-b6c0-c909d9f684b9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.178077 Sep 18 02:37:36.947185 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3850/7672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:36 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:37.970237 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:37.970949 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:37.977856 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:37.978352 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:37.978801 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:37.979512 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:37.979981 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:37.980420 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:38.123926 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:38.132465 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-fada69da-f757-47d3-bc6d-db3b9a7e8eb0 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.167322 Sep 18 02:37:38.133053 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3823/7673] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:37 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:39.155594 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:39.156151 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:39.163138 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:39.163627 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:39.164065 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:39.164767 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:39.165222 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:39.165683 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:39.303552 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:39.311272 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-92449cbe-e6ce-4a5d-8959-7c9560530042 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.160301 Sep 18 02:37:39.311847 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3851/7674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:39 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:40.334509 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:40.335090 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:40.341905 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:40.342408 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:40.342859 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:40.343568 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:40.344053 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:40.344481 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:40.477138 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:40.484905 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-64748564-680f-4720-ad91-3524788eb0d3 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.154420 Sep 18 02:37:40.485484 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3824/7675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:40 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:40.653297 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-87bce991-a576-4120-b273-95f3d5e284e6 req-4b8284a9-6341-4c61-8630-1fb6b551eb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d357b13a-6320-4847-aab8-a7fc0484b256", "name": "network-vif-plugged", "status": "completed", "tag": "560dc2fc-ad82-41f2-a2cd-d58ed1a64019"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:37:40.665445 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-87bce991-a576-4120-b273-95f3d5e284e6 req-4b8284a9-6341-4c61-8630-1fb6b551eb84 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:40.666388 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-87bce991-a576-4120-b273-95f3d5e284e6 req-4b8284a9-6341-4c61-8630-1fb6b551eb84 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:40.666834 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-87bce991-a576-4120-b273-95f3d5e284e6 req-4b8284a9-6341-4c61-8630-1fb6b551eb84 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:40.678254 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-87bce991-a576-4120-b273-95f3d5e284e6 req-4b8284a9-6341-4c61-8630-1fb6b551eb84 service nova] Creating event network-vif-plugged:560dc2fc-ad82-41f2-a2cd-d58ed1a64019 for instance d357b13a-6320-4847-aab8-a7fc0484b256 on n-h1-master-1 Sep 18 02:37:40.683652 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-87bce991-a576-4120-b273-95f3d5e284e6 req-4b8284a9-6341-4c61-8630-1fb6b551eb84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034271 Sep 18 02:37:40.684803 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3852/7676] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:37:41.512194 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:41.512802 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:41.520505 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:41.521006 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:41.521522 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:41.522255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:41.522721 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:41.523160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:41.656701 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:41.665117 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-7ccd02d9-3b99-4b5f-afb4-52d0a3516d2a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1373 microversion: 2.1 time: 0.156859 Sep 18 02:37:41.665732 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3825/7677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:41 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:42.689070 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:42.689832 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:42.696887 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:42.697373 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:42.697846 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:42.698539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:42.698993 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:42.699412 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:42.831409 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:42.839883 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a80e9a1e-8074-46d4-825b-f488c4db4ee5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1558 microversion: 2.1 time: 0.155923 Sep 18 02:37:42.840464 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3853/7678] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:42 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:42.861916 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:37:42.862541 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:37:42.870113 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:42.870599 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:42.871071 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:42.871762 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:42.872233 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:42.872675 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:43.004084 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:37:43.012119 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-3631d464-3946-4978-8299-7413f5d09632 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1558 microversion: 2.1 time: 0.154161 Sep 18 02:37:43.012693 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3826/7679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:37:42 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:37:45.000728 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-1d9867cd-1f7b-45ee-98ef-e96fabe6cf96 req-3fa5c655-f832-46a5-8801-3dc2706ef5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d357b13a-6320-4847-aab8-a7fc0484b256", "tag": "560dc2fc-ad82-41f2-a2cd-d58ed1a64019"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:37:45.011223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d9867cd-1f7b-45ee-98ef-e96fabe6cf96 req-3fa5c655-f832-46a5-8801-3dc2706ef5ba service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:37:45.011784 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d9867cd-1f7b-45ee-98ef-e96fabe6cf96 req-3fa5c655-f832-46a5-8801-3dc2706ef5ba service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:37:45.012275 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-1d9867cd-1f7b-45ee-98ef-e96fabe6cf96 req-3fa5c655-f832-46a5-8801-3dc2706ef5ba service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:37:45.024026 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-1d9867cd-1f7b-45ee-98ef-e96fabe6cf96 req-3fa5c655-f832-46a5-8801-3dc2706ef5ba service nova] Creating event network-changed:560dc2fc-ad82-41f2-a2cd-d58ed1a64019 for instance d357b13a-6320-4847-aab8-a7fc0484b256 on n-h1-master-1 Sep 18 02:37:45.029483 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-1d9867cd-1f7b-45ee-98ef-e96fabe6cf96 req-3fa5c655-f832-46a5-8801-3dc2706ef5ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089495 Sep 18 02:37:45.030198 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3854/7680] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:39:23.870498 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=24 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:39:23.871414 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=56 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:39:23.872978 n-d-master-1 devstack@n-api.service[122373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:39:23.873126 n-d-master-1 devstack@n-api.service[122373]: Sun Sep 18 02:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256/action (ip 10.222.0.25) !!! Sep 18 02:39:23.880386 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-390357217"}} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:39:23.883437 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:23.891746 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:23.892301 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:23.892752 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:23.893465 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:23.894160 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:23.894414 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:24.100189 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-57a265f5-274f-4f22-ae8f-391dcbe44cae tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "POST /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256/action" status: 202 len: 0 microversion: 2.1 time: 0.231671 Sep 18 02:39:24.100840 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3827/7681] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 18 02:39:23 2022] POST /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 18 02:39:29.106872 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 18 02:39:29.108906 n-d-master-1 devstack@n-api.service[122374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 18 02:39:29.109760 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:39:29.111518 n-d-master-1 devstack@n-api.service[122374]: DEBUG dbcounter [-] [122374] Writing DB stats nova_cell1:SELECT=50 {{(pid=122374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:39:29.112879 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 18 02:39:29.113443 n-d-master-1 devstack@n-api.service[122374]: Sun Sep 18 02:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 18 02:39:29.124789 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-e9c2f62b-c05e-4f55-b29f-d52699a2267f req-b608132c-6b2c-414c-8be4-abad793edb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d357b13a-6320-4847-aab8-a7fc0484b256", "name": "network-vif-plugged", "status": "completed", "tag": "560dc2fc-ad82-41f2-a2cd-d58ed1a64019"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:39:29.142051 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9c2f62b-c05e-4f55-b29f-d52699a2267f req-b608132c-6b2c-414c-8be4-abad793edb67 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:29.142665 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9c2f62b-c05e-4f55-b29f-d52699a2267f req-b608132c-6b2c-414c-8be4-abad793edb67 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:29.143340 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-e9c2f62b-c05e-4f55-b29f-d52699a2267f req-b608132c-6b2c-414c-8be4-abad793edb67 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:29.154783 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-e9c2f62b-c05e-4f55-b29f-d52699a2267f req-b608132c-6b2c-414c-8be4-abad793edb67 service nova] Creating event network-vif-plugged:560dc2fc-ad82-41f2-a2cd-d58ed1a64019 for instance d357b13a-6320-4847-aab8-a7fc0484b256 on n-h1-master-1 Sep 18 02:39:29.160547 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-e9c2f62b-c05e-4f55-b29f-d52699a2267f req-b608132c-6b2c-414c-8be4-abad793edb67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055682 Sep 18 02:39:29.161787 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3855/7682] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:39:37.750869 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_api:SELECT=2 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:39:37.751872 n-d-master-1 devstack@n-api.service[122373]: DEBUG dbcounter [-] [122373] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 02:39:37.757944 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [req-42fb6c01-aef3-47f2-943c-5766452b30ef req-ae3e7d1f-65ea-4ff5-8f1a-83190a78339d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d357b13a-6320-4847-aab8-a7fc0484b256", "tag": "560dc2fc-ad82-41f2-a2cd-d58ed1a64019"}]} {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:39:37.758708 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:37.759316 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:37.770980 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-42fb6c01-aef3-47f2-943c-5766452b30ef req-ae3e7d1f-65ea-4ff5-8f1a-83190a78339d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:37.771462 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-42fb6c01-aef3-47f2-943c-5766452b30ef req-ae3e7d1f-65ea-4ff5-8f1a-83190a78339d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:37.771609 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:37.771888 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [req-42fb6c01-aef3-47f2-943c-5766452b30ef req-ae3e7d1f-65ea-4ff5-8f1a-83190a78339d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:37.772209 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:37.772674 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:37.773403 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:37.773898 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:37.775144 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:37.785785 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.compute.server_external_events [req-42fb6c01-aef3-47f2-943c-5766452b30ef req-ae3e7d1f-65ea-4ff5-8f1a-83190a78339d service nova] Creating event network-changed:560dc2fc-ad82-41f2-a2cd-d58ed1a64019 for instance d357b13a-6320-4847-aab8-a7fc0484b256 on n-h1-master-1 Sep 18 02:39:37.791341 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [req-42fb6c01-aef3-47f2-943c-5766452b30ef req-ae3e7d1f-65ea-4ff5-8f1a-83190a78339d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039676 Sep 18 02:39:37.791951 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3856/7683] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:39:37.815427 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Going to try to terminate instance {{(pid=122373) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:39:37.906089 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f5ab31eb-122e-4c50-9ed7-db522c7596b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 204 len: 0 microversion: 2.1 time: 0.157231 Sep 18 02:39:37.906812 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3828/7684] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:39:37 2022] DELETE /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:39:37.918023 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:37.918746 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:37.924775 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [11a3e841-4df4-4354-aa53-3f4ebc0c32cf] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43076. Sep 18 02:39:37.925242 n-d-master-1 devstack@n-api.service[122374]: INFO oslo.messaging._drivers.impl_rabbit [-] [17d82aa8-267c-4746-bb7d-a1231b673a06] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43074. Sep 18 02:39:37.928223 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:37.928928 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:37.929493 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:37.930408 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:37.930872 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:37.931506 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:38.073961 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:39:38.081924 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-a491829c-b029-4896-97dd-ca5059f74459 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1683 microversion: 2.1 time: 0.169340 Sep 18 02:39:38.083050 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3857/7685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:37 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:39:39.062227 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-c7afc9b2-99f3-4253-8315-3fc4be4b5b73 req-c06de3db-824b-43b8-840d-f15607c311bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d357b13a-6320-4847-aab8-a7fc0484b256", "name": "network-vif-unplugged", "status": "completed", "tag": "560dc2fc-ad82-41f2-a2cd-d58ed1a64019"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:39:39.074415 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c7afc9b2-99f3-4253-8315-3fc4be4b5b73 req-c06de3db-824b-43b8-840d-f15607c311bb service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:39.075046 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c7afc9b2-99f3-4253-8315-3fc4be4b5b73 req-c06de3db-824b-43b8-840d-f15607c311bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:39.075494 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-c7afc9b2-99f3-4253-8315-3fc4be4b5b73 req-c06de3db-824b-43b8-840d-f15607c311bb service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:39.087241 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-c7afc9b2-99f3-4253-8315-3fc4be4b5b73 req-c06de3db-824b-43b8-840d-f15607c311bb service nova] Creating event network-vif-unplugged:560dc2fc-ad82-41f2-a2cd-d58ed1a64019 for instance d357b13a-6320-4847-aab8-a7fc0484b256 on n-h1-master-1 Sep 18 02:39:39.092194 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-c7afc9b2-99f3-4253-8315-3fc4be4b5b73 req-c06de3db-824b-43b8-840d-f15607c311bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034091 Sep 18 02:39:39.092826 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3829/7686] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:39:39.106753 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:39.107371 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:39.114763 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:39.115252 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:39.115693 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:39.116395 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:39.116853 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:39.117281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:39.251981 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:39:39.261081 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-72f62d31-64f5-49c2-8f53-89fd5b1a5ece tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1683 microversion: 2.1 time: 0.158218 Sep 18 02:39:39.261896 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3858/7687] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:39 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:39:40.287280 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:40.288006 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:40.294916 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:40.296343 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:40.296610 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:40.297526 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:40.298029 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:40.298464 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:40.339202 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-3886444b-f5b1-4f23-89be-0f18bb65b682 req-7980f162-eeb9-440e-914b-55f66c2f36c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d357b13a-6320-4847-aab8-a7fc0484b256", "name": "network-vif-deleted", "tag": "560dc2fc-ad82-41f2-a2cd-d58ed1a64019"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:39:40.350309 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3886444b-f5b1-4f23-89be-0f18bb65b682 req-7980f162-eeb9-440e-914b-55f66c2f36c1 service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:40.350811 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3886444b-f5b1-4f23-89be-0f18bb65b682 req-7980f162-eeb9-440e-914b-55f66c2f36c1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:40.351255 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-3886444b-f5b1-4f23-89be-0f18bb65b682 req-7980f162-eeb9-440e-914b-55f66c2f36c1 service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:40.362763 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-3886444b-f5b1-4f23-89be-0f18bb65b682 req-7980f162-eeb9-440e-914b-55f66c2f36c1 service nova] Creating event network-vif-deleted:560dc2fc-ad82-41f2-a2cd-d58ed1a64019 for instance d357b13a-6320-4847-aab8-a7fc0484b256 on n-h1-master-1 Sep 18 02:39:40.367433 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-3886444b-f5b1-4f23-89be-0f18bb65b682 req-7980f162-eeb9-440e-914b-55f66c2f36c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111553 Sep 18 02:39:40.368039 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3830/7688] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:39:40.375798 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:39:40.384693 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-59422524-c3b5-43b4-a3d9-ba75de6ab96a tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 200 len: 1333 microversion: 2.1 time: 0.102145 Sep 18 02:39:40.385321 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3859/7689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:40 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:39:41.409493 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:41.411112 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: d357b13a-6320-4847-aab8-a7fc0484b256] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:41.417704 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:41.418206 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:41.418657 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:41.419373 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:41.419843 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:41.420311 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:41.433862 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] HTTP exception thrown: Instance d357b13a-6320-4847-aab8-a7fc0484b256 could not be found. Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Request method failure captured: Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 HTTP/1.1 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJoPOVUiLhCXz-fzhU4IFvQTJ9N1oSwz3-skg27sTOCzadkMsBSAD7gil564WIcMvyiKGyyFJMQHVYMePBEkRSaGSYodNkGkEOx-LjWdJv-Tow2ohYyHag0SF4xGSIm2lOuVhhl88asLClpbXpeyfO02psuwcxFW8bd12jqtzt4QS3DI Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 8006bb47b8d342e0bc7d4c5024cbbf82 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestSnapshotPattern-126721076 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestSnapshotPattern-126721076 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 8006bb47b8d342e0bc7d4c5024cbbf82 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestSnapshotPattern-126721076 Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestSnapshotPattern-126721076-project Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fdfa830987a2442b9bf98161181ab23f Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestSnapshotPattern-126721076-project Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: exception: Instance d357b13a-6320-4847-aab8-a7fc0484b256 could not be found. Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': 'd357b13a-6320-4847-aab8-a7fc0484b256'} Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d357b13a-6320-4847-aab8-a7fc0484b256 could not be found. Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d357b13a-6320-4847-aab8-a7fc0484b256 could not be found. Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:39:41.435501 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d357b13a-6320-4847-aab8-a7fc0484b256 could not be found. Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Returning 404 to user: Instance d357b13a-6320-4847-aab8-a7fc0484b256 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-2ea9df04-297b-46cf-a070-0780b3b04201 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256" status: 404 len: 111 microversion: 2.1 time: 0.032641 Sep 18 02:39:41.442478 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3831/7690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:41 2022] GET /compute/v2.1/servers/d357b13a-6320-4847-aab8-a7fc0484b256 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:39:42.765083 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:42.765948 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:42.766482 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-4ce0b99a-dcbb-42b7-8b79-dc274050746b req-6fe36476-eeeb-4d03-9330-7f6767c253be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b628ac7-bf75-4c2e-91b5-ab530e55e973", "tag": "ccba6e2e-d7e6-4757-8280-e42fffc462ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:39:42.773130 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:42.773654 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:42.774091 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:42.774792 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:42.775281 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:42.775701 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:42.781978 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4ce0b99a-dcbb-42b7-8b79-dc274050746b req-6fe36476-eeeb-4d03-9330-7f6767c253be service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:42.782828 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4ce0b99a-dcbb-42b7-8b79-dc274050746b req-6fe36476-eeeb-4d03-9330-7f6767c253be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:42.783466 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-4ce0b99a-dcbb-42b7-8b79-dc274050746b req-6fe36476-eeeb-4d03-9330-7f6767c253be service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:42.795448 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-4ce0b99a-dcbb-42b7-8b79-dc274050746b req-6fe36476-eeeb-4d03-9330-7f6767c253be service nova] Creating event network-changed:ccba6e2e-d7e6-4757-8280-e42fffc462ea for instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 on n-h2-master-1 Sep 18 02:39:42.801663 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-4ce0b99a-dcbb-42b7-8b79-dc274050746b req-6fe36476-eeeb-4d03-9330-7f6767c253be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038370 Sep 18 02:39:42.802274 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3832/7691] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 02:39:42.809065 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Going to try to terminate instance {{(pid=122374) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 02:39:42.902697 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-cf475e68-0ddf-4f60-87b6-4d51b83a78cc tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 204 len: 0 microversion: 2.1 time: 0.141505 Sep 18 02:39:42.906453 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3860/7692] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 18 02:39:42 2022] DELETE /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 02:39:42.914980 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:42.915707 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:42.924336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:42.924336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:42.924336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:42.924336 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:42.924845 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:42.925005 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:43.083630 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.policy [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122373) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:39:43.091930 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-20744234-bc44-4f26-a19e-de600ac5dbc9 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1683 microversion: 2.1 time: 0.183301 Sep 18 02:39:43.092531 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3833/7693] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:42 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 02:39:44.117795 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:44.118572 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:44.125569 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:44.126074 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:44.126514 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:44.127226 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:44.127684 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:44.128114 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:44.270288 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:39:44.278271 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-f3f87ffa-a74c-47ee-be65-0c48f505c9b5 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1683 microversion: 2.1 time: 0.165387 Sep 18 02:39:44.278863 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3861/7694] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:44 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:39:45.144886 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [req-69c92cf0-3a5a-45fb-a112-f9837209e46e req-b561c211-e33a-4988-975f-59207f5f180d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b628ac7-bf75-4c2e-91b5-ab530e55e973", "name": "network-vif-deleted", "tag": "ccba6e2e-d7e6-4757-8280-e42fffc462ea"}]} {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 02:39:45.158078 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-69c92cf0-3a5a-45fb-a112-f9837209e46e req-b561c211-e33a-4988-975f-59207f5f180d service nova] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:45.158643 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-69c92cf0-3a5a-45fb-a112-f9837209e46e req-b561c211-e33a-4988-975f-59207f5f180d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:45.159538 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [req-69c92cf0-3a5a-45fb-a112-f9837209e46e req-b561c211-e33a-4988-975f-59207f5f180d service nova] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:45.172342 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.compute.server_external_events [req-69c92cf0-3a5a-45fb-a112-f9837209e46e req-b561c211-e33a-4988-975f-59207f5f180d service nova] Creating event network-vif-deleted:ccba6e2e-d7e6-4757-8280-e42fffc462ea for instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 on n-h2-master-1 Sep 18 02:39:45.177270 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [req-69c92cf0-3a5a-45fb-a112-f9837209e46e req-b561c211-e33a-4988-975f-59207f5f180d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040256 Sep 18 02:39:45.177984 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3834/7695] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 18 02:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 02:39:45.302513 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:45.303160 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.compute.api [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122374) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:45.310111 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:45.310539 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:45.310983 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:45.311685 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:45.312146 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:45.312567 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:45.346681 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:45.346989 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:45.347604 n-d-master-1 devstack@n-api.service[122374]: DEBUG oslo_concurrency.lockutils [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:45.348474 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.objects.instance [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lazy-loading 'fault' on Instance uuid 6b628ac7-bf75-4c2e-91b5-ab530e55e973 {{(pid=122374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 02:39:45.391636 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.policy [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdfa830987a2442b9bf98161181ab23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006bb47b8d342e0bc7d4c5024cbbf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 02:39:45.400095 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-0de8da9c-8947-4d8d-bc92-928403662f7d tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 200 len: 1338 microversion: 2.1 time: 0.101460 Sep 18 02:39:45.400677 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3862/7696] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:45 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 02:39:46.434906 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '>' {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:46.435610 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.compute.api [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] [instance: 6b628ac7-bf75-4c2e-91b5-ab530e55e973] Fetching instance by UUID {{(pid=122373) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 02:39:46.441853 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:46.442346 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:46.442794 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:46.443492 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Acquiring lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 02:39:46.443962 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 02:39:46.444388 n-d-master-1 devstack@n-api.service[122373]: DEBUG oslo_concurrency.lockutils [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Lock "bf287de1-14b9-4c4e-84a6-83b94fe82ce2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 02:39:46.458297 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.wsgi [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] HTTP exception thrown: Instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 could not be found. Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Request method failure captured: Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: request: GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 HTTP/1.1 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: Accept: application/json Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: Accept-Encoding: identity Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: Connection: close Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: Content-Length: 0 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: Content-Type: application/json Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: Host: 10.222.0.25 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: Openstack-System-Scope: None Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: User-Agent: python-urllib3/1.26.12 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Auth-Token: gAAAAABjJoPOVUiLhCXz-fzhU4IFvQTJ9N1oSwz3-skg27sTOCzadkMsBSAD7gil564WIcMvyiKGyyFJMQHVYMePBEkRSaGSYodNkGkEOx-LjWdJv-Tow2ohYyHag0SF4xGSIm2lOuVhhl88asLClpbXpeyfO02psuwcxFW8bd12jqtzt4QS3DI Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Id: None Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Domain-Name: None Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Identity-Status: Confirmed Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Is-Admin-Project: True Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Id: default Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Project-Domain-Name: Default Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Project-Id: 8006bb47b8d342e0bc7d4c5024cbbf82 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Project-Name: tempest-TestSnapshotPattern-126721076 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Role: reader,member Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Roles: reader,member Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8006bb47b8d342e0bc7d4c5024cbbf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Tenant: tempest-TestSnapshotPattern-126721076 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Id: 8006bb47b8d342e0bc7d4c5024cbbf82 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-Tenant-Name: tempest-TestSnapshotPattern-126721076 Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-User: tempest-TestSnapshotPattern-126721076-project Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Id: default Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-User-Domain-Name: Default Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-User-Id: fdfa830987a2442b9bf98161181ab23f Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: X-User-Name: tempest-TestSnapshotPattern-126721076-project Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: method: > Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: exception: Instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 could not be found. Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: action_args: {'id': '6b628ac7-bf75-4c2e-91b5-ab530e55e973'} Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: {{(pid=122373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 could not be found. Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 could not be found. Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 02:39:46.459958 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 could not be found. Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: ERROR nova.api.openstack.wsgi Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: DEBUG nova.api.openstack.wsgi [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Returning 404 to user: Instance 6b628ac7-bf75-4c2e-91b5-ab530e55e973 could not be found. {{(pid=122373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: INFO nova.api.openstack.requestlog [None req-f3c79f38-d6c6-47af-925f-c6cb3a91c323 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973" status: 404 len: 111 microversion: 2.1 time: 0.033117 Sep 18 02:39:46.464875 n-d-master-1 devstack@n-api.service[122373]: [pid: 122373|app: 0|req: 3835/7697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 18 02:39:46 2022] GET /compute/v2.1/servers/6b628ac7-bf75-4c2e-91b5-ab530e55e973 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 02:39:46.627667 n-d-master-1 devstack@n-api.service[122374]: DEBUG nova.api.openstack.wsgi [None req-17a5c55d-2667-4ead-a4ba-dd3f4c69c5b6 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] Calling method '.version_select at 0x7f700502a4c0>' {{(pid=122374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 02:39:46.654344 n-d-master-1 devstack@n-api.service[122374]: INFO nova.api.openstack.requestlog [None req-17a5c55d-2667-4ead-a4ba-dd3f4c69c5b6 tempest-TestSnapshotPattern-126721076 tempest-TestSnapshotPattern-126721076-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1924420267" status: 202 len: 0 microversion: 2.1 time: 0.030639 Sep 18 02:39:46.658214 n-d-master-1 devstack@n-api.service[122374]: [pid: 122374|app: 0|req: 3863/7698] 10.222.0.25 () {58 vars in 1257 bytes} [Sun Sep 18 02:39:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1924420267 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)